Green Intelligent Systems and Applications
Volume 4 - Issue 2 - 2024

A Sentiment Analysis of Hate Speech in Philippine Election-Related Posts Using BERT Combined with Convolutional Neural Networks and Model Variations Incorporating Hashtags and ALL-CAPS

Mendoza, Micah Collette O. (Unknown)
Nadurata, Wayne Gabriel S. (Unknown)
Oritz, Mark Gabriel E. (Unknown)
Padlan, Joshua Mari L. (Unknown)
Ponay, Charmaine S. (Unknown)



Article Info

Publish Date
24 Oct 2024

Abstract

As the number of people who use X continually increases, the same thing is true for hate speech. A pressing need exists for automatic detection of posts that promote hate speech. The datasets gathered and validated from the base study were used to categorize posts as either hate or non-hate and classify them as positive, negative, or neutral using Conventional Neural Networks. The partitioning of the labeled data into training and testing sets adhered to a ratio scheme: 70%-30%, 80%-20%, and 90%-10%. The model of this study, BERT-CNN, had an overall better performance than the base study, fastText CNN. Notably, among the three splits, the BERT-CNN model for binary classification without the features of Hashtags and ALL-CAPS with the 90:10 split achieved the best performance with an accuracy of 93.55%, precision of 93.59%, and F1-score of 93.55%. For multi-label classification, the BERT-CNN model demonstrated its optimal performance when incorporating hashtags, specifically with the 90:10 split, achieving an accuracy of 69.14%, precision of 68.44%, recall of 68.40%, and an F1-score of 67.41%. The innovative use of BERT word embeddings paired with CNN proved to excel in classifying Philippine election-related posts as hate or non-hate.

Copyrights © 2024






Journal Info

Abbrev

gisa

Publisher

Subject

Computer Science & IT Control & Systems Engineering Electrical & Electronics Engineering

Description

The journal is intended to provide a platform for research communities from different disciplines to disseminate, exchange and communicate all aspects of green technologies and intelligent systems. The topics of this journal include, but are not limited to: Green communication systems: 5G and 6G ...