CommIT (Communication & Information Technology)
Vol. 16 No. 2 (2022): CommIT Journal

An Explainable AI Model for Hate Speech Detection on Indonesian Twitter

Muhammad Amien Ibrahim (Bina Nusantara University)
Samsul Arifin (Bina Nusantara University)
I Gusti Agung Anom Yudistira (Bina Nusantara University)
Rinda Nariswari (Bina Nusantara University)
Abdul Azis Abdillah (Politeknik Negeri Jakarta)
Nerru Pranuta Murnaka (STKIP Surya)
Puguh Wahyu Prasetyo (Universitas Ahmad Dahlan)



Article Info

Publish Date
08 Jun 2022

Abstract

To avoid citizen disputes, hate speech on social media, such as Twitter, must be automatically detected. The current research in Indonesian Twitter focuses on developing better hate speech detection models. However, there is limited study on the explainability aspects of hate speech detection. The research aims to explain issues that previous researchers have not detailed and attempt to answer the shortcomings of previous researchers. There are 13,169 tweets in the dataset with labels like “hate speech” and “abusive language”. The dataset also provides binary labels on whether hate speech is directed to individual, group, religion, race, physical disability, and gender. In the research, classification is performed by using traditional machine learning models, and the predictions are evaluated using an Explainable AI model, such as Local Interpretable Model-Agnostic Explanations (LIME), to allow users to comprehend why a tweet is regarded as a hateful message. Moreover, models that perform well in classification perceive incorrect words as contributing to hate speech. As a result, such models are unsuitable for deployment in the real world. In the investigation, the combination of XGBoost and logical LIME explanations produces the most logical results. The use of the Explainable AI model highlights the importance of choosing the ideal model while maintaining users’ trust in the deployed model.

Copyrights © 2022






Journal Info

Abbrev

COMMIT

Publisher

Subject

Computer Science & IT

Description

Journal of Communication and Information Technology (CommIT) focuses on various issues spanning: software engineering, mobile technology and applications, robotics, database system, information engineering, artificial intelligent, interactive multimedia, computer networking, information system ...