Populer: Jurnal Penelitian Mahasiswa
Vol. 5 No. 3 (2026): September : Populer: Jurnal Penelitian Mahasiswa

Deteksi Cyberbullying pada Twitter menggunakan Distilbert dan (Explainable Ai) Shap

Hadana Maulana (Universitas Islam Sultan Agung)
Mustafa Mustafa (Universitas Islam Sultan Agung)
Ghufron Ghufron (Universitas Islam Sultan Agung)



Article Info

Publish Date
24 Sep 2026

Abstract

The prevalence of cyberbullying on Twitter demands a fast and transparent automated moderation system. This study designs an efficient and explainable binary cyberbullying detection system using DistilBERT and the SHAP-based Explainable AI (XAI) method. The dataset, sourced from Kaggle, consists of 13,169 raw data filtered into 12,548 clean tweets. Preprocessing was conducted without stemming and stopword removal to preserve the language's semantic context, setting a max_length of 48 tokens. The pre-trained distilbert-base-multilingual-cased model was evaluated on an 80% training and 20% testing data split, while model transparency was validated using SHAP's PartitionExplainer algorithm. Evaluation results show DistilBERT performed robustly, achieving 84% accuracy, 84% precision, 86% F1-score, and 88% recall in detecting bullying, with an Area Under Curve (AUC) score reaching 0.9207. Locally, SHAP evaluation proved that the model concentrated heavy penalty weights on abusive words like "brengsek". Globally, SHAP revealed a unique phenomenon where the most important features were dominated by neutral vocabularies such as "times. roman" and "pendidikan", which the model cleverly utilized as strong discriminative indicators to validate normal texts. In conclusion, the integration of DistilBERT and SHAP yields a classification system that is not only accurate and efficient but also transparent and logically reasoned.

Copyrights © 2026






Journal Info

Abbrev

Populer

Publisher

Subject

Humanities Computer Science & IT Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Social Sciences Other

Description

Populer: Jurnal Penelitian Mahasiswa ini terbit 1 tahun 4 kali (Maret, Juni September dan Desember). Karya yang diterbitkan merupakan suatu hasil penelitian orisinil atau tinjauan Pustaka yang ditulis oleh mahasiswa. Ruang lingkup karya yang diterbitkan mencakup Multidisiplin diantaranya yaitu: Ilmu ...