JOURNAL OF APPLIED INFORMATICS AND COMPUTING
Vol. 10 No. 3 (2026): June 2026

Enhancing Cyberbullying Sentiment Detection: A Comparative Study of IndoBERT and IndoBERTweet over SMOTE and Bernoulli Naive Bayes Approach

Eka Mardiana Putri (Institut Teknologi Sains, dan Kesehatan RS. DR. Soepraoen Kesdam V/BRW)
Mochammad Anshori (Institut Teknologi Sains, dan Kesehatan RS. DR. Soepraoen Kesdam V/BRW)
M. Syauqi Haris (Institut Teknologi Sains, dan Kesehatan RS. DR. Soepraoen Kesdam V/BRW)



Article Info

Publish Date
08 Jun 2026

Abstract

Cyberbullying has become a critical issue in social media use because it can negatively impact users’ mental health and social interactions. The high volume of aggressive comments and hate speech on digital platforms highlights the need for an automatic detection system that can accurately and reliably identify cyberbullying content. This research compares the performance of Indonesian language transformer models, IndoBERT and IndoBERTweet, in detecting text-based cyberbullying. Before modeling, the dataset undergoes Exploratory Data Analysis to understand its characteristics, class distribution, comment length, and potential data imbalance. Next, text preprocessing and tokenization are performed before dividing the data using stratified holdout splitting to preserve class proportions in training and testing sets. Both models are then trained with the same hyperparameter settings to ensure an objective and fair performance comparison. Results show that IndoBERT achieved an accuracy of 0.8333, while IndoBERTweet performed better with an accuracy of 0.8409. The analysis of the confusion matrix and ROC curve confirms that IndoBERTweet is more effective at detecting cyberbullying across different classes. Compared to previous studies using the SMOTE method and Bernoulli Naïve Bayes algorithm, which achieved 84.00% accuracy, this study's findings are slightly higher at 84.09%. Notably, this was achieved without using synthetic oversampling techniques. This suggests that the approach employed in this research can deliver competitive performance even without data balancing with SMOTE. Overall, these findings indicate that a transformer-based approach, combined with a more representative dataset, can improve cyberbullying detection more efficiently and practically. Therefore, IndoBERTweet is a more suitable model for implementing a cyberbullying content moderation system in Indonesia.

Copyrights © 2026






Journal Info

Abbrev

JAIC

Publisher

Subject

Computer Science & IT

Description

Journal of Applied Informatics and Computing (JAIC) Volume 2, Nomor 1, Juli 2018. Berisi tulisan yang diangkat dari hasil penelitian di bidang Teknologi Informatika dan Komputer Terapan dengan e-ISSN: 2548-9828. Terdapat 3 artikel yang telah ditelaah secara substansial oleh tim editorial dan ...