JOURNAL OF APPLIED INFORMATICS AND COMPUTING
Vol. 10 No. 3 (2026): June 2026

Comparative Analysis of the Performance of Machine Learning Methods and Text Embedding Techniques in Classifying Toxic Conversations in the Roblox Game

Octa Dama Yanti (Department of Information Systems, Universitas Sriwijaya)
Syifa Alfariani (Universitas Sriwijaya)
Syifa Naura Milla Celesta (Universitas Sriwijaya)
Ken Dhita Tania (Universitas Sriwijaya)
Ahmad Rifai (Universitas Sriwijaya)



Article Info

Publish Date
17 Jun 2026

Abstract

Online games have evolved into digital social spaces where player interactions often include toxic communication, potentially affecting user experience and psychological well-being, especially among younger players. This research is intended to examine and compare the performance of various machine learning algorithms in classifying toxic chat on the Roblox platform and to identify underlying linguistic patterns. The dataset consists of 7,119 Indonesian-language chat data labeled into six categories: identity_hate, insult, obscene, severe_toxic, threat, and toxic. The methodology includes data preprocessing, text representation using Bag-of-Words (BoW) and TF-IDF, and classification using Naive Bayes, Support Vector Machine (SVM), and Random Forest. To assess how well the model performs, several metrics are used, including accuracy, precision, recall, F1-score, and 3-fold cross-validation. The results show that SVM with TF-IDF achieves the best performance with 84.48% accuracy, followed closely by SVM with BoW. The findings indicate that while classical machine learning models remain effective, challenges persist in distinguishing linguistically similar categories.

Copyrights © 2026






Journal Info

Abbrev

JAIC

Publisher

Subject

Computer Science & IT

Description

Journal of Applied Informatics and Computing (JAIC) Volume 2, Nomor 1, Juli 2018. Berisi tulisan yang diangkat dari hasil penelitian di bidang Teknologi Informatika dan Komputer Terapan dengan e-ISSN: 2548-9828. Terdapat 3 artikel yang telah ditelaah secara substansial oleh tim editorial dan ...