Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Sistemasi: Jurnal Sistem Informasi
Muhammad Elfarizi
Universitas Islam Negeri Sultan Syarif Kasim Riau
Computer Science & IT Electrical & Electronics Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Enhancing Hate Speech and Offensive Language Detection using CatBoost with RoBERTa-based Contextual Embeddings Muhammad Elfarizi; Surya Agustian; Fitra Kurnia; Suwanto Sanjaya; Fitri Insani
SISTEMASI Vol 15, No 7 (2026): Sistemasi: Jurnal Sistem Informasi
Publisher : Universitas Islam Indragiri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32520/stmsi.v15i7.6637

Abstract

The widespread dissemination of hate speech and offensive content on social media platforms has become a critical societal issue, highlighting the need for reliable automated detection systems. This study proposes a hybrid approach that leverages frozen embeddings from the pre-trained language model cardiffnlp/twitter-roberta-base-offensive as a high-level semantic feature extractor, combined with the CatBoost gradient boosting algorithm as the final classifier. The proposed method was evaluated on the HASOC 2021 English dataset through six experimental scenarios and compared with a TF-IDF baseline using CatBoost's default hyperparameters. Experimental results demonstrate that the proposed approach achieved a Macro F1-score of 0.7924 for the binary classification task (Task 1A) and 0.6113 for the multiclass classification task (Task 1B), outperforming the TF-IDF baseline, which achieved scores of 0.7724 and 0.5798, respectively. The proposed system demonstrated a clear performance improvement and achieved results comparable to those of the top-ranked teams on the official HASOC 2021 leaderboard, while avoiding the computational cost associated with fine-tuning large pre-trained language models.
Co-Authors Fitra Kurnia Fitri Insani Surya Agustian Suwanto Sanjaya