Article Per Year (5 Year)
p-Index From 2021 - 2026
1.683
P-Index
This Author published in this journals
All Journal Jurnal Ilmiah Mikrotek Minda Baharu Amalee: Indonesian Journal of Community Research & Engagement Indonesian Journal of Electrical Engineering and Computer Science Jurnal Teknik Informatika (JUTIF) Prosiding Konferensi Nasional PKM-CSR
Hasan Dwi Cahyono
Universitas Sebelas Maret
Humanities Computer Science & IT Control & Systems Engineering Economics, Econometrics & Finance Education Environmental Science Nursing Public Health Social Sciences Other

Published : 11 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 11 Documents
Search

 1   2 
Comparative Analysis of GPT-2 Augmentation, ALBERT, and Similarity Measures for Cyberbullying Detection Hidayat, Zidane; Cahyono, Hasan Dwi; Muslim, Fajar
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 2 (2026): JUTIF Volume 7, Number 2, April 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.2.5320

Abstract

The effectiveness of cyberbullying detection is influenced by the availability of sufficient, diverse, and contextually rich training data, which is often limited in low-resource languages such as Indonesian. To address dataset limitations, researchers have extensively explored data augmentation (DA) as a promising approach to improving model performance. DA generates new data instances by applying transformations to existing data, thereby increasing both dataset size and variability. Prior studies have demonstrated that applying Easy Data Augmentation (EDA) with Support Vector Machine (SVM) classification improved cyberbullying detection performance, even when it faced challenges in capturing semantic and contextual nuances. In this paper, we investigated Indonesian DA methods using the Transformer-based GPT-2 model. The augmented sentences were evaluated and filtered based on context, semantics, diversity, and novelty, with similarity measures such as Euclidean Distance (ED), Cosine Similarity (CS), Jaccard Similarity (JS), and BLEU Score (BLS) ensuring the quality of the augmentation. Furthermore, we compared text classification performance using both SVM and the Transformer-based ALBERT model. Experimental results revealed that incorporating similarity measures and GPT-2 as a DA method failed to improve cyberbullying detection performance, potentially due to the semantic drift introduced by GPT-2 and the inadequacy of similarity measures in capturing nuanced contextual information. However, we found that ALBERT outperformed SVM as a classification model, achieving average F1-scores of 91.77% and 91.72%, respectively. This study contributes to the informatics field by exploring the potential of Transformer-based augmentation and similarity evaluation in enhancing low-resource text classification, while acknowledging the limitations in data quality and model adaptation.
Co-Authors Adiar, Shalsabila Aura Afan Firdaus, Alfiki Diastama Afrizal Doewes, Afrizal Agustinus Bimo Gumelar Amalia Utami, Sekar Gesti Angrainingsih, Rini Ardhi Wijayanto Cahyani, Yonaka Titin Nur Cahyo Darujati Dewi Wisnu Wardani Dewi Wisnu Wardani Dewi Wisnu Wardani Dewi, Nabilla Nurulita Doewoes, Afrizal Guritno, Sangaji Suryo Haryono Setiadi Hendrasuryawan, Brilyan Hidayat, Zidane Mahendra, Yuzzar Rizky Marwa, Adeline Fellita Muslim, Fajar Rahmawan, Rizki Dwi Rini Anggrainingsih Saputra , Iskandar Abdul Azis Setiadi, Haryono Setiyawan, Sitti Ayuningrum Sidiq, Muhammad Rais Syamsul Anam Wardhani, Dewi Wisnu Wijayanto, Ardhi