Infotekmesin
Vol 17 No 2 (2026): Infotekmesin: Juli 2026

Otomatisasi Pelabelan Korpus Sarkasme pada Komentar YouTube Berbahasa Indonesia Menggunakan Model Bahasa RoBERTa

Rizky Agil Singgih Susanto (Amikom Purwokerto)
Taqwa Hariguna (Universitas Amikom Purwokerto)
Azhari Shouni Barkah (Universitas Amikom Purwokerto)



Article Info

Publish Date
01 Aug 2026

Abstract

Sarcasm detection in Indonesian YouTube comments remains challenging due to contextual ambiguity, limited labeled data, and class imbalance. This study proposes a fine-tuned RoBERTa-based auto-labeling pipeline to generate high-confidence pseudo-labels for unlabeled comments. The scientific contribution lies in integrating Back-Translation augmentation, confidence-threshold filtering at P ≥ 0.85, and comparative evaluation against baseline models on a YouTube sarcasm corpus. The data were collected from 10 public Indonesian YouTube videos covering public service, political, social, and entertainment topics during January-March 2025. From 1,000 raw comments, 493 clean comments, 200 manually labeled instances, and 536 final instances were obtained after augmentation and pseudo-label filtering. The 5-fold cross-validation results show that RoBERTa achieved an accuracy of 0.89 and a macro F1-Score of 0.87, with class-wise precision/recall of 0.81/0.81 for sarcasm and 0.92/0.92 for non-sarcasm. Compared with TF-IDF + SVM, BiLSTM, and IndoBERT, RoBERTa improved the F1-Score by 24.29%, 12.99%, and 3.57%, respectively. These findings indicate that RoBERTa-based auto-labeling can support a more controlled expansion of sarcasm corpora while reducing reliance on fully manual annotation.

Copyrights © 2026






Journal Info

Abbrev

infotekmesin

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering Mechanical Engineering

Description

INFOTEKMESIN is a peer-reviewed open-access journal with e-ISSN 2685-9858 and p-ISSN: 2087-1627 published by Pusat Penelitian dan Pengabdian Masyarakat (P3M) Politeknik Negeri Cilacap. The journal invites scientists and engineers to exchange and disseminate theoretical and practice-oriented in the ...