Inez Nurdika Irzani
UIN Walisongo Semarang

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Integrating Linguistic Features with IndoBERT for Detecting Underage-Associated Comments in Indonesian YouTube Inez Nurdika Irzani; Maya Rini Handayani; Dwi Pebrianti; Khothibul Umam
Applied Information System and Management (AISM) Vol. 9 No. 2 (2026): Applied Information System and Management (AISM)
Publisher : Depart. of Information Systems, FST, UIN Syarif Hidayatullah Jakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15408/aism.v9i2.53149

Abstract

Indonesia has issued Government Regulation No. 17 of 2025 on Electronic System Governance for Child Protection (PP TUNAS), which prohibits independent access to digital platforms for individuals under 16. However, age verification remains difficult since users may provide fake birth dates during registration. This study aims to develop a hybrid text classification framework that integrates IndoBERT contextual embeddings with eight handcrafted linguistic features (teen_score, adult_score, emotion_score, grammar_score, word_count, exclamation_count, question_count, and teen_adult_ratio) to identify underage-associated comments on Indonesian YouTube. This study collected 37,450 comments from 271 videos using the YouTube Data API v3 and validated annotation consistency through manual labeling of 500 stratified samples, achieving Cohen's Kappa of 0.853 (almost perfect agreement). To address severe class imbalance, in which under-16 samples accounted for only 1.64%, then applied stratified 5-fold cross-validation with weighted sampling. The hybrid model achieved F1-scores of 0.7777 ± 0.0680 (cross-validation) and 0.9609 (test set). Ablation experiments confirmed explicit age disclosures are essential for the current annotation strategy. Although no significant performance difference was observed versus IndoBERT-only (p = 0.5743), the hybrid model provides explicit linguistic evidence through SHAP and LIME analyses, substantially improving interpretability. This makes the proposed framework suitable for transparent policy-oriented comment screening under PP TUNAS.