Claim Missing Document
Check
Articles

Found 2 Documents
Search

Digital propaganda content detection using a transformer-based model on social media platforms Jonson Manurung; Hengki Tamando Sihotang; R. Fanry Siahaan
Journal of Defense Technology and Engineering Vol. 2 No. 1 (2026): July, Journal of Defense Technology and Engineering
Publisher : Fakultas Teknik dan Teknologi Pertahanan, Universitas Pertahanan Republik Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

Digital propaganda on social media has emerged as a critical challenge to democratic stability and national security. Although transformer-based language models have demonstrated promising performance in text classification, their effectiveness for propaganda detection is often constrained by subtle rhetorical manipulation and severe class imbalance, leading to biased predictions toward majority classes. This study addresses these limitations by proposing a fine-tuned RoBERTa-base model integrated with a class-weighted cross-entropy loss to improve the recognition of minority propaganda instances. The model was trained and evaluated on the SemEval-2020 Task 11 sentence-level corpus containing 14,857 annotated sentences, partitioned into 11,886 training samples and 2,971 test samples using stratified sampling. RoBERTa was selected because its robust pre-training strategy and dynamic masking enable more effective contextual representation learning, while class-weighted loss mitigates the adverse effects of the 22.80% to 77.20% class imbalance by assigning weights of 2.19 and 0.65 to the propaganda and non-propaganda classes, respectively. Under identical fine-tuning settings, the proposed model was compared with BERT-base and DistilBERT-base to ensure a fair architectural evaluation. Experimental results demonstrate that RoBERTa achieved the best performance, attaining 93.47% accuracy and a macro-F1 score of 91.82%, outperforming BERT by 1.28 percentage points and DistilBERT by 2.89 percentage points in macro-F1. These findings demonstrate that combining RoBERTa with class-weighted learning provides a robust and practical approach for propaganda detection, supporting the development of automated content moderation and misinformation monitoring systems for social media platforms. Future work will investigate multilingual propaganda detection and fine-grained propaganda technique classification.
Cyber threat detection on social media using indoBERT and sentiment analysis Bagus Hendra Saputra; Jonson Manurung; Baringin Sianipar; R. Fanry Siahaan
Journal of Defense Technology and Engineering Vol. 2 No. 1 (2026): July, Journal of Defense Technology and Engineering
Publisher : Fakultas Teknik dan Teknologi Pertahanan, Universitas Pertahanan Republik Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

The rapid growth of Indonesian social media has increased the spread of cyber threat-related content, creating significant challenges for digital security monitoring due to the informal language, code-switching, and sentiment-rich expressions commonly used in online communication. Existing detection approaches, particularly those based on multilingual or English-centric language models, often fail to capture the linguistic characteristics of Indonesian text effectively. This study aims to develop an accurate cyber threat detection model by fine-tuning IndoBERT, a transformer-based language model pretrained on a large-scale Indonesian corpus, for binary Threat and Non-Threat classification. The model was trained and evaluated using the Tweet ID Sentiment Dataset containing 10,800 annotated tweets, which were partitioned into training, validation, and test sets, and its performance was compared with four baseline methods: SVM with TF-IDF features, CNN with FastText embeddings, BiLSTM with Word2Vec representations, and multilingual BERT. Experimental results demonstrate that the proposed IndoBERT model achieved the best performance, obtaining an accuracy of 0.9389, a macro-F1 score of 0.9292, and a Threat-class recall of 0.9486, consistently outperforming all baseline models. The novelty of this study lies in demonstrating the effectiveness of a monolingual Indonesian pretrained transformer for cyber threat detection, highlighting the importance of language-specific contextual representations in improving classification performance. These findings indicate that the proposed approach provides a robust and practical solution for automated cyber threat detection, supporting early warning systems and digital security monitoring in Indonesian social media environments. Future work will investigate multiclass cyber threat categorization and cross-platform evaluation to improve model generalizability in real-world applications.