Mia Rosmiati
Universitas Bina Sarana Informatika Kampus Kota Pontianak, Pontianak

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Sentiment Analysis of YouTube Comments on Indonesia-U.S. Trade Agreement: A Comparison of Machine Learning and Deep Learning Dea Amanda; Muhammad Iqbal; Mia Rosmiati
Journal of Information System Research (JOSH) Vol 7 No 4 (2026): July 2026
Publisher : Forum Kerjasama Pendidikan Tinggi (FKPT)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/josh.v7i4.10515

Abstract

The Indonesia–United States Trade Agreement has sparked much public debate on YouTube, but due to the large volume of data and the informal nature of the text, manual analysis is ineffective. Through a comparative study of machine learning (Naïve Bayes and Support Vector Machine) and deep learning (Long Short-Term Memory and IndoBert), this research aims to identify the polarity of public opinion and evaluate the best computational model. This study contributes a comprehensive empirical comparison of the four algorithms within an identical experimental pipeline on an issue that has not been previously explored, thereby offering methodological insights for future sentiment analysis research on similarly informal, domain-specific social media text. The dataset consists of 2,284 comments labeled using the InSet Lexicon. The analysis results show that the neutral class dominates the sentiment distribution (52,0%), followed by the positive class (20,2%) and the negative class (27,8%). Performance evaluation reveals that IndoBERT significantly outperforms other models with an accuracy of 87.71% and a Macro F1-Score of 0.87. Support Vector Machine ranked second (79.00%), followed by Naïve Bayes (61.71%). In contrast, Long Short-Term Memory failed completely (accuracy of 52.00%) due to the “majority class collapse” phenomenon in small-scale datasets. This study concludes that the Transformer architecture (IndoBert) is the most robust approach for classifying sentiment in informal Indonesian-language text containing specific geopolitical and economic terms.