Claim Missing Document
Check
Articles

A Sentiment Analysis of Free Nutritious Meal Program on Platform X: Comparing Naive Bayes, SVM, Random Forest, and IndoBERT Nur Ilham, Alrijal; Kartikadarma, Etika
Journal of Applied Informatics and Computing Vol. 10 No. 3 (2026): June 2026
Publisher : Politeknik Negeri Batam

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30871/jaic.v10i3.12959

Abstract

The Free Nutritious Meal Program (MBG), launched by the Indonesian government in January 2025, generated various public responses on social media, particularly on platform X. This study aims to analyze public sentiment toward the MBG Program and compare the performance of four sentiment classification methods: Naive Bayes, Support Vector Machine (SVM), Random Forest, and IndoBERT. The dataset was collected through tweet crawling using the keywords “MBG” and “Makan Bergizi Gratis” during the period of July–December 2025, resulting in 1,906 Indonesian-language tweets. The preprocessing stage included cleaning, case folding, normalization, tokenization, stopword removal, and stemming. Sentiment labeling was performed using the InSet Lexicon and produced 1,113 negative tweets and 793 positive tweets. Manual validation on part of the dataset was conducted by two independent annotators and achieved a Cohen’s Kappa score of 0.78, indicating substantial agreement. For classical machine learning models, feature extraction was carried out using TF-IDF, while IndoBERT used contextual text representations without stemming. Class imbalance in classical models was handled using SMOTE, whereas IndoBERT applied class weighting. The experimental results show that IndoBERT achieved the best performance with an accuracy of 92.93%. Among the classical models, SVM produced the highest performance with an accuracy of 92.15%, followed by Naive Bayes and Random Forest. Word frequency analysis also revealed that positive sentiment was mainly associated with support for the program and nutrition-related topics, while negative sentiment was dominated by concerns about food safety, budget management, and criticism of the program. Based on the findings, IndoBERT is more effective in understanding the context of Indonesian-language tweets. However, TF-IDF-based classical models, especially SVM, still provide competitive performance with lower computational requirements, making them suitable for sentiment analysis in public policy studies.
Co-Authors Abu Salam Adhitya Nugraha Aditya Wahyu Ramadhan Affandy Affandy Affandy Affandy Ahmad Zainul Fanani Ajib Susanto Akbar Dwi Syahputra Alvin Jaya Hulu, Alvin Angga Apriano Hermawan Aripin Aripin Arnold Adimabua Ojugo Ashari Juang, Ashari Astuti, Yani Parti Azhara Devi Sandi Bayu Prasetyo Bimo Haryo Setyoko Brigita Gaerenda Jingga Putri Catur Supriyanto Christy Atika Sari Cinantya Paramita Dayangku Azriani binti Awang Ismail De Rosal Ignatius Moses Setiadi Desi Purwanti Devva Ricovani Susanto Dhani, Iqbal Dhita Aulia Octaviani Dianna Yanuaresta Dico Tri Rosandi Dita Afida Doheir, Mohamed Dwi Nurul Izzhati Dwi Puji Prabowo Edi Faisal Edy Mulyanto Eferhire Valentine Ugbotu Egia Rosi Subhiyakto Egia Rosi Subhiyakto Egia Rosi Subhiyakto, Egia Rosi Ekaprana Wijaya Endri Mujiono Erika Devi Udayanti Erlin Dolphina Erwin Yudi Hidayat Fahmi Amiq Fahri Firdausillah Farikh Al Zami Fauzi Adi Rafrastara Filmada Ocky Saputra Habib Mustofa Hafidhoh, Nisa'ul Hafidhoh, Nisa’ul Hafidhoh, Nisa’ul Handy Nur Cahya Heribertus Himawan Ifan Rizqa Ifan Rizqa Ifan Rizqa Ifan Rizqa Ifan Rizqa Ifan Rizqa Ihwati Ummi Ika Pantiawati Iskandar, Marcelino Jazuli Jazuli Johary, Lakui Junta Zeniarja Kumoro, Imanuel Dimas Cahyo Kurniawan, Defri Kusni Ingsih L. Budi Handoko Lakui Johary Laras Irsha Ramadani Marcelino Iskandar Meilani Dwi Permatasari Melati Oktafiyani Muhamad Ni'am Syukri Roni Asmi Muhammad Hafidz Muljono, - Najma Fatimah, Nandhita Nathaniel Alexander Nila Tristiarini, Nila Nisa'ul Hafidhoh Nova Rijati Nur Ilham, Alrijal Octara Pribadi Pujiono Pujiono Pujiono Purwanto Purwanto Rahma, Khalida Nur Raihan Yusuf Ricardus Anggi Pramunendar Rino Agung Robet Robet Rohman, Muhammad Syaifur Safa Firdaus, Muhammad Argya Sakti, Maulana Bima Saputra, Filmada Ocky Saraswati, Galuh Wilujeng Sari Ayu Wulandari Sari Wijayanti Sari Wijayanti Sari Wijayanti Setyawati, Vilda A. V. Silvan Pradana Sindhu Rakasiwi Sudibyo, Usman Sugiyanto - Suyud Widiono Syifa Desfiana T. Sutojo Tabitha Chukwudi Aghaunor Tri Listyorini Trisnapradika, Gustina Alfa Usman Sudibyo Utomo, Danang Wahyu Wardatunizza, Indah Wibowo, Alrico Rizki Widayat Yutriatmansyah, Widi Widi Widayat Yutriatmansyah Wikan Isthika Wikan Isthika, Wikan Winarsih, Nurul Anisa Sri Yani Parti Astuti Yani Parti Astuti Yunita Kemala Sari Yutriatmansyah, Widi Widayat Yutriatmansyah, Widi Widayat Zaenal Arofi, Muhammad Labib Zenia Kumala Pratama