Journal of Embedded Systems, Security and Intelligent Systems
Vol 6, No 4 (2025): Desember 2025

Performance Comparison of Svm and Naïve Bayes For Indonesian-Language Sentiment Analysis On Free Fire Reviews Using Tf-Idf And Smote

Wahid, Yokogeri Abdullah (Unknown)
Sanatang (Unknown)
Andayani, Dyah Darma (Unknown)



Article Info

Publish Date
11 Nov 2025

Abstract

The popularity of online games continues to increase, including Free Fire, which has gained more than one billion downloads and millions of user reviews on the Google Play Store. However, the variation and inconsistency of user comments make manual sentiment evaluation difficult. This study aims to compare the performance of Support Vector Machine (SVM) and Naïve Bayes in classifying user review sentiment on the Free Fire game. A total of 535 Indonesian-language reviews were collected using web scraping and processed through text cleaning, case folding, normalization, stopword removal, and stemming. Sentiment labels were assigned manually based on review content. The dataset was divided into training and testing using a 70:30 ratio, and feature extraction used Term Frequency–Inverse Document Frequency (TF-IDF). Two scenarios were implemented: a baseline without class balancing and a scenario using Synthetic Minority Oversampling Technique (SMOTE) to address class imbalance. Results show that SVM outperforms Naïve Bayes in both scenarios. In the baseline, SVM achieved 89.81% accuracy, while Naïve Bayes obtained 82.80%. After SMOTE, SVM improved to 91.08% accuracy and Naïve Bayes to 89.17%. These findings indicate that SVM, especially with SMOTE, provides a more effective and balanced performance for sentiment classification on Free Fire reviews. The study contributes to providing a more accurate understanding of user perception and strengthening model development for sentiment analysis on digital game applications.

Copyrights © 2025






Journal Info

Abbrev

JESSI

Publisher

Subject

Computer Science & IT

Description

The Journal of Embedded System Security and Intelligent System (JESSI), ISSN/e-ISSN 2745-925X/2722-273X covers all topics of technology in the field of embedded system, computer and network security, and intelligence system as well as innovative and productive ideas related to emerging technology ...