Jurnal Teknik Informatika (JUTIF)
Vol. 7 No. 3 (2026): JUTIF Volume 7, Number 3, June 2026

Optimizing Naive Bayes for Sentiment Analysis of M-Passport Reviews Using N-Gram and Synthetic Minority Over-sampling Technique

Devia Kartika (Universitas Putra Indonesia YPTK Padang, Indonesia)
Sarjon Defit (Universitas Putra Indonesia YPTK Padang, Indonesia)



Article Info

Publish Date
15 Jun 2026

Abstract

The diverse user perceptions and increasing number of negative reviews of the M-Passport application indicate the need for sentiment analysis-based evaluation to more accurately measure the quality of digital immigration services. This study aims to analyze user sentiment towards the M-Passport application using an optimized Naïve Bayes classification model. Review data was obtained through web scraping from various digital platforms and processed using text preprocessing, TF-IDF feature extraction, N-Gram representation, and the Synthetic Minority Over-sampling Technique (SMOTE) technique to address data representativeness. The proposed model classifies user reviews into positive, neutral, and negative sentiment categories. Test results show that optimization using N-Gram and SMOTE successfully improved model performance, with accuracy increasing from 61% to 77.51%, precision from 0.75 to 0.78, recall from 0.53 to 0.78, and F1-score from 0.50 to 0.77. These results demonstrate that the combination of feature engineering and data balancing can improve text context representation and sentiment classification stability across multiple classes. Furthermore, sentiment analysis successfully identified key factors contributing to user dissatisfaction, such as technical constraints, feature limitations, and application difficulty. These results demonstrate that the proposed approach is effective in supporting data-driven evaluation to improve the quality of digital immigration services.

Copyrights © 2026






Journal Info

Abbrev

jurnal

Publisher

Subject

Computer Science & IT

Description

Jurnal Teknik Informatika (JUTIF) is an Indonesian national journal, publishes high-quality research papers in the broad field of Informatics, Information Systems and Computer Science, which encompasses software engineering, information system development, computer systems, computer network, ...