Sistemasi: Jurnal Sistem Informasi
Vol 14, No 4 (2025): Sistemasi: Jurnal Sistem Informasi

Classification of Service Sentiments on the by.U Application using the Support Vector Machine Algorithm

Zulkarnain, Zulkarnain (Unknown)
Novita, Rice (Unknown)
Angraini, Angraini (Unknown)
Zarnelly, Zarnelly (Unknown)



Article Info

Publish Date
11 Jul 2025

Abstract

This study aims to classify user sentiment toward the by.U application service using the Support Vector Machine (SVM) algorithm. The background of this research is based on the importance of understanding user opinions on the quality of digital services as a basis for evaluation and service improvement. Review data was collected from the Google Play Store, totaling 9,091 data points, which were then processed through preprocessing stages such as cleaning, case folding, tokenization, stopword removal, and stemming. Sentiments were categorized into three groups: positive, negative, and neutral. The training and testing process involved dividing the data into training and testing sets with an 80:20 ratio, and evaluation was conducted using metrics such as accuracy, precision, recall, and F1-score. The evaluation results showed that the SVM algorithm achieved an accuracy of 83% in classifying sentiments. The model performed best on positive sentiment (precision 84%, recall 90%, F1-score 87%) and negative sentiment (precision 81%, recall 92%, F1-score 86%), while neutral sentiment still had weaknesses with an F1-score of only 64%. This indicates that neutral sentiment classification still requires model enhancement. This study demonstrates that SVM is an effective method for automatically analyzing user opinions on digital services. These classification results can serve as a reference for developers in evaluating and improving service quality based on user feedback.

Copyrights © 2025






Journal Info

Abbrev

stmsi

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

Sistemasi adalah nama terbitan jurnal ilmiah dalam bidang ilmu sains komputer program studi Sistem Informasi Universitas Islam Indragiri, Tembilahan Riau. Jurnal Sistemasi Terbit 3x setahun yaitu bulan Januari, Mei dan September,Focus dan Scope Umum dari Sistemasi yaitu Bidang Sistem Informasi, ...