Journal of Intelligent Systems Technology and Informatics
Vol 2 No 1 (2026): JISTICS, March 2026

Comparison of Score-Based and Content-Based Automatic Sentiment Labeling Using a K-Nearest Neighbor Classifier

Muzaky, Rifky Khoerul (Unknown)
Diniyaturobiah, Hanipah (Unknown)



Article Info

Publish Date
26 Mar 2026

Abstract

This study investigates the performance gap between two automatic sentiment labeling strategies one relying on star ratings and the other derived from textual content in classifying application reviews using the K-Nearest Neighbor (KNN) algorithm. Each review is converted into TF-IDF vectors, and the influence of both labeling approaches on the resulting classifier is examined. Performance is evaluated using accuracy, precision, recall, and F1-score to ensure a comprehensive assessment, with the content-based method achieving an accuracy of 0.81, indicating a more reliable outcome than the score-based variant. The score-driven approach shows weaker consistency, largely due to mismatches between numerical ratings and the sentiment conveyed in written text. Despite these findings, the study is limited by its focus on a single application domain and its reliance on a single classical baseline classifier, which may be sensitive to class imbalance. Future work is encouraged to incorporate more diverse datasets, adopt modern text representation techniques such as word embeddings or transformer-based encodings, and explore classification algorithms that better accommodate uneven class distributions.

Copyrights © 2026






Journal Info

Abbrev

jistics

Publisher

Subject

Computer Science & IT Control & Systems Engineering Engineering

Description

The Journal of Intelligent Systems Technology and Informatics (JISTICS) is an international peer-reviewed open-access journal that publishes high-quality research in the fields of Artificial Intelligence, Intelligent Systems, Information Technology, Computer Science, and Informatics. JISTICS aims to ...