Journal of Computer System and Informatics (JoSYC)
Vol 7 No 4 (2026): August 2026

Analisis Sentimen Ulasan Pengguna Halodoc Menggunakan TextCNN pada Dataset Tidak Seimbang Berbasis NLP

Fitriyani Fitriyani (Universitas Esa Unggul, Jakarta)
Budi Tjahjono (Universitas Esa Unggul, Jakarta)



Article Info

Publish Date
31 Aug 2026

Abstract

This study analyzes user sentiment in Halodoc application reviews using a TextCNN architecture on an Indonesian-language dataset with extreme class imbalance. The dataset consists of 2,000 reviews collected from the Google Play Store and manually labeled into three classes: positive, negative, and neutral. The class distribution comprises 1,800 positive reviews (90%), 175 negative reviews (8.75%), and 25 neutral reviews (1.25%). To reduce bias toward the majority class, the TextCNN model was trained using class weighting and evaluated using accuracy, precision, recall, F1-score, and a confusion matrix. The model achieved an accuracy of 93.75% and a weighted F1-score of 0.94, while the macro F1-score was only 0.57. The recall for the neutral class was 0%, indicating that the model was unable to recognize the minority class effectively. The contributions of this study are threefold: an empirical evaluation of TextCNN on Indonesian Halodoc reviews with extreme class imbalance; an analysis of the effect of class distribution using class-level metrics and error analysis; and an identification of the practical implications of the classification results for monitoring digital healthcare service quality. These findings demonstrate that high accuracy alone is insufficient to represent model performance on imbalanced datasets; therefore, strategies such as oversampling, data augmentation, or hybrid approaches should be considered in future research.

Copyrights © 2026






Journal Info

Abbrev

josyc

Publisher

Subject

Computer Science & IT Decision Sciences, Operations Research & Management Industrial & Manufacturing Engineering

Description

Journal of Computer System and Informatics (JoSYC) covers the whole spectrum of Artificial Inteligent, Computer System, Informatics Technique which includes, but is not limited to: Soft Computing, Distributed Intelligent Systems, Database Management and Information Retrieval, Evolutionary ...