JOURNAL OF APPLIED INFORMATICS AND COMPUTING
Vol. 10 No. 5 (2026): October 2026

Preprocessing Effects on Word2Vec and IndoRoBERTa for Shopee Sentiment Classification

Avitadia Prichanti, Lilik (Unknown)
Rizky Pangestutik, Kinanti (Unknown)
Suhaeni, Cici (Unknown)
Sartono, Bagus (Unknown)



Article Info

Publish Date
14 Oct 2026

Abstract

This study evaluates the effects of heavy and minimal preprocessing on static and contextual text representations for sentiment classification of Indonesian Shopee reviews. The dataset comprised 29,618 Google Play Store reviews collected in January 2026 and weakly labeled from star ratings into negative, neutral, and positive classes. The data were divided into training, validation, and test sets using an 80:10:10 stratified split. Heavy preprocessing included case folding, text cleaning, slang normalization, stopword removal, and stemming, whereas minimal preprocessing applied case folding only. Four experimental configurations combined the two preprocessing strategies with Word2Vec–Logistic Regression and fine-tuned IndoRoBERTa. Model performance was evaluated using accuracy, weighted precision, weighted recall, weighted F1-score, macro F1-score, and confusion matrices. Heavy preprocessing produced a marginal weighted F1-score improvement for Word2Vec–Logistic Regression, from 86.0% to 86.2%. Minimal preprocessing improved IndoRoBERTa’s weighted F1-score from 88.4% to 89.7% and achieved the best accuracy of 90.7% and macro F1-score of 65.8%. The difference between weighted and macro F1-scores indicates that the neutral minority class remained difficult to identify. The findings show that preprocessing effectiveness depends on model architecture. Minimal preprocessing better preserves contextual information for IndoRoBERTa, whereas aggressive preprocessing provides only a marginal benefit for the static baseline.

Copyrights © 2026






Journal Info

Abbrev

JAIC

Publisher

Subject

Computer Science & IT

Description

Journal of Applied Informatics and Computing (JAIC) Volume 2, Nomor 1, Juli 2018. Berisi tulisan yang diangkat dari hasil penelitian di bidang Teknologi Informatika dan Komputer Terapan dengan e-ISSN: 2548-9828. Terdapat 3 artikel yang telah ditelaah secara substansial oleh tim editorial dan ...