RABIT: Jurnal Teknologi dan Sistem Informasi Univrab
Vol 11 No 1 (2026): Januari

HYBRID FINE-TUNING INDOBERT DAN ENSEMBLE TF-IDF LOGISTIC REGRESSION UNTUK ANALISIS SENTIMEN ULASAN APLIKASI ZALORA : HYBRID FINE-TUNING INDOBERT DAN ENSEMBLE TF-IDF LOGISTIC REGRESSION UNTUK ANALISIS SENTIMEN ULASAN APLIKASI ZALORA

Al Ikhsan Faiq (Universitas Sriwijaya)
M. Rudi Sanjaya Sanjaya (Universitas Sriwijaya)
Dwi Rosa Indah (Universitas Sriwijaya)
Endang Lestari Ruskan (Universitas Sriwijaya)



Article Info

Publish Date
11 Jan 2026

Abstract

Sentiment analysis of e-commerce app reviews is essential to capture user perception and guide service improvements. However, review datasets are typically imbalanced—especially for the neutral class—making accuracy-only evaluation inadequate. This study proposes a hybrid approach that combines IndoBERT fine-tuning with a TF–IDF + logistic regression ensemble, augmented with probability calibration via temperature scaling, a dedicated neutral threshold rule, and a rating-based prior for low-confidence predictions. To avoid data leakage, the dataset is first split using stratified sampling into 72% training, 8% validation, and 20% testing; oversampling is applied only on the training split. Training uses label smoothing and early stopping (patience=2). The best validation configuration achieves macro-F1 of 0.8158 (T=0.941; α=0.70; t_neu=0.55; γ=0.10; τ=0.60). On the test set, the proposed model reaches 86.77% accuracy, 81.71% macro-F1, and 86.76% weighted-F1. An ablation study shows consistent gains from the TF–IDF+LR baseline to the full hybrid model, with the most notable improvement in the neutral class.

Copyrights © 2026






Journal Info

Abbrev

rabit

Publisher

Subject

Computer Science & IT Engineering

Description

This journal is called RABIT, where the name comes from two words namely, RAB which means Abdurrab University and IT which means information technology, it can be interpreted as a journal of this journal Journal of Informatics Engineering Study Program Pekanbaru Abdurrab University. This RABIT ...