BAREKENG: Jurnal Ilmu Matematika dan Terapan
Vol 20 No 4 (2026): BAREKENG: Journal of Mathematics and Its Application

A HYBRID BERT-BILSTM-ATTENTION MODEL FOR PUBLIC SENTIMENT ANALYSIS ON A NATIONAL SOCIAL INSURANCE PROVIDER IN INDONESIA

Syaiful Anam (Mathematics Department, Faculty of Mathematics and Natural Sciences, Universitas Brawijaya, Indonesia)
Nur Atiqah Sia Abdullah (Faculty of Computer and Mathematical Sciences, Universiti Teknologi MARA, Malaysia)
Hilmi Aziz Bukhori (Mathematics Department, Faculty of Mathematics and Natural Sciences, Universitas Brawijaya, Indonesia)
Avin Maulana (Mathematics Department, Faculty of Mathematics and Natural Sciences, Universitas Brawijaya, Indonesia)
Regina Vincentia (Mathematics Department, Faculty of Mathematics and Natural Sciences, Universitas Brawijaya, Indonesia)



Article Info

Publish Date
24 Aug 2026

Abstract

Sentiment analysis in Indonesian social media presents significant challenges due to informal language, code-mixing, and sentiment ambiguity in multi-clause expressions. While transformer-based models such as IndoBERT effectively capture contextual semantics, they may struggle to model sentiment transitions and resolve conflicting polarity in noisy and heterogeneous text. To address this limitation, this study employs a hybrid BERT–BiLSTM–Attention model that integrates contextual, sequential, and attention-based representations. Although the architecture itself is not novel, the contribution lies in its systematic integration and empirical evaluation under realistic conditions. Experimental results show that the proposed model achieves an accuracy of 0.85 and a Macro-F1 score of 0.85, outperforming the IndoBERT baseline (0.83) by approximately 2.4%. This improvement is statistically significant (p = 0.027) and supported by effect size analysis, indicating meaningful performance gains. Robustness evaluation under controlled perturbations—including slang injection, character elongation, emoji usage, code-mixing, and class imbalance (up to 30% minority downsampling)—shows only minor performance degradation (0.02–0.03 Macro-F1), demonstrating stable generalization under noisy conditions. These findings provide empirical evidence that the integration of sequential modeling and attention improves the handling of sentiment transitions and multi-clause structures beyond transformer-only approaches, offering practical value for real-world sentiment analysis in Indonesian social media.

Copyrights © 2026






Journal Info

Abbrev

barekeng

Publisher

Subject

Computer Science & IT Control & Systems Engineering Economics, Econometrics & Finance Energy Engineering Mathematics Mechanical Engineering Physics Transportation

Description

BAREKENG: Jurnal ilmu Matematika dan Terapan is one of the scientific publication media, which publish the article related to the result of research or study in the field of Pure Mathematics and Applied Mathematics. Focus and scope of BAREKENG: Jurnal ilmu Matematika dan Terapan, as follows: - Pure ...