JOINCS (Journal of Informatics, Network, and Computer Science)
Vol. 9 No. 1 (2026): April

Context-Aware Transformer-Based Model for Aspect-Based Sentiment Analysis: A Systematic Literature Review: Model Berbasis Transformer yang Sadar Konteks untuk Analisis Sentimen Berbasis Aspek: Tinjauan Literatur Sistematis

Moch. Fauzan (Universitas Muhammadiyah Sidoarjo)
Ika Safitri Windiarti (Universitas Muhammadiyah Malaysia)



Article Info

Publish Date
30 Apr 2026

Abstract

Aspect-Based Sentiment Analysis (ABSA) is a critical natural language processing task aimed at identifying specific aspects within text and determining the sentiment polarity toward each aspect. Transformer-based models, particularly BERT and its variants, have demonstrated significant advances in ABSA through powerful contextual representations. However, challenges in capturing target-specific context and managing inter-subtask dependencies remain. This Systematic Literature Review (SLR) identifies, evaluates, and synthesizes current research on context-aware transformer models for ABSA, with emphasis on context-aware mechanisms, multi-task learning approaches, and BERT-family models. Following the PRISMA 2020 protocol, a structured search was conducted on the Scopus database using three Boolean queries, yielding 851 initial records. After deduplication (n=70), title/abstract screening (n=554 excluded), retrieval (n=147 not retrieved), and full-text eligibility assessment (n=48 excluded), 32 studies were included for synthesis. Three primary model categories were identified: (1) BERT baselines establishing strong end-to-end ABSA performance; (2) context-aware variants employing context-guided attention (CG-BERT, QACG-BERT, LCF-ATEPC, cascade models); and (3) multi-task transformers (BERT-MTL, RoBERTa-MTL, MTL-AraBERT, SABKG, MLEGCN) handling ABSA subtasks jointly. Reported F1-scores ranged from 50–89% across SemEval-2014/2015/2016 and domain-specific datasets. ntext-aware and multi-task transformer models represent the state of the art in ABSA. Open challenges include implicit aspect handling, cross-domain generalization, model efficiency, and evaluation of large generative language models (LLMs) for fine-grained sentiment tasks.

Copyrights © 2026






Journal Info

Abbrev

joincs

Publisher

Subject

Computer Science & IT

Description

JOINCS publishes original research papers in computer science and related subjects in system science, with consideration to the relevant mathematical theory. Applications or technical reports oriented papers may also be accepted and they are expected to contain deep analytic evaluation of the ...