Jurnal Masyarakat Informatika
Vol 17, No 1 (2026): May 2026 (Ongoing)

Parameter-Efficient Few-Shot Sentiment Analysis Using LoRA-Enhanced Transformers

Jibrin, Nurudeen (Unknown)
Aimufua, Gilbert (Unknown)
Onyedikachi, Okorie Sunday (Unknown)
Anthony, Alegbe Adesola (Unknown)
Chukwunwike, Ugbai Solomon (Unknown)
Aliyu, Fadila Dantalle (Unknown)



Article Info

Publish Date
13 Apr 2026

Abstract

Sentiment analysis in low-resource languages is often limited by scarce annotated data and the high computational cost of fine-tuning large language models. This study proposes a parameter-efficient framework that integrates Low-Rank Adaptation (LoRA) with lightweight transformer architectures, including AfriBERTa, DistilBERT, and MiniLMv2, for Hausa sentiment analysis using the NaijaSenti dataset. The framework is designed to address three key challenges: effective few-shot learning, robustness under extreme data scarcity, and mitigation of language-specific linguistic errors. Experimental results demonstrate that AfriBERTa-LoRA achieves 69.0% accuracy, only 4.8 percentage points below a fully fine-tuned XLM-RoBERTa baseline, while utilizing just 1.06% of trainable parameters and reducing GPU memory consumption by approximately 50%. Performance improves consistently with increasing data, indicating strong scalability under few-shot conditions. Linguistic error analysis reveals four dominant Hausa-specific failure modes accounting for 71.5% of misclassifications. Targeted mitigation strategies yield an 8.7 percentage point reduction in error rate (28% relative reduction, p < 0.01), with each individual strategy demonstrating statistical significance. These findings establish LoRA as an effective and efficient paradigm for low-resource natural language processing, providing a scalable and reproducible framework for sentiment analysis in underrepresented African languages.

Copyrights © 2026






Journal Info

Abbrev

jmasif

Publisher

Subject

Computer Science & IT

Description

JURNAL MASYARAKAT INFORMATIKA - JMASIF is a Journal published by the Department of Informatics, Universitas Diponegoro invites lecturers, researchers, students (Bachelor, Master, and Doctoral) as well as practitioners in the field of computer science and informatics to contribute to JMASIF in the ...