Voteteknika (Vocational Teknik Elektronika dan Informatika)
Vol 14, No 3 (2026): Voteteknika (Vocational Teknik Elektronika dan Informatika)

Parameter-Efficient Fine-Tuning of IndoBERT Using LoRA in EmoJournal Web Application for Student Emotion Classification

Marsha Faine Sabina (Universitas Negeri Padang)
Yeka Hendriyani (Universitas Negeri Padang)



Article Info

Publish Date
24 Sep 2026

Abstract

Emotion classification in Indonesian text presents significant linguistic complexity due to non-standard slang, pervasive abbreviations, colloquial particles, and subtle implicit expressions in student daily reflective narratives. Full fine-tuning of large pre-trained contextual Transformer models such as IndoBERT demands substantial graphics memory and computational infrastructure, while introducing severe vulnerability to overfitting and catastrophic forgetting when adapted to domain-specific corpora. This study aims to design, evaluate, and deploy an end-to-end parameter-efficient emotion classification pipeline across six discrete emotional categories (happiness, disgust, anger, sadness, fear, and surprise) by implementing Low-Rank Adaptation (LoRA) on IndoBERT using PyTorch, integrated natively into the Django-based EmoJournal web architecture. The methodology combines computational deep learning experimentation with an Agile Kanban software engineering lifecycle. Text processing encompasses case folding, tokenization via IndoBERT-base-p1, sequence length bounding to 128 tokens, and stratified dataset partitioning. Low-rank decomposition matrices ($r=8, \alpha=16$) are injected into the multi-head self-attention query and value projections, optimizing merely 299,526 trainable parameters out of 124,745,484 total parameters (0.24%). The fine-tuned IndoBERT-LoRA model achieved an internal test accuracy of 98.40%, a macro-F1 score of 0.9840, and a test loss of 0.0577 across 6,141 validation instances. External generalization benchmarking against the out-of-domain Emo Tweet dataset (2,214 samples) yielded an accuracy of 61.92% and a macro-F1 of 0.6286, successfully mapping the boundaries of cross-domain linguistic shift. The serialized adapter model was integrated into EmoJournal via PeftModel, facilitating real-time inference with sub-second latency to generate dynamic confidence scores, seven-day affective longitudinal visualization dashboards, and an Early Warning System (EWS) for institutional counseling units. In conclusion, LoRA adaptation provides a scalable, computationally viable paradigm for deploying deep contextual NLP within expressive digital health platforms without sacrificing core semantic representation.Keywords— IndoBERT, Low-Rank Adaptation (LoRA), Emotion Classification, Natural Language Processing, EmoJournal, PyTorch, Django.

Copyrights © 2026






Journal Info

Abbrev

voteknika

Publisher

Subject

Computer Science & IT Control & Systems Engineering Education Electrical & Electronics Engineering

Description

Jurnal Vocational Teknik Elektronika dan Informatika (VoteTEKNIKA) is a peer-reviewed, scientifc journal published by Department of Electronics Engineering, Faculty of Engineering, Universitas Negeri Padang, Indonesia. The aim of this journal is to publish articles dedicated to all aspects of the ...