Fatma Cahyani
Department of Information System, Institut Teknologi Sepuluh Nopember, Indonesia

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Comparative Evaluation of LoRA-Based Parameter-Efficient Fine-Tuning for Indonesian Informal Text Normalization: A Study on Qwen3-14B and Mistral-14B Fatma Cahyani; Febriliyan Samopa
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 5 (2026): JUTIF Volume 7, Number 5, October 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.5.5758

Abstract

Informal Indonesian text poses challenges for NLP systems due to abbreviations, slang, and incomplete structures that deviate from standard language forms. This study evaluates the effectiveness of parameter-efficient fine-tuning (PEFT) using Low-Rank Adaptation (LoRA) to adapt large language models for informal-to-formal text normalization in a domain-specific context. Two open-weight multilingual models, Qwen3-14B and Mistral3-14B, were fine-tuned on a dataset of 1,233 formal sentences and 6.165 informal variations derived from academic information at Institut Teknologi Sepuluh Nopember (ITS). Evaluation on a held-out test set of 200 informal queries using lexical (BLEU, ROUGE) and semantic (cosine similarity and sentence-transformer-based similarity) metrics. The results show significant improvements after fine-tuning. Qwen3-14B achieved a BLEU score of 0.660, ROUGE-2 of 0.720, cosine similarity of 0.774, and semantic similarity of 0.907, while Mistral3-14B achieved 0.540, 0.624, 0.699, and 0.884, respectively. Additional experiments indicate that varying LoRA rank has minimal impact on performance, suggesting that LoRA configurations are sufficient for this task. These findings demonstrate that LoRA-based parameter-efficient fine-tuning enables effective and computationally efficient adaptation of large language models for Indonesian informal text normalization. This study provides a scalable solution for domain-specific NLP applications in low-resource settings, particularly for languages with high informal variation.