Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Jurnal Riset dan Aplikasi Mahasiswa Informatika (JRAMI)
Husnul Hadah
Universitas Esa Unggul

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Analisis Perbandingan Zero-Shot dan Fine-Tuning pada LLM Untuk Automated Essay Scoring Alexandria Felicia Seanne; Husnul Hadah; Yustika Heti Handal; Britney Levina Sukma; Budi Tjahyono
Jurnal Riset dan Aplikasi Mahasiswa Informatika (JRAMI) Vol. 7 No. 03 (2026): Jurnal Riset dan Aplikasi Mahasiswa Informatika (JRAMI)
Publisher : Program Studi Teknik Informatika, FTIK, Universitas Indraprasta PGRI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30998/jrami.v7i03.1452

Abstract

Automated Essay Scoring (AES) using Large Language Models (LLMs) is rapidly evolving, yet there remains a lack of studies comparing Zero-shot prompting and Fine-tuning approaches on open-weight LLM models. This study analyzes the comparison of these two approaches on the Qwen 2.5-1.5B-Instruct model using the ASAP-AES 2.0 dataset. The Zero-shot approach employs Role Prompting and Chain-of-Thought (CoT) techniques, while Fine-tuning uses Parameter-Efficient Fine-tuning (PEFT/LoRA). Evaluation was conducted using the Quadratic Weighted Kappa (QWK) and Root Mean Square Error (RMSE) metrics. The results show that the Zero-shot approach yields a QWK of 0.0069 with an extreme central tendency bias, while Fine-tuning yields a QWK of 0.3247 (fair agreement). These findings confirm that adapting a Fine-tuning approach is one way to produce a sufficiently accurate automatic essay grading system on small-scale open-weight models
Co-Authors Alexandria Felicia Seanne Britney Levina Sukma Budi Tjahyono Yustika Heti Handal