Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal RABIT: Jurnal Teknologi dan Sistem Informasi Univrab
Clara Diva
Universitas Kristen Indonesia Paulus Makassar
Computer Science & IT Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
HYBRID REFERENCE GENERATION WITH MMR AND TRANSFORMER MODELS FOR AUTOMATIC SHORT ANSWER SCORING Affan Hilmy Natsir; Clara Diva; Husni Mubarak
Rabit : Jurnal Teknologi dan Sistem Informasi Univrab Vol 11 No 1 (2026): Januari
Publisher : LPPM Universitas Abdurrab

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36341/rabit.v11i1.7123

Abstract

The rapid transition to online learning during the COVID-19 pandemic has accelerated the demand for automated assessment systems capable of evaluating students’ understanding objectively, consistently, and efficiently. Automatic Short Answer Scoring (ASAS) has emerged as a central challenge within Natural Language Processing (NLP), particularly for assessing short or open-ended answers. This research proposes an ASAS framework that integrates Reference Answer Generation using Transformer-based models (BART and GPT-2) with the Maximum Marginal Relevance (MMR) method. While MMR has been widely used as an extractive technique to select diverse student answers as reference candidates, its performance remains limited by the availability and variability of student responses. To address this limitation, the proposed approach supplements MMR-generated references with paraphrased reference answers generated by fine-tuned Transformer models, thereby increasing lexical and syntactic diversity. Experimental evaluation was conducted on the Texas Short Answer Corpus, consisting of 2,442 student responses across 10 tasks. The results demonstrate that the proposed hybrid approach improves scoring performance, as indicated by an increase in Pearson correlation and a reduction in RMSE and MAE compared to the baseline MMR-based method.  
Co-Authors Affan Hilmy Natsir Husni Mubarak