Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Journal of Educational Sciences
Saputro, Rochman Bambang Eko
Unknown Affiliation
Religion Humanities Education Library & Information Science Other

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
A Rubric-Integrated Assessment System Using a Large Language Model for Automated Essay Evaluation in Secondary Vocational Schools Saputro, Rochman Bambang Eko; Hikmawan, Rizki
Journal of Educational Sciences Vol. 10 No. 5 (2026): Journal of Educational Sciences
Publisher : FKIP - Universitas Riau

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.31258/jes.10.5.p.11-23

Abstract

This study aims to develop and evaluate an artificial intelligence-based essay assessment system integrated with the National Work Competency Standard (SKKNI) in vocational Informatics education. The system was designed using the ADDIE model, featuring two core functions: (1) automated rubric generation based on indicators, criteria, and weights provided by teachers, and (2) automated essay scoring by a multimodal large language model capable of processing both image and text inputs. Evaluation was conducted on ten student essays assessed in parallel by three experienced teachers and the AI system. Reliability analysis using the Intraclass Correlation Coefficient (ICC) revealed a score of 0.975, classified as “excellent,” indicating strong agreement between AI-generated scores and human ratings. Qualitative findings from teacher interviews confirmed that the system not only reduces administrative burden but also reinforces the teacher’s role as a pedagogical curator, ensuring assessment remains aligned with learning objectives. The key conclusion is that integrating artificial intelligence within a pedagogically centered process (rather than replacing educators) yields a reliable, valid, and sustainable approach to automated essay scoring in vocational education.
Co-Authors Hikmawan, Rizki