Journal of English Teaching and Applied Linguistics (JETAL)
Vol 8 No 1 (2026): September

DEVELOPMENT OF AN AUTOMATIC EVALUATION MODEL FOR ASSESSING THE QUALITY OF INDONESIAN DIGITAL TRANSLATION

Rocia Fani Kaban (Universitas HKBP Nommensen)
Erika Sinambela (Universitas HKBP Nommensen)
Arsen Nahum Situmorang (Universitas HKBP Nommensen)



Article Info

Publish Date
28 Sep 2026

Abstract

This study aims to develop an automatic evaluation model for assessing the quality of Indonesian digital translations and to produce a simple bilingual translation application called Translate You. The research addresses the limitations of existing evaluation metrics, such as BLEU, METEOR, BERTScore, and COMET, which are not fully suitable for Indonesian linguistic characteristics. This study uses a Research and Development (R&D) method combined with a quantitative approach. The data consist of bilingual sentences collected from online articles. Translation outputs are evaluated using an automatic model and a professional translator as the expert validator. The model integrates semantic similarity, fluency, and Indonesian linguistic features. The results show that the developed model produces evaluation scores that are more aligned with expert judgment compared to traditional metrics. The Translate You application also successfully integrates text translation, voice input, and automatic evaluation in a simple system. This research contributes to Translation Quality Assessment (TQA) by providing an Indonesian-specific evaluation model and a practical prototype for translation assessment.

Copyrights © 2026






Journal Info

Abbrev

jetal

Publisher

Subject

Languange, Linguistic, Communication & Media Social Sciences

Description

Journal of English Teaching and Applied Linguistic (JETAL) is a peer-reviewed journal published in Indonesia by the Department of English Education, Faculty of Teacher Training and Education, the University of HKBP NOMMENSEN (PSPBI FKIP UHKBPN). This journal is published twice a year: April and ...