FOSTER: Journal of English Language Teaching
Vol. 7 No. 4 (2026): FOSTER JELT

Evaluating AI-Assisted Translation Quality: A Comparison of ChatGPT and Google Translate in the English–Bahasa Indonesia Context

Deri Herdawan (Politeknik Maritim Negeri Indonesia)
Dhesi Wulan Sari (Politeknik Maritim Negeri Indonesia)
Iis Sujarwati (Universitas Bengkulu)



Article Info

Publish Date
30 Oct 2026

Abstract

This study investigates the translation quality produced by ChatGPT and Google Translate in translating texts from English to Bahasa Indonesia. It compares the performance of both AI-assisted translation tools across five aspects of Translation Quality Assessment (TQA), consisting of Accuracy, Equivalence, Translation Skill, Text Function, and Grammar and Style. The comparison was conducted across three text types, including informative, persuasive, and instructional texts. A questionnaire of nineteen items using a Likert-scale was used to evaluate the translation results, assessed by three raters. A quantitative analysis was employed using the paired-samples t-test and Cohen’s d effect size. In addition, a qualitative examination by the raters was also conducted to identify translation issues generated by the translation tools. The findings reveal that ChatGPT obtained higher scores than Google Translate across all evaluated aspects. Further statistical analysis indicates that the differences are significant and meaningful in practical contexts. ChatGPT showed better performance in producing natural, contextual, and communicative translation results. However, it was also found that ChatGPT generates additional information not explicitly present in the source text. Meanwhile, Google Translate showed the tendency to produce literal translation that sounds awkward and unnatural translation results. It highlights that revision and post-editing efforts are required to improve the quality of translation results by both AI-assisted translation tools. This study concludes that both ChatGPT and Google Translate are more suitable as translation aids rather than complete substitutes for professional human translators.

Copyrights © 2026






Journal Info

Abbrev

contents

Publisher

Subject

Education Languange, Linguistic, Communication & Media

Description

Foster JELTL journal invites scholars, researchers, and students to contribute the result of their studies and researches in the areas related to English Language Education, The focus of the Journal is on all levels, stages, and processes of education (e.g., formal, informal, non-formal, early ...