IDEAS: Journal on English Language Teaching and Learning, Linguistics and Literature
Vol. 14 No. 1 (2026): IDEAS: Journal on English Language Teaching and Learning, Linguistics and Lite

Exploring The Quality of AI Translation in Roblox Chat

Siti Nabila Amira Wangsi (English Literature, Adab and Humanities, Islamic State University of Sunan Gunung Djati Bandung)
Erfan Muhamad Fauzi (3English Literature, Adab and Humanities, Islamic State University of Sunan Gunung Djati Bandung)
Fourus Huznatul Abqoriyyah (3English Literature, Adab and Humanities, Islamic State University of Sunan Gunung Djati Bandung)



Article Info

Publish Date
29 Jun 2026

Abstract

This study evaluates the translation quality of Roblox’s AI translation system by combining translation quality assessment (TQA) with syntactic clause analysis in a multilingual online gaming environment. The study aims to examine how the system translates different clause types based on Nababan’s theory, which is assessed by parameters of accuracy, acceptability, and readability. A qualitative approach was employed using 15 representative Indonesian–English translation pairs, selected from an initial dataset of 34 chat conversations collected from real-time Roblox gameplay. The data were classified into declarative, interrogative, and imperative clauses based on the syntactic framework of Huddleston and Pullum before being evaluated using the TQA model. The results show that the Roblox AI translation system performed best on interrogative clauses, while imperative and informal declarative clauses produced lower translation quality due to frequent lexical, syntactic, and semantic errors. The overall translation quality score was 1.98 on a 1–3 scale, indicating moderate-to-low translation quality. These findings demonstrate that combining TQA with syntactic clause analysis provides a more comprehensive approach to gaming communication and highlights the need for translation models that better accommodate informal language, gaming-specific expressions, and context-dependent interactions.

Copyrights © 2026






Journal Info

Abbrev

ideas

Publisher

Subject

Languange, Linguistic, Communication & Media

Description

IDEAS Journal is published twice a year in the months of June and December (P-ISSN 2338-4778 and E-ISSN 2548-4192); it presents articles on English language teaching and learning, linguistics, and literature. The contents include analyses, studies and application of theories, research report, ...