Educational Journal of Learning Technology
Vol. 4 No. 2 (2027): Educational Journal of Learning Technology (Oktober-Januari 2027)

Accuracy Analysis of Text-to-Speech (TTS) on Chatbot GPT for Arabic Conversation and Grammatical Mapping

Fasya Asy Shyifaauzzahra (Universitas Darussalam Gontor)
Moh. Ismail (Universitas Darussalam Gontor)
Fairuz Subakir Ahmad (Universitas Darussalam Gontor)
Rosendah Dwi Maulaya (Universitas Darussalam Gontor)
Ulfa Muna Kamila (Universitas Darussalam Gontor)
Fera Favirotus Siyam (Universitas Darussalam Gontor)
Annisa Avilya (Universitas Islam Negeri Maulana Malik Ibrahim)



Article Info

Publish Date
28 Oct 2026

Abstract

This qualitative study evaluates ChatGPT-4o's spoken Arabic capabilities and grammatical mapping accuracy across two distinct devices using a single foundational Arabic sentence prompt ("اللغة العربية هي لغة الجنة"). The evaluation criteria encompassed diacritical precision (harakat), phonetic articulation (makhraj), syntactic comprehension (nahw), and I'rab parsing. We cross-verified data generated through structured dialogues against Al-Nahw Al-Wadih and validated it with an Arabic linguistics expert. The empirical findings indicate that ChatGPT-4o achieved uniform excellence, scoring 4 out of 4 in diacritical rendering and phonetic articulation across both devices. However, in systematic syntactic parsing (I'rab), the model achieved measured grammatical accuracy rates of 78.4% on Device I using an Arabic interface and 74.5% on Device II using an English interface. These findings show that while AI can support Arabic conversational practice and basic linguistic inquiries, its structural parsing performance remains constrained by default system language configurations, hardware variations, and overall sentence complexity.

Copyrights © 2027






Journal Info

Abbrev

contents

Publisher

Subject

Computer Science & IT Education Languange, Linguistic, Communication & Media Social Sciences Other

Description

(1) Science education: Educational Innovation, Educational Psychology, Primary and Secondary Education, Vocational Education, Curriculum Development, Instructional Strategies, Learning Processes, (2) Education in Learning: New Learning Models and Applications, Learning Models, Curriculum, Learning ...