Proceeding International Conference on Education
Volume 04, Agustus Tahun 2026: International Conference on Education

Detecting Culture-Religious Hallucination of AI-Generated Feedback on EFL Students’ Argumentative Essay

Sari Dewi Noviyanti (Universitas Islam Negeri (UIN) Walisongo Semarang)
Awwalia Fitratin Izza (Universitas Islam Negeri (UIN) Walisongo Semarang)



Article Info

Publish Date
09 Oct 2026

Abstract

The implications of using large language models (LLMs) in educational technology around generative feedback have positive and negative implications particularly when its content related to religion and culture. This study examines the patterns of hallucination in AI feedback towards Islamic content in EFL student essays in Islamic learning context. A systematic evaluation was conducted of five leading LLMs (ChatGPT, Claude, Grok, DeepSeek, and Gemini) using a newly created hallucination multi-type classification framework. The LLMs were prompt to provide feedback on EFL student essays containing Islamic content; then an evaluation was conducted to the responses using 6 types of hallucination indicators namely source fabrication, attribution errors, content misrepresentation, citation errors, contextual misapplication, and theological misstatement. This study found clear patterns of hallucination across all models, which ChatGPT generated the most errors and Claude Sonnet 4 produces the least errors in his feedback. While LLMs responded to the prompts with hallucination in some forms, the patterns and implications of hallucination were distinctly different across all examples. This information is valuable for educators and developers to consider regarding the legitimacy of AI feedback in religious contexts.

Copyrights © 2026






Journal Info

Abbrev

proceedings

Publisher

Subject

Religion Education Social Sciences Other

Description

Education in the digitalized era: Navigating trends and innovations for future education Sub-themes: 1. Innovative Technologies in Education 2. Digital Learning Platforms and Tools 3. Pedagogical Methods and Innovations in Islamic Education 4. Teaching and Learning 5. Digital Literacy and Skills ...