Online Learning in Educational Research
Vol. 6 No. 3 (2026): Online Learning in Educational Research

An Exploratory Analysis of ChatGPT and Gemini Responses on False Positives in AI-Generated Text Detection

Ahmet Erdost Yastıbaş (Gazi University, Turkey)
Ali Dincer (Ondokuz Mayıs University, Turkey)
Tevfik Darıyemez (Atatürk University, Turkey)



Article Info

Publish Date
30 Sep 2026

Abstract

The increasing use of AI tools has raised concerns about the mislabeling of human-written texts as AI-generated (i.e., false positives), potentially leading to unfair academic decisions in education settings. This study aimed to explore AI-based explanations for this misclassification and develop strategies that L2 teachers can use to reduce them. Adopting a qualitative framework, a textual corpus was created from responses by ChatGPT and Gemini to two prompts about mislabeling texts as AI-generated. The corpus comprised 4 responses totaling 2024 words. It was thematically analyzed. The findings showed that, according to ChatGPT and Gemini, there are five overarching themes regarding possible reasons: linguistic monotony, conventional writing patterns, bias related to non-native English writers, overly polished writing, and limitations of AI detection systems. According to the findings, ChatGPT and Gemini recommended three strategies for L2 teachers to minimize false positives: trace evidence of authors’ writing processes, customize their writing assessments, and use verification techniques in decision-making. Overall, this study contributes to the literature by providing a structured synthesis of AI-generated explanations of false positives and identifying pedagogically relevant strategies for L2 writing assessment, while emphasizing the importance of critically interpreting AI detection results.

Copyrights © 2026






Journal Info

Abbrev

oler

Publisher

Subject

Education

Description

Online Learning in Educational Research (OLER Journal) is a medium of communication for researchers, academicians, and practitioners that provides a means for sustained discussion of relevant issues that fall within the focus and scopes of the journal which examined empirically. Journal Online ...