Journal of Environment and Sustainability Education
Vol. 4 No. 1 (2026)

Exploring the strengths and limitations of AIs, using the socratic method, in solving physics problems

Ramos de Faria, André da Silva (Unknown)
Velloso da Silveira, Márcio (Unknown)
Fontes dos Santos, Antonio Carlos (Unknown)



Article Info

Publish Date
04 Feb 2026

Abstract

The research is designed as a qualitative-analytical case study, employing the Socratic method as an analytical tool to probe reasoning consistency, contradiction recognition, and conceptual stability. Three AI systems: ChatGPT, Gemini, and Copilot, were examined while analyzing a non-standard equilibrium problem involving a pen attached to a vertical wall. The findings indicate that, although the AIs correctly articulate isolated physics concepts, they struggle to integrate these concepts coherently in unfamiliar contexts, exhibiting contradictions, diagrammatic inconsistencies, and an inability to revise reasoning when challenged. These results demonstrate that the principal limitation of current AI systems lies not merely in language generation, but in conceptual reasoning and meaning construction in physics. The study highlights important implications for physics education, emphasizing the need for critical mediation by educators and caution against treating AI-generated explanations as epistemically authoritative.

Copyrights © 2026






Journal Info

Abbrev

joease

Publisher

Subject

Chemistry Education Environmental Science Physics Other

Description

Journal of Environment and Sustainability Education (JOEASE) publishes original, double-blind peer-reviewed articles from throughout the world in the fields of science education and environmental education. The main aim is to give experts in these fields the opportunity to publishing and ...