Jurnal Ilmiah Profesi Pendidikan
Vol. 10 No. 2 (2025): Mei

Evaluating the Impact of AI-Generated Prompts on Programming Proficiency in Physics Study Education Program: A Case Study on Computational Physics Tasks

Taufik, Muhammad (Unknown)
A, Syahrial (Unknown)



Article Info

Publish Date
31 May 2025

Abstract

This study investigates the use of artificial intelligence (AI)-assisted code generation in a computational physics course for physics education students. The study examines students' ability to generate effective prompts for Pascal code, the quality of the generated code, and the resulting computational outputs. A cohort of 28 students was tasked with solving three critical tasks: numerical differentiation, numerical integration, and root-finding. The students' performance was assessed based on three criteria: prompt generation, Pascal code quality, and output quality. Descriptive statistics show that the mean prompt scores for all topics are close to 1.0, with Integration slightly outperforming other topics. Program scores for Integration were higher (mean = 1.25) compared to Differentiation and Root-Finding, suggesting students performed relatively better in Integration tasks. Output scores were closely aligned with program scores, indicating strong student learning transfer. Correlation analysis revealed high relationships between program and output scores, especially for Integration and Root-Finding, highlighting the students’ ability to translate learning into practical applications. Statistical analysis indicates significant variation in student performance across the three tasks, with notable differences in AI-assisted code generation quality. These findings emphasize the varied impact of AI tools on student proficiency in computational tasks.

Copyrights © 2025






Journal Info

Abbrev

jipp

Publisher

Subject

Education

Description

JIPP (Jurnal Ilmiah Profesi Pendidikan) (ISSN Print 2502-7069 and ISSN Online 2620-8326) is a peer-reviewed journal published biannually by Fakultas Keguruan dan Ilmu Pendidikan (FKIP) University of Mataram, Mataram, Lombok, Indonesia. The journal publishes research and conceptual articles in the ...