Journal of Systems Engineering and Information Technology
Vol 4 No 2 (2025): September 2025

An Empirical Evaluation of ChatGPT as an Automated Machine Learning Code Generator for Image Classification

Dedi Mardianto (Unknown)
Milla Apriliana (Unknown)
Eva Oktavia (Unknown)
Ideva Gaputra (Unknown)
Widya Wahyuni (Unknown)



Article Info

Publish Date
19 Oct 2025

Abstract

The emergence of large language models such as ChatGPT has created unprecedented opportunities for automating software development processes, particularly within the machine learning domain. This study aims to empirically evaluate the effectiveness of ChatGPT in generating machine learning code for image classification tasks using the Keras framework. The research employs an experimental methodology utilizing the MNIST dataset, comprising 70,000 handwritten digit images. A systematic series of experiments was conducted through progressive prompting strategies, ranging from basic model construction to comprehensive evaluation protocols. The findings demonstrate that ChatGPT successfully generated 100% executable code without errors, with the resulting models achieving 99% accuracy on the test dataset. A notable discovery emerged in the form of "intelligent deviation" phenomena, wherein ChatGPT autonomously provided Convolutional Neural Network (CNN) architectures despite explicit requests for fully connected layers, demonstrating sophisticated contextual understanding. The generated code quality met professional standards with robust multi-library integration capabilities. This research provides the first systematic empirical contribution regarding large language model capabilities in machine learning code generation, offering significant implications for democratizing artificial intelligence technology access within educational and research contexts.

Copyrights © 2025






Journal Info

Abbrev

JOSEIT

Publisher

Subject

Computer Science & IT

Description

International Journal of Systems Engineering and Information Technology (JOSEIT) is an international journal published by Ikatan Ahli Informatika Indonesia (IAII / Association of Indonesian Informatics Experts). The research article submitted to this online journal will be peer-reviewed. The ...