Computer Journal
Vol. 4 No. 2 (2026): August

Fine-Tuning Model Generative Pre-Trained Transformer 2 (GPT-2) untuk Pembuatan Soal-Jawab Otomatis pada Materi Ilmu Pengetahuan Alam dan Sosial (IPAS) di SD Negeri 1 Wawoangi

Anisa Agustina (Universitas Muslim Buton)
Muhammad Fuad (Universitas Muslim Buton)



Article Info

Publish Date
30 Aug 2026

Abstract

The increasing administrative workload of teachers makes manual preparation of assessment questions time-consuming and may lead to the reuse of questions from previous years. This study examines the application of the transformer-based Generative Pre-trained Transformer 2 (GPT-2) model for automatic question-and-answer generation in elementary school Natural and Social Sciences (IPAS). The model was fine-tuned using 239 Indonesian context-question-answer triples, with 90% used for training and 10% for testing. Fine-tuning was conducted using four dataset sizes: 50, 100, 150, and 239 samples, to examine the relationship between training data volume and generation quality. Model performance was evaluated by examining parameter changes between the pre-trained and fine-tuned models and using the ROUGE metric to measure textual similarity between generated and reference questions and answers. The 239-sample dataset produced the most coherent and contextually appropriate questions, with ROUGE-1, ROUGE-2, and ROUGE-L scores of 1.0 for questions and 0.41, 0.24, and 0.36 for answers. These findings suggest that GPT-2 fine-tuning can support automatic question-generation tools when sufficient training data are available.

Copyrights © 2026






Journal Info

Abbrev

cj

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management

Description

Computer Journal, e-ISSN: 2964-6219 and p-ISSN: 2964-6200 is a free and open-access journal published by the Research Division, YPMMA Institute, Indonesia. Computer Journal is an international, scientific, peer-reviewed, open-access computer science journal, including computer and network ...