Article Per Year (5 Year)
p-Index From 2021 - 2026
5.066
P-Index
This Author published in this journals
All Journal International Journal of Electrical and Computer Engineering Jurnal Pendidikan Sains Techno.Com: Jurnal Teknologi Informasi JSI: Jurnal Sistem Informasi (E-Journal) DINAMIKA DOTCOM TEKNOLOGI INFORMASI Jurnal Informatika Sisforma: Journal of Information Systems ANDHARUPA Khazanah Informatika: Jurnal Ilmu Komputer dan Informatika Jurnal Ilmiah KOMPUTASI Informatika Mulawarman: Jurnal Ilmiah Ilmu Komputer Jurnal Eksplora Informatika JOURNAL OF APPLIED INFORMATICS AND COMPUTING Petir QARDHUL HASAN: MEDIA PENGABDIAN KEPADA MASYARAKAT J-SAKTI (Jurnal Sains Komputer dan Informatika) Jurnal Riset Informatika Jurnal Teknologi Terapan Antivirus : Jurnal Ilmiah Teknik Informatika Abdi Dosen : Jurnal Pengabdian Pada Masyarakat Generation Journal Abdimas: Jurnal Pengabdian Masyarakat Universitas Merdeka Malang Jurnal Abdimas Berdaya : Jurnal Pembelajaran, Pemberdayaan dan Pengabdian Masyarakat J-SAKTI (Jurnal Sains Komputer dan Informatika) International Conference on Industrial Revolution for Polytechnic Education Jurnal Saintekom : Sains, Teknologi, Komputer dan Manajemen Brilliance: Research of Artificial Intelligence MATRIX : JURNAL MANAJEMEN TEKNOLOGI DAN INFORMATIKA Software Development Digital Business Intelligence and Computer Engineering Kohesi: Jurnal Sains dan Teknologi Jurnal Informatika Polinema (JIP) Pengabdian Pendidikan Indonesia (PPI) International Journal of English Language and Pedagogy
Usman Nurhasan
Politeknik Negeri Malang
Religion Aerospace Engineering Agriculture, Biological Sciences & Forestry Arts Humanities Astronomy Automotive Engineering Biochemistry, Genetics & Molecular Biology Chemical Engineering, Chemistry & Bioengineering Chemistry Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Dentistry Earth & Planetary Sciences Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Health Professions Immunology & microbiology Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Library & Information Science Materials Science & Nanotechnology Mathematics Mechanical Engineering Medicine & Pharmacology Neuroscience Nursing Physics Public Health Social Sciences Transportation Veterinary Other

Published : 53 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search
Journal : JOURNAL OF APPLIED INFORMATICS AND COMPUTING

 1 
Programming Assessment in E-Learning through Rule-Based Automatic Question Generation with Large Language Models Saputro, Halim Teguh; Nurhasan, Usman; Nur Wijayaningrum, Vivi
Journal of Applied Informatics and Computing Vol. 9 No. 6 (2025): December 2025
Publisher : Politeknik Negeri Batam

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30871/jaic.v9i6.10901

Abstract

This study develops an evaluation instrument for Python programming using a Rule-Based Automatic Question Generation (AQG) system integrated with Large Language Models (LLMs), designed based on the Revised Bloom’s Taxonomy. The urgency of this research stems from the limitations of conventional programming evaluations, which are often time-consuming, less objective, and insufficiently aligned with cognitive learning levels. The proposed method applies assessment terms as rule-based constraints to guide LLM-generated questions, ensuring both pedagogical validity and structural consistency in JSON format. A total of 91 questions were produced, consisting of multiple-choice and coding items, which were then validated by three programming experts and tested on 32 vocational students. The findings indicate that the instrument achieved an overall validity of 77.66% (valid category), with the highest accuracy at the Apply (96.30%) and Create (100%) levels. The reliability test using Cronbach’s Alpha yielded 0.721, showing acceptable internal consistency. Item difficulty analysis revealed a strong dominance of easy questions (97.78%), with only 2.22% classified as moderate and none as difficult. Student performance also showed a fluctuating pattern: high in Remember (94.79%), Understand (95.83%), and Create (95.60%), but lower in Apply (86.11%), Analyze (90.97%), and Evaluate (87.15%). These results confirm that integrating Rule-Based AQG with LLMs can produce valid, reliable, and adaptive evaluation instruments that not only capture basic programming competencies but also partially address higher-order cognitive skills. This research contributes both practically by providing educators with an efficient tool for generating evaluation items and academically by enriching the growing body of literature on AI-assisted assessment in programming education.
Abstract Syntax Tree Model for Minimizing False Negative in Semantic Evaluation of Python Fill-in-the-Blank Nurhasan, Usman; Prasetya, Didik Dwi; Patmanthara, Syaad
Journal of Applied Informatics and Computing Vol. 9 No. 6 (2025): December 2025
Publisher : Politeknik Negeri Batam

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30871/jaic.v9i6.11090

Abstract

This study develops and evaluates an automated assessment model using Abstract Syntax Trees (AST) with a view to overcoming the limitations of string-matching techniques in the assessment of Fill-in-the-Blank (FIB) programming answers. Traditional string-matching techniques have a relatively high False Negative Rate (FNR) of 21.5% within the context of detecting semantic equivalence. The current model uses semantic structural triangulation to ascertain the semantic similarity of student answers. Technical assessment shows that the AST approach markedly reduces the FNR to 4.5%. The model demonstrates high reliability (ϰ = 0.83) with high classification accuracy (F1 Score = 0.966) which attests to its inferential validity. From a pedagogical perspective, system implementation leads to substantial learning gains, evidenced by a large effect size (Cohen’s d = 1.82) and a high normalized gain (Normalized Gain = 0.90). Multiple regression analysis confirms that semantic accuracy is the primary causal factor driving improved student comprehension. Ontologically, while AST is valid as a partial representation, its limitations—particularly tree isomorphism in recursive structures—highlight the need for further exploration of graph isomorphism approaches. Control Flow Graphs (CFG) and Data Flow Graphs (DFG) offer more expressive relational models for capturing control and data dependencies. The model demonstrates functional feasibility with a System Usability Scale (SUS) score of 76.47. Overall, the AST Triangulation Model is validated as pedagogically effective, inferentially robust, and supportive of evaluative transparency. Future research recommends validating the model on more complex tasks and releasing it as open-source to support reproducibility.
Co-Authors Aflah Rahman Maulidiyah Al Huda, Muhammad Iqbaluddin Alwy Abdullah Ananta, Ahmadi Yuli Andre Asmara, Rossa Anisa Dyah Fatmawati Anugrah Nur Rahmanto Anugrah Nur Rahmantyo Arief Prasetyo Arief Prasetyo Atiqah Nurul Asri Bagas Setya Dian Nugraha Banni Satria Andoko Betlian Fajrin Budi Harijanto, Budi Cahyana, Cahyana Cahyana, Yuanita Hendra Candra Bella Vista Defandy Fanny Abdillah Dian Hanifudin Subhi Didik Dwi Prasetya Dika Rizky Yunianto Efita Tria Wardani Eka Larasati Amalia Elly Setyo Astuti Embriani Dewi Lestari Endah Septa Sintiya Erfan Rohadi Erninda Ristiani Faiz Ushbah Mubarok Fakhris Khusnu Reza Mahfud Fredo Vale Yuda Ughay Gilang Lazuardi Hakimah, Rafidah Putri Haris, Zainal Abdul Hartati, Kirana Hendra Pradibta Hilmy Setya Purnama Putra Imam Fahrur Rozi Indra Dharma Wijaya Indra Dharma Wijaya, Indra Dharma Khairy, Muhammad Shulhan Kurnia, Alwan Ghozi Lazuardi, Gilang Lisuardi, Dina Lumintang, Galur Arasy Maulidiyah, Aflah Rahman Melani, Erlin Mita Kartina Sari Moch Hafiz Nasirrudin Moch Zawaruddin Abdullah Muhammad Dwi Aldi Rizaldi Muhammad Mujahid Muhammad Rizki Oktaviansyah Mula Agung Barata Mustika Mentari Nasirrudin, Moch Hafiz Ningtyas, Noviana Nugraha, Bagas Setya Dian Nur Rahmanto, Anugrah Nur Wijayaningrum, Vivi Nurindrasari, Diana Oktaviansyah, Muhammad Rizki Pamenang, Muhammad Unggul Pramana Yoga Pramana Yoga Saputra Pramudhita, Agung Nugroho Pratama Putra Marhendra Prihatmanda, Ryan Akbar Purnomo, Bagus Putra Prima Arhandi, Putra Prima Qori, Elsa Lusiana Rafandi, Hanif Naufal Rafidah Putri Hakimah Rahma Sabita, Almira Rahmanto, Anugrah Nur Rahmantyo, Anugrah Nur Rakhmat Arianto Retno Damayanti Retno Damayanti Soejoedono Riatma, Galih Putra Risa Juliadilla Rizaldi, Muhammad Dwi Aldi Rizky Alifian Rokhimatul Wakhidah Rosa Andrie Asmara Rozan, Naufal Rudy Ariyanto Rudy Ariyanto Ryan Akbar Prihatmanda Samsul Islam Baddrisshofa Saputro, Halim Teguh Satrio Binusa Suryadi Sukmadewi, Ferina Sumiadji Sumiadji - Suryadi, Satrio Binusa Suryani, Debhys Syaad Patmanthara Syalwa, Laduni Estu Tresna, Esa Luh Tresna, Tresna Triswidrananta, Odhitya Desta Ulfa, Farida Vivin Ayu Lestari Wardani, Efita Tria Wijanarko, Eko Setio Yoga, Pramana Zainal Abidin