Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Jurnal Pendidikan MIPA

Beyond Final Answers: Explainable AI for Step-Level Formative Feedback in Transformational Geometry Nursit, Isbadar; Fuady, Anies; Zauri, Ahmad Sufyan; Phadung, Muneeroh
Jurnal Pendidikan MIPA Vol 26, No 4 (2025): Jurnal Pendidikan MIPA
Publisher : FKIP Universitas Lampung

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.23960/jpmipa.v26i4.pp2584-2612

Abstract

Providing high-quality feedback on students’ solution steps in transformational geometry is challenging in large university classes. Explainable AI (XAI) offers a potential way to automate step-level assessment while keeping model decisions transparent and educationally meaningful. This study examines whether an XAI-based system can validly and reliably score students’ solution steps in transformational geometry, how faithful and fair its explanations are, and whether step-level XAI feedback improves learning in an authentic course setting. This study used a two-phase quantitative design complemented by a small qualitative component. In Phase 1, XAI-based step scores were compared with expert ratings of items involving reflections, rotations, translations, and compositions of transformations, using a rubric with eight indicators (GT1–GT8), and explanation fidelity and subgroup fairness were evaluated. In Phase 2, a clustered quasi-experiment was conducted comparing XAI-based feedback with conventional rubric-based feedback in two classes. Brief and semi-structured interviews were conducted with six students from the XAI class to explore how they interpreted and used the feedback. The results show that the XAI system approximated expert step scoring with acceptable agreement, produced explanations whose highlighted features were meaningfully related to predictions, and exhibited no large performance disparities across gender or study programme. In the classroom experiment, the XAI group achieved moderately higher post-test scores than the control group, with gains concentrated on indicators related to parameter specification and composition of transformations. Interview data suggest that students used the XAI interface to locate and revise specific steps while still relying on the lecturer for deeper conceptual clarification. Overall, the findings indicate that when aligned with a domain-specific rubric, XAI-based step assessment can serve as scalable, task- and process-level formative feedback in transformational geometry, best used in a human-in-the-loop configuration that complements rather than replaces teacher feedback. Keywords: artificial intelligence, mathematics assessment, quasi-experimental design, transformational geometry.
Co-Authors Aa Yuni Abdul Halim Fathani Afandi, Rizki Agus Murniati Ahmad Faiz Praj Nanda Ahmad Fathonin Surya Ahmad Sufyan Zauri Ajar Nur Hidayatullah Alfiani Alfiani Alifiani, Alifiani Alifiani, Alifiani Amiliya Nisaul Khusna Aminnudin, Muhammad Azis Nur Anies Fuady Ashshiddiqi, Yahya Hasbi Asih Rosanti Deramea, Ruhaisa Deviana Novita Sari Diana Lestari Didik Prastiyo Dimitri Auiya Urrahman Dita Hasanah Doluubeng, Muhamad Yusri Dwi Ratna Sari, Dwi Ratna Fadhila Kartika Sari Fedrik Andhika Firmansyah Fenny Putri Arfany Fifi Maulidatil Wahidah Fina Putri Damayanti Firdaus, Izzul Haq Candra Fitri Wahyuni Fuady, Anies Ganjar Setyo Widodo Gilang Herlambang Gusti Firda Khairunnisa Habibah, Siti Ummu Hamzah, Nadiyah Maharani Amir Intan Wulandari Wulandari Ivan Hartaji Ivan Hartaji Ivan Ivan Hartaji Jannah, Ukhti Raudhatul Jiwandono, Nahnu Robid Kamil, Syaifuddin Koviva Wijayanti Kuny Zakiyyatur Rosyidah Lailatul Fitria Layli Hidayah Linda Tri Lestari Lulut Ernin Maharani M. Faishol Arief Maulana, Faiz Miladiyah Miladiyah Moh Arisyur Rahman Moh Ridho Al Jauhariy Muhammad Ridho Hisbullah Muhammad Rifky Maulana Muna, Nailiatul Mustangin Mustangin Muzaqqi, Muhammah Ilham N, Moh Khoirul Mustagfirin Nabila Safirotuz Zahiroh Novelia Fransiska Nurul Azmi Nuse Aliyah Rahmati Phadung, Muneeroh Pratama, Moch. Septian Yoga Rahaju, Rahaju Rahayu, Amelia Puji Raju Raju Regita Laely Nur Fitria Ria Rizka Rahmania Rizka Wahyu Alvina Rizqin Niyah RR. Ettie Rukmigarsari Ruf'aniyah, Ruf'aniyah Salsabilla Ryzka Amalia Siti Nurul Hasana Siti Ummu Habibah Siti Ummu Habibah Sunismi . Surahmat Surahmat Surya Sari Faradiba Syauqiy Syifa Titik Rahayu Widyawati Tyanto, Erdhin Lies Ukhti Raudhatul Jannah Ulul Albab Umaimah Ummi Maghfirah Verdy, Andika Walida, Sikky El Widiyanti, Ria Yayan Eryk Setiawan Yula Milshteyn Zainal Abidin Zainal Abidin Zainal Abidin Zakiyatul Ilmiyah Zakiyatul Ilmiyah