Article Per Year (5 Year)
p-Index From 2021 - 2026
7.361
P-Index
This Author published in this journals
All Journal IAES International Journal of Artificial Intelligence (IJ-AI) International Journal of Advances in Applied Sciences International Journal of Evaluation and Research in Education (IJERE) Jurnal Penelitian dan Pengembangan Pendidikan Jurnal Pendidikan Teknologi dan Kejuruan KARMAPATI (Kumpulan Artikel Mahasiswa Pendidikan Teknik Informatika) ISSN: 2252-9063 Journal of Education and Learning (EduLearn) Jurnal Penelitian dan Evaluasi pendidikan Jurnal Edukasi dan Penelitian Informatika (JEPIN) Register: Jurnal Ilmiah Teknologi Sistem Informasi Emerging Science Journal Wacana Akademika : Majalah Ilmiah Kependidikan Abdimas Dewantara Sebatik Lectura : Jurnal Pendidikan WIDYA LAKSANA International Journal of Natural Science and Engineering Jurnal Nasional Pendidikan Teknik Informatika (JANAPATI) Psychology, Evaluation, and Technology in Educational Research Journal On Teacher Education (Jote) Jurnal Pedagogi dan Pembelajaran Journal of Applied Data Sciences INSERT: Information System and Emerging Technology Journal Empiricism Journal Indonesian Journal of Educational Development (IJED) Journal of Artificial Intelligence and Digital Business Sasambo: Jurnal Abdimas (Journal of Community Service)
P. WAYAN ARTA SUYASA
Universitas Pendidikan Ganesha
Agriculture, Biological Sciences & Forestry Arts Humanities Biochemistry, Genetics & Molecular Biology Chemistry Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Earth & Planetary Sciences Economics, Econometrics & Finance Education Electrical & Electronics Engineering Engineering Environmental Science Languange, Linguistic, Communication & Media Library & Information Science Materials Science & Nanotechnology Mathematics Physics Social Sciences Other

Published : 91 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 91 Documents
Search

 6   7   8   9   10 
Psychometric Validation of an AI-Based Evaluation System for Identifying Discrepancies in Learning Processes P. Wayan Arta Suyasa; I Gusti Ngurah Pujawan; Dewa Gede Hendra Divayana; I Dewa Ayu Made Budhyani; I Made Sugiarta; I Made Candiasa
Journal of Applied Data Sciences Vol 7, No 2: May 2026
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v7i2.1168

Abstract

This research advances the field of educational evaluation by designing and psychometrically validating an artificial intelligence (AI)- based diagnostic tool to detect discrepancies in university learning processes. The main novelty is the integration of the Provus Discrepancy Model combined with a forward-chaining inference engine. This research aims to transform evaluation from an administrative activity to an ongoing process of improvement. The tool was developed and validated through a sequential mixed-methods approach with 400 participants from 3 state universities and 8 evaluation experts. Results from the study provide evidence that the validated system created a substantial range of psychometric characteristics. These psychometric characteristics include strong content validity (SD-CVI/Ave = 0.94); high internal consistency and reliability (Cronbach's α = 0.94); solid construct validity as demonstrated through Confirmatory Factor Analysis (CFA) (CFI = 0.94; RMSEA = 0.054) and a substantial range of predictive analytics (diagnostic learning analytics), which the AI learning analytics engine evaluated learning discrepancies with a 92.4% diagnostic accuracy (47.4% more accurate than manual evaluation methods). The system's validated usefulness is demonstrated through high system usability (SUS = 88.2); high practical utility (85% total score on the Pragmatic Utility Assessment); significant utility (real-world) practical utility (detected 45 discrepancy patterns), cost efficiency (73% cost and 67% analysis time compared to traditional methods), and a range of analytics (predictive and learning discrepancy analytics). The significant contribution of this study is the development of the world's first integrated AI evaluation system that meets high methodological and psychometric standards, along with a set of real-time diagnostic analytics. Ultimately, this study developed the first truly integrated, novel paradigm evaluation system that combined the historically established evaluation construct and mechanisms with the most advanced AI capabilities, providing educators and institutions with evaluation tools to deliver data-driven pedagogical strategies and interventions in higher education. 
Co-Authors Abd. Rasyid Syamsuri Adi Braneva, I Gede Widiada Adie Wahyudi Oktavia Gama Agus Adiarta,ST,MT . Andayani, Made Susi Lissia Ariawan, Ketut Sinda Arthawan, I Putu Agus Yudi Dedi Rahman Dedi Rahman, Dedi Dedy Yusuf Santosa Dessy Seri Wahyuni Dewa Gede Hendra Divayana, Dewa Gede Hendra Dr. I Made Sugiarta, M.Si. . Eka Mertayasa, I Nengah Ekaputra, Putu Wisnu Eliska Juliangkary Erlin Erlin Erlin Erlin Fikri Haikal Gede Adhitya Pranata Gede Aditra Pradnyana Gede Doa Restuadi Darma Gede Saindra Santyadiputra Gede Yudhi Mahardika I Dewa Ayu Made Budhyani I Gede Bendesa Subawa i Gede Ryan Shebastian I Gede Widiada Adi Braneva I Gusti Ayu Komang Tri Sukma Laksmi Dewi I Gusti Ngurah Pujawan I Komang Rusmawan I Made Ardana I Made Ardwi Pradnyana I Made Candiasa I Made Gede Sunarya I Made Putrama I Made Sutajaya I Made Tegeh I Nengah Eka Mertayasa I Nengah Eka Mertayasa I Nyoman Indhi Wiradika I Nyoman Indhi Wiradika I Putu Agus Yudi Arthawan I Putu Gede Surya Tanaya I Putu Wisna Ariawan I Wayan Dirgantara I Wayan Indra Praekanata I Wayan Santyasa I Wayan Suastra Ida Ayu Padmi Sawitri Ida Bagus Nyoman Pascima Juliangkary, Eliska Juniarta, Gede Ketut Agustini Ketut Doni Kristian Ketut Sinda Ariawan M.Cs S.Kom I Made Agus Wirawan . Made Susi Lissia Andayani Made Windu Antara Kesiman Mahardika, Gede Yudhi Mohammad Rezzy Al Zamzammi Ni Kadek Evi Apriani Ni Kadek Tamara Agustini Ni Ketut Widiartini Ni Nyoman Melistriani Ni Putu Erna Surim Virnayanthi Ni Wayan Rena Mariani Nyoman Melati Pramesti Nyoman Santiyadnya Nyoman Sugihartini Pradnyana, I Ketut Andika Praekanata, I Wayan Indra Purnandita, Ida Bagus Purnomo, Putri Eodytha Aisya Putu Deri Ariyasa Dana Putu Sukma Kurniawan Putu Wisnu Ekaputra Ramadan, Rezeki Rezeki Ramadan Rusmawan, I Komang Santosa, Yosdiawan Kurniattama Shebastian, i Gede Ryan Simamora, Adi Putra Parlindungan Sindu, I Gede Partha Sudana, Ida Bagus Kade Merta Sugiharni, Gusti Ayu Dessy Syzca Taqwatika Taqwatika, Syzca Virnayanthi, Ni Putu Erna Surim Wayan Sugandini Widiana, I Kadek Dipa Wiguna, I Kadek Arta Wiradika, I Nyoman Indhi