Article Per Year (5 Year)
p-Index From 2021 - 2026
2.636
P-Index
This Author published in this journals
All Journal IAES International Journal of Artificial Intelligence (IJ-AI) Swabumi (Suara Wawasan Sukabumi) : Ilmu Komputer, Manajemen, dan Sosial INTENSIF: Jurnal Ilmiah Penelitian dan Penerapan Teknologi Sistem Informasi Jurnal Matematika: MANTIK Jurnal Matematika Sains dan Teknologi BAREKENG: Jurnal Ilmu Matematika dan Terapan JCES (Journal of Character Education Society) JTP - Jurnal Teknologi Pendidikan Jurnal Varian JAMBURA JOURNAL OF PROBABILITY AND STATISTICS International Journal of Global Operations Research Parameter: Journal of Statistics Jurnal Statistika dan Sains Data Jurnal Sains dan Kesehatan
Hasanah, Siti Hadijah
Universitas Terbuka, Indonesia
Agriculture, Biological Sciences & Forestry Biochemistry, Genetics & Molecular Biology Chemistry Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Energy Engineering Environmental Science Immunology & microbiology Mathematics Mechanical Engineering Medicine & Pharmacology Physics Social Sciences Transportation Other

Published : 17 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : IAES International Journal of Artificial Intelligence (IJ-AI)

 1 
Generative artificial intelligence as an evaluator and feedback tool in distance learning: a case study on law implementation Nurdiana, Dian; Maulana, Muhamad Riyan; Hasanah, Siti Hadijah; Chairunnisa, Madiha Dzakiyyah; Komuna, Avelyn Pingkan; Rif'an, Muhammad
IAES International Journal of Artificial Intelligence (IJ-AI) Vol 14, No 3: June 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijai.v14.i3.pp2490-2505

Abstract

The development of generative artificial intelligence (GAI) has impacted various fields, including higher education. This research examines the use of GAI as an evaluator and feedback provider in distance legal education. This study tested five GAI models: ChatGPT, Perplexity, Gemini, Bing, and You, using a sample of 20 students and evaluations from legal experts. Descriptive statistical analysis and non-parametric tests, including Wilcoxon, intraclass correlation coefficient (ICC), Kappa, and Kendall's W, were used to assess accuracy, feedback quality, and usability. The results showed that ChatGPT was the most effective GAI, with the highest mean scores of 4.22 from experts and 4.12 from students, followed by Gemini with scores of 4.15 and 4.07. In terms of binary judgement accuracy, Gemini scored 80%, ChatGPT 60%, while Perplexity, Bing, and You had lower scores. Statistical analysis showed moderate agreement (ICC=0.439) and low alignment (Kappa=-0.058) between the GAIs and expert evaluations, with a Kendall's W value of 0.576 indicating moderate consistency in judgements. These findings emphasize the importance of selecting effective GAIs such as ChatGPT and Gemini to improve academic evaluation and learning in legal education, and pave the way for further innovations in the use of AI.
Co-Authors Abdul Rahim Arif, Zainul Chairunnisa, Madiha Dzakiyyah Dewi Juliah Ratnaningsih Eka Julianti Epin Nur Cahya Hendrayani, Hendrayani Isnurani Kertanah, Kertanah Komuna, Avelyn Pingkan M. Fathurahman Maulana, Muhamad Riyan Mujahidin, Ilham Nina Valentika Ningsih, Eva Lestari Nurdiana, Dian Nurmayanti, Wiwit Pura Rif'an, Muhammad Sri Enny Triwidiastuti Sri Maulidia Permatasari