Claim Missing Document
Check
Articles

Found 2 Documents
Search
Journal : Journal of Applied Data Sciences

User Interface Design for DIVAYANA Evaluation Application Based on Positive-Negative Discrepancy Divayana, Dewa Gede Hendra; Suyasa, P. Wayan Arta; Ariawan, I Putu Wisna; Mariani, Ni Wayan Rena; Sugiharni, Gusti Ayu Dessy; Gama, Adie Wahyudi Oktavia
Journal of Applied Data Sciences Vol 4, No 4: DECEMBER 2023
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v4i4.136

Abstract

This study aims to show the user interface design form of the DIVAYANA evaluation application based on Positive-Negative Discrepancy. The method in this research is a development method that uses the Borg and Gall model. The development refers to the design stage, initial design trials, and revisions to initial design trials. Tests on user interface design involved 104 respondents. The instrument was a questionnaire consisting of 15 questions. Analysis of the trial data used a quantitative descriptive technique. The results of the study show that the quality of the user interface design is quite good. The impact of the results of this research on educational evaluators is that there is new knowledge about the existence of a user interface design that is important to know to support the realization of physical quality evaluation applications.
Psychometric Validation of an AI-Based Evaluation System for Identifying Discrepancies in Learning Processes Suyasa, P. Wayan Arta; Pujawan, I Gusti Ngurah; Divayana, Dewa Gede Hendra; Budhyani, I Dewa Ayu Made; Sugiarta, I Made; Candiasa, I Made
Journal of Applied Data Sciences Vol 7, No 2: May 2026
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v7i2.1168

Abstract

This research advances the field of educational evaluation by designing and psychometrically validating an artificial intelligence (AI)- based diagnostic tool to detect discrepancies in university learning processes. The main novelty is the integration of the Provus Discrepancy Model combined with a forward-chaining inference engine. This research aims to transform evaluation from an administrative activity to an ongoing process of improvement. The tool was developed and validated through a sequential mixed-methods approach with 400 participants from 3 state universities and 8 evaluation experts. Results from the study provide evidence that the validated system created a substantial range of psychometric characteristics. These psychometric characteristics include strong content validity (SD-CVI/Ave = 0.94); high internal consistency and reliability (Cronbach's α = 0.94); solid construct validity as demonstrated through Confirmatory Factor Analysis (CFA) (CFI = 0.94; RMSEA = 0.054) and a substantial range of predictive analytics (diagnostic learning analytics), which the AI learning analytics engine evaluated learning discrepancies with a 92.4% diagnostic accuracy (47.4% more accurate than manual evaluation methods). The system's validated usefulness is demonstrated through high system usability (SUS = 88.2); high practical utility (85% total score on the Pragmatic Utility Assessment); significant utility (real-world) practical utility (detected 45 discrepancy patterns), cost efficiency (73% cost and 67% analysis time compared to traditional methods), and a range of analytics (predictive and learning discrepancy analytics). The significant contribution of this study is the development of the world's first integrated AI evaluation system that meets high methodological and psychometric standards, along with a set of real-time diagnostic analytics. Ultimately, this study developed the first truly integrated, novel paradigm evaluation system that combined the historically established evaluation construct and mechanisms with the most advanced AI capabilities, providing educators and institutions with evaluation tools to deliver data-driven pedagogical strategies and interventions in higher education. 
Co-Authors Abd. Rasyid Syamsuri Adi Braneva, I Gede Widiada Adie Wahyudi Oktavia Gama Agus Adiarta,ST,MT . Andayani, Made Susi Lissia Ariawan, Ketut Sinda Arthawan, I Putu Agus Yudi Dedi Rahman Dedi Rahman, Dedi Dedy Yusuf Santosa Dessy Seri Wahyuni Dewa Gede Hendra Divayana, Dewa Gede Hendra Dr. I Made Sugiarta, M.Si. . Eka Mertayasa, I Nengah Ekaputra, Putu Wisnu Eliska Juliangkary Erlin Erlin Erlin Erlin Fikri Haikal Gede Aditra Pradnyana Gede Doa Restuadi Darma Gede Saindra Santyadiputra Gede Yudhi Mahardika I Dewa Ayu Made Budhyani i Gede Ryan Shebastian I Gede Widiada Adi Braneva I Gusti Ngurah Pujawan I Komang Rusmawan I Made Ardana I Made Ardwi Pradnyana I Made Candiasa I Made Gede Sunarya I Made Putrama I Made Sutajaya I Made Tegeh I Nengah Eka Mertayasa I Nengah Eka Mertayasa I Nyoman Indhi Wiradika I Nyoman Indhi Wiradika I Putu Agus Yudi Arthawan I Putu Gede Surya Tanaya I Putu Wisna Ariawan I Wayan Dirgantara I Wayan Indra Praekanata I Wayan Santyasa I Wayan Suastra Juliangkary, Eliska Juniarta, Gede Ketut Agustini Ketut Sinda Ariawan M.Cs S.Kom I Made Agus Wirawan . Made Susi Lissia Andayani Made Windu Antara Kesiman Mahardika, Gede Yudhi Ni Kadek Evi Apriani Ni Kadek Tamara Agustini Ni Ketut Widiartini Ni Nyoman Melistriani Ni Putu Erna Surim Virnayanthi Ni Wayan Rena Mariani Nyoman Melati Pramesti Nyoman Santiyadnya Nyoman Sugihartini Pradnyana, I Ketut Andika Praekanata, I Wayan Indra Purnandita, Ida Bagus Purnomo, Putri Eodytha Aisya Putu Deri Ariyasa Dana Putu Sukma Kurniawan Putu Wisnu Ekaputra Ramadan, Rezeki Rezeki Ramadan Rusmawan, I Komang Santosa, Yosdiawan Kurniattama Sawitri, Ida Ayu Padmi Shebastian, i Gede Ryan Simamora, Adi Putra Parlindungan Sindu, I Gede Partha Sudana, Ida Bagus Kade Merta Sugiharni, Gusti Ayu Dessy Syzca Taqwatika Taqwatika, Syzca Virnayanthi, Ni Putu Erna Surim Wayan Sugandini Widiana, I Kadek Dipa Wiguna, I Kadek Arta Wiradika, I Nyoman Indhi