Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : International Journal of Engineering, Science and Information Technology

Advancing the Measurement of MOOCs Software Quality: Validation of Assessment Tools Using the I-CVI Expert Framework Praseptiawan, Mugi; Che Pee, Ahmad Naim; Zakaria, Mohd Hafiz; Noertjahyana, Agustinus
International Journal of Engineering, Science and Information Technology Vol 5, No 3 (2025)
Publisher : Malikussaleh University, Aceh, Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52088/ijesty.v5i3.911

Abstract

The growing use of MOOCs in the post-pandemic era, particularly in developing countries, requires the availability of valid assessment tools to ensure software quality that meets users' needs. However, several tools are still being used without a proper content validation process, which risks producing biased and unrepresentative data. This study aims to evaluate the validity of the content of an assessment instrument designed to measure the dimension of software quality on the Massive Open Online Courses (MOOC) platform, particularly in the context of the increased adoption of online learning post-pandemic in developing countries. The instrument comprises 27 statement items representing ten quality software factors: functionality, usability, reliability, performance, security, maintainability, portability, compatibility, support, and integration. The validation was carried out by involving seven experts in information systems and digital learning. The method used is an item-level content validity index (I-CVI) based on a descriptive quantitative approach, with each item being assessed using a 5-point Likert scale. An item is declared valid if it obtains an I-CVI score of ? 0.79. The analysis showed that 21 items were valid; three needed to be revised at the I-CVI value between 0.70–0.78, and 3 invalid items at the I-CVI value 0.70. The functionality, usability, support, and integration quality factors had the highest levels of validity, while the safety and support dimensions showed a higher degree of divergence in the expert assessment. These findings highlight the need for content validation to ensure MOOC indicators are accurate and relevant. The study showed the need for advanced validation tests involving real users and other validation methods, such as Aiken V or the fuzzy analysis hierarchy process (FAHP) to enhance the reliability and practical relevance of the tools developed.
Co-Authors A.A. Ketut Agung Cahyawan W Agus Setiawan Suhariono Agustinus Darmawan Andilolo Ahmad, Sharifah Sakinah Syed Albert Halim, Albert Alexander Setiawan Alvin Assianto Leiman Anastasia Lidya Maukar Andreanus Agung Andreas Handojo Andrey Hariyanto Anik Vega Vitianingsih Anita Nathania Purbowo Che Pee, Ahmad Naim Daniel Satriautama, Daniel Daniel Wilhenson Kuntani, Daniel Wilhenson David Harjowinoto, David Della Nova Ongkodjojo Denissa Alfiany Luhulima Devi Christiani Angir, Devi Christiani Endhy, Kezia Tiatira Fanny Febriani Santoso, Fanny Febriani Fujianto - Genadiarto, Anthony Sutera Go David Gunawan Gregorius Satia Budhi Handajani, Endah Tri Esti Handojo, Steven Halim Hartanto Rusli Heinrich Wiradinata Hendy Santoso Henry Novianus Palit Ibnu Gunawan Istiadi Justinus Andjarwirawan Kabzar, Vladimir Kartika Gunadi Kevin Darmawan Limantoro Leo Willyanto Santoso M Zainal Arifin, M Zainal Machael Cahyadi, Machael MARIFANI FITRI ARISA Maukar, Anastasia L Maulana, Sandy Yunan Michael Christian Wibisono Mohamed Asghaiyer, Asghaiyer Natanael, Theodorus Nico Hartono, Nico Ocky Mahendra Alim, Ocky Mahendra Osbert Tjitro Sampurna Palit, Henry N Pangestu, Resza Adistya Paul Agustinus Praseptiawan, Mugi Raymond Adrian Hardha, Raymond Adrian Regina, Gladys O Renardi Dewanto Cahyadi, Renardi Dewanto Richard Pangalila, Richard Rosaline Debora Kusuma Rudy Adipranata Sandy Sulistio Shandy Widjaya, Shandy Silvia Rostianingsih Slamet Kacung, Slamet Stien Tjiangdiono, Stien Surjo, Gregorius Maria Vianny Novita, Vianny Vincentius Aditya Nugraha Widya Ongels, Widya William Andi Pattera Yulia Yulia Zakaria, Mohd Hafiz