Article Per Year (5 Year)
p-Index From 2021 - 2026
3.77
P-Index
This Author published in this journals
All Journal Fokus Bisnis KEMBARA Masyarakat, Kebudayaan dan Politik Al Ishlah Jurnal Pendidikan JURNAL GALUNG TROPIKA RETORIKA: Jurnal Bahasa, Sastra, dan Pengajarannya SELAPARANG: Jurnal Pengabdian Masyarakat Berkemajuan Abditani : Jurnal Pengabdian Masyarakat Jurnal Onoma: Pendidikan, Bahasa, dan Sastra Kumawula: Jurnal Pengabdian Kepada Masyarakat Ethical Lingua: Journal of Language Teaching and Literature Jurnal Kependidikan: Jurnal Hasil Penelitian dan Kajian Kepustakaan di Bidang Pendidikan, Pengajaran dan Pembelajaran Jurnal Riset dan Inovasi Pembelajaran Golden Ratio of Mapping Idea and Literature Format J-AKSI : JURNAL AKUNTANSI DAN SISTEM INFORMASI DEIKTIS: Jurnal Pendidikan Bahasa dan Sastra International Journal of Law and Society Edcomtech: Jurnal Kajian Teknologi Pendidikan
Harmita Sari
Department Of Education And Human Potentials Development, National Dong Hwa University, Taiwan/Universitas Muhammadiyah Palopo
Agriculture, Biological Sciences & Forestry Arts Humanities Chemistry Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Education Engineering Environmental Science Health Professions Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Library & Information Science Mathematics Medicine & Pharmacology Nursing Public Health Social Sciences Other

Published : 31 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 31 Documents
Search

 1   2   3   4 
The Role of Generative AI in Advancing Educational Technology Research: A Systematic Review of Qualitative Data Analysis Dedi Aco; Ming-Chou Liu; Harmita Sari
Edcomtech: Jurnal Kajian Teknologi Pendidikan Vol. 11 No. 1 (2026)
Publisher : Universitas Negeri Malang in collaboration with APSTPI and IPTPI

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.17977/um039v11i12026p108-127

Abstract

Large language models (LLMs) are increasingly used for qualitative data analysis; however, questions remain regarding their reliability compared to human coders. Following PRISMA 2020 guidelines, this systematic review synthesizes empirical evidence on the use of generative artificial intelligence for coding interview and focus group data. Of the 1,085 records retrieved from six academic databases between 2020 and 2026, 30 studies met the inclusion criteria. The findings indicate that LLMs, predominantly GPT-4, achieve moderate to substantial thematic agreement with human coders, with Cohen’s kappa values ranging from 0.40 to 0.91 (median 0.72) and accuracy rates between 77% and 96%. Reliability significantly improves with optimized prompting strategies and multi-run ensemble methods. Although LLMs demonstrate exceptional efficiency, reducing analysis time by 80% to 95%, they still face limitations in capturing cultural nuance, interpretive depth, and context-dependent coding. Therefore, current evidence supports the use of LLMs as an augmentation tool rather than a replacement for human researchers. Hybrid human-AI workflows, combining computational efficiency with human interpretive rigor, represent the most promising approach for robust qualitative analysis. For educational researchers, these findings highlight the potential of LLMs to advance qualitative learning analytics by enabling rapid processing of large-scale student data. Ultimately, this hybrid approach allows for deeper insights into technology-enhanced learning environments without sacrificing pedagogical nuance.
Co-Authors A. Nurhayati A. Nurhayati Abdul Kadir Abid Ramadhan Altri Wahida Altri Wahida Andi Nurhayati Andi Rizkiyah Hasbi Andi Syukri Samsuri Anita Hafid Anshari Anshari Anwar, Suhardi M. Asmila Asriany Asriany Chen Ching Yang Dedi Aco Dedi Aco Dedi Aco Deni Hadiansah Deni Hadiansah Eko Firmansyah Elva Amrin Endang Sugianto Hamka Hurria Hurria Husnani Aliah Ibrahim Halim, Ibrahim Imam Pribadi Indra Kusdarianto, Indra Israini Suriati Junaidi Junaidi Junaidi, Junaidi Kartini Kartini Lelelangan, Herfika Liu, Ming Chou Masdar Bahari Ming-Chou Liu Ming-Chou Liu Mochammad Imron Awalludin Muhammad Yusuf Pajarianto, Hadi Pancana Beta Puspa Sari Puspa Sari, Puspa Rahmat Kamaruddin Rahmatia, R. Rajiman, Widyawanti Rani Rabiussani Ratna Rendi S. M. Anwar Salju Salju Samsinar Samsinar Samsinar Samsinar Samsinar Samsinar Suhardi M. Anwar, Suhardi M. Sulaeman Sumiati Putri Natalia Sumiati Putri Natalia Wahyuniar Wahyuniar Widya Utami Yang, Chen Ching