Claim Missing Document
Check
Articles

Found 15 Documents
Search

Evaluating ChatGPT’s Accuracy Across Cognitive Levels in Academic Assessments Nurhasanah, Astutiati; Suralaga, Fadhilah; Rosyidah, Ida; Nihayah, Zahrotun; Sari, Riri Fitri; Solihat, Ade; Ernada, Nabila
TARBIYA: Journal of Education in Muslim Society TARBIYA: JOURNAL OF EDUCATION IN MUSLIM SOCIETY | VOL. 11 NO. 2 2024
Publisher : Faculty of Educational Sciences, Syarif Hidayatullah State Islamic University

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15408/tjems.v11i2.44701

Abstract

AbstractThis study evaluates the accuracy of ChatGPT’s free version in answering academic questions based on Bloom’s Taxonomy cognitive levels (C1–C6) and disciplines (physics, social sciences, and religious studies) at two universities in Jakarta. A mixed-method approach was used, combining statistical and content analyses. Thirty-five lecturers from UIN Jakarta and the University of Indonesia submitted exam questions in Bahasa Indonesia to ChatGPT, and the responses were scored on a 0–100 accuracy scale. Results show that ChatGPT performs well on multiple-choice questions (C1–C3) in physics but struggles with higher-order tasks (C5–C6) requiring synthesis, evaluation, and creativity. In social sciences, accuracy was consistent, particularly in theoretical questions, though ChatGPT faced challenges with data-driven analysis and practical application. Religious studies exhibited high accuracy across all cognitive levels due to the structured and doctrinal nature of the material.Statistical analysis revealed significant differences in accuracy between lower and higher cognitive levels in physics (p = 0.005) and religious studies (p = 0.011), but no significant difference in social sciences (p = 0.137). ANOVA (p = 0.464) showed no significant differences across disciplines. This study highlights ChatGPT’s effectiveness in answering lower to intermediate-level questions (C1–C4) but identifies limitations with higher-level tasks (C5–C6). These findings encourage educators to design questions that assess deeper cognitive skills while utilizing AI’s strengths in supporting learning and knowledge acquisition.AbstrakStudi ini mengevaluasi akurasi versi gratis ChatGPT dalam menjawab pertanyaan akademik berdasarkan tingkat kognitif Taksonomi Bloom (C1–C6) dan disiplin ilmu (fisika, ilmu sosial, dan studi keagamaan) di dua universitas di Jakarta. Pendekatan mixed-method digunakan, menggabungkan analisis statistik dan konten. Sebanyak 35 dosen dari UIN Jakarta dan Universitas Indonesia mengajukan soal ujian dalam Bahasa Indonesia ke ChatGPT, dan jawaban yang dihasilkan dinilai pada skala akurasi 0–100. Hasil penelitian menunjukkan bahwa ChatGPT unggul pada soal pilihan ganda (C1–C3) di bidang fisika, tetapi kesulitan pada tugas tingkat tinggi (C5–C6) yang membutuhkan sintesis, evaluasi, dan kreativitas. Pada ilmu sosial, akurasi cenderung konsisten, terutama pada soal teoretis, meskipun ChatGPT menghadapi tantangan dalam analisis berbasis data dan penerapan praktis. Pada studi agama, ChatGPT menunjukkan akurasi tinggi di semua tingkat kognitif karena struktur materi dan interpretasi doktrin yang jelas. Analisis statistik menunjukkan perbedaan signifikan pada akurasi antara tingkat kognitif rendah dan tinggi di fisika (p = 0,005) dan studi agama (p = 0,011), tetapi tidak pada ilmu sosial (p = 0,137). Hasil ANOVA (p = 0,464) menunjukkan tidak ada perbedaan signifikan antar disiplin ilmu secara keseluruhan. Studi ini menyoroti efektivitas ChatGPT dalam menjawab soal tingkat rendah hingga menengah (C1–C4) tetapi mengidentifikasi keterbatasan pada tugas tingkat tinggi (C5–C6). Temuan ini mendorong pendidik untuk merancang soal yang mengukur keterampilan kognitif mendalam sambil memanfaatkan kekuatan AI dalam mendukung pembelajaran dan akuisisi pengetahuan.How to Cite: Nurhasanah, A., Suralaga, F., Rosyidah, I., Nihayah, Z., Sari, R. F., Solihat, A., & Ernada, N. (2024). Evaluating ChatGPT’s Accuracy Across Cognitive Levels in Academic Assessments. TARBIYA: Journal of Education in Muslim Society, 11(2), 211-224. https://doi.org/10.15408/tjems.v11i2.44701
NEGOSIASI BUDAYA DALAM OLAHRAGA (Studi Kasus Atlet Berhijab Figure skating Pertama Uni Emirat Arab) Faiza Kintan Maharani; Ade Solihat
Akrab Juara : Jurnal Ilmu-ilmu Sosial Vol. 8 No. 3 (2023): Agustus
Publisher : Yayasan Azam Kemajuan Rantau Anak Bengkalis

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.58487/akrabjuara.v8i3.2143

Abstract

The phenomenon of hijab is creating more and more space for consideration. The use of hijab among female athletes in various sports is increasing. This research discusses the clothing performance of Zahra Lari, a figure skating athlete from Abu Dhabi, United Arab Emirates. Figure skating is a sport performed by dancing on ice with tight clothing attached to the athlete's body. This type of tight-fitting clothing is aerodynamic and lightweight to make it easier for athletes to move without feeling overloaded. Zahra Lari was the first female athlete to wear the hijab at the 2012 European Cup Winter Championships in Italy. Zahra Lari received a deduction in the competition due to her unusual use of the hijab. The deduction made Zahra Lari appeal to the International Skating Union (ISU), because she felt unfairly treated. The appeal was eventually accepted by the ISU and since then many figure skating athletes have worn the hijab in various competitions. Zahra Lari's efforts to negotiate the figure skating clothing model with the addition of hijab is the focus of this research. This research aims to explain how Zahra Lari negotiates culture in order to be accepted to compete in international figure skating competitions without leaving her attitude and worldview in dressing. This research uses a qualitative method. Data collection techniques were carried out by studying English-language media and remote interviews. Interviews were conducted with Zahra Lari as the main informant. Interviews were also conducted with a figure skating coach in Kuwait and a Kuwaiti national figure skating athlete. The results showed that Zahra Lari's cultural negotiation had an impact on cultural harmonisation in figure skating.
A Socio-Cultural Change in Saudi Arabia through the Lens of Comedy: An Analysis of the Film 'Crashing Eid' Solihat, Ade
Journal of Art, Film, Television, Animation, Games and Technology Vol. 4 No. 1 (2025)
Publisher : Perkumpulan Program Studi Film dan Televisi Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar

Abstract

This article analyzes the Saudi Arabian film "Crashing Eid," released in 2023. The research aims to describe how Saudi Arabian society uses film as a medium to communicate socio-cultural change. Through content analysis of the film, this study explores the plots and characters that depict the discourse of current issues and how Saudi Arabian society, known for its adherence to customs, faces various socio-cultural problems. Additionally, a narrative analysis was conducted by examining dialogues that reveal the cultural negotiations taking place. The article presents findings on the reflective efforts of Saudi Arabian society toward issues of racism and their attempts to negotiate with modernity through comedy films. The phenomenon of socio-cultural change depicted in this film also illustrates Giddens' theory of socio-cultural change, particularly the duality of structure and agency that are interrelated in constructing a new, more open face of Saudi Arabia.
Evaluating ChatGPT’s Accuracy Across Cognitive Levels in Academic Assessments Nurhasanah, Astutiati; Suralaga, Fadhilah; Rosyidah, Ida; Nihayah, Zahrotun; Sari, Riri Fitri; Solihat, Ade; Ernada, Nabila
TARBIYA: Journal of Education in Muslim Society TARBIYA: JOURNAL OF EDUCATION IN MUSLIM SOCIETY | VOL. 11 NO. 2 2024
Publisher : Faculty of Education and Teacher Training, UIN (State Islamic University) Syarif Hidayatul

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15408/tjems.v11i2.44701

Abstract

AbstractThis study evaluates the accuracy of ChatGPT’s free version in answering academic questions based on Bloom’s Taxonomy cognitive levels (C1–C6) and disciplines (physics, social sciences, and religious studies) at two universities in Jakarta. A mixed-method approach was used, combining statistical and content analyses. Thirty-five lecturers from UIN Jakarta and the University of Indonesia submitted exam questions in Bahasa Indonesia to ChatGPT, and the responses were scored on a 0–100 accuracy scale. Results show that ChatGPT performs well on multiple-choice questions (C1–C3) in physics but struggles with higher-order tasks (C5–C6) requiring synthesis, evaluation, and creativity. In social sciences, accuracy was consistent, particularly in theoretical questions, though ChatGPT faced challenges with data-driven analysis and practical application. Religious studies exhibited high accuracy across all cognitive levels due to the structured and doctrinal nature of the material.Statistical analysis revealed significant differences in accuracy between lower and higher cognitive levels in physics (p = 0.005) and religious studies (p = 0.011), but no significant difference in social sciences (p = 0.137). ANOVA (p = 0.464) showed no significant differences across disciplines. This study highlights ChatGPT’s effectiveness in answering lower to intermediate-level questions (C1–C4) but identifies limitations with higher-level tasks (C5–C6). These findings encourage educators to design questions that assess deeper cognitive skills while utilizing AI’s strengths in supporting learning and knowledge acquisition.AbstrakStudi ini mengevaluasi akurasi versi gratis ChatGPT dalam menjawab pertanyaan akademik berdasarkan tingkat kognitif Taksonomi Bloom (C1–C6) dan disiplin ilmu (fisika, ilmu sosial, dan studi keagamaan) di dua universitas di Jakarta. Pendekatan mixed-method digunakan, menggabungkan analisis statistik dan konten. Sebanyak 35 dosen dari UIN Jakarta dan Universitas Indonesia mengajukan soal ujian dalam Bahasa Indonesia ke ChatGPT, dan jawaban yang dihasilkan dinilai pada skala akurasi 0–100. Hasil penelitian menunjukkan bahwa ChatGPT unggul pada soal pilihan ganda (C1–C3) di bidang fisika, tetapi kesulitan pada tugas tingkat tinggi (C5–C6) yang membutuhkan sintesis, evaluasi, dan kreativitas. Pada ilmu sosial, akurasi cenderung konsisten, terutama pada soal teoretis, meskipun ChatGPT menghadapi tantangan dalam analisis berbasis data dan penerapan praktis. Pada studi agama, ChatGPT menunjukkan akurasi tinggi di semua tingkat kognitif karena struktur materi dan interpretasi doktrin yang jelas. Analisis statistik menunjukkan perbedaan signifikan pada akurasi antara tingkat kognitif rendah dan tinggi di fisika (p = 0,005) dan studi agama (p = 0,011), tetapi tidak pada ilmu sosial (p = 0,137). Hasil ANOVA (p = 0,464) menunjukkan tidak ada perbedaan signifikan antar disiplin ilmu secara keseluruhan. Studi ini menyoroti efektivitas ChatGPT dalam menjawab soal tingkat rendah hingga menengah (C1–C4) tetapi mengidentifikasi keterbatasan pada tugas tingkat tinggi (C5–C6). Temuan ini mendorong pendidik untuk merancang soal yang mengukur keterampilan kognitif mendalam sambil memanfaatkan kekuatan AI dalam mendukung pembelajaran dan akuisisi pengetahuan.How to Cite: Nurhasanah, A., Suralaga, F., Rosyidah, I., Nihayah, Z., Sari, R. F., Solihat, A., & Ernada, N. (2024). Evaluating ChatGPT’s Accuracy Across Cognitive Levels in Academic Assessments. TARBIYA: Journal of Education in Muslim Society, 11(2), 211-224. https://doi.org/10.15408/tjems.v11i2.44701
Power relation and knowledge: linking Islamic education to socio-political reform in Saudi Arabia Latifah, Ainiyatul; Solihat, Ade
ATTARBIYAH: Journal of Islamic Culture and Education Vol. 9 No. 2 (2024): Attarbiyah: Journal of Islamic Culture and Education
Publisher : UIN Salatiga

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.18326/attarbiyah.v9i2.157-172

Abstract

Saudi Vision 2030, conveived by His Royal Highness Prince Muhammad bin Salman (MBS), represents a transformative initiative to foster openness and shift away from Wahhabism to establish a more moderate Islam. As part of this vision, the reform of the Islamic education curriculum plays a crucial role. This study examines the curriculum reform processes and strategies, focusing on Dirasat Islamiyah textbooks addressing inter-religious and intrareligious relations. Employing a qualitative approach and text analysis, the research applies Michel Foucault's theory of power-knowledge relations to analyze the state's role in shaping educational content. The findings reveal that the reformed curriculum seeks to construct and internalize ideologies that align the younger Saudi generation with the moderate Islam agenda of MBS's government, supporting Saudi Vision 2030. This study contributes to the theoretical discourse on power-knowledge dynamics by showcasing education's role in advancing state-driven ideological shifts during significant socio-political reforms.