JURNAL ILMIAH PENDIDIKAN FISIKA AL BIRUNI
Vol 14 No 2 (2025): Jurnal Ilmiah Pendidikan Fisika Al-Biruni

Can Multiple-Choice Items Measure Critical Thinking in Socio-Scientific Environmental Issues? Evidence from a Global Warming Assessment of Grade 10 Students Using Rasch Analysis

Aviyanti, Lina (Unknown)
Fratiwi, Nuzulira Janeusse (Unknown)
Nurdini, Nurdini (Unknown)
Salam, Abdul (Unknown)
Nawas, Abu (Unknown)



Article Info

Publish Date
20 Dec 2025

Abstract

This study examines whether multiple-choice items can be used to measure students’ critical thinking in socio-scientific environmental issues, using global warming and renewable energy as contextual domains. To address this question, the Critical Thinking Instrument for Global Warming and Renewable Energy (CT-GREEN) was developed as a set of 40 multiple-choice items grounded in domain-specific critical thinking indicators. The instrument was designed following the ADDIE model and administered to 132 tenth-grade students in Bandung, West Java. Rasch modeling using Winsteps (version 4.5.0) was employed to examine construct dimensionality, item fit, and measurement reliability. The results show that 38 of the 40 items demonstrated acceptable fit to the Rasch model, while two items exhibited misfit and require revision. The raw variance explained by measures was 27.6%, indicating moderate unidimensionality, which is reasonable given the multifaceted nature of critical thinking. The instrument demonstrated high item reliability (0.94) and adequate person reliability (0.73), with a Cronbach’s alpha (KR-20) of 0.76, suggesting acceptable internal consistency for exploratory assessment purposes. Overall, the findings indicate that CT-GREEN demonstrates acceptable psychometric properties and provides preliminary evidence that well-designed multiple-choice items, when embedded in socio-scientific environmental contexts and analyzed using Rasch measurement, can be used to assess students’ critical thinking. However, further refinement and validation across broader populations are recommended before making stronger generalizations.

Copyrights © 2025






Journal Info

Abbrev

AL-BIRUNI

Publisher

Subject

Earth & Planetary Sciences Education Electrical & Electronics Engineering Physics

Description

Jurnal Ilmiah Pendidikan Fisika Al-Biruni is a medium of communication used by researchers, lecturers, teachers, practitioners, and University student for submitting result of studies and prioritized result of research in the field of theoretical physics, applied physics, and physics learning ...