Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Academia Open

Validated Culturally Responsive Science Assessment Using Integrated Content and Construct Analysis Ali, Aisyah; Bektiarso, Singgih; Walukow, Auldry Fransje; Narulita, Erlia; Kadir, Akhmad
Academia Open Vol. 10 No. 2 (2025): December
Publisher : Universitas Muhammadiyah Sidoarjo

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21070/acopen.10.2025.12776

Abstract

(General Background) The alignment of science assessment with students’ socio-cultural contexts is essential to ensure fairness and meaningful measurement of learning outcomes. (Specific Background) However, most contextualized assessments in science education emphasize content validity without empirically confirming their construct structure, limiting their interpretive strength. (Knowledge Gap) There remains a lack of studies that integrate content, empirical, and construct validity evidence in culturally responsive instruments, particularly those designed in parallel pre–post forms. (Aims) This study aimed to develop and validate an ethnoscience-based pre–post instrument by linking Aiken’s Content Validity Ratio (CVR, 4-point scale) with Confirmatory Factor Analysis (CFA, CR/AVE). (Results) Findings from five expert reviews showed 22 of 40 items exceeded the conservative threshold (Aiken’s V ≥ 0.80; CVR = 1.00). Field trials (N = 50) demonstrated moderate difficulty and positive discrimination, while CFA confirmed a three-factor structure with good fit (χ² = 34.203, df = 24, p = 0.083; CFI = 0.94; TLI = 0.92; RMSEA = 0.065). Composite reliability ranged from 0.718–0.797, and AVE was adequate for two factors (0.506; 0.568) and marginal for one (0.459). (Novelty) The study presents a transparent “content–empirical–construct” decision trail rarely reported in ethnoscience assessment. (Implications) This integrative validation framework demonstrates that cultural responsiveness and psychometric rigor can coexist, guiding fair and contextual science learning evaluations. Highlights: Integrates Aiken–CVR and CFA for comprehensive validity evidence. Confirms three-factor model with strong reliability and moderate AVE. Demonstrates synergy between cultural relevance and measurement rigor. Keywords: Content Validity, Confirmatory Factor Analysis, Ethnoscience, Culturally Responsive Assessment, Psychometric Validation
Co-Authors .,, Rasmiyana Agatha, Nabiela Dini Agviolita, Putri Aini Meitanti Rosalina Akhmad Kadir Al Hadi, Salma Khatami Ali, Aisyah Amala Sholeha Apridza Amalia, Rachma Fadhillah Anjar Putro Utomo Anusorn Kongsawang Areerat Chuseng Aris Singgih Budiarso Bambang Sugiharto Bella, Frimita Bevo Wahono Billa, Attika Salsa Daud, Nadhiratuzzahra Alifiah Dewi, Ratna Sari Dyah Intan Prismasari Faizah Firdaus Fatmawati Ningsih Febrianti, Riska Ayu Fikri Ainur Risma Hardiyanti Oktavia Gerda Permata Aji HARDIAN SUSILO ADDY Hilya Wildana Sofia Holida Isnania Iir Nur Choiriya Ika Lia Novenda Ima Masafatus Sholihah Intan Ria Neliana Iryani Endah Febrianti Jekti Prihatin Kanoklada . Khairunnisa, Icha Khoirul Anam Kiswara, Nur Hanifah Alim Krisianti Ayu Monita Kuswati Kuswati laili, Mumtahana Lina Winarti Linda Kusumawati Ludfillah, Rayyan Zhafir Lum’atul Khoirot Rizki Luthfia, Syarifattul M. Amien Rais Manikya Pramudya Marditianingsih, Meilia Putri Maulana, Alfan Irsyad muhammad rizqi nur Nabiela Dini Agatha Nadyatul Ilma Indah Savira Nur Ahmad Nurul Aslami Nury Qurrota Ayun Pramudya Dwi Aristya Putra Qulbi, Siti Shofa Assyifa Ratna Sari Dewi Ria Yulian Rif’atul Fitri Supa’at Rohmah Jwita Sari Rusdianto Rusmala Evi Anggraeni S Suratno Singgih Bektiarso Siti Murdiyah Slamet Hariyadi Slamet Hariyadi Slamet Hariyadi Sofia, Hilya Wildana Sri Wahyuni Sri Wahyuni Sudarti Sudarti Supeno Suratno Suratno Sylvia Rimbanita Purwanto Ulin Nuha Vendi Eko Susilo Wachju Subchan Walukow, Auldry Fransje Widhi Dyah Sawitri Yayuk Fatmawati Yayuk Fatmawati, Yayuk Yeni Firdayanti Yulian, Ria Zahro, Aliza