p-Index From 2021 - 2026
7.091
P-Index
Claim Missing Document
Check
Articles

AI-based assessment: Aiken index analysis of content validity in scientific literacy instruments on the basic laws of chemistry with ethnochemistry Fila Delfia Zai; Sri Yamtinah; Ari Syahidul Shidiq; Hayuni Retno Widarti; Antuni Wiyarsi
Jurnal Pendidikan Kimia Vol. 16 No. 3 (2024): J. Pendidik. Kim : December 2024
Publisher : Pascasarjana Universitas Negeri Medan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24114/jpkim.v16i3.65174

Abstract

Scientific Literacy Assessment (SLA) is used to measure science literacy on basic chemical law material that has been qualified and tested. This study aims to prove the content validity of ethnochemistry SLA instruments integrated with artificial intelligence (AI) systems using Aiken's validity index so that they can measure students' scientific literacy in basic chemical law material. The research design uses the ADDIE development model (Analysis, design, development, implementation and evaluation which is simplified into analysis, design, and development. Content validity data was obtained from 10 experts, namely 7 chemistry education lecturers from UNS, UNY, and UM and 3 chemistry teachers in Surakarta through focus group discussions (FGD). The content validation test is based on aspects of context, language, and construct. A valid instrument is indicated by an Aiken index value of more than or equal to 0.73. The AI-integrated ethnochemistry SLA instrument on basic laws of chemistry material produced 15 valid items with an Aiken index greater than 0.73.
Integrating Scratch with Project-Based Learning to Cultivate Students' Academic Performance Wenny Pinta Litna Tarigan; Paidi Paidi; Antuni Wiyarsi; Suhartini Suhartini; Sukma Fajri
Journal of Innovation in Educational and Cultural Research Vol 5, No 4 (2024)
Publisher : Yayasan Keluarga Guru Mandiri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.46843/jiecr.v5i4.1994

Abstract

This study addresses the challenge of enhancing students' academic performance, including creativity, learning achievement, problem-solving ability, motivation, and attitude, by integrating problem-solving into biology lessons through Scratch and Project-based Learning (PjBL). The focus was on high school students studying the digestive system, a topic often taught through traditional lecture-based methods, which can limit engagement and deeper understanding. A quasi-experimental design with a nonequivalent control group pretest-posttest was employed, involving 105 eleventh-grade students divided into three groups: PjBL with Scratch, PjBL without Scratch, and a control group receiving direct instruction (DI). The same teacher taught all groups to ensure consistency. Research instruments included cognitive tests, problem-solving assessments, and questionnaires measuring creativity, motivation, and attitudes toward biology and programming. Results indicated that PjBL with the Scratch group significantly outperformed the other two groups in all aspects, demonstrating improved learning outcomes and a greater ability to apply knowledge in creative and meaningful ways. Students expressed higher motivation and more positive attitudes toward the subject matter. This study concludes that integrating Scratch with PjBL enriches biology education and enhances interdisciplinary learning. The findings contribute to educational science by offering a scalable, innovative model that bridges STEM fields and fosters critical 21st-century skills.
Development of a Culturally Contextualized Chemistry Literacy Test Based on West Kalimantan Culture on Thermochemistry Topics Aisyah, Siti; Wiyarsi, Antuni
Jurnal Pendidikan Matematika dan Sains Vol. 13 No. 2 (2025): December 2025
Publisher : Faculty of Mathematics and Natural Sciences, Universitas Negeri Yogyakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/jpms.v13i2.84709

Abstract

The aim of this research is to produce a chemical literacy assessment instrument based on cultural context for high school students on the topic of thermochemistry. The instrument development was carried out by constructing and validating the culturally contextualized chemical literacy test through the following stages: (1) identification of aspects and indicators of culturally based chemical literacy; (2) construction of the assessment instrument; (3) theoretical validation; (4) empirical validation; (5) reliability testing; and (6) difficulty level analysis. Data were analyzed using the Winsteps application and interpreted through the Rasch Model. The developed instrument consists of 12 items encompassing four chemical literacy indicators: Chemical Knowledge Concept, Chemistry in Context, Higher-Order Thinking Skills, and Attitude. The cultural context includes four West Kalimantan cultural themes: Dayak traditional tuak drinking, betel chewing tradition, nasi hadap-hadapan ceremony, and the karbit cannon festival. Validity was confirmed through Outfit MNSQ, Outfit ZSTD, and Point Measure Correlation (Pt. Mean Corr) values. Reliability analysis showed a Cronbach’s alpha of 0.56 (moderate), person reliability of 0.68 (moderate), and item reliability of 0.95 (very high). The instrument covers various difficulty levels: easy (1 item), moderate (9 items), and difficult (2 items), indicating a well-distributed test construction.
PENGEMBANGAN INSTRUMEN PENILAIAN SIKAP BERKEBHINEKAAN GLOBAL: VALIDITAS DAN RELIABILITAS Setiawan, Indra; Wiyarsi, Antuni
Jurnal Pendidikan Kimia Unkhair (JPKU) Vol 4, No 1 (2024): Jurnal Pendidikan Kimia Unkhair (JPKU)
Publisher : Universitas Khairun

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33387/jpku.v4i1.8405

Abstract

 Informasi Jurnal Kata Kunci:                Angket, Berkebhinekaan global, Kurikulum Merdeka AbstrakPenelitian ini bertujuan untuk mengembangkan instrumen penilaian sikap berkebhinekaan global, khususnya terkait dengan penentuan aspek-aspek sikap berkebhinekaan global yang dapat digunakan sebagai dasar dalam merumuskan indikator-indikator motivasi belajar tersebut. Adapun aspek-aspek motivasi belajar yang digunakan sebagai dasar dalam pengembangan instrumen motivasi tersebut, meliputi: mengenal budaya, menghargai budaya, interaksi antar buadya, refleksi terhadap kebhinekaan. Berdasarkan keempat aspek motivasi tersebut, selanjutnya dirumuskan indikator-indikator sikap berkebhinekaan global. Akhirnya, indikator-indikator itulah yang dipakai sebagai dasar untuk merumuskan butir-butir pernyataan dalam suatu angket sebagai instrumen untuk mengukur sikap berkebhinekaan global. Instrumen sikap berkebhinekaan global tersebut berupa angket dengan menggunakan skala Likert. Berdasarkan hasil pengujian, ternyata instrumen motivasi belajar fisika yang dikembangkan ini terdapat 30 pernyataan valid yang dikembangkan. Sedangkan, derajat reliabilitasnya tergolong tinggi, yaitu dengan ditunjukkan oleh nilai koefisien korelasi sebesar 0,781.Keyword:Questionnaire, Global Diversity, Kurikulum MerdekaAbstractThis study aims to develop a global diversity attitude assessment instrument, especially related to determining aspects of global diversity attitudes that can be used as the basis for formulating indicators of learning motivation. The aspects of learning motivation used as the basis for the development of the motivation instrument include: recognizing culture, appreciating culture, interaction between cultures, reflection on diversity. Based on these four aspects of motivation, indicators of global diversity attitudes were formulated. Finally, these indicators are used as the basis for formulating statement items in a questionnaire as an instrument to measure global diversity attitudes. The global diversity attitude instrument is a questionnaire using a Likert scale. Based on the test results, it turns out that the developed physics learning motivation instrument has 30 valid statements developed. Meanwhile, the degree of reliability is high, which is indicated by the correlation coefficient value of 0.781.
AI-based assessment: Aiken index analysis of content validity in scientific literacy instruments on the basic laws of chemistry with ethnochemistry Zai, Fila Delfia; Yamtinah, Sri; Shidiq, Ari Syahidul; Widarti, Hayuni Retno; Wiyarsi, Antuni
Jurnal Pendidikan Kimia Vol. 16 No. 3 (2024): J. Pendidik. Kim : December 2024
Publisher : Pascasarjana Universitas Negeri Medan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.24114/jpkim.v16i3.65174

Abstract

Scientific Literacy Assessment (SLA) is used to measure science literacy on basic chemical law material that has been qualified and tested. This study aims to prove the content validity of ethnochemistry SLA instruments integrated with artificial intelligence (AI) systems using Aiken's validity index so that they can measure students' scientific literacy in basic chemical law material. The research design uses the ADDIE development model (Analysis, design, development, implementation and evaluation which is simplified into analysis, design, and development. Content validity data was obtained from 10 experts, namely 7 chemistry education lecturers from UNS, UNY, and UM and 3 chemistry teachers in Surakarta through focus group discussions (FGD). The content validation test is based on aspects of context, language, and construct. A valid instrument is indicated by an Aiken index value of more than or equal to 0.73. The AI-integrated ethnochemistry SLA instrument on basic laws of chemistry material produced 15 valid items with an Aiken index greater than 0.73.
Validation of an AI-based automatic assessment system for scientific literacy instruments on green chemistry integrated with ethnochemistry Rahmawati, Dian; Yamtinah, Sri; Shidiq, Ari Syahidul; Widiarti, Hayuni Retno; Wiyarsi, Antuni
Journal of Environment and Sustainability Education Vol. 3 No. 2 (2025)
Publisher : Education and Development Research

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62672/joease.v3i2.70

Abstract

This study aims to measure the content validity of an AI-based automatic assessment system for scientific literacy instruments on green chemistry integrated with ethnochemistry using Aiken’s V index. The research design adopts the R&D model with the ADDIE approach, limited to the analysis, design, and development stages. A combination of quantitative and qualitative descriptive methods was utilized through purposive sampling, engaging 10 experts—chemistry education lecturers from UNS, UNY, UM, and high school chemistry teachers in Surakarta. Data were obtained through Focus Group Discussions (FGD), focusing on three aspects: context, language, and construct. Essay-based instrument items were rated using four relevance categories: irrelevant, less relevant, quite relevant, and relevant. Items with an Aiken index ≥ 0.73 were considered valid. The results showed that 1 question item had moderate validity and 14 question items had high validity, making them suitable for further testing. The questions were designed to assess students’ understanding of green chemistry principles and their ability to relate these to ethnochemistry practices—local cultural knowledge that supports sustainability. The formulation of the questions also demonstrated how the application of local culture can be interpreted through green chemistry to enhance scientific awareness and environmental responsibility. Based on the content validation results and subsequent revisions, the instrument is deemed ready to move forward to the limited trial stage.
Assessing the Effectiveness of Case-Based Learning on Students' Attitudes Toward Chemistry and Formal Reasoning in Acid-Base Topics Apriyanti, Adelia; Wiyarsi, Antuni
Jurnal Tadris Kimiya Vol 9 No 2 (2024)
Publisher : Department of Chemistry Education, UIN Sunan Gunung Djati Bandung

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15575/jtk.v9i2.34434

Abstract

Effective teaching strategies are critical in enhancing students' attitudes toward chemistry and formal reasoning abilities, particularly for complex topics like acids and bases. Case-based learning has emerged as a promising alternative to traditional scientific learning methods. This study aims to compare the differences in attitudes toward chemistry and formal reasoning skills between students exposed to case-based learning and those undergoing scientific learning on acids and bases. A quasi-experimental design with a posttest-only control group was applied to 122 student of 11th grade science students in Yogyakarta, selected using simple random sampling. Data were collected through case-based essay questions and attitude questionnaires. Multivariate analysis (Hotelling Trace) assessed the differences between groups. The analysis revealed a significant difference (p = 0.000 < 0.05) in attitudes and formal reasoning skills between the two groups. Students in the case-based learning group demonstrated significantly better attitudes toward chemistry compared to those in the scientific learning group. These findings highlight the potential of case-based learning to enhance students’ engagement and reasoning skills in chemistry. By integrating case-based approaches into acid-base learning, teachers can adopt alternative methods to improve student outcomes. This study underscores the importance of diversifying teaching strategies to address the challenges of complex scientific topics effectively.
CRITICAL THINKING BASED ON THE INTEGRATION OF BATIK LOCAL WISDOM IN SCIENCE LEARNING: A TEST DEVELOPMENT Zuniari, Nurul Iqdami; Wiyarsi, Antuni
JURNAL EDUSCIENCE Vol 12, No 3 (2025): Jurnal Eduscience (JES), (Authors from Malaysia and Indonesia)
Publisher : Universitas Labuhanbatu

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36987/jes.v12i3.6572

Abstract

Purpose-This study aims to develop an evaluation tool to measure students' critical thinking skills, specifically integrating the process of making batik local wisdom into science learning.Methodology-This research uses the Research and Development (R&D) method with the 4D model, which includes four main stages: Define, Design, Develop, and Disseminate. A random sampling technique is used, which involves160 students.Findings-The instrument consists of 20 questions validated with Aiken's V values ranging from 0.93 to 0.97, indicating excellent content validity. All question items are declared fit based on the Rasch model analysis. The instrument had an item reliability of 0.91 and a respondent reliability of 0.73. Analysis of the distribution of threshold values (b) shows that most questions are in the medium category.Contribution-This research integrates local wisdom, namely batik, into assessing critical thinking skills, an approach rarely encountered in previous research. In conclusion, the developed instrument effectively measures students' critical thinking skills. It can be used to measure them, especially in the context of learning about batik as part of local wisdom.
Efektivitas Alat Peraga Mini Solar Panel dengan Model Inkuiri Terbimbing pada Topik Energi Terbarukan untuk Meningkatkan Keterampilan Berpikir Kritis Peserta Didik Sarina; Wiyarsi, Antuni; Pertiwi, Andini; J, Jumadi; Dahliani, Eka
Jurnal Pendidikan Indonesia Vol 14 No 2 (2025): June
Publisher : Lembaga Penelitian dan Pengabdian kepada Masyarakat

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.23887/jpi-undiksha.v14i2.88004

Abstract

Critical thinking skills are essential for students to navigate future challenges and comprehend complex issues. However, many students have not been trained to think critically in the context of science, particularly because the learning process still emphasises theoretical learning over active exploration. This study aims to analyse the effectiveness of using mini solar panel teaching aids in conjunction with a guided inquiry model in improving the critical thinking skills of grade VIII junior high school students. This study was a Pre-Experiment with a one-group pretest-posttest Design. The study population consisted of all grade VIII junior high school students, with a sample of class VIII B comprising 31 students. The results showed that mini solar panel teaching aids, combined with a guided inquiry model, were effective in improving students' critical thinking skills, with an average increase in the N-Gain score of 0.63 in the moderate category. Second, there was a significant difference in the average score of students' critical thinking skills before and after the implementation of the teaching aids, with an average pretest score of 5.56 and a post-test score of 11.16. Third, the implementation of mini solar panel teaching aids using a guided inquiry approach had a significant impact on the development of students' critical thinking skills. This study demonstrates that the use of mini solar panel teaching aids in conjunction with a guided inquiry model can be an effective learning method for enhancing students' critical thinking skills in science learning.
Implementation of Differentiated Learning on Acid-Base Materials to Improve Learning Motivation and Critical Thinking Skills of High School Students Musdalifah, Hainun; Wiyarsi , Antuni
International Journal of Educational Evaluation and Policy Analysis Vol. 2 No. 4 (2025): October : International Journal of Educational Evaluation and Policy Analysis
Publisher : Asosiasi Riset Ilmu Pendidikan Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62951/ijeepa.v2i4.415

Abstract

This study aims to analyze significant differences in learning motivation and critical thinking skills simultaneously between students who learn with differentiated learning and those who do not, determine the effective contribution of the implementation of differentiated learning on acid-base materials to learning motivation and critical thinking skills of students simultaneously, to determine the effective contribution of differentiated learning implementation on acid-base material to high school students' learning motivation, to determine the effective contribution of differentiated learning on acid-base material to high school students' critical thinking skills, to determine the level of achievement of students' critical thinking skills in experimental and control classes. This study used a quasi-experiment model with a pretest-posttest control group design. The sample of this study consisted of two classes, namely experimental class and control class, with random sampling. The experimental class used differentiated learning, while the control class used discovery learning. Critical thinking skills data were obtained from the description test data and learning motivation data through questionnaires. MANOVA test was used to analyze differences in critical thinking skills and student learning motivation in experimental and control classes simultaneously. Test of between subject effects is used to analyze differences in each dependent variable in experimental and control classes. Partial eta square test is used to analyze the effective contribution of differentiated learning to the dependent variable. Descriptive statistics to determine the level of achievement of critical thinking skills. The results showed there were significant differences in learning motivation and critical thinking skills simultaneously and individually between students who used differentiated learning and those who did not, the effective contribution of differentiated learning on acid-base materials to critical thinking skills and student learning motivation simultaneously was 16.9% (high), the effective contribution of differentiated learning on acid-base material to students' critical thinking skills is 6. 1% (medium), the effective contribution of differentiated learning on acid-base material to student learning motivation is 12% (medium), the level of achievement of critical thinking skills in the experimental class is in the good category, while in the control class in the sufficient category.
Co-Authors Achmad Nur Rochim Ahmad Saputra Aminatun, Tien Anafiza, Rizqa Devi Anggra Prasetya Cahya Anti Kolonial Prodjosantoso Apriyanti, Adelia Ari Syahidul Shidiq Ari Syahidul Shidiq Ari Syahidul Shidiq Ari Syahidul Shidiq Atina Rizanatul Fachriyah Aura Heidya Septa Azmi, Nur Sabrina Ahmad Bambang Susilo Crys Fajar Partana Dahliani, Eka Das Salirawati Das Salirawati Della Novri Yanti Deni Ainur Rokhim Dian Rahmawati Dita Puji Rahayu Eddy Sulistyowati Eli Rohaeti Erfan Priyambodo Erlina Azmi Siregar Fa'ari Salsabila Fadhlan Muchlas Abrori Fatihatussa’adah, Ira Fauziah, Putri Nanda Febri Saputri Fila Delfia Zai Fitri, Hajidah Salsabila Allissa Ginesia Dudin Wijaya Harahap, Lenni Khotimah Harry Firman Harry Firman Hasrilia Beskara Hayuni Retno Widarti Heru Pratomo Hussain, Abbas Ali Iftikhar Indra Setiawan Insih Wilujeng Ira Fatihatussa’adah J, Jumadi Jaslin Ikhsan K. H. Sugiyarto Kamari, Azlan Kristian Handoyo Sugiyarto Laifa Rahmawati Laisa Nasta'in Lumadya, Sih Agung Lutfiah Nur Hidayati Mabrukah, Nabilah Putri Marfuatun Marfuatun Metridewi Primastuti Meyga Evi Ferama Sari Mr Sjaeful Anwar Mr Sumar Hendayana Muhd Ibrahim bin Muhamad Damanhuri Muhd Ibrahim Damanhuri Muhd Ibrahim Muhamad Damanhuri Munawarah, Sinta Al Musdalifah, Hainun Nanik Dwi Nurhayati Nanik Dwi Nurhayati Naseer Ahmed Naseer Ahmed Naseer Ahmed Nira Listyawati Nur Aeni Ariyanti Nur Fitriyana Nur Fitriyana Paidi Pertiwi, Andini Pratiwi, Galuh Pratiwi, Yunilia Nur Puput Dyah Nur Safitri Putri, Bela Anisa Rar.Nat. Senam Restu Utami Ristiyani, Yulinda Rr. Lis Permana Sari Sabar Nurrohman Salsabila, Fa'ari Saputra, Ahmad Sarina Senam Senam Shidiq, Ari Syahidul Siddiq, Ari Syahidul Sigit Priatmoko Siti Aisyah Sri Handayani Sri Retno Dwi Ariani Sri Retno Dwi Ariani Sri Yamtinah Suhartini Suhartini Sukisman Sukisman Sukkaew, Adulsman Sukma Fajri Sulistyo Saputro Sunartri, Sunartri Supriadi, Didi Suryadi Budi Utomo Sutiman Sutiman Sutiman Sutiman Syamsudin, Frendi Ihwan Tarigan, Wenny Pinta Litna Utami, Amaira Wahyu Sugiarto Widiarti, Hayuni Retno Yessi Prihartina Yunus, Muhamad Fahmi Yuyun Ernawati Zai, Fila Delfia Zuniari, Nurul Iqdami Zuniari, Nurul Iqdami