cover
Article Per Year (5 Year)
All
Home Page
OAI Link
Editorial Team
Contact
Reviewer
Google Scholar
Contact Name
-
Contact Email
-
Phone
-
Journal Mail Official
-
Editorial Address
-
Location
Kab. sleman,
Daerah istimewa yogyakarta
INDONESIA
REiD (Research and Evaluation in Education)
Published by Universitas Negeri Yogyakarta
ISSN : -     EISSN : 24606995     DOI : -
Core Subject : Education,
Education
Arjuna Subject : -
Articles 8 Documents
 1 
Search results for , issue "Vol. 10 No. 1 (2024)" : 8 Documents clear
Stability of estimation item parameter in IRT dichotomy considering the number of participants Ibrahim, Zulfa Safina; Retnawati, Heri; Irambona, Alfred; Pérez, Beatriz Eugenia Orantes
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.73055

Abstract

This research is related to item response theory (IRT) which is needed to measure the goodness of a test set, while item parameter estimation is needed to determine the technical properties of a test item. Stability of item parameter estimation is conducted to determine the minimum sample that can be used to obtain good item parameter estimation results. The purpose of this study is to describe the effect of the number of test takers on the stability of item parameter estimation with the Bayes method (expected a posteriori, EAP) on dichotomous data. This research is an exploratory descriptive research with a bootstrap approach using the EAP method. The EAP method is performed by modifying the likelihood and function to include prior information about the participant's 9 score. Bootstrapping on the original data is done to take bootstrap samples. with ten different sample sizes of 100, 150, 250, 300, 500, 700, 1,000, 1,500, 2,000, 2,500 were then replicated ten times and grain parameter estimation was performed. Each sample data with ten replications was calculated Root Mean Squared Difference (RMSD) value. The results showed that the 2PL model was chosen as the best model. The RMSD value obtained proves that many test participants affect the stability of item parameter estimation on dichotomous data with the 2PL model. The minimum sample to ensure the stability of item parameter estimates with the 2PL model is 1,000 test participants.
Construction of an instrument for evaluating the teaching process in higher education: Content and construct validity Setiawan, Risky; Wagiran, Wagiran; Alsamiri, Yasir
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.63483

Abstract

This study aims to reveal the content validity, construct validity, and reliability of the instrument for evaluating the teaching process in higher education. This research is development research applying the ADDIE model from Molenda. The indicators evaluated consist of context, inputs, processes, and products. The sample consisted of 1200 students from eight faculties, each represented by three study programs. Data analysis uses three stages: content validity test analysis using the V -Aiken method involving six panellists or experts; construct validity test using Confirmatory Factor Analysis (CFA). Quantitative descriptive analysis and interpretive qualitative analysis used the Miles and Huberman method. The results showed that the developed evaluation instrument had good proof of the validity of the content, with an average V-Aiken score of 0.752, which was in the high category. Universitas Negeri Yogyakarta's evaluation instrument, which was developed through the instrument, already meets the validity of an exemplary construct of a good loading factor value (> 0.3). It has a composite reliability score above 0.7 and Cronbach's alpha above 0.6. The analysis results show that all empirical test criteria indicate the data is fit against the developed model.
Constructing and providing content validity evidence through the Aiken's V index based on the experts' judgments of the instrument to measure mathematical problem-solving skills Kania, Nia; Kusumah, Yaya S.; Dahlan, Jarnawi Afgani; Nurlaelah, Elah; Gí¼rbí¼z, Ferit; Bonyah, Ebenezer
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.71032

Abstract

Test content-based proof of validity is a type of evidence that supports the validity of a measuring instrument. This research aims to develop a mathematical problem-solving assessment instrument utilizing five experts. This study is classified as developmental research and follows a research design that includes two separate stages: the preliminary design stage and the prototype stage. However, its application is restricted to Prototype 1 and Prototype 2, specifically for expert evaluation. This instrument was designed explicitly for grade VIII students studying mathematics, covering all the topics from the odd semesters. The analysis progressed through three distinct stages "” curriculum analysis, content analysis, and context analysis "” each contributing to a comprehensive understanding of instructional resources. The study sought to narrow the gap between theoretical knowledge and practical application in mathematics education by incorporating real-world context. Surveys have revealed difficulties in answering mathematical problems, highlighting the need to address gaps in learning to improve competency. The careful and thorough construction of test instruments, considering factors such as validity, established the foundation for creating accurate assessment tools. The content validity assessment by the expert panel, with scores ranging from 0.817 to 0.884 based on the V-Aiken category, confirms that the instrument is vital in assessing students' mathematical problem -solving skills, and the implementation of this study yielded many valuable insights for educators and academics. This study helps improve mathematics education resources and evaluations to promote mathematical thinking.
Number sense profile of prospective elementary school teachers in blended Mathematics learning Novitasari, Welly; Herwin, Herwin; Supartinah, Supartinah; Wulandari, Putri; Budiharti, Budiharti
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.51394

Abstract

Number sense is a skill that contributes significantly to learning mathematics. However, number sense is often positioned as a fundamental skill whose development is more focused on children. The contribution of number sense in mathematics is even more apparent at higher levels of education. Ironically, number sense seems ignored and has become a rarely studied topic in higher education. Thus, the student's number sense ability profile seems buried with various problems. This study aims to reveal the profile of prospective elementary school teachers' number sense abilities and the factors causing their failure in solving math problems during the implementation of blended learning. This study uses a qualitative approach with 37 prospective elementary school teachers as research subjects. The observation of the test and lecture activities is the data collection method. The results showed that the prospective elementary school teachers' number sense ability was still relatively low. Based on the components, the order of number sense abilities is from the highest, namely: (1) knowledge and number facilities with the achievement of 14.41%; (2) knowledge and facilities for number operations with the achievement of 8.12%; and (3) knowledge and facilities of numbers and operations for computing settings with an achievement of 1.8%. The low number sense ability is caused by the habit of solving problems procedurally and the failure to solve problems due to misconceptions, not understanding concepts, inaccuracy, inability to understand questions, and difficulty representing fractions. Various factors causing the failure arose due to the limitations of implementing blended learning.
Understanding barriers to optimal supervision and delivery of the National Certificate (vocational) curriculum through TVET college lecturers' reflective evaluations Williams, Angelona Rewhydah; Prins, Karel; Nkambule, Bongani Innocent; Ngubane, Sindile Amina
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.72274

Abstract

Propounded by reflective theory, this qualitative case study drew on TVET lecturers' reflective evaluations of factors that they considered to have a bearing on optimal supervision and delivery of the National Certificate (Vocational) curriculum. Data were collected from participants across three campuses of a TVET college in the Eastern Cape Province, South Africa. Twelve lecturers of different seniority were purposively sampled and interviewed in two focus group sessions. The first focus session involved six participants: four post-level 2 and two post-level 3 personnel recognized by the South African Council for Educators (SACE) as "office -based lecturers" and classified within the middle management echelon of curriculum management and supervision. The second focus group session entailed six post-level 1 personnel (recognized by SACE as "classroom-based lecturers"). The findings problematized (1) the Department of Higher Education and Training's failure to monitor and evaluate curriculum delivery processes; (2) a lack of comprehensive professional development opportunities for classroom-based lecturers; (3) poor coordination of work-integrated learning (WIL) programs and processes; (4) curriculum supervisors' limited time for classroom visits due to heavy administrative workload; (5) the absence of communities of practice for knowledge sharing purposes among lecturers; (6) students' language barriers, which led to low pass rates; (7) shortage of qualified student support practitioners and onsite academic support programs; and (8) unreliable Internet connectivity and rigid access to technology infrastructure. The study recommends that the college leadership should address these challenges by applying all possible measures to optimize lecturers' curriculum supervision and delivery practices at the selected TVET college .
A psychometric evaluation of an item bank for an English reading comprehension tool using Rasch analysis Yim, Louis Wai Keung; Lye, Che Yee; Koh, Poh Wee
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.65284

Abstract

This study reports the psychometric evaluation of an item bank for an Assessment for Learning (AfL) tool to assess primary school students' reading comprehension skills. A pool of 46 primary 1 to 6 reading passages and their accompanying 522 multiple choice and short answer items were developed based on the Progress in International Reading Literacy Study (PIRLS) assessment framework. They were field-tested at 27 schools in Singapore involving 9834 students aged between 7 and 13. Four main comprehension processes outlined in PIRLS were assessed: focusing on and retrieving explicitly stated information, making straightforward inferences, interpreting and integrating ideas and information, and evaluating and critiquing content and textual elements. Rasch analysis was employed to examine students' item response patterns for (1) model and item fit; (2) differential item functioning (DIF) about gender and test platform used; (3) local item dependence (LID) within and amongst reading passages; and (4) distractor issues about options within the multiple-choice-type items. Results showed that the data adequately fit the unidimensional Rasch model across all test levels with good internal consistency. Psycho metric issues found amongst items were primarily related to ill-functioning distractors and local dependence on items. Problematic items identified were reviewed and subsequently amended by a panel of assessment professionals for future recalibration. This psychometrically and theoretically sound item bank is envisaged to be valuable to developing comprehensive classroom AfL tools that provide information for the English reading comprehension instructional design in the Singaporean context.
Differential Item Functioning of the region-based national examination equipment Setiawan, Adi; Kassymova, Gulzhaina Kuralbaevna; Mbazumutima, Vianney; Agustyani, Anggit Reviana Dewi
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.73270

Abstract

This research aims to detect Differential Item Functioning (DIF) in the 2014/2015 National Examination Questions in mathematics of junior high schools and equivalent-level schools in the Yogyakarta region as a reference group and the South Kalimantan region as a focus group using the Likelihood Ratio Test (LRT) method, Area Measure Raju, and Lord. A sensitivity analysis was conducted to determine the most sensitive method. The data consisted of 5,465 National Examination papers of the students from the two regions who worked on type A questions. A sample of 1,000 exam papers for each region was established using the simple random sampling (SRS) technique, which was conducted to avoid the effect of sample size. The research results showed that by using the LRT method, the researchers found 36 items had significant DIF detection, 32 items were significant for Raju Area, and all items had significant DIF detection using Lord. Lord Method is the most sensitive method because it can detect most DIF items.
Simulation of low-high method in adaptive testing Rukli, Rukli; Atan, Noor Azeam
REID (Research and Evaluation in Education) Vol. 10 No. 1 (2024)
Publisher : Graduate School of Universitas Negeri Yogyakarta & Himpunan Evaluasi Pendidikan Indonesia (HEPI)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21831/reid.v10i1.66922

Abstract

The era of disruption significantly engineered a classic testing system into an adaptive testing system where each test taker takes a unique test. However, the carrying capacity of the adaptive testing system engineering is experiencing obstacles in terms of the method of presenting the test questions. The study aims to introduce the low-high adaptive tracking method with the item response theory approach, where the difficulty level of the questions is adapted to the test takers' abilities. The number of test questions in the question bank is 400 questions. Data analysis used the Bilog-MG program. The range of the difficulty level of the questions and the ability level of the test takers was determined [-3.3]. The initialization of the ability of each test taker is set flexibly. The test taker's response uses the pattern of all wrong, all true, and normal responses. The research results show that the low-high method with the IRT approach matches the pattern of the method of giving adaptive test questions. The low-high method requires about 17 test questions to find the ability of the test takers. Another characteristic of the low-high method is that if the responses of the test takers' three to five questions are all correct, then the calculation of divergent abilities is positive, and if the responses of the test takers' three to five questions are all wrong, then the calculation of convergent abilities is negative. Teachers can use the low-high method to design and assemble adaptive tests in schools electronically and manually.

Page 1 of 1 | Total Record : 8

 1 

Filter by Year

2024 2024


Reset
Filter By Issues
All Issue Vol. 11 No. 2 (2025) Vol. 11 No. 1 (2025) Vol. 10 No. 2 (2024) Vol. 10 No. 1 (2024) Vol. 9 No. 2 (2023) Vol. 9 No. 1 (2023) Vol. 8 No. 2 (2022) Vol. 8 No. 1 (2022) Vol 7, No 2 (2021) Vol 7, No 1 (2021) Vol 6, No 2 (2020) Vol 6, No 1 (2020): June Vol 5, No 2 (2019): December Vol 5, No 1 (2019): June Vol 4, No 2 (2018): December Vol 4, No 1 (2018): June Vol 3, No 2 (2017): December Vol 3, No 1 (2017): June Vol 2, No 2 (2016): December Vol 2, No 1 (2016): June Vol 1, No 2 (2015): December Vol. 1 No. 1 (2015): June More Issue