Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I)
Bambang Suryadi
Faculty of Psychology, UIN Syarif Hidayatullah Jakarta, Indonesia
Education Social Sciences

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Ensuring Fairness in Educational Book Evaluation: A Many-Facet Rasch Analysis ofRater Severity and Item Functioning Suprananto Suprananto; Bambang Suryadi; Jenny Lewis; Valendra Granitha Shandika Puri
JP3I (Jurnal Pengukuran Psikologi dan Pendidikan Indonesia) Vol. 15 No. 2 (2026): JP3I
Publisher : FAKULTAS PSIKOLOGI UIN SYARIF HIDAYATULLAH JAKARTA

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15408/jp3i.v15i2.51647

Abstract

 Maintaining the quality of educational textbooks requires valid, reliable, and transparent evaluation.However, multi-rater assessments may be affected by differences in judgment and rater severity. Thisstudy examined a textbook evaluation system using the Many-Facet Rasch Model (MFRM). Sixevaluators assessed three books using a 12-item instrument. The findings revealed substantial variationin rater severity, including one unusually severe rater, indicating a need to improve consistency inevaluators’ judgments. Most items functioned adequately, but two showed misfit and required revisionor removal. The analysis also distinguished differences in the estimated quality of the three books whileaccounting for rater effects. These findings demonstrate the practical value of MFRM for strengtheningthe fairness and credibility of textbook evaluation. Institutions responsible for textbook assessment shouldregularly review evaluation instruments, clarify rating criteria, and provide training and calibration topromote consistent judgments. They should also investigate unusually severe or inconsistent ratingpatterns and revise or remove items that do not function as intended. Incorporating MFRM intoevaluation procedures can help institutions identify weaknesses in instruments and rating practices,support evidence-based textbook selection, and improve quality assurance. These steps can helppolicymakers establish more transparent and rigorous processes for evaluating educational materials. 
Co-Authors Jenny Lewis Suprananto, Suprananto Valendra Granitha Shandika Puri