Indonesian Journal of Applied Science and Engineering
Vol. 3 No. 1 (2025)

Item Analysis of an English Achievement Test Using Rasch Model and Classical Test Theory

Rezkilaturahmi Rezkilaturahmi (Universitas Negeri Yogyakarta)
Nur Hidayanto Pancoro Setyo Putro (Universitas Negeri Yogyakarta)
Guldana Begimbetova (Abai Kazakh Pedagogical University)
Oscar Ndayizeye (Hebei Foreign Studies University)
Muthmainnah Muthmainnah (Universitas Muhammadiyah Kendari)
Dinda Khaira Latifa (Universitas Negeri Yogyakarta)



Article Info

Publish Date
11 Oct 2026

Abstract

This study aimed to evaluate the quality of English test items developed by the English Teachers Working Group (MGMP) in Muna District, Indonesia. The study specifically examined the psychometric characteristics of the items in terms of item difficulty, discrimination, distractor effectiveness, and item fit using Classical Test Theory (CTT) and Item Response Theory (IRT). This study employed a quantitative psychometric approach. The data consisted of responses to an English achievement test developed and administered by English teachers participating in the MGMP in Muna District. Item quality was initially examined using Classical Test Theory based on item difficulty, discrimination index, and distractor effectiveness. Further analysis was conducted using the Rasch model of Item Response Theory with the Quest program to evaluate item difficulty and item fit based on INFIT Mean Square (MNSQ) statistics. The results of both approaches were used to determine whether individual items were acceptable, required revision, or should be rejected. The analysis revealed variation in the psychometric quality of the test items. The CTT analysis showed differences in item difficulty, discrimination, and distractor effectiveness, while the Rasch analysis revealed variation in item difficulty and item fit. The combined findings indicated that some items demonstrated acceptable psychometric characteristics, whereas others required revision. In addition, several items could not be evaluated using Quest. These findings indicate that although more than half of the items demonstrated acceptable psychometric characteristics, a substantial proportion still requires improvement before being used as a high-quality English assessment.

Copyrights © 2025






Journal Info

Abbrev

ijase

Publisher

Subject

Description

The Indonesian Journal of Applied Science and Engineering is a peer-reviewed, open-access academic journal. The journal is dedicated to advancing knowledge and disseminating high-quality research at the intersection of applied science, engineering, education, and social science, with a strong ...