Indonesian Journal of Applied Science and Engineering
Vol. 5 No. 1 (2027)

A Classical Test Theory Analysis of an English Achievement Test

Rezkilaturahmi Rezkilaturahmi (Universitas Negeri Yogyakarta)
Edi Istiyono (Universitas Negeri Yogyakarta)
Widihastuti Widihastuti (Universitas Negeri Yogyakarta)
Muhammad Istiqlal (Universitas Negeri Yogyakarta)
Oscar Ndayizeye (Hebei Foreign Studies University)
John Rey Osben Pelila (Benguet State University)
Muthmainnah Muthmainnah (Unknown)



Article Info

Publish Date
25 Oct 2026

Abstract

The quality of assessment items is an important aspect of ensuring that English language tests provide reliable and meaningful information about students’ achievement. This study aimed to analyze the quality of a 15 item English language achievement test using Classical Test Theory (CTT). The analysis focused on test reliability, item difficulty, item discrimination, and the effect of item deletion on internal consistency. A quantitative approach was employed using responses from 96 students from two public senior high schools in Muna Regency, Southeast Sulawesi, Indonesia. The data were analyzed using descriptive item analysis and Cronbach’s alpha to evaluate the internal consistency of the assessment. The results indicated that the assessment demonstrated satisfactory internal consistency. The item difficulty analysis showed variation across the items, with items ranging from very difficult to moderate. The discrimination analysis revealed that several items demonstrated good to very good discrimination, while several items showed poor discrimination and require further review. The alpha if deleted analysis indicated that removing individual items did not improve the overall internal consistency of the assessment. These findings suggest that the assessment has an acceptable foundation but still requires item-level refinement. Items with satisfactory discrimination can be retained, whereas poorly discriminating items should be reviewed in terms of item wording, answer keys, distractors, and alignment with the intended learning objectives. The study highlights the usefulness of CTT as a practical approach for identifying problematic items and supporting the improvement of English language assessment quality.

Copyrights © 2027






Journal Info

Abbrev

ijase

Publisher

Subject

Description

The Indonesian Journal of Applied Science and Engineering is a peer-reviewed, open-access academic journal. The journal is dedicated to advancing knowledge and disseminating high-quality research at the intersection of applied science, engineering, education, and social science, with a strong ...