Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I)
Vol 12, No 2 (2023): JP3I

Ensuring Parameter Estimation Accuracy in 3PL IRT Modeling: The Role of Test Length and Sample Size

Hasan Djidu (Universitas Negeri Yogyakarta
Universitas Sembilanbelas November Kolaka)

Heri Retnawati (Universitas Negeri Yogyakarta)
Haryanto Haryanto (Universitas Negeri Yogyakarta)



Article Info

Publish Date
10 Nov 2023

Abstract

The objective of this simulation study was to evaluate the accuracy of item parameters estimation when employing the 3PL IRT model, mainly focusing on sample size and the length of the test (number of test items). The investigation used six datasets produced by WinGen, each comprising 5000 responses and varying test lengths within 10 to 40 items. For each dataset, the study conducted simulations and re-analyzed the data 15 times, generating a total of 2025 data subsets and estimating 225 parameters for each item. The results revealed that smaller sample sizes led to more pronounced biases, emphasizing a recommended minimum sample size of 3000 for precise parameter estimation. Additionally, the study found that a limited number of items (short test) yielded biased estimations and proposed a minimum of 25 or 40 test items for accurate estimation using the 3PL IRT model. These findings offer valuable insights for test developers in making informed decisions regarding sample sizes and test length, ultimately ensuring reliable and accurate parameter estimates.

Copyrights © 2023






Journal Info

Abbrev

jp3i

Publisher

Subject

Education Social Sciences

Description

Jurnal Pengukuran Psikologi dan Pendidikan Indonesia (JP3I) adalah jurnal ilmiah yang diterbitkan oleh Fakultas Psikologi, Universitas Islam Negeri Syarif Hidayatullah Jakarta. Jurnal ini bertujuan untuk memfasilitasi interaksi, diskusi, dan gagasan di antara para ilmuwan psikologi Indonesia. ...