Jurnal Penelitian dan Evaluasi Pendidikan
Vol. 30 No. 1 (2026)

Construct validity and reliability of a high-stakes mathematics test for junior high school: A case from the Indonesian national examination

Astutiati Astutiati (Universitas Negeri Yogyakarta)
Muhammad Kusnun Muhsin (Universitas Negeri Yogyakarta)
Raden Rosnawati (Universitas Negeri Yogyakarta)
Heri Retnawati (Universitas Negeri Yogyakarta)
Ezi Apino (Universitas Negeri Yogyakarta)
Ibnu Rafi (National Sun Yat-sen University)
Umi Farisiyah (Universitas Negeri Yogyakarta)



Article Info

Publish Date
31 Jul 2026

Abstract

High-stakes tests are used to inform critical decisions concerning students, teachers, schools, and educational policies. Therefore, they must meet rigorous quality-assurance standards. One key approach to ensuring the quality of high-stakes tests is establishing construct validity and reliability. This study aims to prove the construct validity and estimate the construct reliability for a high-stakes mathematics test for junior high school students. This study uses response data from participants taking the national junior high school mathematics exam in Indonesia. A simple random sampling technique was used to select 300 samples. Data were analyzed using second-order confirmatory factor analysis with the help of the R program. The study results revealed four factors that make up the mathematical ability construct: number, algebra, geometry, and statistics. All manifest variables (18 indicators) confirmed a significant contribution. The model fit indicators are met (chi-square = 140.013, df = 131, p = 0.279, RMSEA = 0.015, CFI = 0.994, TLI = 0.993; SRMR = 0.039), so the construct measured in the high-stakes mathematics test is valid for measuring students’ mathematical abilities. Thus, the test construct has a reliability coefficient of 0.98, reflecting that the construct is reliable for measuring mathematical abilities.

Copyrights © 2026






Journal Info

Abbrev

HEPI

Publisher

Subject

Decision Sciences, Operations Research & Management Education

Description

Jurnal Penelitian dan Evaluasi Pendidikan memuat dan menyebarluaskan hasil-hasil penelitian pendidikan dosen, dan penelitian disertasi mahasiswa S3 dari berbagai perguruan tinggi di Indonesia. Hasil-hasil penelitian yang disampaikan pada jurnal ini tidak terbatas pada bidang evaluasi pendidikan ...