International Journal of Evaluation and Research in Education (IJERE)
Vol 15, No 4: August 2026

Establishing quality indicators for higher-order thinking skills: development and validation using factor analysis

Nia Kania (Universitas Majalengka)
Florence Kyaruzi (University of Dar es Salaam)



Article Info

Publish Date
05 Aug 2026

Abstract

Assessing higher-order thinking skills (HOTS) in mathematics education remains challenging because available instruments often measure critical thinking (CT), creative thinking (CrT), and problem-solving (PS) separately, limiting a coherent evaluation of their interrelated nature. This study developed and empirically validated an integrated set of quality indicators for HOTS assessment using a mixed-methods design. In the qualitative phase, focus group discussions (FGDs) with five experts in mathematics education and educational evaluation generated theory-driven indicators grounded in instructional practice. In the quantitative phase, 70 participants (university lecturers, secondary school teachers, and undergraduate students) were selected through stratified purposive sampling to evaluate the indicators. An exploratory factor analysis (EFA) was performed using principal axis factoring with varimax rotation, and factorability was confirmed using Kaiser-Meyer-Olkin (KMO) and Bartlett’s test of sphericity. The results showed satisfactory construct validity (KMO=0.75; Bartlett’s p

Copyrights © 2026






Journal Info

Abbrev

IJERE

Publisher

Subject

Education

Description

The International Journal of Evaluation and Research in Education (IJERE) is an interdisciplinary publication of original research and writing on education which publishes papers to international audiences of educational researchers. The IJERE aims to provide a forum for scholarly understanding of ...