<![CDATA[Evaluation instruments for vocational teacher upskilling and reskilling programmes are often validated through expert judgement alone, without empirical field testing, and rarely in remote schools. This study examined the preliminary psychometric properties of two CIPP-based instruments developed to evaluate the teacher upskilling and reskilling programme at SMKN 4 Merauke, South Papua. An instrument development design with an exploratory pilot survey was employed. The instruments—a 15-item teacher questionnaire covering the Context, Input, Process and Product dimensions and a 7-item student scale covering Process and Product—were reviewed by expert judges and then administered to all five productive teachers (saturated sampling) and 20 advanced students (purposive sampling) using a five-point Likert scale. Item validity was examined with Pearson item–total correlations and reliability with Cronbach's alpha in R. All seven student items met the critical value (r = 0.587–0.958; r-critical = 0.444), and the student scale showed high internal consistency (α = 0.928; 95% CI 0.854–0.964). For the teacher scale, only five of 15 items exceeded the critical value for N = 5 (r-critical = 0.878); item G5 correlated negatively with the total (r = −0.365), and the correlation matrix was not positive definite, so the alpha estimate (α = 0.884; 95% CI 0.392–0.978) is unstable. The student scale is ready for wider field testing, whereas the teacher scale requires item revision—particularly of double-barrelled items—and re-testing with a substantially larger sample. The study illustrates how small-sample pilot testing can diagnose item-level problems before CIPP instruments are used in remote vocational schools.]]>
Copyrights © 2026
