Test items in the motorcycle electrical maintenance subject at Indonesian vocational high schools still focus on recall, so students' ability to analyse and evaluate ignition faults is rarely measured. This study aimed to develop a Higher Order Thinking Skills (HOTS) assessment instrument for the motorcycle electronic ignition system and to examine its quality. We followed the 4D development model (define, design, develop, disseminate) proposed by Thiagarajan. Fifteen multiple-choice items at the analysing (C4) and evaluating (C5) levels were reviewed by two experts and then administered to 44 twelfth-grade students of the Motorcycle Engineering and Business programme at two public vocational high schools in Jakarta. Data were analysed using point-biserial correlation, the Kuder-Richardson 20 (KR-20) formula, the discrimination index, and the difficulty index. Thirteen of the 15 items were valid (r ≥ 0.297), and the reliability coefficient was 0.71 (high). Among the valid items, nine showed good discrimination, one excellent, and three satisfactory; six items were of moderate difficulty and seven were difficult, with no easy items. Teachers can use the 13 items to assess students' diagnostic reasoning on electronic ignition faults, while the two rejected items need rewriting before use.
Copyrights © 2026