Transforma: Jurnal Manajemen
Vol. 4 No. 2 (2026): Transforma: Jurnal Manajemen

Analysis Of Score Changes And Ceiling Effects On The Asn Integrity Training Test: Implications For The Ministry Of Transportation's Learning Evaluation

Rima Febrina (Universitas Negeri Yogyakarta, Indonesia)
Afsuni Wijananto (Universitas Negeri Yogyakarta, Indonesia)
Dyan Apriyani (Universitas Negeri Yogyakarta, Indonesia)
Siswantoyo Siswantoyo (Universitas Negeri Yogyakarta, Indonesia)



Article Info

Publish Date
06 Oct 2026

Abstract

Civil servant integrity training requires evaluation frameworks that distinguish recorded cognitive test performance from ethical workplace behavior. This study examines score changes and ceiling effects in the ASN Berintegritas training program and their implications for learning evaluation within Indonesia’s Ministry of Transportation. A retrospective quantitative design analyzed Learning Management System (LMS) records from March 18 to September 3, 2026. The primary analysis involved 24,174 paired participant records after excluding 38 invalid time-sequence pairs. Data were processed in R using descriptive statistics, paired t-tests, and McNemar’s test. Mean scores increased significantly from 90.25 to 95.27, representing a 5.02-point gain (95% CI: 4.85–5.19; p < .001). However, the median individual score difference was 0.00: 41.49% of participants improved, 41.10% remained unchanged, and 17.41% declined. The proportion of maximum scores (100) expanded from 43.18% at pretest to 57.30% at posttest (p<.001). High upper-end score concentration indicates a substantial ceiling effect that constrains the measurement of true learning gains. Furthermore, the lack of a control group and test-equating evidence precludes causal conclusions about training efficacy or the development of behavioral integrity. These findings highlight the need for Kemenhub Corporate University to refine question banks, implement Situational Judgment Tests (SJTs), and integrate cognitive assessments with workplace behavioral observations and Zona Integritas frameworks.

Copyrights © 2026






Journal Info

Abbrev

tjm

Publisher

Subject

Economics, Econometrics & Finance

Description

Transforma: Jurnal Manajemen is a scholarly journal that focuses on the field of management. The journal provides a platform for researchers, academics, and professionals to share knowledge, insights, and the latest advancements in various aspects of management. Topics covered include strategic ...