Claim Missing Document
Check
Articles

Found 2 Documents
Search

Analysis of the Effects of MCQ Enthusiasm, Attendance, Discussion Activeness, and Test Completion on Essay Success in Online Leadership Learning Arief Hamdani Gunawan; Siswantoyo Siswantoyo
Eduvest - Journal of Universal Studies Vol. 6 No. 4 (2026): Eduvest - Journal of Universal Studies
Publisher : Green Publisher Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.59188/eduvest.v6i4.53034

Abstract

Evaluating the effectiveness of leadership learning for senior-level employees (one level below the director) presents unique challenges in measuring competencies. This research aims to analyze the predictive validity of various instruments of online learning activities on the strategic competence of participants, as measured through the success of essay preparation. The predictive variables tested included: (1) Enthusiasm for working on the Multiple Choice Question (MCQ), (2) Attendance of Kick-Off Meeting, (3) Attendance of Online Sessions, (4) Activity of Discussions, (5) Completion of Reaction Test, and (6) Completion of Learning Test. The study involved 40 senior employees from various companies. Data were analyzed using Binary Logistic Regression. The results showed that the regression model explained 63% of the variance in essay success. Key findings revealed that administrative variables (attendance) and procedural cognitive tests (MCQs) did not have a significant influence on essay success. The only variable proven to have a significant effect was Discussion Activity (Sig < 0.05), with an Odds Ratio of 19.3. This indicates that, for executive-level learners, leadership competencies are more validly predicted through the dialectic of arguments in discussions rather than mere presence or memorization of theory.
Analysis Of Score Changes And Ceiling Effects On The Asn Integrity Training Test: Implications For The Ministry Of Transportation's Learning Evaluation Rima Febrina; Afsuni Wijananto; Dyan Apriyani; Siswantoyo Siswantoyo
Transforma Jurnal Manajemen Vol. 4 No. 2 (2026): Transforma: Jurnal Manajemen
Publisher : Pascasarjana Universitas Pasundan

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.56457/tjm.v4i2.417

Abstract

Civil servant integrity training requires evaluation frameworks that distinguish recorded cognitive test performance from ethical workplace behavior. This study examines score changes and ceiling effects in the ASN Berintegritas training program and their implications for learning evaluation within Indonesia’s Ministry of Transportation. A retrospective quantitative design analyzed Learning Management System (LMS) records from March 18 to September 3, 2026. The primary analysis involved 24,174 paired participant records after excluding 38 invalid time-sequence pairs. Data were processed in R using descriptive statistics, paired t-tests, and McNemar’s test. Mean scores increased significantly from 90.25 to 95.27, representing a 5.02-point gain (95% CI: 4.85–5.19; p < .001). However, the median individual score difference was 0.00: 41.49% of participants improved, 41.10% remained unchanged, and 17.41% declined. The proportion of maximum scores (100) expanded from 43.18% at pretest to 57.30% at posttest (p<.001). High upper-end score concentration indicates a substantial ceiling effect that constrains the measurement of true learning gains. Furthermore, the lack of a control group and test-equating evidence precludes causal conclusions about training efficacy or the development of behavioral integrity. These findings highlight the need for Kemenhub Corporate University to refine question banks, implement Situational Judgment Tests (SJTs), and integrate cognitive assessments with workplace behavioral observations and Zona Integritas frameworks.