Claim Missing Document
Check
Articles

Found 2 Documents
Search

Comparative Study of Artificial Intelligence Accuracy on Project Team Member Assessment Poltak Evencus Hutajulu; Andreas Rumata Simanjuntak; Toba Sastrawan Manik; R Reza El Akbar
MIX: JURNAL ILMIAH MANAJEMEN Vol. 16 No. 2 (2026): MIX : Jurnal Ilmiah Manajemen
Publisher : Universitas Mercu Buana

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.22441/jurnal_mix.2026.v16i2.014

Abstract

Objectives: This study compares five AI platforms (ChatGPT 5.2, Claude Sonnet 4.5, Gemini 3 Pro, GLM 4.7, DeepSeek V3.2) with manual HR assessment in team performance evaluation, examining accuracy and predictive validity by correlating with program success rates.Methodology: Using a within-subjects design, 32 team members managing 619 locations were evaluated by six methods via standardized prompts. Analysis included comparative tests, accuracy metrics, and correlation between performance scores and graduation rates.Finding: All AI platforms scored higher than the HR baseline. Correlation analysis revealed substantial differences in predictive validity. Claude Sonnet 4.5 demonstrated the strongest correlation with graduation rates (ρ = 0.70), followed by GLM 4.7 (ρ = 0.67), accounting for approximately 50-55% of the outcome variability. The HR baseline unexpectedly showed a negative correlation with program success (ρ = -0.49), indicating misalignment between the evaluation criteria and actual effectiveness. DeepSeek V3.2 most closely matched HR scores but showed only moderate predictive validity, while ChatGPT 5.2 showed no meaningful relationship with outcomes.Conclusion: AI platforms differ substantially in predictive validity. Organizations should prioritize outcome-based validation over human agreement when selecting AI for HR decisions and consider recalibrating manual evaluation systems.
Approach Integration Design Sprints to Design Thinking in Learning Management System Sakattaku Siti Nabilah Nida; R Reza El Akbar; Alam Rahmatulloh
Khazanah Informatika : Jurnal Ilmu Komputer dan Informatika Vol. 10 No. 1 (2024): April 2024
Publisher : Universitas Muhammadiyah Surakarta

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.23917/khif.v10i1.4833

Abstract

The Ministry of Education and Culture has introduced a new phase of its independent learning policy called the Movement Organization Program (POP). As a participant in POP, the Sakata Innovation Center Foundation offers a Saung Coding training program that combines hybrid learning methods, including utilizing the Sakattaku Learning Management System (LMS) platform. However, feedback from teachers and school principals indicates that 45% of the respondents (20 out of 45) faced difficulties and discomfort while using the LMS. The user interface (UI) and user experience (UX) are crucial in enhancing the system's functionality and overall user satisfaction. Hence, this research aims to analyze and develop a plan to implement improvements in the UI/UX of the sakattaku.com LMS. The study also involves testing the system and recommending design enhancements. By prioritizing UI and UX, the research combines the compatibility of Design Thinking and Design Sprint methodologies. The final findings indicate that 9 of 15 expert users completed the assigned scenario tasks successfully. The User Experience Questionnaire (UEQ), administered to a sample of 45 individuals, yielded positive impressions across all assessment aspects, with particular improvement noted in the clarity aspect, which transformed from a below-average rating to an excellent rating. Additionally, the novelty aspect exhibited the highest positive difference, with a value of 75.6%.