MIX : Jurnal Ilmiah Manajemen
Vol. 16 No. 2 (2026): MIX : Jurnal Ilmiah Manajemen

Comparative Study of Artificial Intelligence Accuracy on Project Team Member Assessment

Poltak Evencus Hutajulu (Industrial Chemical Technology Polytechnic)
Andreas Rumata Simanjuntak (Industrial Chemical Technology Polytechnic)
Toba Sastrawan Manik (Industrial Chemical Technology Polytechnic)
R Reza El Akbar (Siliwangi University)



Article Info

Publish Date
26 Jul 2026

Abstract

Objectives: This study compares five AI platforms (ChatGPT 5.2, Claude Sonnet 4.5, Gemini 3 Pro, GLM 4.7, DeepSeek V3.2) with manual HR assessment in team performance evaluation, examining accuracy and predictive validity by correlating with program success rates.Methodology: Using a within-subjects design, 32 team members managing 619 locations were evaluated by six methods via standardized prompts. Analysis included comparative tests, accuracy metrics, and correlation between performance scores and graduation rates.Finding: All AI platforms scored higher than the HR baseline. Correlation analysis revealed substantial differences in predictive validity. Claude Sonnet 4.5 demonstrated the strongest correlation with graduation rates (ρ = 0.70), followed by GLM 4.7 (ρ = 0.67), accounting for approximately 50-55% of the outcome variability. The HR baseline unexpectedly showed a negative correlation with program success (ρ = -0.49), indicating misalignment between the evaluation criteria and actual effectiveness. DeepSeek V3.2 most closely matched HR scores but showed only moderate predictive validity, while ChatGPT 5.2 showed no meaningful relationship with outcomes.Conclusion: AI platforms differ substantially in predictive validity. Organizations should prioritize outcome-based validation over human agreement when selecting AI for HR decisions and consider recalibrating manual evaluation systems.

Copyrights © 2026






Journal Info

Abbrev

Jurnal_Mix

Publisher

Subject

Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Social Sciences

Description

MIX: Jurnal Ilmiah Manajemen is a journal that publishes the results of empirical research that has strong novelty with reference to the latest journals and contributes greatly to scientific development in the fields of Management: Finance, Marketing, Human Resources, and ...