Ketut Jaya Atmaja
Indonesian Institute of Business and Technology, Denpasar, Indonesia

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Comparing Machine Learning and Optimized Ensemble Models for Student Retention Ketut Jaya Atmaja; Ni Wayan Sumartini Saraswati; Eddy Hartono; Ni Kadek Bumi Krismentari
Jurnal Nasional Pendidikan Teknik Informatika: JANAPATI Vol. 15 No. 1 (2026)
Publisher : Prodi Pendidikan Teknik Informatika Universitas Pendidikan Ganesha

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.23887/janapati.v15i1.103164

Abstract

Student retention is a crucial issue in higher education, as low retention rates directly increase the risk of dropout and affect institutional reputation and sustainability. This study aims to compare the performance of single machine learning (ML) models, namely Naïve Bayes (NB), Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Logistic Regression (LR), Random Forest (RF), and Artificial Neural Network (ANN), with an optimized ensemble learning approach using Voting Classification. The optimization was carried out through weighted soft voting, the selection of complementary model combinations, and handling class imbalance with the SMOTE method. The student dataset was processed through preprocessing techniques and validated using 10-fold cross-validation, with model performance evaluated by accuracy, precision, recall, and F1-score metrics. The results indicate that Soft Voting Classification consistently outperforms individual models, with the KNN_ANN_SVM combination achieving the highest accuracy of 87.55%. However, the experiments also show that the application of SMOTE did not improve performance. The best-performing model has the potential to serve as the basis for developing an Early Warning System to support data-driven interventions in reducing student dropout risk.