Parameter: Jurnal Matematika, Statistika dan Terapannya
Vol 4 No 3 (2025): Parameter: Jurnal Matematika, Statistika dan Terapannya

Evaluating the Performance of Ordinal Logistic Regression and XGBoost on Ordinal Classification Datasets

Hanifa, Jasmin Nur (Unknown)
Mingka, Rizka Annisa (Unknown)
Indahwati, Indahwati (Unknown)
Silvianti, Pika (Unknown)



Article Info

Publish Date
20 Dec 2025

Abstract

Choosing the appropriate classification model is crucial, especially when dealing with data featuring an ordinal dependent variable. This study explores and compares the performance of Ordinal Logistic Regression (OLR) and Ordinal XGBoost in classifying ordinal data using ten datasets obtained from the UCI Machine Learning Repository and Kaggle, which vary in the number of observations and features. Each dataset undergoes multicollinearity detection, an 80% training and 20% testing data split, and class balancing using SMOTE. Model performance is evaluated using metrics such as accuracy, F1-score, AUC, MSE, precision, and recall. The results show that ordinal XGBoost outperforms on datasets with complex structures and a higher number of features, achieving a maximum accuracy of 0.953. In contrast, Ordinal Logistic Regression demonstrates more stable performance on datasets with fewer features or balanced class distributions.

Copyrights © 2025






Journal Info

Abbrev

parameter

Publisher

Subject

Mathematics

Description

Parameter: Jurnal Matematika, Statistika dan Terapannya is an open access journal (e-journal) published since April 2022. Parameteris published by Department of Mathematics, Faculty of Science and Mathematics, Pattimura. Parameterpublished scientific articles on various aspects related to ...