Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi)
Vol 10 No 4 (2026): August 2026

Comparative Study of Machine Learning Algorithms Using Bagging and XGBoost Techniques for Breast Cancer Classification

Rully Pramudita (Universitas Bina Insani)
Dwi Ismiyana Putri (Universitas Bina Insani)
Bambang Kriswantara (Universitas Bina Insani)
Vina Zahrotun Nazah (Universitas Bina Insani)
Rahmat Budiarto (Al-Baha University)



Article Info

Publish Date
25 Aug 2026

Abstract

Machine learning (ML) has become an important data-driven approach for classification and prediction, including applications in medical diagnosis. Ensemble methods can improve classifier performance by combining complementary learning mechanisms. However, systematic evidence on the sequential use of Bagging and XGBoost across different classifier architectures remains limited. This study develops a staged ensemble framework in which five classifiers—Support Vector Machine (SVM), Neural Network (NN), Logistic Regression (LR), Decision Tree (DT), and K-Nearest Neighbours (KNN)—are first optimized through Bagging and subsequently enhanced using XGBoost. The experiments were conducted on the Breast Cancer Wisconsin (Diagnostic) dataset under a consistent 70:30 train–test protocol. Performance was assessed using accuracy, confusion matrices, ROC curves, and Area Under the Curve (AUC), while repeated experiments were used to examine statistical significance. The results show that the staged Bagging–XGBoost approach improves both predictive accuracy and class discrimination across the evaluated classifier types. Neural Network achieved the largest improvement, with mean accuracy increasing from 93.1% to 97.0% across repeated experiments. The findings demonstrate that the sequential framework can improve non-tree-based as well as tree-based classifiers, providing empirical evidence for broader use of staged ensemble integration in breast cancer classification.

Copyrights © 2026






Journal Info

Abbrev

RESTI

Publisher

Subject

Computer Science & IT Engineering

Description

Jurnal RESTI (Rekayasa Sistem dan Teknologi Informasi) dimaksudkan sebagai media kajian ilmiah hasil penelitian, pemikiran dan kajian analisis-kritis mengenai penelitian Rekayasa Sistem, Teknik Informatika/Teknologi Informasi, Manajemen Informatika dan Sistem Informasi. Sebagai bagian dari semangat ...