Building of Informatics, Technology and Science
Vol 8 No 2 (2026): September 2026

Analisis Perbandingan Random Forest dan XGBoost dalam Prediksi Pembatalan Pesanan Shopee Menggunakan Interpretasi SHAP

Muhammad Bayu Samudra (Universitas Sriwijaya, Palembang)
Mira Afrina (Universitas Sriwijaya, Palembang)
Allsela Meiriza (Universitas Sriwijaya, Palembang)
Rizka Dhini Kurnia (Universitas Sriwijaya, Palembang)
Ardina Ariani (Universitas Sriwijaya, Palembang)



Article Info

Publish Date
08 Sep 2026

Abstract

Order cancellation is a significant issue for e-commerce platforms because it can result in revenue loss, increased operational costs, and reduced transaction management efficiency. This study aims to compare the performance of Random Forest and Extreme Gradient Boosting (XGBoost) in predicting customer order cancellations on Shopee and to interpret the factors contributing to the prediction outcomes using an Explainable Artificial Intelligence approach based on SHapley Additive exPlanations (SHAP). The study employed the Shopee Consumer Behaviour Cancellation Order Analysis dataset obtained from Kaggle. The research process consisted of data preprocessing, dataset partitioning using the Stratified Train-Test Split method with an 80:20 ratio, implementation of both algorithms, model evaluation using Accuracy, Precision, Recall, F1-Score, and Receiver Operating Characteristic–Area Under Curve (ROC-AUC), followed by model interpretation using SHAP. The evaluation results indicate that Random Forest achieved better performance across most evaluation metrics, while XGBoost obtained a slightly higher ROC-AUC value. SHAP analysis identified Total Discount, Buyer-Paid Shipping Cost, Estimated Shipping Cost, and Estimated Shipping Fee Deduction as the variables contributing most to order cancellation predictions.These findings indicate that combining predictive algorithms with an Explainable Artificial Intelligence approach not only supports the classification of order cancellations but also provides insights into the factors influencing prediction outcomes, which can serve as a consideration for reducing order cancellations on e-commerce platforms.

Copyrights © 2026






Journal Info

Abbrev

bits

Publisher

Subject

Computer Science & IT

Description

Building of Informatics, Technology and Science (BITS) is an open access media in publishing scientific articles that contain the results of research in information technology and computers. Paper that enters this journal will be checked for plagiarism and peer-rewiew first to maintain its quality. ...