Erliyan Redy Susanto
Universitas Teknokrat Indonesia, Bandar Lampung

Published : 2 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 2 Documents
Search

Analisis Komparasi Kinerja SVM, Random Forest, dan XGBoost untuk Diagnosis Penyakit Batu Empedu Ananda Dika Erlangga; Erliyan Redy Susanto
Building of Informatics, Technology and Science (BITS) Vol 8 No 2 (2026): September 2026
Publisher : Forum Kerjasama Pendidikan Tinggi

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/bits.v8i2.11008

Abstract

Gallstone disease is a hepatobiliary disorder that requires accurate diagnosis to support timely management and reduce the risk of complications. The availability of clinical and laboratory data provides an opportunity to apply machine learning as a supporting approach for disease classification. This study aims to compare the performance of Support Vector Machine (SVM), Random Forest, and XGBoost algorithms for gallstone disease classification using the Gallstone Dataset from the UCI Machine Learning Repository. The contribution of this study is to provide a comparative evaluation of SVM, Random Forest, and XGBoost on the Gallstone Dataset by consistently applying feature selection, feature standardization, class imbalance handling, and cross-validation to obtain a more objective comparison of the three algorithms. The dataset consists of 319 samples; therefore, model evaluation needs to consider the limited sample size and the potential risk of overfitting, which may affect model generalization. The research stages include feature selection using the ANOVA F-Value, handling class imbalance using the Synthetic Minority Over-sampling Technique (SMOTE), feature standardization, model development, and validation using Stratified 5-Fold Cross Validation. Evaluation was conducted using accuracy, precision, recall, F1-score, and Area Under the Curve (AUC). The results show that XGBoost achieved the best performance, with an accuracy of 79.00%, precision of 80.95%, recall of 75.32%, F1-score of 78.03%, and AUC of 85.04%. Random Forest achieved an accuracy of 78.06%, while SVM achieved 74.92%. Feature importance analysis indicated that C-Reactive Protein (CRP), Vitamin D, Hyperlipidemia, Bone Mass, and Aspartate Aminotransferase (AST) were among the attributes that contributed significantly to the classification. The results indicate that XGBoost outperformed SVM and Random Forest on the dataset used and has potential as a supporting approach for developing a gallstone disease classification system; however, evaluation using larger and more diverse datasets is required to confirm its generalization capability.
Komparasi Algoritma Support Vector Machine, Random Forest, dan XGBoost: Prediksi Penyakit Huntington Berdasarkan Data Ekspresi Gen Reza Zaynury Winata; Erliyan Redy Susanto
Building of Informatics, Technology and Science (BITS) Vol 8 No 2 (2026): September 2026
Publisher : Forum Kerjasama Pendidikan Tinggi

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/bits.v8i2.11097

Abstract

Huntington's disease is a progressive neurodegenerative disorder caused by mutations in the Huntingtin (HTT) gene, and early diagnosis remains an ongoing challenge. Leveraging gene expression data through machine learning holds potential for improving the prediction accuracy of this disease; however, the characteristics of microarray data very high feature dimensionality combined with a limited sample size (small-n large-p) together with class imbalance, increase the risk of overfitting and data leakage. This study compares the performance of Support Vector Machine (SVM), Random Forest, and Extreme Gradient Boosting (XGBoost) in predicting Huntington's disease status using the GSE135589 microarray dataset. The research pipeline includes data standardization, feature selection (SelectKBest based on the ANOVA F-test), class balancing (SMOTE), and hyperparameter tuning via GridSearchCV with Stratified 5-Fold Cross-Validation, in which the number of features (k) is also tuned as a nested hyperparameter alongside other model parameters to prevent information leakage between the training and test data. All preprocessing steps were applied exclusively to the training data (fit-on-train, transform-on-test) to ensure performance estimates free from optimistic bias. The results show that the linear-kernel SVM achieved the best performance, with an accuracy of 88.89%, precision of 89.66%, recall of 96.30%, F1-score of 92.86%, and ROC-AUC of 90.95%, outperforming Random Forest and XGBoost on the independent test set. These findings indicate that regularized linear approaches outperform tree-based models under conditions where feature dimensionality far exceeds sample size. The main novelty of this study lies in tuning the number of features (k) as a nested hyperparameter within the cross-validation scheme rather than as a separate step prior to model training, as is common in most comparable studies, thereby producing a stricter, leakage-free generalization estimate, while also serving as the first comprehensive benchmark comparing the three algorithms specifically within the domain of Huntington's disease gene expression data.