Scientific Journal of Informatics
Vol 11, No 1 (2024): February 2024

Implementation of Feature Selection Strategies to Enhance Classification Using XGBoost and Decision Tree

Nadya, Fhara Elvina Pingky (Unknown)
Ferdiansyah, M.Firdaus Ibadi (Unknown)
Nastiti, Vinna Rahmayanti Setyaning (Unknown)
Aditya, Christian Sri Kusuma (Unknown)



Article Info

Publish Date
29 Feb 2024

Abstract

Purpose: Grades in the world of education are often a benchmark for students to be considered successful or not during the learning period. The facilities and teaching staff provided by schools with the same portion do not make student grades the same, the value gap is still found in every school. The purpose of this research is to produce a better accuracy rate by applying feature selection Information Gain (IG), Recursive Feature Elimination (RFE), Lasso, and Hybrid (RFE + Mutual Information) using XGBoost and Decision Tree models.Methods: This research was conducted using 649 Portuguese course student data that had been pre-processed according to data requirements, then, feature selection was carried out to select features that affect the target, after that all data can be classified using XGBoost and Decision tree, finally evaluating and displaying the results. Results: The results showed that feature selection Information Gain combined with the XGBoost algorithm has the best accuracy results compared to others, which is 81.53%.Novelty: The contribution of this research is to improve the classification accuracy results of previous research by using 2 traditional machine learning algorithms and some feature selection.

Copyrights © 2024






Journal Info

Abbrev

SJI

Publisher

Subject

Computer Science & IT

Description

Scientific Journal of Informatics published by the Department of Computer Science, Semarang State University, a scientific journal of Information Systems and Information Technology which includes scholarly writings on pure research and applied research in the field of information systems and ...