Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : joiv international journal on informatics visualization

The Effect of Feature Selection on Machine Learning Classification Pardede, Jasman; Dwianto, Rio
JOIV : International Journal on Informatics Visualization Vol 9, No 4 (2025)
Publisher : Society of Visual Informatics

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62527/joiv.9.4.2926

Abstract

High-dimensional datasets can lead to overfitting and computationally expensive model building on machine learning. This study uses a dimensionality reduction technique, namely feature selection techniques, to overcome these problems. Five feature selection methods were used, i.e., Chi-Square (CS), Information Gain (IG), Genetic Algorithm (GA), Particle Swarm Optimization (PSO), and Least Absolute Shrinkage and Selection Operator (LASSO), and three classifier methods viz. Naïve Bayes, Extreme Gradient Boosting (XGB), and RF Classifier. The dataset used is the Heart Attack Analysis & Prediction Dataset. In this study, three scenarios of the best feature selection were carried out, namely: 1. selection of the best feature using a specific feature selection, 2. the intersection of selection of the best feature from the same category, 3. the intersection of selection of the best feature from the five proposed feature selection methods. The performance model is measured using accuracy, precision, recall, f1-score, AUC, and training time. This study reveals that feature selection is very effective in improving the performance of prediction models. Based on the experiment results, the best feature selection is CS and IG in the Filter Category with the XGB model. The best feature selected improved the performance of accuracy, precision, recall, f1-score, and AUC, i.e., 1.7%, 1%, 2.3%, 1.6%, and 0.2%, respectively. Meanwhile, training time requirements decreased by 23.5%. Feature selection with specific techniques performs better than feature selection by selecting the best features from the same category feature selection technique or various other feature selection methods.  
Co-Authors Abdullah, Syadda adlan chosyiyar rochman Afis Siswantini Ahmada, Marsa Akbar, Saiful Al Fauzan, Farel Anugrah Alfyansyah, Rangga Alpriatna Malik, Yuzzar Amal M, Ichlasul Amal, Irfan Anisa Putri Setyaningrum Ardi Fajar Maulana Asep Nana Hermana Asep Nana Hermana B, Mira Musrini Benhard Sitohang Bernovaldy, Muhammad Akbar Caecilia Sri Wahyuning Chalifa Chazar Chazar, Chalifa Daffa A R, Muhammad Darmawan, Dicky Dea Kurniasih Dewi, Renita Dika Prasetia Pamungkas Dina Budhi Utami Dina Budhi Utami, Dina Budhi Dwi Adi Lenggana Putra Dwianto, Rio Dwikinta, Made Anindya Ekklesia, Maleakhi Fadhillah Prasetyo, Rachma Fandi Fifi Herni Mustofa Galih Swarghani Ghixandra Julyaneu Irawadi HENDRI HARDIANSAH Hermana, Asep Nana Hilman Syawaluddin Hilwa Athifah KLEB, SYAFIQ SALIM Luqman Yudhianto Luthfi Athallah, Rifqi Marisa Premitasari, Marisa Miftahuddin, Yusup Milenio, Rizka Milandga Mira Musrini B Muhamad Rifki Pratama Muhammad Akbar Bernovaldy Muhammad Azhari Muhammad Fadlansyah Zikri Akhiruddin Rawosi MUHAMMAD FAUZAN RASPATI Muhammad Mulyawan Muhammad Rama Reyswara MUHAMMAD RIFALDI BADU Muhammad Zaki Mahran Mufid Noval Rizky Nugraha Nurhasanah, Youllia Indrawaty Nurrohmah, Desita Pakpahan, Ivan Perdinan, Rivan Dio Putra Riyanto, Aquila Putra, Dwi Adi Lenggana Raka Gemi Ibrahim Raka Satria, Marius Rawosi, Muhammad Fadlansyah Zikri Akhiruddin RAYYAN RAYYAN Renita Dewi Ridhwana M, Fadhlan Rijal, Khairul Rizka Milandga Milenio Rizka Milandga Milenio Rizka Milandga Milenio Rizka Milandga Milenio rochman, adlan chosyiyar Sandia, Muhammad Sakha Satria Darmawan, Kevin Setyaningrum, Anisa Putri Siswantini, Afis Supriyandari, Listy Nuri Swarghani, Galih Thalita Zharifa Nathania Ungkawa, U. Uung Ungkawa Yudhianto, Luqman Yudistira, Agil Yunastrian, Kurniandha Yusuf S, Muhammad