Aji Prasetya Wibawa
Departemen Teknik Elektro dan Informatika, Universitas Negeri Malang, Indonesia

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Feature Selection Using Genetic Algorithm Combined with Linear Discriminant Analysis and k-Nearest Neighbors for High-Dimensional Text Classification Eko Puji Laksono; M Zainal Arifin; Aji Prasetya Wibawa
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 4 (2026): JUTIF Volume 7, Number 4, August 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.4.5423

Abstract

Text classification is an important task in natural language processing that faces the main challenge of high dimensionality in the representation of text features, such as Bag-of-Words and TF-IDF. High dimensionality leads to data sparsity, increased computational complexity, and decreased model performance due to irrelevant and redundant features. Therefore, an effective feature selection method is needed to improve the accuracy and efficiency of text classification. This study aims to develop an optimal feature selection method by integrating Genetic Algorithm (GA) as a wrapper method, Linear Discriminant Analysis (LDA) for dimension reduction, and k-Nearest Neighbors (k-NN) as a classifier in a high-dimensional text classification pipeline. GA is used to explore a subset of features in an adaptive and global manner, LDA transforms features into spaces with maximum class separability, and k-NN classifies based on proximity within optimized feature spaces. Experiments were conducted on three standard text datasets, namely 20 Newsgroups, Reuters-21578, and BBC News, with a comprehensive evaluation using a variety of preprocessing configurations and feature representations. The results showed that the GA+LDA+k-NN approach significantly improved the classification accuracy compared to traditional feature selection methods such as Chi-Square, Information Gain, and Mutual Information. This approach is also more robust against noise and is able to handle minority classes better. These findings confirm the urgency of using evolutionary optimization-based feature selection methods in high-dimensional text classification, which not only improves model performance but also provides a practical solution for large-scale and complex text data processing. Thus, this research makes an important contribution both theoretically and applicatively in the development of modern text classification systems.