Claim Missing Document
Check
Articles

Found 5 Documents
Search

Optimizing the performance of the K-Nearest Neighbors algorithm using grid search and feature scaling to improve data classification accuracy Manurung, Jonson; Saragih, Hondor; Prabukusumo, Muhammad Azhar; Firdaus, Eryan Ahmad
Jurnal Mandiri IT Vol. 14 No. 2 (2025): Computer Science and Field
Publisher : Institute of Computer Science (IOCS)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.35335/mandiri.v14i2.466

Abstract

The performance of distance-based classification algorithms such as K-Nearest Neighbors (KNN) is highly dependent on proper feature scaling and optimal parameter selection. Without systematic optimization, KNN may experience decreased accuracy due to feature scale disparities and suboptimal k-values. This study aims to enhance the performance of the KNN algorithm through the integration of Feature Scaling and Grid Search Cross-Validation as a parameter optimization strategy. The research employs the Breast Cancer Wisconsin Dataset, divided into 80% training and 20% testing data. Feature normalization was performed using StandardScaler, while Grid Search was applied to determine the optimal combination of parameters, including the number of neighbors (k), weighting function (weights), and distance metric (metric). The optimized KNN configuration with k = 9, weights = distance, and metric = manhattan achieved an average accuracy of 97.19%, outperforming the baseline accuracy of 93.86%. A paired t-test confirmed that the improvement was statistically significant (p < 0.05). These findings demonstrate that the synergy between feature scaling and parameter tuning can substantially improve both the accuracy and stability of KNN models. The scientific novelty of this study lies in the systematic integration of normalization and parameter optimization through Grid Search, providing an empirical framework that enhances KNN’s robustness across datasets with heterogeneous feature distributions. The proposed approach is recommended for medical data classification and can be adapted to other domains with heterogeneous numerical feature distributions.
Optimization of XGBoost hyperparameters using grid search and random search for credit card default prediction Firdaus, Eryan Ahmad; Manurung, Jonson; Saragih, Hondor; Prabukusumo, Muhammad Azhar
Jurnal Mandiri IT Vol. 14 No. 2 (2025): Computer Science and Field
Publisher : Institute of Computer Science (IOCS)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.35335/mandiri.v14i2.468

Abstract

This study explores the optimization of the Extreme Gradient Boosting (XGBoost) algorithm for credit card default prediction through systematic hyperparameter tuning using Grid Search and Random Search methodologies. Utilizing the publicly available Default of Credit Card Clients dataset from the UCI Machine Learning Repository, the research focuses on enhancing model performance by fine-tuning critical parameters such as learning rate, maximum tree depth, number of estimators, subsample ratio, and column sampling rate. The baseline XGBoost model achieved an accuracy of 0.8118, while the tuned models using Grid Search and Random Search improved the accuracy to 0.8183 and 0.8188, respectively. Although the improvement appears modest, the optimized models exhibited enhanced balance between precision and recall, particularly in identifying defaulters within an imbalanced dataset—an essential aspect in credit risk assessment. The results demonstrate that systematic hyperparameter optimization not only improves predictive performance but also contributes to model stability and generalization. Moreover, Random Search proved to be more computationally efficient, achieving near-optimal performance with fewer evaluations than Grid Search, thereby emphasizing its practicality for large-scale financial risk modeling applications. The novelty of this study lies in the comparative evaluation of two optimization techniques within the context of financial risk prediction, providing practical insights into how efficient hyperparameter tuning can enhance the reliability and scalability of machine learning models used in real-world credit risk management systems.
Hyperparameter optimization of graph neural networks for predicting complex network dynamics using bayesian meta-learning Saragih, Hondor; Manurung, Jonson; Prabukusumo, Muhammad Azhar; Firdaus, Eryan Ahmad
Jurnal Mandiri IT Vol. 14 No. 2 (2025): Computer Science and Field
Publisher : Institute of Computer Science (IOCS)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.35335/mandiri.v14i2.469

Abstract

The rapid growth of graph-structured data in domains such as transportation, social networks, and biological systems has increased the demand for more adaptive and efficient Graph Neural Network (GNN) architectures. However, GNN performance remains highly sensitive to hyperparameter configurations, which are often tuned through computationally expensive manual or heuristic methods. This study proposes a novel Bayesian Meta-Learning (BML)-based framework for hyperparameter optimization of GNNs aimed at improving the prediction accuracy of complex network dynamics. The framework integrates Bayesian optimization with a meta-learning prior adaptation mechanism, enabling the model to learn optimal hyperparameter distributions across multiple graph tasks. Experimental evaluations conducted on three benchmark datasets—Cora, Citeseer, and PubMed—comprising up to 20,000 nodes with diverse structural complexities, demonstrate that the proposed BML-GNN framework achieves faster convergence, lower validation loss, and higher predictive accuracy than both baseline GNN and traditional Bayesian Optimization approaches. Quantitatively, the BML-GNN model attains an R² score exceeding 0.97 with a significant reduction in RMSE, confirming its strong generalization capability. Although the method shows notable performance improvements, its computational overhead during meta-training and reliance on well-defined prior distributions represent potential limitations. Overall, the integration of Bayesian Meta-Learning provides a robust, scalable, and uncertainty-aware optimization strategy that advances the development of reliable GNN models for complex network modeling and intelligent system design.
Swarm driven automatic feature selection and classification framework for parkinson voice data Prabukusumo, Muhammad Azhar; Saragih, Hondor; Manurung, Jonson
Jurnal Mandiri IT Vol. 14 No. 2 (2025): Computer Science and Field
Publisher : Institute of Computer Science (IOCS)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.35335/mandiri.v14i2.470

Abstract

Parkinson’s disease (PD) severely impairs motor and vocal functions, and early detection is crucial for effective intervention. Conventional diagnostic procedures remain subjective and time-consuming, highlighting the need for automated, data-driven approaches. This study aims to develop an intelligent and fully automated framework integrating Particle Swarm Optimization (PSO)–based feature selection with ensemble machine learning classifiers for PD detection using voice data. The proposed Swarm-Driven Automatic Feature Selection and Classification Framework (SAFSCF) automates data preprocessing, adaptive feature optimization, and classification within a unified pipeline. The framework was evaluated on the Parkinson’s Speech Dataset comprising 743 numerical features. Baseline models achieved accuracies of 0.7738 (Logistic Regression), 0.8651 (Random Forest), and 0.8690 (Gradient Boosting). After PSO optimization, the feature set was reduced by nearly 50% to 382 attributes, achieving a test accuracy of 0.8421 slightly higher than the full-feature model (0.8355). Convergence plots confirmed that PSO effectively minimized the fitness function while maintaining high classification stability. Feature importance analysis revealed that the most discriminative attributes were derived from log energy, Teager Kaiser energy operators (TKEO), MFCCs, Shimmer, and entropy-based features biomarkers known to reflect Parkinsonian speech degradation. These findings demonstrate that the proposed framework enhances computational efficiency and interpretability, offering a reproducible and scalable solution for non-invasive, voice-based PD diagnosis.
Pelatihan dan Demonstrasi Antena Satelit bagi Pramuka Penegak untuk Komunikasi Tanggap Bencana di Kabupaten Pandeglang Provinsi Banten dalam Kegiatan Latsitardanus XLV Tahun 2025 Ahmad Firdaus, Eryan; Manurung, Jonson; Prabukusumo, Muhammad Azhar; Nuriansyah, Agam; Dhaifullah, Rendi Hanif
Jurnal Pengabdian Masyarakat Nauli Vol. 4 No. 1 (2025): Agustus, Jurnal Pengabdian Masyarakat Nauli
Publisher : Marcha Institute

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.35335/nauli.v4i1.234

Abstract

Kegiatan Latihan Integrasi Taruna Wreda Nusantara (Latsitardanus) XLV tahun 2025 di Provinsi Banten merupakan wadah pengabdian masyarakat yang berfokus pada peningkatan kapasitas generasi muda. Salah satu program yang dilaksanakan adalah pelatihan dan demonstrasi penggunaan antena satelit yang ditujukan bagi Pramuka Penegak di Kabupaten Pandeglang. Program ini bertujuan untuk membekali para anggota Pramuka dengan keterampilan komunikasi tanggap bencana, mengingat pentingnya akses komunikasi yang andal di daerah yang memiliki potensi rawan bencana. Pelatihan ini mencakup pengenalan dasar teknologi antena satelit, prosedur operasional, serta simulasi komunikasi dalam skenario darurat. Melalui demonstrasi langsung, peserta diberikan pemahaman praktis mengenai cara mendirikan dan mengoperasikan perangkat komunikasi satelit. Diharapkan, setelah mengikuti kegiatan ini, Pramuka Penegak dapat berperan aktif sebagai ujung tombak dalam sistem komunikasi darurat, baik untuk mengkoordinasikan bantuan maupun menyampaikan informasi penting saat infrastruktur komunikasi konvensional tidak berfungsi. Program ini menjadi kontribusi nyata Latsitardanus XLV/2025 dalam menciptakan kader-kader muda yang kompeten, tanggap, dan siap siaga untuk membantu masyarakat di lingkungan sekitar.