Metaheuristic-Based Hyperparameter Optimization Analysis of Deep Neural Network for Cross-Project Defect Prediction in Mobile Applications

Abdul Rahman, Maulana
Herteno, Rudy
Adi Nugroho, Radityo
Abadi, Friska
Wahyu Saputro, Setyo

Indonesian Journal of Electronics, Electromedical Engineering, and Medical Informatics
Vol. 8 No. 2 (2026): May

Software Defect Prediction (SDP) plays a strategic role in identifying software defects during the early stages of development, thereby enabling more efficient allocation of testing resources, particularly in the rapidly evolving mobile application domain characterized by fast release cycles. The commonly used Within-Project Defect Prediction (WPDP) approach is often constrained by the limited availability of historical data, especially in projects at early stages of development. As an alternative, Cross-Project Defect Prediction (CPDP) leverages historical data from other projects as training sources. Moreover, the performance of the Deep Neural Network (DNN) used in SDP is highly dependent on accurate hyperparameter configurations, where manual tuning requires substantial time and computational resources without guaranteeing optimal results. To address this issue, this study analyzes and compares the effectiveness of three metaheuristic algorithms, namely Particle Swarm Optimization (PSO), Genetic Algorithm (GA), and Grey Wolf Optimizer (GWO), in optimizing DNN hyperparameters within a CPDP framework. This study utilizes 14 open-source Android mobile application projects and employs the Leave-One-Out Cross-Validation technique. The performance of each combination is evaluated using ROC-AUC as the primary metric. The Wilcoxon Signed-Rank Test with a Bonferroni correction is used to assess the statistical significance of the observed performance differences. The experimental results demonstrate that GWO-DNN achieves the best performance, with an average ROC-AUC of 0.721, and is the only combination that remains statistically significant after Bonferroni correction, with a small effect size based on Cliff’s delta. Overall, the findings of this study indicate that metaheuristic-based hyperparameter tuning is a sufficiently effective approach for improving the capability of DNN in cross-project software defect prediction within the mobile application domain, although the observed improvements remain moderate.