IAES International Journal of Artificial Intelligence (IJ-AI)
Vol 15, No 4: August 2026

Genetic algorithm-optimized BERTopic with SHAP explainability for institutional research trend analysis

Muhammad Dedi Irawan (Universitas Islam Negeri Sumatera Utara)
Yustria Handika Siregar (Politeknik Cendana)
Hewa Majeed Zangana (Duhok Polytechnic University)
Ali Ikhwan (Universitas Islam Negeri Sumatera Utara)



Article Info

Publish Date
01 Aug 2026

Abstract

Institutional research grant titles constitute short-text grey literature characterized by heterogeneous semantic structures, making topic identification and research trend analysis challenging. This study proposes an integrated bidirectional encoder representation from transformers-based topic modeling (BERTopic) framework combining genetic algorithm (GA)-based hyperparameter optimization and Shapley additive explanations (SHAP)-based interpretability to improve semantic topic quality and model transparency. GA was applied to optimize dimensionality-reduction and density-based clustering parameters, while SHAP was used to estimate the contribution of bigram features to the surrogate classifier’s predictions of BERTopic-generated topic labels. Experimental results demonstrated that the proposed framework improved topic coherence from 0.367 to 0.543 while reducing the outlier ratio from 21.12% to 13.55%. In addition, the number of topics decreased from 46 to 10, resulting in a more compact and less fragmented topic structure. The resulting topic structure revealed dominant themes related to higher education, religious moderation, Islamic counseling, halal tourism, and sharia banking. Overall, the proposed framework contributes to the development of more coherent, interpretable, and semantically robust topic modeling for institutional short-text grey literature analysis.

Copyrights © 2026






Journal Info

Abbrev

IJAI

Publisher

Subject

Computer Science & IT Engineering

Description

IAES International Journal of Artificial Intelligence (IJ-AI) publishes articles in the field of artificial intelligence (AI). The scope covers all artificial intelligence area and its application in the following topics: neural networks; fuzzy logic; simulated biological evolution algorithms (like ...