Edwin Hari Agus Prastyo
Universitas Hasyim Asy'ari

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : journal of embedded systems security and intelligent systems

Automated Assessment of Research Grant Proposals Using Hybrid Semantic-Tabular Machine Learning: An Application to the SRIKANDI Research Management System Edwin Hari Agus Prastyo; Meriana Wahyu Nugroho; Reza Augusta Jannatul Firdaus; Tanhella Zein Vitadiar
Journal of Embedded Systems, Security and Intelligent Systems Vol 7 No 2 (2026): June 2026
Publisher : Program Studi Teknik Komputer

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.59562/jessi.v7i2.12634

Abstract

Purpose – This study aims to develop and evaluate a hybrid semantic-tabular machine learning framework for supporting the automated assessment of research grant proposals in the SRIKANDI Research Management System at Universitas Hasyim Asy’ari Tebuireng Jombang. Design/methods/approach – The study employed a computational experimental design using historical institutional proposal data from the SRIKANDI system. A total of 190 proposals were labeled based on the institutional LPPM scoring threshold, consisting of 107 approved and 83 not approved proposals. The proposed framework integrates semantic features extracted from proposal narratives using IndoBERT with structured tabular features, including document completeness, proposal score, text quality, budget information, research field, and proposer track-record indicators. The fused 786-dimensional feature representation was classified using a Random Forest model with balanced class weights. Model performance was evaluated using accuracy, precision, recall, F1-score, ROC-AUC, confusion matrix analysis, and SHAP-based explainability. Findings – The hybrid model achieved strong predictive performance on the holdout test set, with 96.55% accuracy, 96.54% weighted F1-score, 96.75% weighted precision, 96.55% weighted recall, and ROC-AUC of 1.0000. The model correctly classified all approved proposals and misclassified only one not-approved proposal. SHAP analysis showed that word count, reference count, proposal text quality, and proposal score were the most interpretable contributors, while IndoBERT semantic dimensions added meaningful predictive value beyond administrative features. Research implications/limitations – The findings indicate that hybrid semantic-tabular learning can support more consistent and transparent preliminary proposal screening. However, the study is limited by its single-institution dataset, relatively small sample size, high feature-to-sample ratio, and dependence on score-threshold labeling. Originality/value – This study contributes a replicable explainable AI framework that combines Indonesian-language semantic representation, institutional tabular features, and SHAP-based interpretability for research grant proposal assessment within a university research management system.