Claim Missing Document
Check
Articles

Found 1 Documents
Search

Integrating Large Language Models into Decision Support Systems for Objective Student Competition Participant Selection Eka V. Dangkua; Fazrul Anugrah Sahi; Nikmasari Pakaya; Indhitya R. Padiku; Muchlis Polin; Rahmat Taufik R. L Bau
Journal of Renewable Engineering Vol. 3 No. 2 (2026): JORE - April
Publisher : Pt. Anagata Sembagi Education

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.62872/wfdsxn09

Abstract

The selection process for competition participants in the Informatics Engineering Department at Gorontalo State University is still carried out manually, potentially leading to subjectivity and suboptimal identification of deserving students. This study developed an artificial intelligence-based selection system using a Large Language Model (LLM) integrated with the Retrieval-Augmented Generation (RAG) approach. The developed system, named Scout, recommends competitions that match student profiles based on academic data, interests, experience, and achievements. The system evaluation used the Precision@K and Hit@K metrics to measure recommendation accuracy, and RAGAS to assess the quality of retrieval and chatbot responses. Test results showed that the Scout system obtained a Precision@3 score of 0.87 and a Faithfulness score of 0.91, indicating high recommendation relevance and factual consistency. Thus, the implementation of LLM and RAG has proven effective in increasing the objectivity and efficiency of the selection process and has the potential to become the basis for the development of an AI-based academic decision support system in higher education