Erlangga Wijaya
Univesitas Teknologi Yogyakarta

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

Integrasi Informasi Akademik Publik dan Data Personal Mahasiswa pada Chatbot Berbasis Large Language Model dengan Pendekatan Retrieval-Augmented Generation Erlangga Wijaya; Ikrimach Ikrimach
JSAI (Journal Scientific and Applied Informatics) Vol 9 No 3 (2026): November
Publisher : Fakultas Teknik Universitas Muhammadiyah Bengkulu

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.36085/jsai.v9i3.11971

Abstract

Objective: This study aims to develop an academic chatbot based on a Large Language Model (LLM) using a Retrieval-Augmented Generation (RAG) approach to integrate public academic information and students' personal academic data at Universitas Teknologi Yogyakarta (UTY). Methods: The system utilizes public academic documents processed through text extraction, chunking, and embedding, then stored in ChromaDB. Personal academic data are retrieved through authentication via the Academic Information System (SIA) and stored in PostgreSQL. Evaluation consists of Black Box Testing involving nine scenarios and RAG assessment using 50 questions across five evaluation metrics. Results: Functional testing achieved a success rate of 100% (9 out of 9 scenarios). RAG evaluation yielded 96.0% for Retrieval Hit Rate and Context Relevance, 93.2% for Answer Relevance, 94.0% for Faithfulness, and an equivalent Accuracy score of 92.8% of the maximum scale. Conclusion: Integrating RAG with personal academic data can provide academic information services through a single conversational interface with authenticated access mechanisms.