JSAI (Journal Scientific and Applied Informatics)
Vol 9 No 3 (2026): November

Integrasi Informasi Akademik Publik dan Data Personal Mahasiswa pada Chatbot Berbasis Large Language Model dengan Pendekatan Retrieval-Augmented Generation

Erlangga Wijaya (Univesitas Teknologi Yogyakarta)
Ikrimach Ikrimach (Universitas Teknologi Yogyakarta)



Article Info

Publish Date
02 Nov 2026

Abstract

Objective: This study aims to develop an academic chatbot based on a Large Language Model (LLM) using a Retrieval-Augmented Generation (RAG) approach to integrate public academic information and students' personal academic data at Universitas Teknologi Yogyakarta (UTY). Methods: The system utilizes public academic documents processed through text extraction, chunking, and embedding, then stored in ChromaDB. Personal academic data are retrieved through authentication via the Academic Information System (SIA) and stored in PostgreSQL. Evaluation consists of Black Box Testing involving nine scenarios and RAG assessment using 50 questions across five evaluation metrics. Results: Functional testing achieved a success rate of 100% (9 out of 9 scenarios). RAG evaluation yielded 96.0% for Retrieval Hit Rate and Context Relevance, 93.2% for Answer Relevance, 94.0% for Faithfulness, and an equivalent Accuracy score of 92.8% of the maximum scale. Conclusion: Integrating RAG with personal academic data can provide academic information services through a single conversational interface with authenticated access mechanisms.

Copyrights © 2026






Journal Info

Abbrev

JSAI

Publisher

Subject

Computer Science & IT

Description

Jurnal terbitan dibawah fakultas teknik universitas muhammadiyah bengkulu. Pada jurnal ini akan membahas tema tentag Mobile, Animasi, Computer Vision, dan Networking yang merupakan jurnal berbasis science pada informatika, beserta penelitian yang berkaitan dengan implementasi metode dan atau ...