Journal of Telematics and Informatics
Vol 12, No 1 (2024)

Large Language Model and Retrieval-Augmented Generation Model for Indonesian Publication

Milasanti, Denina (Universitas Islam Sultan Agung)
Subroto, Imam Much Ibnu (Universitas Islam Sultan Agung)
Haviana, Sam Farisa Chaerul (Universitas Islam Sultan Agung)



Article Info

Publish Date
12 Dec 2024

Abstract

Garba Rujukan Digital (GARUDA) is a platform for publications and references in scientific articles, journals, and theses in Indonesia. However, to be able to find specific information in many articles and journals, of course, it is necessary to develop a system to make it easier to find this information. Therefore, a chatbot system with Large Language Model (LLM) and Retrieval Augmented Generation (RAG) was developed which is used to retrieve information through data-based chatbots on GARUDA. To find out the results of this study, a matrix evaluation was carried out using the ROUGE score with an average result of the value range from 42.68% to 68.03%. Thus, the evaluation showed that the output worked quite well in answering questions in scientific articles in the GARUDA Computer Science & IT indexed journal, especially on web-based subtopics.Keywords: chatbot, RAG, LLM, GARUDA Kemdikbud 

Copyrights © 2024






Journal Info

Abbrev

JTI

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

Journal of Telematics and Informatics (e-ISSN: 2303-3703, p-ISSN: 2303-3711) is an interdisciplinary journal of original research and writing in the wide areas of telematics and informatics. The journal encompasses a variety of topics, including but not limited to: The technology of sending, ...