Jurnal Teknologi Informasi dan Multimedia
Vol. 8 No. 2 (2026): May

Evaluasi Sistem Retrieval-Augmented Generation Berbasis Low-Code dalam Meningkatkan Akurasi Konseptual Pembelajaran Sosiologi

Rusmanto Rusmanto (Program Studi Sistem Informasi, Sekolah Tinggi Teknologi Terpadu Nurul Fikri)
Jasrino Maulana Putra (Program Studi Sistem Informasi, Sekolah Tinggi Teknologi Terpadu Nurul Fikri)



Article Info

Publish Date
29 May 2026

Abstract

The utilization of Large Language Models (LLMs) in higher education offers significant efficiency, yet it introduces critical risks of information hallucination and conceptual bias, particularly in the discipline of Sociology. This study aims to evaluate the performance of a Retrieval-Augmented Generation (RAG) system based on the low-code platform n8n as a robust solution for hallucina-tion mitigation. The system integrates semantic search using Supabase as a vector database and the Gemini 2.5 Flash model to restrict response generation exclusively to verified academic litera-ture. The research employed an Experimental Single-System Evaluation method with a du-al-evaluation approach (quantitative and qualitative) across 50 test instruments. Quantitative testing using the ROUGE-L metric recorded a mean score of 0.354, indicating adequate structural similarity despite variations inherent to the paraphrasing nature of LLMs in analytical tasks. Thematic qualitative analysis of evaluator comments revealed 98.2% positive sentiment, with the dominant theme being “Conceptually Accurate”. Ultimately, 100% of the expert panel declared the system suitable for implementation as a reliable supplementary learning medium.

Copyrights © 2026






Journal Info

Abbrev

jtim

Publisher

Subject

Computer Science & IT

Description

Cakupan dan ruang lingkup JTIM terdiri dari Databases System, Data Mining/Web Mining, Datawarehouse, Artificial Integelence, Business Integelence, Cloud & Grid Computing, Decision Support System, Human Computer & Interaction, Mobile Computing & Application, E-System, Machine Learning, Deep Learning, ...