Jurnal Ragam Pengabdian
Vol. 3 No. 2 (2026): Mei-Agustus, Sustainable Development Goals (SDGs): Multidisciplinary Perspectiv

Agnostic Multi-Source Retrieval-Augmented Generation for Documents and Database Question Answering

Dwi Setya Adi, Krisna (Unknown)
Michael Siregar, Ivan (Unknown)



Article Info

Publish Date
29 Jul 2026

Abstract

Key personnel turnover creates knowledge gaps in document-based service organizations, where information is distributed across technical specifications, operational databases, and team discussions. This study develops a multi-source Retrieval-Augmented Generation (RAG) based Question Answering (QA) system that automatically integrates heterogeneous knowledge sources through a unified source parameter. Using the Adapter Pattern, the system converts PDF/TXT documents and PostgreSQL tables into a common representation, builds a FAISS vector index, retrieves relevant context, and generates grounded answers with Gemini 2.5 Flash. Evaluation employs eight metrics and three composite scores: Knowledge Transfer Effectiveness (KTE), Multi-Source Retrieval Score (MSRS), and Answer Quality Index (AQI). Experiments were conducted on the BOND_SYS dataset using 25 Indonesian questions covering specification documents, an 8-table PostgreSQL database, and 908 developer discussion messages. Results show perfect retrieval performance (Precision@K = 1.000; MRR = 1.000) across all scenarios. The full hybrid configuration achieves the highest Overall score (0.373), while Scenario C records the highest MSRS (0.825). Scenario E obtains ROUGE-L = 0.181 and BLEU-1 = 0.196 using five manually curated reference answers. Two baseline comparisons further support this contribution: a zero-shot LLM without retrieval correctly answered only 8% of questions, while a BM25 keyword-search baseline, competitive on single-source scenarios, was outperformed on cross-referencing tasks, underscoring the added value of dense multi-source retrieval.  The findings demonstrate that integrating formal documents, structured databases, and discussion logs enhances knowledge transfer and question answering for organizational support and employee onboarding.

Copyrights © 2026






Journal Info

Abbrev

juragan

Publisher

Subject

Environmental Science Social Sciences Other

Description

Berisi hasil-hasil kegiatan pengabdian dan pemberdayaan masyarakat berupa penerapan berbagai bidang ilmu diantaranya pendidikan, ekonomi, agama, teknik, pertanian, sosial humaniora, komputer dan kesehatan yang ditulis dalam bahasa Indonesia maupun bahasa ...