Article Per Year (5 Year)
p-Index From 2021 - 2026
6.793
P-Index
This Author published in this journals
All Journal Jurnal Simetris Jurnal Informatika dan Teknik Elektro Terapan Sistemasi: Jurnal Sistem Informasi Jurnal Sisfokom (Sistem Informasi dan Komputer) WIDYABHAKTI Jurnal Ilmiah Populer Jurnal Riset Informatika JURNAL MANAJEMEN BISNIS JOISIE (Journal Of Information Systems And Informatics Engineering) Journal of Information Systems and Informatics bit-Tech Zonasi: Jurnal Sistem Informasi JATI (Jurnal Mahasiswa Teknik Informatika) INFORMASI (Jurnal Informatika dan Sistem Informasi) JPKMI (Jurnal Pengabdian Kepada Masyarakat Indonesia) Jurnal Layanan Masyarakat (Journal of Public Service) Jifosi Nusantara Science and Technology Proceedings Jurnal Pendidikan dan Teknologi Indonesia Jurnal Informatika dan Teknologi Komputer ( J-ICOM) Jurnal Ilmiah Wahana Pendidikan International Journal Of Computer, Network Security and Information System (IJCONSIST) AJARCDE (Asian Journal of Applied Research for Community Development and Empowerment) Journal of Computer Science and Information Systems (JCoInS) Journal of Governance and Administrative Reform Jurnal Sistem Informasi dan Bisnis Cerdas Eduvest - Journal of Universal Studies MDP Student Conference ILTEK : Jurnal Teknologi Scientica: Jurnal Ilmiah Sains dan Teknologi
Pratama, Arista
Unknown Affiliation
Religion Aerospace Engineering Agriculture, Biological Sciences & Forestry Humanities Chemical Engineering, Chemistry & Bioengineering Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Earth & Planetary Sciences Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Health Professions Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Materials Science & Nanotechnology Mechanical Engineering Medicine & Pharmacology Neuroscience Public Health Social Sciences Other

Published : 57 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : bit-Tech

 1 
Performance Analysis of Reasoning Models in RAG-Based Question Answering System for University Admission Services Setiawan, Muhammad Surya Adhi; Pratama, Arista; Ananto, Prasasti Karunia Farista
bit-Tech Vol. 8 No. 3 (2026): bit-Tech
Publisher : Komunitas Dosen Indonesia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.32877/bt.v8i3.3707

Abstract

Access to accurate, relevant, and timely information is crucial for prospective university students; however, conventional information services often struggle with high query volumes and the risk of generative hallucinations in automated systems. This study investigates whether reasoning-oriented large language models provide measurable improvements in response quality within a Retrieval-Augmented Generation (RAG) architecture for university admission services. The study hypothesizes that internal chain-of-thought reasoning improves factual grounding compared with non-reasoning models under identical retrieval conditions. A vector-based institutional knowledge base was constructed from 30 official admission sources using VoyageAI embeddings and evaluated on a multilingual dataset of 353 real-world inquiries in Indonesian, English, and Javanese dialects. To isolate the effect of reasoning capabilities, retrieval outputs and prompt configurations were controlled across all models. Performance was evaluated using the RAGAS framework across six models categorized as reasoning (DeepSeek-R1, Gemini-2.5-Flash, o4-mini) and non-reasoning (DeepSeek-V3, Gemini-2.0-Flash, GPT-4o-mini). The results show that reasoning models achieved a higher average RAGAS score (0.7772) than non-reasoning models (0.7289), representing a 6.63% improvement, with the largest gain observed in factual correctness (+15.95%). Additional multilingual benchmarking confirmed that reasoning models maintain more stable performance across languages. Gemini-2.5-Flash achieved the highest composite score (0.8207) while maintaining favorable cost efficiency. These findings indicate that reasoning-enabled models significantly improve factual reliability in domain-specific RAG systems, although overall system performance remains strongly dependent on retrieval quality.
Co-Authors abda Taqiya, Namira Achmadha, Zharvi Adelia Sefri Larasati Adha, Didan Rizky Agussalim, Agussalim Alief, Muhammad Dian Nur Angelina Naibaho, Anna Vita Anggela, Vanesa Wanda Ardika Nurmawati, Ardika Artanto, Aphief Tri Asif Faroqi Asif Faroqi, Asif Cholid Fadil Cyndya, Cyndya Nandhany Damaira, Bfindah Diva Dafina Amajida Dwi Permana, Abiyoga Elfirdaus, Ivana Endang Sholihatin Erifiandi, Edwin Erwan Adi Saputro Fadillah, Ainun Rizkyani Fahroz Dwi Pratiwi Faradila, Anggita Firosya, Ardilla Han Familiya Hanum, Apriliana Latifah Harnit Putri, Callista Harun Al Rasyid Harya, Gyska Indah Hilman, Muhammad Irsyadhie, Muhammad Rafi Junior, Dannie M. Mulay kusnarto, kusnarto Kusuma Dewi, Faradila Kusumaningayu, Apriliana Pramesinta Leilani, Ailsa Belinda Lestari, Cynthia Widya Luh Putu Ratna Sundari Maya Safitri, Eristya Meirina, Filda Dwi Mohamad Irwan Afandi Muhdi, Nalini Nanang Haryono Naufal, Muhammad Rakha Nisrina, Nasywa Agra Noor, Talenta Ekklesia Odilio Bintang Mutis, Aloysius Paramita S., Amanda Prasasti Karunia Farista Ananto Pulungan, Lawaahizh Hanifah Putra, Andre Yusuf Trisna Putra, Muhammad Rizki Erlangga Putri, Gizka Refyana Putri, Rhizma Elliza Putri, Syachla Malikha Rahma, Faradhiya Aulia Reza Fatahillah, Muhammad Ridwandono, Doddy Sabila, Radhiya Safira Az Zahrah, Alfi Safitri , Eristya Maya Safitri, Eristya Maya Saputra, Brahmantya Adi Saputra, Dimas Dicky Sasongko, Septiono Raka Wahyu Satria Kurniawan, Ade Setiawan, Muhammad Surya Adhi Shantika, Nurisa Rahma Sholihatin, Endang Sholihatin Sillehu, Fidyah Salsabila Putri Sinaga, Dwianna Sukirmiyadi, Sukirmiyadi Suryantari, Putu Anggi Suwandi, Safitri Pradhista Swasti, Ika Korika Tri Puspa Rinjeni Vianetra, Bayu Prasetya Virdha Rahma Aulia Wanti Mindari Wati, Seftin Fitri Ana Widya Pratiwi Wulansari, Anita