ANALISIS KOMPARATIF EFEKTIVITAS RULE-BASED CHATBOT DAN GENERATIVE AI CHATBOT DALAM MENDUKUNG LAYANAN AKADEMIK BERBASIS SMART CAMPUS

Agung Tantra Sepzulfi (STIKOM Tunas Bangsa Pematang Siantar)
Irvan Haviz (STIKOM Tunas Bangsa Pematang Siantar)

Jurnal Inovasi Artificial Intelligence & Komputasional Nusantara
Vol. 5 No. 1 (2026): Volume 5 No 1 Tahun 2026

ABSTRAK Perkembangan kecerdasan buatan (Artificial Intelligence/AI) telah mendorong transformasi layanan akademik di perguruan tinggi menuju paradigma Smart Campus. Namun, implementasi chatbot tunggal sering dihadapkan pada masalah trade-off antara kecepatan respons dan fleksibilitas bahasa. Penelitian ini mengusulkan kebaruan (novelty) berupa perancangan dan analisis Hybrid Chatbot Architecture yang mengintegrasikan Rule-Based Engine (Jaccard Similarity) dan Generative AI Engine (RAG berbasis Gemini API) melalui mekanisme Decision Router. Penelitian menggunakan metode kuantitatif komparatif berbasis eksprimen prototype dengan melibatkan 60 responden mahasiswa aktif yang dipilih menggunakan teknik purposive sampling. Evaluasi kinerja komparatif dilakukan pada lima dimensi utama: akurasi respons, response time, kepuasan pengguna, naturalness komunikasi, dan usability. Hasil penelitian menunjukkan bahwa Generative AI Chatbot memperoleh skor unggul pada dimensi akurasi respons (92.4% vs 83.4%), kepuasan pengguna (mean 4.37 vs 3.82), naturalness komunikasi (mean 4.56 vs 3.41), dan usability System Usability Scale/SUS (80.3 vs 71.5). Sementara Rule-Based Chatbot menunjukkan keunggulan signifikan pada aspek response time (215 ms vs 1.207 ms). Uji Independent Sample T-Test mengonfirmasi perbedaan yang signifikan secara statistik ($p < 0.05$) pada sebagian besar dimensi evaluasi. Penelitian ini menyimpulkan bahwa integrasi arsitektur hybrid yang diusulkan berhasil menjadi solusi optimal untuk Smart Campus di Indonesia dengan merekonsiliasi kecepatan model aturan dan kecerdasan model generatif secara simultan. Kata Kunci: Hybrid Chatbot Architecture, Generative AI, Smart Campus, Decision Router, Retrieval-Augmented Generation (RAG), User Satisfaction. ABSTRACT The development of Artificial Intelligence (AI) has driven the transformation of academic services in higher education towards a Smart Campus paradigm. However, single chatbot implementations often face a trade-off between response speed and language flexibility. This study proposes a novelty by designing and analyzing a Hybrid Chatbot Architecture that integrates a Rule-Based Engine (Jaccard Similarity) and a Generative AI Engine (RAG based on Gemini API) via a Decision Router mechanism. This research employs a comparative quantitative method based on prototype experimentation, involving 60 active student respondents selected using a purposive sampling technique. Comparative performance evaluation was conducted across five main dimensions: response accuracy, response time, user satisfaction, communication naturalness, and usability. The results indicate that the Generative AI Chatbot achieved superior scores in response accuracy (92.4% vs 83.4%), user satisfaction (mean 4.37 vs 3.82), communication naturalness (mean 4.56 vs 3.41), and System Usability Scale (SUS) scores (80.3 vs 71.5). Meanwhile, the Rule-Based Chatbot demonstrated significant advantages in response time (215 ms vs 1,207 ms). The Independent Sample T-Test confirmed statistically significant differences ($p < 0.05$) across most evaluation dimensions. This study concludes that the proposed hybrid architecture successfully serves as the optimal solution for Smart Campus in Indonesia by simultaneously reconciling the speed of the rule-based model and the intelligence of the generative model. Keywords: Hybrid Chatbot Architecture, Generative AI, Smart Campus, Decision Router, Retrieval-Augmented Generation (RAG), User Satisfaction.