Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Electrical Engineering and Computer Science
Constantinus Satrio
Bina Nusantara University

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Complexity aware cascade architecture for improving user satisfaction in conversational AI Constantinus Satrio; Devi Fitrianah
Indonesian Journal of Electrical Engineering and Computer Science Vol 42, No 1: April 2026
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijeecs.v42.i1.pp205-214

Abstract

Conventional task-oriented chatbots frequently suffer from task incompletions and low user satisfaction when handling complex queries. This research intro duces the complexity aware cascade, an adaptive architecture that improves user service quality by dynamically matching query complexity with the appropri ate computational response. The system uses confidence and relevance scores to intelligently route requests through a sequence of a natural language under standing (NLU) model, a retrieval-augmented generation (RAG) pipeline, or a large language model (LLM). The tiered architecture was evaluated via a ran domized controlled trial (RCT) with 150 participants, measuring task success and user satisfaction. The full cascade achieved a 90% journey completion rate, representing a 92.3% improvement over baseline system and substantial gains in SERVQUAL-based service quality scores. The experiment was conducted in a domain-specific knowledge base (essential oils) with a convenience sam ple that does not represent the global population, and no real-time deployment or long-term cost analysis was performed. Accordingly, the findings should be interpreted as evidence of effectiveness in a limited setting rather than as directly scalable to all domains. Even with these limitations, this study provides arigorously tested blueprint for developing more robust and user-centric conversational AI systems.
Co-Authors Devi Fitrianah