Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Jurnal Teknik Informatika (JUTIF)
Kalamullah Ramli
Computer Engineering, Universitas Indonesia, Indonesia
Computer Science & IT

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Design and Evaluation of Multilayered Guardrails for Securing Large Language Model and Retrieval Augmented Generation Based Employee Recruitment Chatbots Angga Pratama; Kalamullah Ramli
Jurnal Teknik Informatika (Jutif) Vol. 7 No. 5 (2026): JUTIF Volume 7, Number 5, October 2026
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2026.7.5.5761

Abstract

Large Language Models (LLM) deployed in sensitive public services, particularly staff selection chatbot systems, are critically vulnerable to prompt injection and jailbreak attacks, yet existing guardrail solutions remain homogeneous and prone to single points of failure. This research designs, implements, and evaluates a novel multi-layered guardrail architecture based on a defence-in-depth strategy, systematically integrated across the input, retrieval, and output stages of a Retrieval-Augmented Generation (RAG) pipeline. A comparative experimental study was conducted, benchmarking the proposed architecture against state-of-the-art baselines, Llama Guard and NeMo Guardrails, across security and performance metrics. The proposed architecture achieved a Harmful Refusal Rate of 99.5% and demonstrated confirmed robustness against prompt injection, jailbreak, and data leakage vectors as validated by the Garak Vulnerability Scanner. Despite the inherent latency trade-off of layered processing, the system maintained superior efficiency with a median latency of 8.29 seconds, outperforming Llama Guard (8.80 s) and NeMo Guardrails (8.56 s). These findings establish that a defence-in-depth guardrail approach delivers an optimal balance between security and performance, and contribute a replicable architectural framework to the field of AI security for hardening LLM-RAG systems in high-stakes, public-sector deployments.
Co-Authors Angga Pratama