Jurnal Ilmiah Research and Development Student
Vol. 4 No. 2 (2026): Juni : Jurnal Ilmiah Research and Development

Pengembangan Sistem Informasi Otomotif Berbasis Chatbot Menggunakan DeBERTa

Fadhel Putra Felmi (Universitas Tarumanagara)
Viny Cristanti M (Universitas Tarumanagara)



Article Info

Publish Date
30 Jun 2026

Abstract

is study aims to develop an automotive chatbot system capable of providing contextual, accurate, and reference-based responses using the Retrieval-augmented generation (RAG) approach. Conventional automotive information services often face limitations in delivering relevant technical information quickly and accurately. Large Language Models (LLMs) provide natural responses but still suffer from hallucination issues that may reduce answer reliability.To address this limitation, the proposed system integrates semantic retrieval using Multilingual E5 and reranking using DeBERTa v3 before generating responses through a Large Language Model. User queries and automotive documents are transformed into semantic vector representations, enabling retrieval based on contextual similarity rather than keyword matching. Retrieved documents are subsequently reranked to improve contextual relevance before being used as supporting knowledge during answer Generation.The system is implemented as a web-based application and evaluated using retrieval metrics and the RAGAS framework. Experimental results indicate that the proposed approach improves contextual understanding and answer relevance while reducing the possibility of hallucinated responses. The developed chatbot demonstrates the potential of Retrieval-augmented generation for supporting intelligent automotive information services. The evaluation results show that the proposed system achieved a Faithfulness score of 1.000, an Answer Relevancy score of 0.883, and a Context Precision score of 1.000. These results indicate that the integration of Multilingual E5 and DeBERTa v3 successfully improves contextual relevance while reducing the risk of hallucinated responses

Copyrights © 2026






Journal Info

Abbrev

jis

Publisher

Subject

Religion Decision Sciences, Operations Research & Management Economics, Econometrics & Finance Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice

Description

Jurnal Ilmiah Research and Development Student, ISSN: (cetak), ISSN: (online) adalah jurnal yang ditujukan untuk publikasi artikel ilmiah yang diterbitkan oleh CV ALIMS Publishing . Jurnal Ilmiah Research and Development Student merupakan platform publikasi jurnal Karya suatu hasil penelitian ...