Lontar Komputer: Jurnal Ilmiah Teknologi Informasi
Vol 15 No 03 (2024): Vol.15, No. 3 December 2024

QnA Chatbot with Mistral 7B and RAG method: Traffic Law Case Study

Muhammad Roiful Anam (Universitas Islam Nahdlatul Ulama Jepara)
Agus Subhan Akbar (Unknown)
Heru Saputro (Unknown)



Article Info

Publish Date
31 Jan 2025

Abstract

Mistral 7B is a language model designed to achieve high efficiency and performance in handling Natural Language Processing (NLP). This research will evaluate the model's effectiveness in legal data processing using the Retrieval-Augmented Generation (RAG) method, focusing on road traffic and transportation law No 22/2009. The system was built using the LangChain framework, followed by fine-tuning the model and evaluated using BERTScore. Results showed that the fine-tuned Mistral 7B achieved an F1 score of 0.9151, higher than the version without fine-tuning (0.8804) and GPT-4 (0.8364). To improve accuracy, the model utilizes specific keywords that make it easier to find relevant data. Fine-tuning was shown to enhance precision, while the use of key elements in questions helped the model focus more on important information. The results are expected to support the development of artificial intelligence (AI) in Indonesia's legal system and provide practical guidance for applying AI technology in other areas of law.

Copyrights © 2024






Journal Info

Abbrev

lontar

Publisher

Subject

Computer Science & IT

Description

Lontar Komputer [ISSN Print 2088-1541] [ISSN Online 2541-5832] is a journal that focuses on the theory, practice, and methodology of all aspects of technology in the field of computer science and engineering as well as productive and innovative ideas related to new technology and information ...