Jurnal Bumigora Information Technology (BITe)
Vol. 6 No. 2 (2024)

Improving Large Language Model’s Ability to Find the Words Relationship

Alam, Sirojul (Unknown)
Abdul Jabar, Jaka (Unknown)
Abdurrachman, Fauzi (Unknown)
Suharjo, Bambang (Unknown)
Rimbawa, H.A Danang (Unknown)



Article Info

Publish Date
09 Nov 2024

Abstract

Background: It is still possible to enhance the capabilities of popular and widely used large language models (LLMs) such as Generative Pre-trained Transformer (GPT). Using the Retrieval-Augmented Generation (RAG) architecture is one method of achieving enhancement. This architectural approach incorporates outside data into the model to improve LLM capabilities. Objective: The aim of this research is to prove that the RAG can help LLMs respond with greater precision and rationale. Method: The method used in this work is utilizing Huggingface Application Programming Interface (API) for word embedding, store and find the relationship of the words. Result: The results show how well RAG performs, as the attractively rendered graph makes clear. The knowledge that has been obtained is logical and understandable, such as the word Logistic Regression that related to accuracy, F1 score, and defined as a simple and the best model compared to Naïve Bayes and Support Vector Machine (SVM) model. Conclusion: The conclusion is RAG helps LLMs to improve its capability well.

Copyrights © 2024






Journal Info

Abbrev

bite

Publisher

Subject

Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Electrical & Electronics Engineering

Description

Jurnal Bumigora Information Technology (BITe) is one of the journals owned at Bumigora University which is managed by the Department of Computer Science. This journal is intended to provide publications for academics, researchers and practitioners who wish to publish research in the field of ...