Claim Missing Document
Check
Articles

Found 22 Documents
Search

Comparative Performance of Retrieval Augmented Generation Tourism Chatbots: Kinerja Komparatif Retrieval Augmented Generation pada Chatbot Pariwisata Farizi, Amar Al; Arsi, Primandani; Subarkah, Pungkas
Indonesian Journal of Innovation Studies Vol. 27 No. 1 (2026): January
Publisher : Universitas Muhammadiyah Sidoarjo

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21070/ijins.v27i1.1836

Abstract

General Background: The rapid adoption of artificial intelligence in smart tourism has increased the use of contextual chatbots to deliver destination information efficiently. Specific Background: However, tourism chatbots based on Large Language Models frequently encounter information hallucination, reducing reliability when handling dynamic and local tourism data. Knowledge Gap: Existing studies mainly focus on rule-based or single-model chatbot implementations and provide limited comparative evaluation of Retrieval Augmented Generation configurations combining embedding models and Large Language Models. Aims: This study aims to comparatively evaluate multiple Retrieval Augmented Generation configurations to identify the most suitable combination for contextual tourism chatbots and to analyze differences between large multilingual and small monolingual embedding models using a local tourism dataset. Results: Experimental evaluation using data from 49 tourist destinations in Banyumas Regency shows that the Multilingual-E5-Large embedding model consistently achieves perfect Precision, Recall, and F1-Score across all tested Large Language Models. The combination of Multilingual-E5-Large and GPT-4.1-Mini demonstrates the most balanced performance, achieving a BERTScore F1 of 0.7515 with an average response time of 1.555 seconds. Novelty: This research provides a systematic comparative assessment of embedding capacity and Large Language Model selection within a unified Retrieval Augmented Generation framework for tourism chatbots. Implications: The findings offer practical guidance for selecting model configurations that ensure accurate retrieval, high-quality responses, and efficient system performance in contextual tourism information services. Highlights • Multilingual embedding models deliver consistently higher retrieval accuracy across all tested configurations• GPT-4.1-Mini produces the most balanced generative quality and response latency• Embedding model selection plays a more decisive role than language model variation Keywords Retrieval Augmented Generation; Tourism Chatbot; Large Language Model; Embedding Model; Comparative Evaluation
Pendampingan Media Pembelajaran Berbasis Artificial Intelligence Untuk Meningkatkan Kinerja Guru Subarkah, Pungkas; Arsi, Primandani; Rofiqoh, Dayana; Anggraeni, Ratih; Riyanto
Society : Jurnal Pengabdian dan Pemberdayaan Masyarakat Vol. 7 No. 1 (2026): Vol. 7 No. 1, April 2026
Publisher : Universitas Dinamika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.37802/society.v7i1.1268

Abstract

One institution that plays a role in education is the school. Their contribution to the development of high-quality human resources for a country's advancement is very important, namely, educators or teachers. Therefore, the position of learning is very important to continue to be the driving force for learning units or schools so that they can continue to improve the quality of learning or the quality of learning for their students. One way to improve the quality of educators or teachers is by improving teacher performance. The purpose of this service is to improve teacher performance through artificial intelligence training, in order to add to and improve teacher performance in the current era at SMA Negeri 1 Banyumas. The methods used to carry out this activity included the preparation stage, the implementation stage, and the evaluation stage. The results obtained from the mentoring of learning media based on artificial intelligence showed that the 31 participating teachers experienced an increase in their knowledge and skills, as evidenced by the post-test results, which scored 91%. It is hoped that similar training will continue to be carried out in the future.