Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Bulletin of Computer Science Research

Implementasi Langchain dan Large Language Models Dalam Automatic Question Generation Untuk Computer Assisted Test Novri Rahman; Harahap, Nazruddin Safaat; Affandes, Muhammad; Pizaini
Bulletin of Computer Science Research Vol. 5 No. 4 (2025): June 2025
Publisher : Forum Kerjasama Pendidikan Tinggi (FKPT)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/bulletincsr.v5i4.558

Abstract

The advancement of Artificial Intelligence (AI), particularly Large Language Models (LLM), presents new opportunities in transforming educational assessment systems. This study aims to implement the LangChain framework integrated with LLM for an Automatic Question Generation (AQG) system within a Computer Assisted Test (CAT) platform, using eleventh-grade Biology subject matter as a case study. The methodology includes data collection from PDF-based instructional materials, text embedding using Facebook AI Similarity Search (FAISS) as the knowledge base, and automatic question generation through the GPT-4o model. The system is developed using a microservices architecture comprising frontend and backend services built with the Next.js, FastAPI, and Express.js frameworks. System evaluation was conducted using the User Acceptance Test (UAT) and the DeepEval framework. The evaluation results show a teacher satisfaction rate of 92.7% and a positive response from students at 67.5%. Meanwhile, the DeepEval assessment reported average scores of 3,69% for hallucination, 97,44% for contextual precision, 83,30% for contextual relevancy, 70,63% for answer relevancy, and 92,47% for prompt alignment. These findings indicate that the integration of LangChain and LLM is effective in generating contextually accurate and relevant questions, although improvements are still needed in answer relevancy. This study is expected to provide an efficient solution for digital-based educational assessment and contribute to future developments in educational AI.
Co-Authors Abdul Aziz Ahmad Efendi Al Fajri Albis Ya Albi Aldri Permana, Lutfi Alwis Nazir Alwis Nazir Alwis Nazir Amany Akhyar Amany Akhyar Amany Akhyar Andrian Wahyu Ardelia, Adinda Abidah Asmarita Asmarita Badri Yusuf Baehaqi Chandra, Reski Mai citra ainul mardhia putri Destri Putri Yani Dhymas Julyan Riyanto Eka Pandu Cynthia Elin Haerani Elin Haerani Elin Haerani Elvia Budianita Elvina Afriani Fadhilah Syafria Fatmawati Fatmawati Febi Yanto Fikry, Muhammad Fitri Insani Fitri Insani Fitri Wulandari Fitri Wulandari Gunawan Setia Wiguna Gusti, Siska Kurnia Harahap, Nazaruddin Safaat hariansyah, Aldi imelda amuis Iqbal Salim Thalib Iwan Iskandar Iwan Iskandar Iwan Iskandar Jasril Jasril Jasril Jasril Kana Saputra S Khairul Amri Khonofi, Khoidir Kurniansyah, Juliandi Lola Oktavia Mar'arif, Muhammad Mulky Marlina, Resti Muhammad Fikry Muhammad Irsyad Muhammad Irsyad Muhammad Ridha Muhammad Rizky Ramadhan Nazruddin Safaat Nazruddin Safaat H Nazruddin Safaat H Nazruddin Safaat H Novi Yanti Novialdi T Novri Rahman Novri Yanto Novriyanto Novriyanto Novriyanto Nurhapiza, Nurhapiza Oktavia, Lola Pizaini Pizaini Prameswari, Putri Rahmad Kurniawan Raja Sultan Firsky Ramu Will Sandra Reski Mai Candra Reski Mai Candra Reski Mai Candra Reski Mai Candra Reski Mai Candra Reski Mai Candra Rindi Yani Rometdo Muzawi, Rometdo Roni Setyawan Saputra, Rozi Sarah Lasniari Sarah Lasniari Surya Andika Suwanto Sanjaya Syarifuddin Syarifuddin Tania, Windy Teddie Darmizal Teddie Darmizal Thomas Alva Edison Tri Prastio Nugroho Wedi Kurniawan Wirasatria Putra Yazid, Fathuddin Yelfi Vitriani Yelfi Vitriani Zuriati Ardila Safitri