p-Index From 2021 - 2026
8.157
P-Index
This Author published in this journals
All Journal TEKNIK INFORMATIKA Jurnal Penelitian Saintek Teknika Jupiter Jurnal Ekonomi : Journal of Economic BISNIS: Jurnal Bisnis dan Manajemen Islam Jurnal Ushuluddin SITEKIN: Jurnal Sains, Teknologi dan Industri Islam Futura Jurnal Varidika Jurnal Ekonomi dan Bisnis Islam Orbith : Majalah Ilmiah Pengembangan Rekayasa dan Sosial Jurnal Manajemen & Supervisi Pendidikan Jurnal Teknologi dan Sistem Komputer Jurnal Akuntansi dan Pajak Jurnal CoreIT Seminar Nasional Teknologi Informasi Komunikasi dan Industri Jurnal As-Salam Sebatik Jurnal Pengabdian Masyarakat AbdiMas Jurnal Nasional Komputasi dan Teknologi Informasi JIPI (Jurnal Ilmiah Penelitian dan Pembelajaran Informatika) Jutisi: Jurnal Ilmiah Teknik Informatika dan Sistem Informasi Jurnal Teknologi Informasi dan Multimedia Jurnal Informatika dan Rekayasa Elektronik JMB : Jurnal Manajemen dan Bisnis Zonasi: Jurnal Sistem Informasi Jurnal Tekinkom (Teknik Informasi dan Komputer) JOURNAL OF INFORMATION SYSTEM MANAGEMENT (JOISM) REMIK : Riset dan E-Jurnal Manajemen Informatika Komputer Journal of Computer System and Informatics (JoSYC) JUKI : Jurnal Komputer dan Informatika Jurnal Computer Science and Information Technology (CoSciTech) Jurnal Pendidikan dan Teknologi Indonesia Jurnal Informatika Terpadu Nusantara: Journal for Southeast Asian Islamic Studies Bulletin of Computer Science Research KLIK: Kajian Ilmiah Informatika dan Komputer Bulletin of Information Technology (BIT) Jurnal Abdimas Prakasa Dakara Jurnal Teknoif Teknik Informatika Institut Teknologi Padang Malcom: Indonesian Journal of Machine Learning and Computer Science CONSEN: Indonesian Journal of Community Services and Engagement Sahabat Sosial: Jurnal Pengabdian Masyarakat SATIN - Sains dan Teknologi Informasi International Journal of Health Sciences Journal Of Artificial Intelligence And Software Engineering Media Kesehatan Politeknik Kesehatan Makassar Jurnal Indonesia : Manajemen Informatika dan Komunikasi Science, Technology, and Communication Journal Celebes Journal of Community Services
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Bulletin of Computer Science Research

Implementasi Langchain dan Large Language Models Dalam Automatic Question Generation Untuk Computer Assisted Test Novri Rahman; Harahap, Nazruddin Safaat; Affandes, Muhammad; Pizaini
Bulletin of Computer Science Research Vol. 5 No. 4 (2025): June 2025
Publisher : Forum Kerjasama Pendidikan Tinggi (FKPT)

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47065/bulletincsr.v5i4.558

Abstract

The advancement of Artificial Intelligence (AI), particularly Large Language Models (LLM), presents new opportunities in transforming educational assessment systems. This study aims to implement the LangChain framework integrated with LLM for an Automatic Question Generation (AQG) system within a Computer Assisted Test (CAT) platform, using eleventh-grade Biology subject matter as a case study. The methodology includes data collection from PDF-based instructional materials, text embedding using Facebook AI Similarity Search (FAISS) as the knowledge base, and automatic question generation through the GPT-4o model. The system is developed using a microservices architecture comprising frontend and backend services built with the Next.js, FastAPI, and Express.js frameworks. System evaluation was conducted using the User Acceptance Test (UAT) and the DeepEval framework. The evaluation results show a teacher satisfaction rate of 92.7% and a positive response from students at 67.5%. Meanwhile, the DeepEval assessment reported average scores of 3,69% for hallucination, 97,44% for contextual precision, 83,30% for contextual relevancy, 70,63% for answer relevancy, and 92,47% for prompt alignment. These findings indicate that the integration of LangChain and LLM is effective in generating contextually accurate and relevant questions, although improvements are still needed in answer relevancy. This study is expected to provide an efficient solution for digital-based educational assessment and contribute to future developments in educational AI.
Co-Authors A, Adhyatma Abd. Ghofur Abdul Aziz Abdul Aziz Abdul Ghafur Afdhalel Vickro Afdhol Rinaldi Afifah, Dhiya Dwi Ahadi, Ridho Ahmad Fauzan Ahmad Sutrio Prihatinoto Ahmad, Muhammad Iqbal Ahmad, Rizmah Zakiah Nur Aji Bayu Permadi Akbar Akbar Ali Imran Andi Nursiah , Idris , Anjar Briliannita Annis Syahzuni, Barlia Aprilia, Risma Arda, Darmi Ari Anggarani Winadi Prasetyoning Tyas Arum, Hafidza Sanshia Aryanti, Dessy Ayunda , Ayunda Fatmasari Baehaqi Bayu Dwinata Putra Yatabri Cindy , Cindy Yolanda citra ainul mardhia putri Delifah, Nur Deny Dewana Hastanto Desy Prastyani Dhymas Julyan Riyanto Eka Pandu Cynthia Ekawati, Nur Eko Saputra Elvia Budianita Elvina Afriani Elyani, Elyani Ernawati Ernawati Erry Yudhya Mulyani Erwan Baharudin Fachrul Hakim Fadhilah Syafria Fahmi Kasri Fahrezy, Irgi Fahroha, Fani Afrida Fajar Febriyadi Fatima Akmal Putri, Fatima Akmal Fauzi Ihsan Febi Yanto Febrian Rizki Adi Sutiyo Fina Tamima Annahwa Fitra Kurnia Fitra Kurnia Fitri Insani Fitri Wulandari Ganiyev, Avazbek Gunawan Setia Wiguna Hastuti Hastuti Helviansyah, Try Henry Arianto Heriyanti Idhafi, Zaky Iis Afrianty Irsyad , Muhammad Iwan Iskandar Iwan Iskandar Iwan Iskandar Iwan Iskandar Jasril Jasril Jefitra Abdu Ar Razzak Julina Julina K, Hairuddin Kasmuri Kasmuri, Kasmuri Khairiah Khairiah Khamo, Khamo Waruwu kurnia, fitra Latif, Sarifudin Andi Lawami, Reza Haya Lestari Handayani Liza Afriyanti Lubis, Anggun Tri Utami BR. M. Fahrizal M. Septrio Rafinaldo M.Faisal Harahap Mar'arif, Muhammad Mulky Masduki Masduki Maulana, Muhammad Rizky Moi, Mohammed Rizki Muhammad Affandes Muhammad Fikry Muhammad Irsyad Muhammad Irsyad Muhammad Irsyad Negara, Benny Sukma Niken Aisyah Maharani Herwanza Novi Yanti Novi Yanti Novri Kurniawan Kurniawan Novri Rahman Nugrahaini, Inten Nurhaedah , Nurhaedah Nurhayani Nurhayati , Nurhayati Okfalisa Okfalisa Oktariani Sari Oktavia, Lola Oppie, Oppie Meisya Tanjung Pannyiwi, Rahmat Pizaini Pizaini Pizzaini Pizzaini Poppy Gus Silviana Pratiwi, Reski Dewi Putri, Nadia Sandi Rahmad Kurniawan Rasyid, Djusmadi Reski Mai Candra Reski Mai Candra Reski Mai Candra Rina Anindita Rini Susanti Rita Musdalifah Rosidi, Imron Royhisar Martahan Simanungkalit Ruqaiyah, Ruqaiyah Rusnita, Rusnita Safiani A. Faaroek Saparuddin Siregar Saputra, Ikhsan Dwi Sari, Lydia Permata Sari, Oktariani Satriawan, Agus Serli, Serli Setiyati, Ritta Silfia Silfia Silitonga, Evalina Siregar, Siti Nurholiza Suci Rahayu Sugandi, Hatami Karsa Suharna, Jaka Suhartini Suhartini Surya Agustian Suwanto Sanjaya Syam, Rosida Teddie Darmizal Tondok, Theresa Umar, Risa Bernadip Usman Usman Vita Intan Safitri Wedi Kurniawan Wijaya, Andy Huang Windarti, Sriyani Yanuar Ramadhan Yermi, Yermi Yulis, Dian Meiliani Yusra Yusra, Yusra Zahirah, Qonitah Rifda Zuriani Rizki