Claim Missing Document
Check
Articles

Found 31 Documents
Search

A comparative analysis of five textual similarity methods for automatic short answer grading Bakti, Imam Rangga; Jati, Handaru; Nurkhamid, Nurkhamid; Bunda, Yola Permata
Journal of Soft Computing Exploration Vol. 7 No. 1 (2026): March 2026
Publisher : SHM Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52465/joscex.v7i1.11

Abstract

This study investigates the application of text mining techniques in Automatic Short Answer Grading (ASAG) by comparing five textual similarity methods: Cosine Similarity, Jaccard Similarity, Dice’s Coefficient, Overlap Coefficient, and Matching Coefficient. The dataset consists of five definition-based questions answered by 25 students in a Human–Computer Interaction course. The data were preprocessed using case folding, tokenization, stop word removal, and stemming. The results show that Cosine Similarity achieved the highest similarity score of 67.00%, followed by Overlap Coefficient (66.67%) and Dice’s Coefficient (63.16%), while Jaccard Similarity and Matching Coefficient produced lower scores of 46.15%. These findings indicate that vector-based similarity methods are more effective in handling variations in sentence structure and keyword usage compared to set-based approaches, particularly for definition-based short answers. This study provides a comparative evaluation of multiple lexical similarity methods within a unified experimental setting, offering practical insights for selecting appropriate techniques in ASAG applications.
Co-Authors AA Sudharmawan, AA Afriansyah Afriansyah Afriansyah Agus Kartini, Siti Ahmad Sumantri - Alifiansyah, Eldi Anwar Syahputra, Syofyan Anwar Syaputra, Sofyan Asep Supriyanto Ayoe Jumala, Tjik Ayu Fitriani Baginda Harahap Bakti, Imam Rangga Budi Harianto Catra Indra Cahyadi Chairu Sabila, Puji Cut Try Utami Cut Try Utari Cut Try Utari Deni Oktavia, Deni Dila Handayani Eddis Syahputra Pane, Eddis Syahputra Elyani, Elyani Erni Rouza, Erni Fahmi, Muhammad Ikhwan Fariza Habibi hajatina hajatina Handaru Jati HAPOSAN HUTAHAEAN Hardianto, Roki Haryadi, Octadino Hasibuan, Wahyu Hendri Maradona, Hendri Herri Trisna Frianto, Herri Trisna Imam Rangga Bakti Intan Zarina binti Raja Zaki Hashim, Raja Iskandar Zulkarnain, Wisnu Jhoni Hidayat Kartini, Siti Agus Kurniawan Sinaga Legito M. Yogi Riyantama Isjoni Meidi Wani Lestari, Meidi Wani Muhammad Fadlan Siregar Muhammad Fadlan Siregar Muhammad Rusdi Nasution, Muhammad Romi Nelisa, Nelisa Novendra, Rizki Nurkhamid, Nurkhamid Nurul Afni Nurul Afni Pane, Eddissyah Putra Ridwan Syahputra Rifqi, Mi'rajul Riki Adriant Romi Nasution, Muhammad Sabariah Sabariah Santri Kusuma, Budhi Satria Riki Mustafa, Satria Riki Sofyan Anwar Syahputra Sulaiman, Abidin Suprianto Supriyanto, Asep Syafriwel, Syafriwel Syahputra Pane, Eddis Syahputra, Syofyan Anwar Syahtriatna Djusar Syofyan Anwar Syahputra Taufik Ismail Simanjuntak Tomi Abdilah Toresa, Dafwen Trisna Frianto, Herri Turnandes, Yogo Ulum, Zahrul Ulya, Siti Utami, Urfi Walhidayat Wirdahchoiriah Yogi Irawan