Claim Missing Document
Check
Articles

Development of Sentence Similarity Detection Application with Semantic Similarity and Machine Learning Approaches (Case Study: Student Thesis Title) Suhardi rahman, Edi; Iswal Burhan, Muhammad; T Mangesa, Riana
Jurnal Media Elektrik Vol. 23 No. 1 (2025): MEDIA ELEKTRIK
Publisher : Jurusan Pendidikan Teknik Elektro

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.59562/metrik.v23i1.10503

Abstract

This study aims to develop an intelligent application for detecting the semantic similarity of undergraduate thesis titles using Natural Language Processing and machine learning techniques. The need for this system arises from the growing number of thesis title submissions in Indonesian universities, which increases the risk of duplication and challenges the effectiveness of manual novelty-verification processes. The development follows a Research and Development (R&D) approach consisting of needs analysis, NLP model development, implementation, and evaluation. A dataset of 114 thesis titles was collected from official academic archives, with 87 titles remaining after data cleaning for the model benchmarking. The Sentence-BERT (IndoSBERT) model is used as the core of the semantic similarity engine, achieving an accuracy of 93% and an F1-score of 0.90, outperforming traditional approaches such as TF-IDF and LSA. System evaluation was conducted based on ISO/IEC 25010, showing strong performance in functional suitability, time behavior (average response time 1.82 s), reliability (100% uptime/24 h), and usability evaluated by 25 respondents using the SUS instrument (score = 80, excellent). The results indicate that the proposed system can significantly assist study programs in identifying potential topic duplications and strengthening academic governance. However, the limited dataset size and single-domain scope (engineering and informatics education) restrict the model’s generalizability. Future development may include larger multi-domain datasets and broader novelty evaluation coverage, such as proposals and abstracts. This study contributes to practical automation support and technological innovation for academic quality assurance.
Co-Authors A. Astri Surya Ramadani Abdan Syakur, Abdan Abdul Djawad , Yasser Abdul Haliq Abdul Ma’arief Al Imran Abdul Muis Mappalotteng Adriyansah Adriyansah Ahmad Hidayat Adam Ahmad Muflih Akbar Jafar Al Imran Al Imran, Abdul Ma’arief Alfiya NFH Alifya NFH Alifya NFH Alifyah NFH Alisa Yuliarsih Almunawati, Natasya Amal Akbar Amukune, Stephen Andi Imran Anjas Mara Anzar Anzar, Anzar Aqsha, Ismail Arifiyanti, Fitria Aryandani, Nurhadits Carella Asis Nojeng Aspandi, Ade Aulia, Wilda Ayu Tri Wardani Ayu Tri Wardani Baharman Baharman, Baharman Bakri, Hasrul Baso, Fadhlirrahman Dandi Dandi Darmawan, Fitrah Dasmayanti Lestari Dewi Fatmarani Surianto Dyah Vitalocca Dyah Vitaloka Fajryanisari , Indah Fathahillah Fathahillah Firdaus Firdaus Gowa, Srijadi Hafid, Ichsan Kamil A Haripuddin . Haripuddin Haripuddin Hasrul Hasrul Helda Ibrahim Herawati Herawati Herawati Hisyam, Muhammad Fadhil I Nyoman Adi Putra Iswal Burhan, Muhammad Iwan Suhardi Jamaluddin Jamaluddin Jumadi Mabe Parenreng Karim, Sugeng A Karim, Sugeng A. M. Miftach Fakhri Mangesa, Riana T Massikki, Massikki Mega Putri Pamuso , Noviola Miftahul Khair Mahpul Muh Nasir Malik Muh Usman Mustari Muh. Iswal Burhan Muh. Nasir Malik Muh. Usman Mustari Muhammad Ihsan Maro Muhammad Ihsan Maro Muhammad Yusuf Mappeasse Muis Mappalotteng , Abdul Muliana, Hanana Mursyid Ardiansyah Namira Aprisani Namirah Aprisani NFH, Alifya Ni Komang Yuliani Nur Luthfiyani Fajrin Mima Nurfitrah Sasrianita Nurfitrah Sasrianita Nurhusna Nurrahman Qishas. H, A.M Nurul Iftitah Mutmainnah Ismail Nurul Mukhlisa Abdal Nurul Mukhlisa Abdal Ramadani, A. Astri Surya Riana T Mangesa Riana T. Mangesa Riana T. Mangesa Rusdin, Rosmala Ruslan Ruslan Ruslan Ruslan S Lamada, Mustari S, Aprilianti Nirmala Sugeng A. Karim Syacitra Arli S Syacitra Arli S Syahrul Syahrul Syarifuddin Kasim T Mangesa, Riana Taris, Lu'mu Tjandi, Yunus Uleng, A. Pattapari Wardani, Ayu Tri Widiya, Citra Wiwi Arianti Yasdin, Yasdin Yusuf Mappeasse, Muhammad Zainuddin, Zainuddin Zulhajji, Zulhajji