Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Media Elektrik
Ali Asgar Zainal Abidin
Institut Teknologi Sains dan Bisnis Muhammadiyah Selayar, Indonesia
Computer Science & IT Control & Systems Engineering Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Development and Evaluation of an Indonesian Thesis-Title Similarity Detection System Using Hybrid TF-IDF–SBERT Retrieval and LightGBM Reranking Abdul Ma'arief Al Imran; Mursyid Ardiansyah; Ali Asgar Zainal Abidin
Jurnal Media Elektrik Vol. 23 No. 3 (2026): MEDIA ELEKTRIK
Publisher : Jurusan Pendidikan Teknik Elektro

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.59562/metrik.v23i3.14414

Abstract

This study developed and evaluated an Indonesian thesis-title similarity detection system to support the early screening of potentially similar research titles. The reference corpus consisted of 28,117 unique thesis titles collected from a publicly accessible institutional repository. The system integrates TF-IDF-based lexical retrieval, SBERT-based semantic retrieval, Union Top-K candidate selection, and machine learning reranking. Logistic Regression, XGBoost, and LightGBM were trained using threshold-derived pseudo-labels, while the final model performance was evaluated on an independent human-validated dataset constructed from a title-disjoint evaluation partition. A total of 900 candidate title pairs were independently assessed by two academic validators, achieving a Cohen’s kappa of 0.877. LightGBM achieved the best performance, with an accuracy of 94.67% and a macro F1-score of 0.9467. ISO/IEC 25010 evaluation showed a 100% functional pass rate, an 84.17% usability score, performance scores of 92.3% on mobile and 96.8% on desktop, while the automated security assessment categorized the staging deployment as Fairly Secure with two medium-risk findings. The system can support academic title-similarity screening; however, its generalizability remains limited by the use of a single-institution corpus and requires further multi-institutional validation.
Co-Authors Abdul Ma’arief Al Imran Mursyid Ardiansyah