Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Khazanah Journal of Religion and Technology
Muhammad Rizki Al-Fathir
Unknown Affiliation
Religion Computer Science & IT Engineering Languange, Linguistic, Communication & Media Social Sciences

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Evaluation of DistilBERT and BiLSTM Models for the Development of Islamic Chatbots Based on Tag Classification Muhammad Rizki Al-Fathir; Muhammad Saifurridwani 'Ijazi; Nabila Lailatanzila; Nirwan Rasyid Ridlo; Riza Anwar Fadil
Khazanah Journal of Religion and Technology Vol. 4 No. 1 (2026): June
Publisher : Asosiasi Khazanah Cendekia

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.15575/qa9xcq55

Abstract

This study evaluates the performance of DistilBERT and Bidirectional Long Short-Term Memory (BiLSTM) models for intent classification in Islamic chatbots, with the main challenge being a highly imbalanced dataset containing 2,031 unique intents. Following the CRISP-DM methodology, the DistilBERT model was fine-tuned using Focal Loss to address class imbalance, while the BiLSTM model was built from scratch with a standard loss function. The evaluation results demonstrated the absolute superiority of DistilBERT, achieving an accuracy of 65.15%, far surpassing BiLSTM, which achieved only 34.50% due to severe overfitting. Although the final model sizes of both were similar, DistilBERT training proved to be significantly more efficient. These findings demonstrate that a Transformer-based architecture combined with an appropriate strategy, such as Focal Loss, is a much more robust and effective solution for large-scale, imbalanced text classification in specific domains. The practical feasibility of this approach was validated through its successful implementation in a publicly accessible, functional chatbot prototype.
Co-Authors Muhammad Saifurridwani 'Ijazi Nabila Lailatanzila Nirwan Rasyid Ridlo Riza Anwar Fadil