Aiti: Jurnal Teknologi Informasi
Vol 21 No 2 (2024)

Interpretasi model Stacking Ensemble untuk analisis sentimen ulasan aplikasi pinjaman online menggunakan LIME

Munna, Aliyatul (Unknown)
Zuliarso, Eri (Unknown)



Article Info

Publish Date
30 Sep 2024

Abstract

Local Interpretable Model-agnostic Explanations (LIME) can be used to overcome black box problems in the results of sentiment analysis classification models. This research uses reviews of online loan applications on the Play Store as a dataset. Each classification model has weaknesses and its performance can be improved by using stacking ensembles, especially to overcome the problem of imbalanced data classes. The dataset that has been obtained will be cleaned, pre-processed and converted into a numerical vector using TF-IDF. Classification is carried out using three basic models, namely random forest, naïve Bayes and support vector machine (SVM). The output of the basic classification model is used as an input for stacking ensemble logistic regression. Based on the comparison of the four models, stacking ensemble has the best performance with an accuracy of 87.05%. The application of LIME for interpreting classification models with sample data succeeded in explaining the factors that influence model decisions with a prediction probability of 95% and in accordance with manual observations. The results of this research can be used as insight and education to the public about the ease of online loan and its dangers, which are reflected in the positive and negative sentiments in a review.

Copyrights © 2024






Journal Info

Abbrev

aiti

Publisher

Subject

Computer Science & IT

Description

AITI: Jurnal Teknologi Informasi is a peer-review journal focusing on information system and technology issues. AITI invites academics and researchers who do original research in information system and technology, including but not limited to: Cryptography Networking Internet of Things Big Data Data ...