Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Information Systems Engineering and Business Intelligence

Unveiling User Sentiment: Aspect-Based Analysis and Topic Modeling of Ride-Hailing and Google Play App Reviews Pranatawijaya, Viktor Handrianus; Sari, Nova Noor Kamala; Rahman, Resha Ananda; Christian, Efrans; Geges, Septian
Journal of Information Systems Engineering and Business Intelligence Vol. 10 No. 3 (2024): October
Publisher : Universitas Airlangga

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.20473/jisebi.10.3.328-339

Abstract

Background: Mobile app usage is increasing in the digital age, with Ride-Hailing app becoming the primary example of this trend. To obtain valuable understanding of how people perceive and interact with mobile app, user reviews on platforms such as Google Play are usually analyzed. This analysis can assist developers to identify areas for improvement in both Ride-hailing and Google Play App. A promising method that can be used to analyze user perception in this instance is Aspect-Based Sentiment Analysis (ABSA). Objective: This research aimed to apply ABSA to user reviews using Bidirectional Encoder Representations from Transformers (BERT) models. In this context, aspect identification and topic modeling were performed by using Latent Dirichlet Allocation (LDA). The model extracted topics from the reviews and used Generative Artificial Intelligence (GenAI) to define the aspects of the topics to further enhance the analysis. For consistency and accuracy, the method included sentiment annotation by a human annotator. Methods: A total of two datasets were used in this research, with the first collected by scraping user reviews of Ride-Hailing App while the second was obtained from Kaggle, and to identify relevant topics, modeling was performed using LDA. These topics were then categorized into aspects using GenAI, covering areas, such as customer experience, service, payment, app features, task management, and event management. Subsequently, sentiment labeling was conducted using human annotators to provide a reliable baseline. BERT model was then used to classify sentiment with aspect hints, and the evaluation included calculations of accuracy, precision, recall, and F1-score. Results: The results showed that BERT model achieved the highest accuracy of 97% in sentiment analysis across all datasets. Conclusion: This research provided valuable understanding of user experience and established a strong ABSA framework for analyzing user reviews using LDA, Aspect Annotation, GenAI, and BERT sentiment models. Future research could expand this method to other app categories and incorporate real-time ABSA for continuous monitoring and dynamic feedback.   Keywords: User Reviews, Aspect-Based Sentiment Analysis (ABSA), Sentiment Analysis, Topic Modeling, Generative Artificial Intelligence (GenAI)
Co-Authors Ade Chandra Saputra Adflin, Jacob Agus Sehatman Saragih Alyura, Ripaldo Andini, Wafik Anugrah Putra, Putu Bagus Adidyana Anugrahnu, Dian Putra Aprilian, Rivan Aprillinsa, Camila Aprimikardo, Aprimikardo Ardeanto, Robert Ariesta Lestari Arya Bima Mohammad Heriansyah Augustin, Darryl Sandi Christian Rufus, Edward Cristivioni Criye Fatriani, Jane Dwiyankie, Ravema Nanda Ehuwinae, Okta Felicia Sylviana Ferdinan, Bryan Desmonda Fitriah, Andi Nurul Geradi Muke, Rio Gilbran, Pedroni Hadi, Muhammad Ilmiannor Handrianus Pranatawijaya, Viktor Hidayat, Febrian Nur Jadiaman Parhusip, Jadiaman Joshua Evan Savero Julian, Ary Sigit Karolita, Devi Kristianti, Novera Leonardo, Tomas Lowryanty, Ni Putu Maulana, Ferdy Afriza Mavanudin, Zhykwa Ceryl Monalisa, Agatha Muhamad Rafliansyah Muhammad Arifin Ilham Muhammad fauzan Nahumi Nugrahaningsih Naufal Fakhri Nova Noor Kamala Sari Nugraha Hasibuan, Dicky Nur Haniatin Jannah Oktha Pikami, Billy Pentanugraha, Elsan Priskila, Ressa Priyani, Natasya Putra, Putu Bagus A.A. Putra, Putu Bagus Adidyana Anugrah Rahman, Resha Ananda Ramadhani, Aditya Ananda Rendy Saputra Ressa Priskila Revelin Putri, Nadya Rinaldi Rizwar Rizkyaka Riyadi, Raydamar Sahay, Abertun Sagit Saputra, Muhammad Dwi Savero, Joshua Evan Septian Geges Siregar, Rayanti Veronica Sriyanto, Naufal Ihsan Tanciang, Tanciang Tarigan, Yedija Tety Citra Natha Viktor Handrianus Pranatawijaya Viktor Handrianus Pranatawijaya Widiatry Widiatry, Widiatry Zahra, Fatiya Ummu Hanifah Zailami, Firdaus