Knowledge Engineering and Data Science
Vol 7, No 1 (2024)

Hybrid Method for User Review Sentiment Categorization in ChatGPT Application Using N-Gram and Word2Vec Features

Nisa, Husna Luthfiatun (Unknown)
Ahdika, Atina (Unknown)



Article Info

Publish Date
24 Apr 2024

Abstract

The rapid development of Artificial Intelligence (AI) has significantly influenced nearly all aspects of life. One AI product widely used by people worldwide is the Chat Generative Pre-Training Transformer (ChatGPT), which can respond to questions conversationally. Although data indicates that the use of ChatGPT in Indonesia is less widespread than in other countries, a Populix survey reveals that half of the respondents have utilized ChatGPT, using AI more than once a month. This indicates its crucial role among the Indonesian population. ChatGPT is not limited to browsers; it is also available as a downloadable application on the Google Play Store. The ChatGPT application has garnered various user reviews, particularly those from Indonesia. Therefore, this research employs the Naïve Bayes Classifier and K-Means Clustering to classify sentiments and group user reviews of the ChatGPT application originating from Indonesia. The study utilizes TF-IDF and Word2Vec as feature extraction methods, combining various N-Gram in data preprocessing to consider the context of sequentially arranged words that may carry meaning. The best classification results are obtained from the trigram classification model, as indicated by precision, recall, and accuracy values of 0.99 each, along with an F1-score of 1. Clustering also yields positive results, with some overlapping, yet words within clusters exhibit high similarity. Categorization results suggest that user reviews of the ChatGPT application from Indonesia tend to be positive, expressing satisfaction impressions, providing feedback for feature development, and expressing hope for the continued availability of the accessible version of ChatGPT due to its remarkable benefits.

Copyrights © 2024






Journal Info

Abbrev

keds

Publisher

Subject

Computer Science & IT Engineering

Description

KEDS, brings together researchers, industry practitioners, and potential users, to promote collaborations, exchange ideas and practices, discuss new opportunities, and investigate analytics frameworks on data-driven and knowledge base ...