Generative AI has provided real benefits in key sectors of the public sector. However, the rapid expansion of AI assistant services also raises concerns about whether newly released products can consistently meet user expectations, especially as negative experiences are increasingly expressed through public reviews. Its positive impacts encourage competitive rivalry among AI assistant product developers, including xAI, which also participates by formulating the Grok AI application. As a relatively new product with over 50 million downloads, GrokAI needs to perform an evaluation to maintain its competitiveness. This condition leads to the research goal of analyzing user sentiment toward GrokAI application through reviews on Google Play Store and comparing the performance of Machine Learning and Deep Learning classification models within the framework of Knowledge Discovery in Databases (KDD). This study uses 11,108 review data classified using the VADER Lexicon method, resulting in 7,633 positive reviews and 3,475 negative reviews. The data is then tested on XGBoost (Extreme Gradient Boosting) and LSTM (Long-Short Term Memory) models. The results show that the XGBoost model performs slightly better with an accuracy of 87.22%, compared to LSTM, which reaches 86.58%. However, both models exhibit significant performance disparities in classifying negative classes due to the extreme difference in data quantity. The knowledge discovery process reveals that the majority of positive sentiment appreciates the free access and general functions of the application. Meanwhile, negative sentiment focuses on complaints related to response time, output quality, and specific features such as image and voice. The main recommendation is to maintain the advantage of free access also improve features and processing logic to sustain loyalty and service quality. Future research is suggested to test models with more balanced data and optimize dataset cleaning to improve accuracy in minority classes.
Copyrights © 2025