IAES International Journal of Artificial Intelligence (IJ-AI)
Vol 12, No 2: June 2023

Effect of word embedding vector dimensionality on sentiment analysis through short and long texts

Mohamed Chiny (Ibn Tofail University)
Marouane Chihab (Ibn Tofail University)
Abdelkarim Ait Lahcen (Ibn Tofail University)
Omar Bencharef (Cadi Ayyad University)
Younes Chihab (Ibn Tofail University)



Article Info

Publish Date
01 Jun 2023

Abstract

Word embedding has become the most popular method of lexical description in a given context in the natural language processing domain, especially through the word to vector (Word2Vec) and global vectors (GloVe) implementations. Since GloVe is a pre-trained model that provides access to word mapping vectors on many dimensionalities, a large number of applications rely on its prowess, especially in the field of sentiment analysis. However, in the literature, we found that in many cases, GloVe is implemented with arbitrary dimensionalities (often 300d) regardless of the length of the text to be analyzed. In this work, we conducted a study that identifies the effect of the dimensionality of word embedding mapping vectors on short and long texts in a sentiment analysis context. The results suggest that as the dimensionality of the vectors increases, the performance metrics of the model also increase for long texts. In contrast, for short texts, we recorded a threshold at which dimensionality does not matter.

Copyrights © 2023






Journal Info

Abbrev

IJAI

Publisher

Subject

Computer Science & IT Engineering

Description

IAES International Journal of Artificial Intelligence (IJ-AI) publishes articles in the field of artificial intelligence (AI). The scope covers all artificial intelligence area and its application in the following topics: neural networks; fuzzy logic; simulated biological evolution algorithms (like ...