Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Electrical Engineering and Computer Science
Abhinav, Nallamalli Venkat
Unknown Affiliation

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
UniMSE: a unified approach for multimodal sentiment analysis leveraging the CMU-MOSI Dataset Basu, Miriyala Trinath; Saha, Mainak; Gupta, Arpita; Hazra, Sumit; Fatima, Shahin; Sumalakshmi, Chundakath House; Shanvi, Nallagopu; Reddy, Nyalapatla Anush; Abhinav, Nallamalli Venkat; Hemanth, Koganti
Indonesian Journal of Electrical Engineering and Computer Science Vol 39, No 3: September 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijeecs.v39.i3.pp2032-2042

Abstract

This paper explores multimodal sentiment analysis using the CMU-MOSI dataset to enhance emotion detection through a unified approach called UniMSE. Traditional sentiment analysis, often reliant on single modalities such as text, faces limitations in capturing complex emotional nuances. UniMSE overcomes these challenges by integrating text, audio, and visual cues, significantly improving sentiment classification accuracy. The study reviews key datasets and compares leading models, showcasing the strengths of multimodal approaches. UniMSE leverages task formalization, pre-trained modality fusion, and multimodal contrastive learning, achieving superior performance on widely used benchmarks like MOSI and MOSEI. Additionally, the paper addresses the difficulties in effectively fusing diverse modalities and interpreting non-verbal signals, including sarcasm and tone. Future research directions are proposed to further advance multimodal sentiment analysis, with potential applications in areas like social media monitoring and mental health assessment. This work highlights UniMSE's contribution to developing more empathetic artificial intelligence (AI) systems capable of understanding complex emotional expressions.
Co-Authors Basu, Miriyala Trinath Fatima, Shahin Gupta, Arpita Hazra, Sumit Hemanth, Koganti Reddy, Nyalapatla Anush Saha, Mainak Shanvi, Nallagopu Sumalakshmi, Chundakath House