Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal International Journal of Applied Artificial Intelligence and Robotics (IJAIC)
Santosh Singh
Department of Information Technology, University of Mumbai

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Evaluating the Impact of Behavioural Features on Hindi Speech Emotion Recognition: A Multimodal Deep Learning Approach Sujata Kotian; Santosh Singh
International Journal of Applied Artificial Intelligence and Robotics Vol 2 No 1 (March 2026)
Publisher : PT. Literasi Teknologi Informatika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.67745/ijaic.v2i1.9

Abstract

Context: Speech Emotion Recognition (SER) is an important part of affective computing, but that it cannot work effectively in low resource languages like Hindi. The available SER systems have focused on low-level speech features (acoustic and prosodic) and little has been done to investigate the high-level behavioural speech features (e.g., pauses and rhythm) even though they are significant in human emotional communication. Objective: This study aimed to explore the hypothesis, whether explicit behavioral speech features can enhance Hindi SER performance, as well as study their joint role in complementing acoustic and prosodic features within a multimodal deep learning system. Method: A curated Hindi emotional speech corpus of 2,370 utterances of 25 speakers composed of seven emotion classes was studied through a controlled experimental study. The acoustic, prosodic and behavioral features were obtained and represented with a dual-branch multimodal deep learning framework that included CNN/transformer and BiLSTM-attention modules. Results: The entire multimodal model had an accuracy of 83.9% and a macro-F1 of 0.81, which was significantly higher than the acoustics-only and acoustics-prosodic baselines. The behavioral features provided significant progress to low-arousal emotions, including sadness and neutral, and medium to large effect sizes. Conclusions: The results show that Hindi SER accuracy and strength is significantly increased by behavioral speech cues. To practitioners, the findings provide justification to apply behavior-aware SER in practice, whereas to researchers, they show the necessity to explicitly model the behavioral characteristics in low-resource and culturally diverse languages.
Co-Authors Sujata Kotian