Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal JITK (Jurnal Ilmu Pengetahuan dan Komputer)
Sugiyarto Surono
Ahmad Dahlan University
Computer Science & IT

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
DEEP BELIEF NETWORK (DBN) IMPLEMENTATION FOR MULTIMODAL CLASSIFICATION OF SENTIMENT ANALYSIS Hilmi Hibatullah; Aris Thobirin; Sugiyarto Surono
JITK (Jurnal Ilmu Pengetahuan dan Teknologi Komputer) Vol. 10 No. 3 (2025): JITK Issue February 2025
Publisher : LPPM Nusa Mandiri

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.33480/jitk.v10i3.6257

Abstract

In sentiment analysis, the use of multimodal data, consisting of a combination of images and text, is becoming increasingly important for understanding digital context. However, the main challenge lies in effectively integrating these two types of data into a single learning model. Deep Belief Network (DBN), with its capability to learn hierarchical data representations, is utilized to explore optimal strategies for multimodal sentiment analysis. The dataset includes 34,034 images from the FERPlus dataset to train the model in classifying emotions based on facial expressions, as well as 999 text and image samples obtained through crawling X. Experiments were conducted by comparing the performance of DBN with 2, 3, and 4 hidden layers across different test data sizes (10%-50%). The results indicate that the 3-hidden-layer configuration achieved the best performance, with a highest accuracy of 76% at a 20% test data size. Additionally, testing different learning rates (10⁻⁴ to 10⁻⁷) produced consistent results, but the fastest computation time was achieved with a learning rate of 10⁻⁴. Based on these findings, DBN with a 3-hidden-layer configuration and a learning rate of 10⁻⁴ is considered a more efficient alternative for multimodal sentiment analysis based on text and images.
Co-Authors Aris Thobirin Hilmi Hibatullah