Article Per Year (5 Year)
p-Index From 2021 - 2026
3.886
P-Index
This Author published in this journals
All Journal JOURNAL OF INFORMATICS AND TELECOMMUNICATION ENGINEERING JOURNAL OF APPLIED INFORMATICS AND COMPUTING JURTEKSI JOURNAL OF SCIENCE AND SOCIAL RESEARCH Jurnal Sistem Informasi Kaputama (JSIK) MULTINETICS Journal of Applied Engineering and Technological Science (JAETS) Indonesian Journal of Electrical Engineering and Computer Science GANDRUNG: Jurnal Pengabdian Kepada Masyarakat Journal Software, Hardware and Information Technology Bulletin of Information Technology (BIT) International Journal of Science and Society (IJSOC) Journal of Computer Science and Informatics Engineering Jurnal Sains dan Teknologi Journal International of Lingua and Technology SWARNA Engineering Science Letter The Journal of Artificial Intelligence and Development Electronic Integrated Computer Algorithm Journal JGEN : Jurnal Pengabdian Kepada Masyarakat SWARNA: Jurnal Pengabdian Kepada Masyarakat Jurnal Pengabdian Kepada Masyarakat dan Desa (PASSA) AQILA : Acceleration, Quantum, Information Technology and Algorithm Journal Journal of Computer Science Advancements
Prayudani, Santi
Politeknik Negeri Medan
Religion Aerospace Engineering Agriculture, Biological Sciences & Forestry Arts Humanities Automotive Engineering Chemical Engineering, Chemistry & Bioengineering Chemistry Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Dentistry Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Health Professions Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Materials Science & Nanotechnology Mathematics Mechanical Engineering Medicine & Pharmacology Nursing Physics Public Health Social Sciences Veterinary Other

Published : 34 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : engineering science letter

 1 
Multi-Modal Deep Learning Approach for Waste Management: Integrating Image Classification and Text Mining for Environmental Awareness Santi Prayudani; Ainul Hizriadi; Yuyun Yusnida Lase
Engineering Science Letter Vol. 5 No. 02 (2026): In Press - Engineering Science Letter
Publisher : The Indonesian Institute of Science and Technology Research

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.56741/IISTR.esl.002036

Abstract

Environmental degradation caused by inefficient waste management remains a major global challenge, largely due to the limitations of conventional systems that rely on manual waste sorting and limited utilization of heterogeneous data sources. This study proposes a novel multi-modal deep learning framework that integrates visual and textual information to enhance waste classification performance while simultaneously providing insights into environmental awareness. The proposed framework combines convolutional neural networks (CNNs) for waste image classification and a recurrent neural network with long short-term memory (LSTM) architecture for text analysis. Visual and textual feature representations are integrated through a feature-level fusion strategy using vector concatenation before final classification. The image dataset consists of six waste categories, cardboard, glass, metal, paper, plastic, and trash, while the textual dataset contains waste management descriptions, community feedback, and environmental discourse collected from public and field sources. Environmental awareness was assessed through text mining by identifying dominant themes related to recycling practices, waste sorting behavior, environmental responsibility, and public concern regarding pollution and sustainability issues. Experimental results demonstrate that the proposed multimodal framework achieves an accuracy of 88.9% and an F1-score of 0.89, outperforming image-only and text-only models with accuracies of 78.4% and 81.2%, respectively. This corresponds to absolute performance improvements of 10.5% over the image-based model and 7.7% over the text-based model, while reducing the classification error rate by 40.96%. Furthermore, the multimodal model exhibits superior robustness under degraded data conditions, with only a 4.7% reduction in accuracy compared to larger performance declines observed in unimodal approaches. The main contribution of this study lies in the integration of waste image recognition and environmental-awareness extraction within a unified multimodal learning framework, enabling not only accurate waste categorization but also the generation of behavioral and sustainability-related insights that support more intelligent and sustainable waste management systems.
Co-Authors Adam, Hikmah Adwin Adha, Lilis Tiara Ahmad Hidayat Ainul Hizriadi Ainul Hizriadi Al Khowarizmi Andam Lukcyhasnita Ariyani, Tika F. Friendly Fatmi, Yulia Friendly Friendly, Friendly Gabriel Ardi Hutagalung Ginting, Heri Sanjaya Harfita, Nur Laily Harizahahyu Harizahayu, Harizahayu Harris Aminuddin Haryadi Haryadi - Hidayah, Rizki Hikmah Adwin Adam Husna, Meryatul Ivan Jaya Jaya, Ivan Julham Julham Julham Julham Kadri Yusuf Lampson Pindahaman Purba Lubis, Arif Ridho Muhammad Fathoni Muhammad Luthfi Hamzah Muhammadiyah, Mas’ud Muharman Lubis Munthe, Joy Lousia Brigitha Na, Li Nishida, Daiki Nugroho, Muhammad Rivan Putra, Purwa Hasan Putri, Desfita Eka Radea Shiddiq Rahayu Mayang Sari Salam, Azrizal Sembiring, Zakaria Shiddiq, Radea Sibarani, Yous Sinaga, Kristin Sinuraya, Junus Situmorang, Dita Rouli Basa Suadi Zainal Syafli, Sekar Arini Syamsul Arifin Tazkiyatun Nisa Tumanggor, Orli Virdyra Tasril Wiwin Sry Adinda Banjarnahor Xiang, Yang Yulia Fatmi Yusnida Lase, Yuyun Yusuf, Kadri Yuyun Yusnida Lase Zakaria Sembiring Zakaria Sembiring