Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Indonesian Journal of Electrical Engineering and Computer Science

Integrating ELECTRA and BERT models in transformer-based mental healthcare chatbot Zeniarja, Junta; Paramita, Cinantya; Subhiyakto, Egia Rosi; Rakasiwi, Sindhu; Shidik, Guruh Fajar; Andono, Pulung Nurtantio; Savicevic, Anamarija Jurcev
Indonesian Journal of Electrical Engineering and Computer Science Vol 37, No 1: January 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijeecs.v37.i1.pp315-324

Abstract

Over the last decade, the surge in mental health disorders has necessitated innovative support methods, notably artificial intelligent (AI) chatbots. These chatbots provide prompt, tailored conversations, becoming crucial in mental health support. This article delves into the use of sophisticated models like convolutional neural network (CNN), long-short term memory (LSTM), efficiently learning an encoder that classifies token replacements accurately (ELECTRA), and bidirectional encoder representation of transformers (BERT) in developing effective mental health chatbots. Despite their importance for emotional assistance, these chatbots struggle with precise and relevant responses to complex mental health issues. BERT, while strong in contextual understanding, lacks in response generation. Conversely, ELECTRA shows promise in text creation but is not fully exploited in mental health contexts. The article investigates merging ELECTRA and BERT to improve chatbot efficiency in mental health situations. By leveraging an extensive mental health dialogue dataset, this integration substantially enhanced chatbot precision, surpassing 99% accuracy in mental health responses. This development is a significant stride in advancing AI chatbot interactions and their contribution to mental health support.
Co-Authors Abu Salam Abu Salam Adhitya Nugraha Adhitya Nugraha Adi Wibowo Afridiansyah, Rahmanda Agus Winarno Agus Winarno, Agus Ahmad Alaik Maulani Ailsa Nurina Cahyani Ainul Yaqin Alan Ma’ruf, Farda Alya Nurfaiza Azzahra Anisatawalanita Ukhifahdhina Anugrah, Muhammad Ikhsan Ardytha Luthfiarta Ardytha Luthfiarta Asih Rohmani Asih Rohmani Asih Rohmani Atika Rahmawati Bayu Aryanto Budi Warsito Cahyani, Ailsa Nurina Candra, Rejka Aditya Catur Supriyanto Catur Supriyanto Debrina Luna Arghata Mangkawa Deby Arida NiMatus Sa’adah Devi Ayu Rachmawati Dianti, Reza Nur Diyan Adiatma Dzaky, Azmi Abiyyu Edi Faisal Edi Sugiarto Edi Sugiarto Edi Sugiarto Egia Rosi Subhiyakto, Egia Rosi Erwin Yudi Hidayat Esmi Nur Fitri Esmi Nur Fitri Esmi Nur Fitri Fajarudin Zakariya Farda Alan Ma'ruf Farda Alan Ma’ruf Ferry Bintang Nugroho Fikri Budiman Fikri Budiman Firmansyah, Gustian Angga Ganiswari, Syuhra Putri Guruh Fajar Shidik Haresta, Alif Agsakli Harun Al Azies Ida Ayu Putu Sri Widnyani Ika Novita Dewi Jaya, Sava Irhab Atma Khoirunnisa, Emila Kiki Widia Kurniawan Ridwan Surohardjo Kurniawan, Defri L. Budi Handoko Luh Putu Ratna Sundari Lutfi Kharisma M Hafidz Ariansyah M. Hafidz Ariansyah Manurung, Ayub Michaelangelo Mas'ud, Ryan Ali Maulani, Ahmad Alaik Mufida Rahayu Muhammad Jamhari Muhammad Joyo Satrio Muljono Muljono Nabila, Qotrunnada Nitho Alif Ibadurrahman Novi Hendriyanto Nur Rokhman Octaviani, Dhita Aulia Paramita, Cinantya Pratama, Rifky Ariya Pulung Nurtantio Andono Putra, Vander Mulya Putri, Rusyda Tsaniya Eka Raden Arief Nugroho Rama Eka Saputra Ramadhan Rakhmat Sani Ramadhan, Ahnaf Irfan Ramadhan, Muhammad Eky Restu Agung Pamuji Rezaroebojo, Rizal Riyan Ardiansyah Rohman, Adib Annur Savicevic, Anamarija Jurcev Setiawan, Dicky Setiawan Sindhu Rakasiwi Sri Winarno Sri Winarno Sri Winarno Syabilla, Mutiara Utomo, Danang Wahyu Valentina Widya Suryaningtyas, Valentina Widya Wibowo Wicaksono Wibowo Wicaksono