Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Indonesian Journal of Electrical Engineering and Computer Science

Integrating ELECTRA and BERT models in transformer-based mental healthcare chatbot Zeniarja, Junta; Paramita, Cinantya; Subhiyakto, Egia Rosi; Rakasiwi, Sindhu; Shidik, Guruh Fajar; Andono, Pulung Nurtantio; Savicevic, Anamarija Jurcev
Indonesian Journal of Electrical Engineering and Computer Science Vol 37, No 1: January 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/ijeecs.v37.i1.pp315-324

Abstract

Over the last decade, the surge in mental health disorders has necessitated innovative support methods, notably artificial intelligent (AI) chatbots. These chatbots provide prompt, tailored conversations, becoming crucial in mental health support. This article delves into the use of sophisticated models like convolutional neural network (CNN), long-short term memory (LSTM), efficiently learning an encoder that classifies token replacements accurately (ELECTRA), and bidirectional encoder representation of transformers (BERT) in developing effective mental health chatbots. Despite their importance for emotional assistance, these chatbots struggle with precise and relevant responses to complex mental health issues. BERT, while strong in contextual understanding, lacks in response generation. Conversely, ELECTRA shows promise in text creation but is not fully exploited in mental health contexts. The article investigates merging ELECTRA and BERT to improve chatbot efficiency in mental health situations. By leveraging an extensive mental health dialogue dataset, this integration substantially enhanced chatbot precision, surpassing 99% accuracy in mental health responses. This development is a significant stride in advancing AI chatbot interactions and their contribution to mental health support.
Co-Authors Abdussalam Abdussalam, Abdussalam Affandy Affandy Aisyatul Karima Andrean, Muhammad Niko Andreas Wilson Setiawan Anggraini, Fitria Anhsori, Khusman Astuti, Yani Parti Azzahra, Tarissa Aura Budi Harjo Cahaya Jatmoko Catur Supriyanto Catur Supriyanto Catur Supriyanto Catur Supriyanto Chaerul Umam Chaerul Umam Christy Atika Sari Dewi Pergiwati Dliyauddin, Muhammad Doheir, Mohamed Dwi Eko Waluyo Dwi Puji Prabowo, Dwi Puji Dzaky, Azmi Abiyyu Edi Noersasongko Egia Rosi Subhiyakto, Egia Rosi Eko Hari Rachmawanto Elkaf Rahmawan Pramudya Erlin Dolphina Erna Zuni Astuti Fafaza, Safira Alya Fajrian Nur Adnan Fakhrurrozi Fakhrurrozi, Fakhrurrozi Firmansyah, Rusmal Harun Al Azies Hayu Wikan Kinasih Heru Lestiawan I Ketut Eddy Purnama Ika Pantiawati Islam, Hussain Md Mehedul Junta Zeniarja Kusuma, Edi Jaya Kusumawati, Yupie L. Budi Handoko Lenci Aryani Megantara, Rama Aria Mochamad Hariadi Muhammad Huda, Alam Muhammad Naufal, Muhammad Ningrum, Amanda Prawita Nurmandhani, Ririn Paramita, Cinantya Pergiwati, Dewi Praskatama, Vincentius Pujiono Pujiono Pulung Nurtantio Andono Purwanto Purwanto Putra, Permana Langgeng Wicaksono Ellwid Rafsanjani, Muhammad Ivan Rahadian, Arief Ramadhan Rakhmat Sani Ramadhani, Irfan Wahyu Rastri Prathivi Ratmana, Danny Oka Ricardus Anggi Pramunendar Riri Damayanti Apnena Rohman, Muhammad Syaifur Saputra, Filmada Ocky Saraswati, Galuh Wilujeng Sarker, Md. Kamruzzaman Savicevic, Anamarija Jurcev Shier Nee Saw Sinaga, Daurat Sindhu Rakasiwi Soeleman, M. Arief Sri Winarno Swanny Trikajanti Widyaatmadja Vincent Suhartono Wahyu Adi Nugroho Wellia Shinta Sari Winarsih, Nurul Anisa Sri Yaacob, Noorayisahbe Mohd Yani Parti Astuti Zainal Arifin Hasibuan Zami, Farrikh Al Zul Azri bin Muhamad Noh