Claim Missing Document
Check
Articles

Found 4 Documents
Search
Journal : Journal of Applied Data Sciences

Early Stopping on CNN-LSTM Development to Improve Classification Performance Anam, M. Khairul; Defit, Sarjon; Haviluddin, Haviluddin; Efrizoni, Lusiana; Firdaus, Muhammad Bambang
Journal of Applied Data Sciences Vol 5, No 3: SEPTEMBER 2024
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v5i3.312

Abstract

Currently, CNN-LSTM has been widely developed through changes in its architecture and other modifications to improve the performance of this hybrid model. However, some studies pay less attention to overfitting, even though overfitting must be prevented as it can provide good accuracy initially but leads to classification errors when new data is added. Therefore, extra prevention measures are necessary to avoid overfitting. This research uses dropout with early stopping to prevent overfitting. The dataset used for testing is sourced from Twitter; this research also develops architectures using activation functions within each architecture. The developed architecture consists of CNN, MaxPooling1D, Dropout, LSTM, Dense, Dropout, Dense, and SoftMax as the output. Architecture A uses default activations such as ReLU for CNN and Tanh for LSTM. In Architecture B, all activations are replaced by Tanh, and in Architecture C, they are entirely replaced by ReLU. This research also performed hyperparameter tuning such as the number of layers, batch size, and learning rate. This study found that dropout and early stopping can increase accuracy to 85% and prevent overfitting. The best architecture entirely uses ReLU activation as it demonstrates advantages in computational efficiency, convergence speed, the ability to capture relevant patterns, and resistance to noise.
Improved Performance of Hybrid GRU-BiLSTM for Detection Emotion on Twitter Dataset Anam, M. Khairul; Munawir, Munawir; Efrizoni, Lusiana; Fadillah, Nurul; Agustin, Wirta; Syahputra, Irwanda; Lestari, Tri Putri; Firdaus, Muhammad Bambang; Lathifah, Lathifah; Sari, Atalya Kurnia
Journal of Applied Data Sciences Vol 6, No 1: JANUARY 2025
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v6i1.459

Abstract

This study addresses emotion detection challenges in tweets, focusing on contextual understanding and class imbalance. A novel hybrid deep learning architecture combining GRU-BiLSTM with SMOTE is proposed to enhance classification performance on an Israel-Palestine conflict dataset. The dataset contains 40,000 tweets labeled with six emotions: anger, disgust, fear, joy, sadness, and surprise. SMOTE effectively balances the dataset, improving model fairness in detecting minority classes. Experimental results show that the GRU-BiLSTM hybrid with an 80:20 data split achieves the highest accuracy of 89%, surpassing BiLSTM alone, which obtained 88%, and other state-of-the-art models. Notably, the proposed model delivers significant improvement in detecting the emotion of joy (recall: 0.87, F1-score: 0.86). In contrast, the surprise category remains challenging (recall: 0.24). Compared to existing research, this study highlights the effectiveness of combining SMOTE and hybrid GRU-BiLSTM, outperforming models such as CNN, GRU, and LSTM on similar datasets. The incorporation of GloVe embeddings enhances contextual word representations, enabling nuanced emotion detection even in sarcastic or ambiguous texts. The novelty lies in addressing class imbalance systematically with SMOTE and leveraging GRU-BiLSTM's complementary strengths, yielding superior performance metrics. This approach contributes to advancing emotion detection tasks, especially in conflict-related social media data, by offering a robust, context-sensitive, and balanced classification method.
Improving Evaluation Metrics for Text Summarization: A Comparative Study and Proposal of a Novel Metric Junadhi, Junadhi; Agustin, Agustin; Efrizoni, Lusiana; Okmayura, Finanta; Habibie, Dedi Rahman; Muslim, Muslim
Journal of Applied Data Sciences Vol 6, No 2: MAY 2025
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v6i2.547

Abstract

This research evaluates and compares the effectiveness of various evaluation metrics in text summarization, focusing on the development of a new metric that holistically measures summary quality. Commonly used metrics, including ROUGE, BLEU, METEOR, and BERTScore, were tested on three datasets: CNN/DailyMail, XSum, and PubMed. The analysis revealed that while ROUGE achieved an average score of 0.65, it struggled to capture semantic nuances, particularly for abstractive summarization models. In contrast, BERTScore, which incorporates semantic representation, performed better with an average score of 0.75. To address these limitations, we developed the Proposed Metric, which combines semantic similarity, n-gram overlap, and sentence fluency. The Proposed Metric achieved an average score of 0.78 across datasets, surpassing conventional metrics by providing more accurate assessments of summary quality. This research contributes a novel approach to text summarization evaluation by integrating semantic and structural aspects into a single metric. The findings highlight the Proposed Metric's ability to capture contextual coherence and semantic alignment, making it suitable for real-world applications such as news summarization and medical research. These results emphasize the importance of developing holistic metrics for better evaluation of text summarization models.
Adaptive Neural Collaborative Filtering with Textual Review Integration for Enhanced User Experience in Digital Platforms Efrizoni, Lusiana; Ali, Edwar; Asnal, Hadi; Junadhi, Junadhi
Journal of Applied Data Sciences Vol 6, No 4: December 2025
Publisher : Bright Publisher

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.47738/jads.v6i4.944

Abstract

This research proposes a hybrid rating prediction model that integrates Neural Collaborative Filtering (NCF), Long Short-Term Memory (LSTM), and semantic analysis through Natural Language Processing (NLP) to enhance recommendation accuracy. The main objective is to improve alignment between system predictions and actual user preferences by leveraging multi-source information from the Amazon Movies and TV dataset, which includes explicit user–item ratings and textual reviews. The core idea is to combine three complementary processing paths—(1) user–item interaction modeling via NCF, (2) temporal dynamics capture through LSTM, and (3) semantic understanding of reviews using NLP—into a unified deep learning-based adaptive architecture. Experimental evaluation demonstrates that this multi-input approach outperforms the baseline collaborative filtering model, with the Mean Absolute Error (MAE) reduced from 1.3201 to 1.2817 (a 2.91% improvement) and the Mean Squared Error (MSE) reduced from 2.2315 to 2.1894 (a 1.89% improvement). Training metrics visualization further shows a stable convergence pattern, with the MAE gap between training and validation consistently below 0.03, indicating minimal overfitting. The findings confirm that integrating cross-dimensional signals significantly enhances predictive performance and can contribute to increased user satisfaction and engagement in recommendation platforms. The novelty of this work lies in the simultaneous integration of interaction, temporal, and semantic dimensions into a single adaptive recommendation framework, a configuration not jointly explored in prior studies. Moreover, the flexible architecture enables adaptation to other domains such as e-commerce, music, or online learning, broadening its practical applicability.
Co-Authors -, Dwi Haryono Afrinanda, Rizky Agung Marinda Agus Tri Nurhuda Agustin Agustin Agustin Agustin Agustin Agustin, Endy Wulan Ahmad - Fauzan Ahmad Fauzan Ahmad Rizali Anam, M Khairul Andhika, Imam Anthony Anggrawan Anugraha, Yoga Safitra Aprilia, Fanesa Arifin, Muhammad Amirul Armoogum , Sheeba Aulia, Rahma Azhari, Zahra Cikita, Putri Dadynata, Eric Dea Safitri Deni, Rahmad Devi Puspita Sari, Devi Puspita Dhini Septhya Djamalilleil, Said Azka Fauzan Edwar Ali Erlinda, Susi Ermy Pily, Annisa Khoirala ester nababan Fadly Fadly Farhan Pratama Farida Try Puspa Siregar Fatdha, Eiva Febrianda Putra Filza Izzati Finanta Okmayura Firdaus, Muhammad Bambang Firman, Muhammad Aditya Fransiskus Zoromi Fransiskus Zoromi, Fransiskus Habibie, Dedi Rahman Hadi Asnal, Hadi Hafsah Fulaila Tahiyat Handayani, Nadya Satya Haviluddin Haviluddin Helda Yenni, Helda Hidaya Spitri Iftar Ramadhan Ihsan, Raja Muhammad Ike Yunia Pasa Irwanda Syahputra Julianti, Nadea Junadhi Junadhi Junadhi Junadhi Junadhi, Junadhi Karpen Kartina Diah K. W. Kharisma Rahayu Koko Harianto Lathifah, Lathifah Lestari, Fika Ayu Lili Marlia M. Azzuhri Dinata M. Irpan Marhadi, Nanda Maulana, Fitra Melva Suryani Muhammad Bambang Firdaus Muhammad Oase Ansharullah Muhammad Syaifullah MUHAMMAD TAJUDDIN Munawir Munawir Muslim Muslim Nanda, Annisa Nasution , Zikri Hardyan Nurul fadillah, Nurul Oktavianda Oktavianda, Oktavianda Purnama, Muhammad Adji Putra, Febrianda Putri, Adinda Dwi Putri, Siti Faradila R. Guntur Surya Yuwana - Rahmaddeni Rahmaddeni Rahmaddeni, - Rahmiati Rahmiati Rais Amin Raja Muhammad Ihsan Ramadhani, Jilang Rati Rahmadani Ratna Andini Husen Revaldo, Bagus Tri Riadhil Jannah Rini Yanti, Rini Risky Harahap Risman Risman Rizki Astuti Rometdo Muzawi, Rometdo Sahelvi, Elza Salsabila Rabbani Sapina, Nur Sapitri, Riska Mela Sari, Atalya Kurnia Sarjon Defit Sarjon Defit Setiawan , Andri Shahreen Kasim, Shahreen Sholekhah, Fitriana Sularno Supian, Acuan Susandri, Susandri Susanti, Susanti Susi Erlinda Syahrul Imardi Syarifuddin Elmi Tahiyat, Hafsah Fulaila Tashid Tawa Bagus, Wahyu Torkis Nasution Tri Putri Lestari, Tri Putri Tri Revaldo, Bagus Triyani Arita Fitri Ulfa, Arvan Izzatul Unang Rio Uthami, Kurnia Vindi Fitria Wirta Agustin Wirta Wirta Yanti, Rini Yoyon Efendi Yulli Zulianda Zahra Azhari Zakaria , Mohd Zaki Zakaria, Mohd Zaki Zega, Wilman Zikri Hadryan nst Zulafwan Zuriatul Khairi Zuriatul Khairi