Claim Missing Document
Check
Articles

Found 3 Documents
Search
Journal : Bulletin of Electrical Engineering and Informatics

Hybrid RNNs and USE for enhanced sequential sentence classification in biomedical paper abstracts Ndama, Oussama; Bensassi, Ismail; En-Naimi, El Mokhtar
Bulletin of Electrical Engineering and Informatics Vol 13, No 5: October 2024
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v13i5.8240

Abstract

This research evaluates a number of hybrid recurrent neural network (RNN) architectures for classifying sequential sentences in biomedical abstracts. The architectures include long short-term memory (LSTM), bidirectional LSTM (BI-LSTM), gated recurrent unit (GRU), and bidirectional GRU (BI-GRU) models, all of which are combined with the universal sentence encoder (USE). The investigation assesses their efficacy in categorizing sentences into predefined classes: background, objective, method, result, and conclusion. Each RNN variant is used with the pre-trained USE as word embeddings to find complex sequential relationships in biomedical text. Results demonstrate the adaptability and effectiveness of these hybrid architectures in discerning diverse sentence functions. This research addresses the need for improved literature comprehension in biomedicine by employing automated sentence classification techniques, highlighting the significance of advanced hybrid algorithms in enhancing text classification methodologies within biomedical research.
Hybrid approach for tweets similarity classification founded on case based reasoning and machine learning techniques Bensassi, Ismail; Kouissi, Mohamed; Ndama, Oussama; En-Naimi, El Mokhtar; Zouhair, Abdelhamid
Bulletin of Electrical Engineering and Informatics Vol 14, No 1: February 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v14i1.8452

Abstract

Twitter sentiment analysis becomes a popular research subject in the last decade. It aims to extract sentiments of users through their public opinion about a given topic. This article proposes a hybrid approach for Twitter sentiment analysis founded on dynamic case based reasoning (DCBR), multinomial logistic regression machine learning algorithm and multi-agent system. Our approach proposes a method to find similar tweets based on content similarity measure using the scientific measurement of keyword weight term frequency-inverse document frequency (TF-IDF). This approach includes gathering and pre-processing tweets, getting score and polarity of tweets, the use of multinomial logistic regression machine learning algorithm to classify our tweets into various classes, using the feature extraction method to extract useful features and then the K-nearest neighbors (KNN) algorithm to make it easier to find similar tweets to our tweet target case. This approach is adaptive and generic and able to track users' tweet to predict their behavior and sentiments in critical situations and delivering personalized content. The current study focuses on Covid-19 tweets, and a public Twitter dataset is used for this purpose.
The impact of BERT-infused deep learning models on sentiment analysis accuracy in financial news Ndama, Oussama; Bensassi, Ismail; Mokhtar En-Naimi, El
Bulletin of Electrical Engineering and Informatics Vol 14, No 2: April 2025
Publisher : Institute of Advanced Engineering and Science

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.11591/eei.v14i2.8469

Abstract

This study delves into the enhancement of sentiment analysis accuracy within the financial news domain through the integration of bidirectional encoder representations from transformers (BERT) with traditional deep learning models, including artificial neural networks (ANN), long short-term memory (LSTM) networks, gated recurrent units (GRU), and convolutional neural networks (CNN). By employing a comprehensive method encompassing data preprocessing, polarity analysis, and the application of advanced neural network architectures, we investigate the impact of incorporating BERT’s contextual embeddings on the models’ sentiment classification performance. The findings reveal significant improvements in model accuracy, precision, recall, and F1 scores when BERT is integrated, surpassing both traditional sentiment analysis models and contemporary natural language processing (NLP) transformers. This research contributes to the body of knowledge in financial sentiment analysis by demonstrating the potential of combining deep learning and NLP technologies to achieve a more nuanced understanding of financial news sentiment. The study’s insights advocate for a shift towards sophisticated, context-aware models, highlighting the pivotal role of transformer-based techniques in advancing the field.