Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
Vol 12, No 3: September 2024

BERT-BiLSTM model for hierarchical Arabic text classification

Hamzaoui, Benamar (Department of Computer Science, Institute of Science, University centre of Naama, Algeria)
Bouchiha, Djelloul (Department of Computer Science, Institute of Science, University centre of Naama, Algeria)
Bouziane, Abdelghani (Department of Computer Science, Institute of Science, University centre of Naama, Algeria)
Doumi, Noureddine (University of Saida, Algeria)



Article Info

Publish Date
30 Sep 2024

Abstract

Text classification is a fundamental task in natural language processing (NLP) aimed at categorizing text documents into predefined categories or labels. Leveraging artificial intelligence (AI) tools, particularly deep learning and machine learning, has significantly enhanced text classification capabilities. However, for the Arabic language, which lacks comprehensive resources in this domain, the challenge is even more pronounced. Hierarchical text classification, which organizes categories into a tree-like structure, presents added complexity due to inter-category similarities and connections across different levels. In addressing this challenge, we propose a deep learning model based on BERT (Bidirectional Encoder Representations from Transformers) and BiLSTM (Bidirectional Long Short-Term Memory). Experimental evaluations demonstrate the effectiveness of our approach compared to existing methods, yielding promising results. Our study contributes to advancing text classification methodologies, particularly in the context of Arabic language processing.

Copyrights © 2024






Journal Info

Abbrev

IJEEI

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

Indonesian Journal of Electrical Engineering and Informatics (IJEEI) is a peer reviewed International Journal in English published four issues per year (March, June, September and December). The aim of Indonesian Journal of Electrical Engineering and Informatics (IJEEI) is to publish high-quality ...