Article Per Year (5 Year)
p-Index From 2021 - 2026
0.23
P-Index
This Author published in this journals
All Journal Indonesian Journal of Electrical Engineering and Informatics (IJEEI)
Abdul-Hadi Nabi Ahmed
Faculty of Graduate Studies for Statistical Research (FGSSR), Cairo University, Giza, Egypt
Computer Science & IT Electrical & Electronics Engineering

Published : 1 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search

 1 
Enhancing Arabic Diacritization Using BERT with BiLSTM and BiGRU Heads Ahmed Abdelhamed Elgayar; Abdul-Hadi Nabi Ahmed; Basma Ezzat El-Demerdash; Ahmed E. Soliman
Indonesian Journal of Electrical Engineering and Informatics (IJEEI) Vol 14, No 2: June 2026
Publisher : IAES Indonesian Section

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52549/ijeei.v14i2.7033

Abstract

Arabic diacritization is the task of adding diacritical marks to Arabic text to aid correct articulation, resolve lexical ambiguity, and support downstream natural language processing tasks. This study proposes a hybrid deep learning architecture that augments a pre-trained transformer encoder (AraBERTv02) with a sequential prediction head built on either a Bidirectional Long Short-Term Memory (BiLSTM) or a Bidirectional Gated Recurrent Unit (BiGRU) network, replacing the conventional linear classification layer. This design introduces an explicit sequential inductive bias at the output level, enabling the model to capture local label dependencies that are not modeled by a standard linear head. The models were trained and evaluated on the Tashkeela Processed (TP) benchmark corpus of fully diacritized Modern Standard Arabic. The BiLSTM based model achieves a Diacritic Error Rate (DER) of 1.82% and a Word Error Rate (WER) of 2.58% while the BiGRU variant has a DER of 1.84% and a WER of 2.62% both outperforming the prior state-of-the-art on the same benchmark (WER: 3.34%). Error analysis reveals a systematic confusion of short vowels, especially in verb-initial contexts where fatha and damma alternate to mark active and passive voice, illustrating the inherent morphological complexity of Arabic diacritization. The proposed architecture is also shown to be suitable for real-world deployment with an inference time of 9.22 ms and 8.74 ms per sentence for BiLSTM and BiGRU models respectively. Thus, both variants are compatible with near real-time applications such as Arabic text-to-speech systems and educational tools.
Co-Authors Ahmed Abdelhamed Elgayar Ahmed E. Soliman Basma Ezzat El-Demerdash