Indonesian Journal of Electrical Engineering and Computer Science
Vol 27, No 1: July 2022

Semantics based English-Arabic machine translation evaluation

Majdi Beseiso (Al-Balqa Applied University)
Samiksha Tripathi (Rsystems international)
Bashar Al-Shboul (University of Jordan)
Renad Aljadid (University of Jordan)



Article Info

Publish Date
01 Jul 2022

Abstract

Some classic machine translation (MT) Evaluation methods, such as the bilingual evaluation understudy score (BLEU), have notably underperformed in evaluating machine translations for morphologically rich languages like Arabic. However, the recent remarkable advancements in the domain of word vectors and sentence vectors have opened up new research avenues for low-resource languages. This paper proposes a novel linguistic-based evaluation method for English-translated sentences in Arabic. The proposed approach includes penalties based on length, positions, and context-based schemes such as part-of-speech tagging (POS) and multilingual sentenceBERT (SBERT) models for machine translation evaluation. The proposed technique is tested using pearson correlation as a performance evaluation parameter and compared with state-of-the-art techniques. The experimental results demonstrate that the proposed model evidently outperforms other MT evaluation methods such as BLEU.

Copyrights © 2022