International Journal of Informatics and Communication Technology (IJ-ICT)
Vol 12, No 1: April 2023

Development of a PC-based sign language translator

Kamoli Akinwale Amusa (Federal University of Agriculture)
Ayorinde Joseph Olanipekun (Federal University of Agriculture)
Tolulope Christiana Erinosho (Federal University of Agriculture)
Abiodun Akeem Salaam (Federal University of Agriculture)
Sodiq Segun Razaq (Federal University of Agriculture)



Article Info

Publish Date
01 Apr 2023

Abstract

While a hearing-impaired individual depends on sign language and gestures, non-hearing-impaired person uses verbal language. Thus, there is need for means of arbitration to forestall situation when a non-hearing-impaired individual who does not understand the sign language wants to communicate with a hearing-impaired person. This paper is concerned with the development of a PC-based sign language translator to facilitate effective communication between hearing-impaired and non-hearing-impaired persons. Database of hand gestures in American sign language (ASL) is created using Python scripts. TensorFlow (TF) is used in the creation of a pipeline configuration model for machine learning of annotated images of gestures in the database with the real time gestures. The implementation is done in Python software environment and it runs on a PC equipped with a web camera to capture real time gestures for comparison and interpretations. The developed sign language translator is able to translate ASL/gestures to written texts along with corresponding audio renderings at an average duration of about one second. In addition, the translator is able to match real time gestures with the equivalent gesture images stored in the database even at 44% similarity.

Copyrights © 2023






Journal Info

Abbrev

IJICT

Publisher

Subject

Computer Science & IT

Description

International Journal of Informatics and Communication Technology (IJ-ICT) is a common platform for publishing quality research paper as well as other intellectual outputs. This Journal is published by Institute of Advanced Engineering and Science (IAES) whose aims is to promote the dissemination of ...