Glove based wearable devices for sign language-GloSign

Soly Mathew Biju (University of Wollongong)
Obada Al-Khatib (University of Wollongong)
Hashir Zahid Sheikh (University of Wollongong)
Farhad Oroumchian (University of Wollongong)

IAES International Journal of Artificial Intelligence (IJ-AI)
Vol 12, No 4: December 2023

Loss of the capability to talk or hear has psychological and social effects onthe affected individuals due to the absence of appropriate interaction. SignLanguage is used by such individuals to assist them in communicating witheach other. This paper proposes a glove called GloSign that can convertAmerican sign language to characters. This glove consists of flex and inertialmeasurement unit (IMU) sensors to identify gestures. The data from glove isuploaded on IoT platform, which makes the glove portable and wireless. Thedata from gloves is passed through a k-nearest neighbors (KNN) Algorithmmachine learning algorithm to improve the accuracy of the system. Thesystem was able to achieve an accuracy of 96.8%. The glove can also be usedto form sentences. The output is displayed on the screen or is converted tospeech. This glove can be used in communicating with people who don’t knowsign language.