Claim Missing Document
Check
Articles

Found 2 Documents
Search

Indonesian Sign Language (SIBI) Learning Media Application Based on Deep Learning Technology for Deaf Children Anggraeni, Martianda; Andhika F. R., Harum; Rante, Hestiasari; Sukaridhoto, Sritrusta
Journal of Technology and Informatics (JoTI) Vol. 5 No. 1 (2023): Vol. 5 No.1 (2023)
Publisher : Universitas Dinamika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.37802/joti.v5i1.384

Abstract

One of the main methods in teaching deaf children effectively is through visualization of learning materials. Previous research has developed augmented reality-based interactive learning media for deaf children. However, these learning media have limitations related to smartphone memory, dependence on certain flashcards, and limited amount of material due to flashcard limitations. Here, researchers innovate to develop SIBI learning media applications based on deep learning technology that material does not depend on a specific flashcard, but the application is able to detect real objects and various images. TensorFlow Lite is considered lighter but still allows the system to run deep learning on mobile devices with low latency. This application is designed to capture a real object or image through the camera, then the object or image will be processed and recognized using TensorFlow Lite. The object recognition process is carried out at the classification layer using switch-case syntax and global class synchronization with the YouTube API. After the image or object is recognized, the system will issue an output in the form of an Indonesian sign language video link from the object.
Indonesian Sign Language (SIBI) Vocabulary Learning Media Design Based on Augmented Reality for Hearing-Impaired Children Anggraeni, Martianda; Sarinastiti, Widi; Wati, Setiyo
Jurnal EECCIS (Electrics, Electronics, Communications, Controls, Informatics, Systems) Vol. 13 No. 3 (2019)
Publisher : Faculty of Engineering, Universitas Brawijaya

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21776/jeeccis.v13i3.620

Abstract

The lack of mastery of spoken and written vocabulary makes hearing-impaired children have poor vocabulary designations. A case study in a kindergarten school for hearing-impaired children in Surabaya, the students are taught to understand vocabulary through media recognition with original objects, artificial objects, and through images. For media recognition through images usually use media in the flashcards form. The rapid development of Information and Communication Technologies (ICT) such as the Augmented Reality (AR) should also be utilized to support the learning media for hearing-impaired children. In this study an application based on AR technology has been integrated with flashcards as a learning tool for children with hearing impairment in learning the vocabulary of the Indonesian sign language (SIBI) In designing the learning media, we use Luther's version of multimedia development method, include concept, design, material collecting, assembly, testing, and distribution. Based on the test results, it would be concluded that the AR application system would run well as evidenced by the buttons on this AR application 100% running according to its function. Markers on the flashcard 97% are detected by the system and would be integrated with appropriate video displays. As for this AR application that runs offline in which all assets and videos are stored in the application database installed on the device, the RAM and processor capacity is very influential on the success and speed of detection of markers and access to display video. So it is recommended to use a device with a minimum of 1.5 GB RAM and a 1.4GHz Quad-core processor. With this AR application, we hope hearing-impaired children become more interested in learning and increasing their vocabulary independently.