Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Engineering, Mathematics and Computer Science Journal (EMACS)

American Sign Language Translation to Display the Text (Subtitles) using a Convolutional Neural Network Ramadhan, Muhammad Fajar; Samsuryadi, Samsuryadi; Primanita, Anggina
Engineering, MAthematics and Computer Science Journal (EMACS) Vol. 6 No. 3 (2024): EMACS
Publisher : Bina Nusantara University

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.21512/emacsjournal.v6i3.11904

Abstract

Sign language is a harmonious combination of hand gestures, postures, and facial expressions. One of the most used and also the most researched Sign Language is American Sign Language (ASL) because it is easier to implement and also more common to apply on a daily basic. More and more research related to American Sign Language aims to make it easier for the speech impaired to communicate with other normal people. Now, American Sign Language research is starting to refer to the vision of computers so that everyone in the world can easily understand American Sign Language through machine learning. Technology continues to develop sign language translation, especially American Sign Language using the Convolutional Neural Network. This study uses the Densenet201 and DenseNet201 PyTorch architectures to translate American Sign Language, then display the translation into written form on a monitor screen. There are 4 comparisons of data splits, namely 90:10, 80:20, 70:30, and 60:30. The results showed the best results on DenseNet201 PyTorch in the train-test dataset comparison of 70:30 with an accuracy of 0.99732, precision of 0.99737, recall (sensitivity) of 0.99732, specificity of 0.99990, F1-score of 0.99731, and error of 0.00268. The results of the translation of American Sign Language into written form were successfully carried out by performance evaluation using ROUGE-1 and ROUGE-L resulting in a precision of 0.14286, Recall (sensitivity) 0.14286, and F1-score.
Co-Authors Agus Mistiawan Ahmad Fali Oklilas Ahmad Heryanto Akbar, M. Agung Ali Firdaus Anna Dwi Marjusalinah Apit Fathurohman Apriansyah Putra Aprilisa, Shinta Archibald Hutahaean, Jerrel Adriel Ardina Ariani Ardina Ariani Ariani, Ardina Arnelawati, Arnelawati Astuti, Dwi Lydia Zuharah Ayu Luviyanti Tanjung Azhar Azhar Bambang Tutuko Barlian Khasoggi Buchari, Muhammad Ali Cahyadi, Gabriel Ekoputra Hartono Darmawahyuni, Annisa Darmawijoyo, Darmawijoyo Dedy Fitriady Fitriady Deris Stiawan Desty Rodiah Dewy Yuliana Dian Palupi Rini Dian Palupi Rini Dian Palupi Rini Dian Palupi Rini Dwi Budi Santoso Dwi Lydia Zuharah Astuti Dwi Lydia Zuharah Astuti Dwi Meylitasari Tarigan Ermatita - Erni Erni Esti Susiloningsih Fatma Susilawati Mohamad Firdaus Firdaus Hadipurnama Satria Hadipurnawan Satria Hasby Rifky Islami, Anggun Jambak, Muhammad Ihsan Jayanti Jayanti Julian Supardi Khairun Nisa Kurniabudi, Kurniabudi Leni Marlina Lingga Wijaya, Harma Oktafia Lintang Auliya Kurdiati Lintang Auliya Kurdiati M. Nejatullah Sidqi Marlina Sylvia Meryansumayeka Meryansumayeka Mohamad, Fatma Susilawati Muhammad Fachrurrozi Muhammad Naufal Rachmatullah Mukhlis Febriady Murniati . Nur Rachmat Nusantara, Duano Sapta Primanita, Anggina Purnama, Benni Rahmat Budiarto Ramadhan, Muhammad Fajar Ratu Ilma Indra Putri Rifkie Primartha Risda Intan Sistyawati Riszky Pabela Pratiwi Rizq Khairi Yazid Rossi Passarella Rudi Kurniawan Rudi Kurniawan Saparudin Saparudin Sapitri, Ade Iriani Serrano, Philip Alger M. Sharipuddin, Sharipuddin Sisca Puspita Sepriliani Siti Nurmaini Sukemi Sukemi Sukemi Sukemi Sutarno Sutarno Tri Kurnia Sari Vincen, Vincen Willy, Willy Yesinta Florensia Yogi Tiara Pratama Yulia Hapsari Yundari, Yundari Zahra Alwi Zulkardi Zulkardi