Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Intelligent Systems Technology and Informatics

Indonesian Sign Language Alphabet Image Classification using Vision Transformer Agustiansyah, Yoga; Kurniadi, Dede
Journal of Intelligent Systems Technology and Informatics Vol 1 No 1 (2025): JISTICS, March 2025
Publisher : Aliansi Peneliti Informatika

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.64878/jistics.v1i1.5

Abstract

Effective communication is fundamental for social interaction, yet individuals with hearing impairments often face significant barriers. Indonesian Sign Language (BISINDO) is a vital communication tool for the deaf community in Indonesia. However, limited public understanding of BISINDO creates communication barriers, which necessitate an accurate automatic recognition system. This research aims to investigate the efficacy of the Vision Transformer (ViT) model, a state-of-the-art deep learning architecture, for classifying static BISINDO alphabet images, exploring its potential to overcome the limitations of previous approaches through robust feature extraction. The methodology involved utilizing a dataset of 26 BISINDO alphabet classes, which underwent comprehensive preprocessing, including class balancing via augmentation and image normalization. The Google/vit-base-patch16-224-in21k ViT model was adapted with a custom classification head and trained using a two-phase strategy: initial feature extraction with a frozen backbone, followed by full network fine-tuning. The fine-tuned Vision Transformer model demonstrated exceptional performance on the unseen test set, achieving an accuracy of 99.77% (95% CI: 99.55%–99.99%), precision of 99.77%, recall of 99.72%, and a weighted F1-score of 0.9977, significantly surpassing many previously reported methods. The findings compellingly confirm that the ViT model is a highly effective and robust solution for BISINDO alphabet image classification, underscoring the potential of advanced Transformer-based architectures in developing accurate assistive communication technologies to benefit the Indonesian deaf and hard-of-hearing community.
Co-Authors Abania, Nia Abdulah, Farhan Naufal Abdurrahman, Fauzan Abdussalam, Iqbal Abdussalam Abdusy Syakur Amin Ade Sutedi Ade Sutedi Ade Sutedi, Ade Adiwangsa, Alfian Akmal Agus Hermawan Agus Nugraha Agustiansyah, Yoga Ahmad Habib Lutfi Aisyah Fitri Islami Ajif, Arvin Muhammad Ajiz, Rafi Nurkholiq Akbar, Gugun Geusan Alamsyah, Renaldy Aldy Rialdy Atmadja Ali Djamhuri Alisha Fauzia, Fathia Alkamal, Chaerulsyah Alvin Zainal Musthafa Alwan Nul Hakim Amrulloh, Muhammad Fawaz Andri Saepuloh Aneu Suci Nurjanah Asri Indah Pertiwi Asri Mulyani Asri Rahayu Ningsih Ayu Suryani B. Balilo Jr , Benedicto B. Balilo Jr, Benedicto Balilo Jr, Benedicto B. Barlinti Maryam Budik Burhanuddin, Ridwan Cahya Mutiara Dede Sopiah Della Adelia Anugrah Detila Rostilawati Dewi Tresnawati Dhea Arynie Noor Annisa Diar Nur Rizky Diaz Radhian Salam Diazki, Moch Haiqal Diki Jaelani Dini Destiani Siti Fatimah Diva Nuratnika Rahayu Dudy Mohammad Arifin Dyka Afan Afthori Dzikri Nursyaban Efi Sofiah Elsen, Rickard Eri Satria Erick Fernando B311087192 Erwan Yani Erwan Yani, Erwan Erwin Gunadhi Rahayu, Raden Erwin Widianto Fadillah, Hadi Bagus Faisal, Ridwan Nur Fajar Rahman Faturrohman, Nadhif Fauziah, Fathia Alisha Fauziyah, Asyifa Fikri Zakaria Rahman Firmansyah, Marshal Fitri Nuraeni Fitriani, Ranti Fitriyani Gelar Panca Ginanjar Ghilman Hasbi Basith Gisna Fauzian Dermawan H. Bunyamin Hadi Wijaya, Tryana Haekal, Mohamad Fikri Hamzah Nurrifqi Fakhri Fikrillah Hari Ilham Nur Akbar Hasfi Syahrul Ramadhan Hazar, Aura Fitria Helmalia P, Nabilla Febriani Hendri Aji Pangestu Heri Johari Heri Suhendar Heri Suhendar Hilmi Aulawi Ida Farida Ikbal Lukmanul Hakim Ikhrom, Taufik Darul Ikmal Muhammad Fadhil Ilham Muhamad Ramdan Imas Dewi Ariyanti Inda Muliana Indra Trisna Raharja Indri Tri Julianto Indri Tri Julianto Intan Sri Fatmalasari Irawan, Muhammad Randy Irfan Qusaeri Irfanov, Muhammad Irsyad Ahmad Iskandar, Joko Jajang Jaenudin Jajang Romansyah Jembar, Tegar Hanafi Khaerunisa, Nisrina Khoerunisa, Sarah Kusmayadi, Kusmayadi Latif, A. Abdul Latifah, Ayu Leni Fitriani Leni Fitriani, Leni Lia Amelia Lindayani, Lindayani M. Mesa Fauzi Mahendra Akbar Musadad Maulana , Muhammad Arief Maulana, Ahmad Rakha Maulana, Ilham Ahmad Maulana, Yusep Maulina, Wina Senja Meta Regita Mochamad Deni Ramdani Muhamad Solihin Muhammad Abdul Yusup Hanifah Muhammad Affan Al Sidqi Muhammad Rikza Nashrulloh Muhammad Saleh Muhammad Sanusi Muhammad Wildan Muliana, Inda Muttaqin, Moch Riefky Chaerul Nita Nurliawati Nugraha, M Aldi Nugraha, Nikolas Pranata Nurfadillah, Rifa Sri Nurhaliza, Nabila Putri Nurlisina, Elisa Nurpatmah, Lisna Nursa'diah, Rifania Sapta Nursyaban, Dzikri Nurul Fauziah Nurul Khumaida Nurzaman, Muhammad Zein Omar Komarudin Pratama, Reifalga Gais Prayoga, Moch. Gumelar Putri, Mita Hidayani Raharja, Indra Trisna Rahayu, Diva Nuratnika Rahayu, Raden Erwin Gunadhi Rahmat, Agil Rahmi, Murni Lestari Rajab, Ilham Syahidatul Ramdhan, Dekha Ramdhani Hidayat Randy Wardan Ridwan Setiawan Ridwan Setiawan Ridwan Setiawan Ridwan Setiawan Rifky Muhammad Shidiq Rinda Cahyana Rinda Cahyana Risfiyanisa Fasha Rizki Fauziah Roeri Fajri Firdaus Rohman, Fauza Rohmanto, Ricky Rostina Sundayana Rubi Setiawan Rudi Sutrio Safei P, M Iqbal Ismail Sarah Khoerunisa Sermana, Elsa Maharani Sheny Puspita Indriyani Siti Rima Fauziyah Sofwan Hamdan Fikri Sopiah, Dede Sri Intan Multajam Sri Mulyani Lestari Sri Rahayu SRI RAHAYU Sri Rahayu Syahrul Sidiq Syaiffani, Moch Assami Tina Maryana Undang Indrajaya W, Faksi Ahmad Wahidah, Tania Agusviani Wiwit Septiani Yanti Sofiyanti Yayat Supriatna Yoga Handoko Agustin Yosep Septiana Yosep Septiana Yuni Yuliani Yusfar Ilhaqul Choer Yusuf Mauluddin Zaqiah, Neng Nufus Zulkarnaen, Ade Iskandar