Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : IJISTECH

Image Captioning Approach for Household Environment Visual Understanding Dhomas Hatta Fudholi
IJISTECH (International Journal of Information System and Technology) Vol 5, No 3 (2021): October
Publisher : Sekolah Tinggi Ilmu Komputer (STIKOM) Tunas Bangsa

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30645/ijistech.v5i3.135

Abstract

Image captioning task generates a description from an image in a form of a sentence. It holds various critical usage in different applications and domains, such as indexing in retrieval system, by capturing semantic information within the images. In the area of live quality support system, an image captioning model may be used by visual impaired people to achieve visual understanding of their surroundings. In this paper, we present a novel image captioning model that aims to give visual understanding on household environment. To develop the model, we use five different household objects (sinks, chairs, tables, beds, couches) from MS COCO datasets. We create three new captions, in Bahasa Indonesia, for the selected data. The captions describe the name, the color, the position/location, the size, and the type/characteristic of the related object and its close surrounding. InceptionV3 and LSTM architecture is used to train the model with GloVe as the word embedding. In this study, our developed image captioning model can generate caption well and achieved BLEU-1 score of 0.502033, BLEU-2 score of 0.312539, BLEU-3 score of 0.193333, BLEU-4 score of 0.106111, METEOR score of 0.183193, ROUGE-L score of 0.358339, and CIDEr score of 0.348903.
Co-Authors Abdullah Aziz Sembada Abdullah Aziz Sembada Abyan Fadilla Noor Aditya Perwira Joan Dwitama Affan Taufiqur Afrianto, Nurdi Ahmad Fathan Hidayatullah, Ahmad Fathan Ahmad Luthfi Ahmad Rafie Pratama Altesa Yunistira Andi Wafda Andri Heru Saputra Annisa Zahra Ari Farhan Nurihsan Ari Sujarwo Arief Rahman Arrie Kurniawardhani Arrie Kurniawardhani Chandra Kusuma Dewa Chatarina Umbul Wahyuni Dendy Surya Darmawan Deny Rahmalianto Dimas Adi Wibowo Dimas Danu Budi Pratikto Dimas Pamilih Epin Andrian Dimas Panji Eka Jalaputra Dirgahayu, Raden Teduh Dziky ridhwanulah Eko Prasetio Widhi Eko Setiawan Erin Eka Citra Fahmi Adi Nugraha Ferdian Nursulistio Fery Luvita Sari Gilang Persada Bhagawadita Gunanto Gunanto Harry Akbar Al Hakim Ibnu Fajar Arrochman Insanur Hanifuddin Iqbal Syauqi Mubarak Izzan Yattaqi Nugraha Izzati Muhimmah Jaka Nugraha LAILA KUSUMA WARDANI Lizda Iswari M. Ulil Albab Surya Negara Malik Abdul Aziz Mawar Hardiyanti Meilita . Moch Yusuf Asyhari Moch. Bagoes Pakarti, Moch. Bagoes Muhammad Abyanda Tamaza Muhammad Habib Izdhihar Muhammad Rizhan Ridha Muhammad Sulthon Alif Novian Mahardika Putra Purwoko, Agus Raden Teduh Dirgahayu Rahadian Kurniawan Rakhmat Syarifudin Rendy Ressa Sutrisno Ridho Iman Tiyar Risca Naquitasia Royan Abida N. Nayoan Sabar Aritonang Rajagukguk Safira Yuniar Putri Buana Salma Aufa Azaliarahma Salsabila Zahirah Pranida Septia Rani Septia Rani Sigit Nugroho Siti Mutmainah Siwi Cahyaningtyas Sri Mulyati Teduh Dirgahayu Tri Handayani Umar Abdul Aziz Al-Faruq Wahyu Fajrin Mustafa windi astriningsih Yasmin Aulia Ramadhini Yoga Sahria Yudi prayudi Zikri Wahyuzi