Article Per Year (5 Year)
p-Index From 2020 - 2025
7.987
P-Index
This Author published in this journals
All Journal IAES International Journal of Artificial Intelligence (IJ-AI) IJCCS (Indonesian Journal of Computing and Cybernetics Systems) Seminar Nasional Aplikasi Teknologi Informasi (SNATI) Jurnal Buana Informatika Dinamika Informatika Jurnal Teknologi MAGISTRA Sinergi Jurnal Teknologi Informasi dan Ilmu Komputer Telematika Proceedings Konferensi Nasional Sistem dan Informatika (KNS&I) Seminar Nasional Informatika (SEMNASIF) INFORMATIKA Khazanah Informatika: Jurnal Ilmu Komputer dan Informatika Jurnal Ilmiah KOMPUTASI Sistemasi: Jurnal Sistem Informasi JOIV : International Journal on Informatics Visualization Sinkron : Jurnal dan Penelitian Teknik Informatika Creative Information Technology Journal Jurnal Sains dan Informatika MATRIK : Jurnal Manajemen, Teknik Informatika, dan Rekayasa Komputer Jurnal Penelitian dan Pengabdian Kepada Masyarakat UNSIQ CSRID (Computer Science Research and Its Development Journal) Informasi Interaktif JOISIE (Journal Of Information Systems And Informatics Engineering) EDUMATIC: Jurnal Pendidikan Informatika Jurnal Suara Keadilan Technologia: Jurnal Ilmiah KURVATEK Jurnal Tecnoscienza Respati Jurnal Sistem Komputer & Kecerdasan Buatan Journal of Computer System and Informatics (JoSYC) Jurnal Informa: Jurnal Penelitian dan Pengabdian Masyarakat Madani : Indonesian Journal of Civil Society JURNAL PENDIDIKAN, SAINS DAN TEKNOLOGI Jurnal TIKOMSIN (Teknologi Informasi dan Komunikasi Sinar Nusantara) Jurnal Teknimedia: Teknologi Informasi dan Multimedia Journal of Electrical Engineering and Computer (JEECOM) Jurnal Computer Science and Information Technology (CoSciTech) Jurnal Senopati : Sustainability, Ergonomics, Optimization, and Application of Industrial Engineering Journal of Applied Sciences, Management and Engineering Technology (JASMET) Jurnal Ekonomi dan Teknik Informatika Transformasi Jurnal Ilmiah IT CIDA : Diseminasi Teknologi Informasi Jurnal Dinamika Informatika (JDI) Prosiding Seminar Nasional Sisfotek (Sistem Informasi dan Teknologi Informasi) PELS (Procedia of Engineering and Life Science) JAIA - Journal of Artificial Intelligence and Applications Duta.com : Jurnal Ilmiah Teknologi Informasi dan Komunikasi EXPLORE Prosiding University Research Colloquium COREAI: Jurnal Kecerdasan Buatan, Komputasi dan Teknologi Informasi Prosiding SEMNAS INOTEK (Seminar Nasional Inovasi Teknologi) Journal of Information Technology and society (JITS) Teknomatika: Jurnal Informatika dan Komputer Explore Jurnal Teknologi SWAGATI: Journal of Community Service
Andi Sunyoto
Universitas Amikom Yogyakarta
Humanities Chemical Engineering, Chemistry & Bioengineering Civil Engineering, Building, Construction & Architecture Computer Science & IT Control & Systems Engineering Decision Sciences, Operations Research & Management Earth & Planetary Sciences Economics, Econometrics & Finance Education Electrical & Electronics Engineering Energy Engineering Environmental Science Industrial & Manufacturing Engineering Languange, Linguistic, Communication & Media Law, Crime, Criminology & Criminal Justice Materials Science & Nanotechnology Mathematics Mechanical Engineering Medicine & Pharmacology Social Sciences Transportation Other

Published : 103 Documents Claim Missing Document
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : JOIV : International Journal on Informatics Visualization

 1 
Pre-Trained CNN Architecture Analysis for Transformer-Based Indonesian Image Caption Generation Model Rifqi Mulyawan; Andi Sunyoto; Alva Hendi Muhammad Muhammad
JOIV : International Journal on Informatics Visualization Vol 7, No 2 (2023)
Publisher : Society of Visual Informatics

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.30630/joiv.7.2.1387

Abstract

Classification and object recognition in image processing has significantly improved computer vision tasks. The method is often used for visual problems, especially in picture classification utilizing the Convolutional Neural Network (CNN). In the popular state-of-the-art (SOTA) task of generating a caption on an image, the implementation is often used for feature extraction of an image as an encoder. Instead of performing direct classification, these extracted features are sent from the encoder to the decoder section to generate the sequence. So, some CNN layers related to the classification task are not required. This study aims to determine which CNN pre-trained architecture or model performs best in extracting image features using a state-of-the-art Transformer model as its decoder. Unlike the original Transformer’s architecture, we implemented a vector-to-sequence way instead of sequence-to-sequence for the model. Indonesian Flickr8k and Flick30k datasets were used in this research. Evaluations were carried out using several pre-trained architectures, including ResNet18, ResNet34, ResNet50, ResNet101, VGG16, Efficientnet_b0, Efficientnet_b1, and Googlenet. The qualitative model inference results and quantitative evaluation scores were analyzed in this study. The test results show that the ResNet50 architecture can produce stable sequence generation with the highest accuracy value. With some experimentation, finetuning the encoder can significantly increase the model evaluation score. As for future work, further exploration with larger datasets like Flickr30k, MS COCO 14, MS COCO 17, and other image captioning datasets in Indonesian also implementing a new Transformers-based method can be used to get a better Indonesian automatic image captioning model. 
Co-Authors *, Pramono A.A. Ketut Agung Cahyawan W Aam Shodiqul Munir Abdul Jalil Rozaqi Abdul Jalil Rozaqi Abdul Mizwar A. Rahim Abidarin Rosidi Abidarin Rosidi Ade Kurniawan kurniawan Ade Pujianto Afis Julianto Afis Julianto Agus Harjoko Agus Harjoko AGUS PURWANTO Ahmad Sanusi Mashuri Aidina Ristyawan, Aidina Alva Hendi Muhammad Alva Hendi Muhammad Alva Hendi Muhammad Muhammad Ana Wati Ndarbeni Anna Baita Annas Al Amin Arif Sutikno Asro Nasiri Asro Nasiri Asro Nasiri Astria, Kadek Kiki B, Arijal Bambang Soedijono Bambang Soedijono WA Banu Dwi Putranto Bayu Anugerah Putra Bayu Setiaji Bonifacius Vicky Indriyono Bonifacius Vicky Indriyono, Bonifacius Vicky Cahyo, D. Diffran Nur Dhanar Intan Surya Saputra Diansyah, Ahmad Febri Dwi Sari Widyowaty Dwi Yuli Prasetyo Eka Yulia Sari Eko Pramono Eko Pramono Ema Utami Emha Taufiq Luthfi Emha Taufiq Luthfi Ferry Wahyu Wibowo Ferry Wahyu Wibowo Firdiyan Syah Fitri Handayani Gagah Gumelar Gori, Takhamo Hani Atun Mumtahana Hani Atun Mumtahana Hani Setiani Hanif Al Fatta Hanif Al Fatta Hanif Al Fatta Hanif Al Fatta Harianto, Harianto Hidayat Hidayat Ibnu Hadi Purwanto Ikhwan Baidlowi Sumafta Ikmah Ikmah Indah Nofikasari Indra Irawanto Ismail, Muhamad Yusuf Isthigosah, Maie K Kusrini Kapti . kurniawan, Ade Kurniawan Kurniawan, Mei P Kusnawi Kusnawi Kusnawi Kusnawi Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Kusrini Liana Trihardianingsih Licantik M rudyanto Arief M. Afriansyah M. Hanafi M. Rudyanto Arief M. Suyanto M. Suyanto, M. M. Syukri Mustafa Maie Istighosah Mei P. Kurniawan Mohammad Suyanto Mudawil Qulub Muhammad Rudyanto Arief Muhammad Setiyawan Muhammad, Anva Hendi Muhartini, Sitti Mumtahana, Hani Atun Mursyid Ardiansyah Nalendra, Adimas Ketut Nasiri, Asro Nizar Haris Masruri Ni’matur Rohim Noordin Asnawi Norlaila2 Nugraha, Anggit Ferdita Nulngafan, Nulngafan Nur Arifin Akbar Parsiyono Parsiyono Patmawati Patmawati, Patmawati Pramono * Putranto, Dinar Wakhid Quratul Ain Rafli Junaidi Kasim Rahim Jamal Rahmat Hidayat Raynaldi Fatih Amanullah Ria Andriani Rifda Faticha Alfa Aziza Rifqi Mulyawan Riyanto, Thomas Pramuji Singgih Riza Marsuciati Rizfi Syarif Rizky Arya Kurniawan Rudi Prietno Sahirul Muklis Saiful Bahri Salmuasih - Samsul Bahri Sari, Rita Novita Setiawan Budiman Sholihin, Iasya Silvi Agustanti Bambang Singgih Arif Widodo Slamet Triyanto Soedijono W A, Bambang Sudarmawan Sudarmawan Sudarmawan, Sudarmawan Sudiana Sudiana Sukresno Sukresno Sulistyowati Sulistyowati Suliswaningsih Suliswaningsih Supomo, Eko Sutejo, Danang Syah, Firdiyan Syah, Firdiyan Syukirman Amir TONNY HIDAYAT Ulinuha, Hinova Rezha W., Bambang Soedijono WA, Bambang Soedijono Wahyu Caesarendra Wahyu Hidayat Wihayati, Wihayati Windarni, Vikky Aprelia Windha Mega Pradnya Dhuhita Wing Wahyu Winarno Yoga Dwi Pambudi Yoga Pristyanto Yohanes Setyo Prabowo, Yohanes Setyo Yusuf Sutanto Zaipin, Zaipin