p-Index From 2021 - 2026
6.932
P-Index
This Author published in this journals
All Journal Jurnal Presipitasi : Media Komunikasi dan Pengembangan Teknik Lingkungan Diponegoro Journal of Management Jurnal Ilmiah Mahasiswa FEB EKONOBIS (JURNAL EKONOMI DAN BISNIS) Erudio: Journal of Educational Innovation Jurnal Dimensi JURNAL KEPEMIMPINAN DAN PENGURUSAN SEKOLAH EDUFORTECH Jurnal Hukum Magnum Opus Jurnal Sosial Humaniora Sigli Management Studies and Entrepreneurship Journal (MSEJ) Jurnal Abdi Insani PUBLIKASI PENELITIAN TERAPAN DAN KEBIJAKAN Journal of Digital Marketing and Halal Industry Journal of Intelligent Computing and Health Informatics (JICHI) Jurnal Teknik Informatika (JUTIF) Elastisitas Jurnal Ekonomi Pembangunan Jernih : Jurnal Tugas Akhir Mahasiswa Tafkir: Interdisciplinary Journal of Islamic Education JIKEM: Jurnal Ilmu Komputer, Ekonomi dan Manajemen Jurnal Ilmu Ekonomi Journal of Health Community Service JURNAL ELEKTRO DAN INFORMATIKA SWADHARMA (JEIS) Collegium Studiosum Journal Bureaucracy Journal : Indonesia Journal of Law and Social-Political Governance Jurnal Puan Indonesia Jurnal Pengabdian Inovasi dan Teknologi Kepada Masyarakat Jurnal Ekonomika Dan Bisnis Jurnal Manajemen, Organisasi, Dan Bisnis Malcom: Indonesian Journal of Machine Learning and Computer Science SUARGA : Studi Keberagamaan dan Keberagaman Jurnal Konstanta : Ekonomi Pembangunan Eduvest - Journal of Universal Studies Jurnal Pengabdian Masyarakat Bangsa Jurnal Oportunitas : Ekonomi Pembangunan Coastal and Marine Journal Welfare State Jurnal Hukum Jurnal Paramaedutama Jurnal Pengabdian Masyarakat Linguapedia Jurnal Witana NuCSJo : Nusantara Community Service Journal JIMT: Jurnal Informatika, Multimedia dan Teknik Nusantara Computer and Design Review IJSS: International Journal of Social JILMATEKS Jurnal Ilmiah Mahasiswa Teknik Sipil
Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Journal of Intelligent Computing and Health Informatics (JICHI)

Evaluation of a Semantic Representation-Based Retrieval Model on a Text Dataset Generated from Image Transformation Firmansyah, Muhammad; Marutho, Dhendra; Ilham, Ahmad; Saputra, Irwansyah
Journal of Intelligent Computing & Health Informatics Vol 6, No 2 (2025): September
Publisher : Universitas Muhammadiyah Semarang Press

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.26714/jichi.v6i2.19240

Abstract

The increasing demand for efficient multimodal information retrieval has driven significant research into bridging visual and textual data. While sophisticated models like CLIP offer state-of-the-art semantic alignment, their substantial computational requirements present challenges for deployment in resource-constrained environments. This study introduces a lightweight retrieval framework that leverages the BLIP image captioning model to transform image data into rich textual descriptions, effectively reframing cross-modal retrieval as a text-to-text task. We systematically evaluated three retrieval models BM25, SBERT, and T5 on caption-transformed MSCOCO and Flickr30K datasets, utilizing both classical metrics (Recall@5, mAP) and semantic-aware metrics (SAR@5, Semantic mAP). Experimental results demonstrate that T5 achieves superior semantic performance (SAR@5 = 0.561, Semantic mAP = 0.524), surpassing SBERT (SAR@5 = 0.524) and outperforming the lexical BM25 baseline (SAR@5 = 0.312). Notably, the proposed BLIP+T5 pipeline attains 88% of CLIP’s semantic accuracy while reducing inference latency by approximately 60% and decreasing GPU memory consumption by over 60%. These findings underscore the potential of caption-based retrieval frameworks as scalable, cost-effective alternatives to computationally intensive multimodal systems, especially in latency-sensitive and resource-limited scenarios. Future work will explore fine-tuning strategies, domain-adapted semantic metrics, and robustness under real-world conditions to further advance retrieval effectiveness.
Co-Authors A, Oky Yudi Abdurrahman, Muhammad Farhan Abiyah, Indra Adib Achmad, Amsakar Adhitya Bagus Singandaru Adibrata, Sudirman Ainul Yaqin Ali Rahman Alpino Susanto, Alpino Amri Gunasti Amrillah Andika Andika Andika, Sri Apriani, Isna Apriyandi, Putra Arif Maulana, Arif Arif Rahman Hakim Aslimah, Aslimah Aulia, Nur Afti Az Zahra, Alifia Azizah, Nur Jannah Bagus, Wahyu Bahrudin, Nugi Bhaskara, Renaldi Surya Budi Setiawan, Arip Catur Fatchu Ukhriyawati Chairul Abdi Claudia, Ferby Dhendra Marutho Dyo Arga Nata, Muhamad EMI SALMAH Eri Sasmita Susanto Ervin Nora Susanti, Ervin Nora Farizki, Daniel Achmad Fikri, Sultoni Firdausy, Muhammad Abrar Firmansyah, Esa Frans Simangunsong Gandhi Sutjahjo Guchy, Restia Octane Gunawan, Bambang Ady Gusti Ihda Mazaya, Gusti Ihda Hadi, Moch. Aminuddin Haq, Ahmad Khoir Al Hari Astuti, Henik hartanto hartanto Hendarti, Hendarti Herdinov, Adam Hidayat, Ali Akbar Hidayat, Lutfi Alvian Hikmawati, Inayah Himawan Sutanto, Himawan Ika Kartika Ilham, Ahmad Imroatul Khasanah Irhash, Irhash Irwan Irwan Ismaili, Ismaili Iwan Harsono Jati, Dian Rahayu Karim, M. Ainul KARISMAWAN, PUTU Khairunisa, Assavira Kusdiyanti, Erma L, Adinda Fitriyah Laily Purnamasari, Dewi Lubis, Almatia Efendi M. Irwan M. Irwan, M. Irwan Mahmudi, Hadi Maria, Linda Masrun Masrun masrun Maulana Al Aby, Theo Mauliddin, Rizky Akbar Maulidia, Vera Mizwar, Andi Mochammad Machlul Alamin MUAIDY YASIN, MUAIDY Muftiadi, M. Rizza Muhammad Agreindra Helmiawan Muhammad Alqadri Burga Muhammad Aria Wahyudi Muhammad Iqbal Muhammad Sri Wahyudi Suliswanto Muin, Suriati Abd Musyoliha, Tuti Muzakar, Muzakar Nabela, Nabela Nabilat En Najla, Aura Nasir Hamzah Nasrul, Herni Widiyah Nilawati, Indah Nirtha Nofitasari, Solehati Nopi Stiyati Prihatini Nova, Kiky Rizky Nugraha, Nanda Nugraha, Thomas Fajar Nur Fahruqi, M. Nur Tjendani, Endah Nur, Alqadri Nuraulia, Nasyah Nurul Hasanah Octavia, Azella Nosih Paramita Sari, Paramita Paratama, Faradillah Perangin-angin, Robet Prabowo, Ien Yus Rizal Pramesti, Adelia Widya Prawira, Nurul Adi Prayitno Basuki, Prayitno Purnama, Isnan Purwanti, Irna Putra, Surya Dwi Putri, Megawati Listyana Qurrotul Aini Rahman, Ali Rasyidin, Mukhammad Hafid Rianto, Yan Ridwan Afandi Rijal, Muhammad Nor Ripai, Muhamad Rishan Adha Riswandha, Mohammad Adhiya Riza Miftahul Khair Rizki Eka Putra, Rizki Eka Rizky Firdaus, Rizky Rizqi Puteri Mahyudin Rosdiana Rosdiana S, Raja Eko Dwi SABINA, VINA Sadiq, Ahmad Safitri, Nur Aprilia Sahri Sahri Sahri Sahrudin, Sahrudin Saputra, Irwansyah Sari, Nova Puspita Savira, Aora Septiyani, Santi Sikin, Muhamad Simamora, Andika Sri Langgeng Ratnasari St. Maryam, St. Subhan Purwadinata, Subhan Suhana Suhana Supardi, Sudarman Suphia, Suphia Suriani, Suci Surti, Surti T, Thoyyibah Tanjung , Yanto Titi Yuniarti, Titi Ul Walidaien, Syifa Ulfa, Yakut Nahdiana Ulumuddin, Mochammad Fatih Wahidin Wahidin Wahyuni , Hera Watono Widari, Baiq Widyanor, Julian Yahya, Helmi Yusuf, Maskur Zara Tania Rahmadi