Claim Missing Document
Check
Articles

Found 1 Documents
Search
Journal : Jurnal Teknik Informatika (JUTIF)

Early Fusion of CNN Features for Multimodal Biometric Authentication from ECG and Fingerprint Using MLP, LSTM, GCN, and GAT Priyatama, Muhammad Abdhi; Nugrahadi, Dodon Turianto; Budiman, Irwan; Farmadi, Andi; Faisal, Mohammad Reza; Purnama, Bedy; Adi, Puput Dani Prasetyo; Ngo, Luu Duc
Jurnal Teknik Informatika (Jutif) Vol. 6 No. 6 (2025): JUTIF Volume 6, Number 6, Desember 2025
Publisher : Informatika, Universitas Jenderal Soedirman

Show Abstract | Download Original | Original Source | Check in Google Scholar | DOI: 10.52436/1.jutif.2025.6.6.5299

Abstract

Traditional authentication methods such as PINs and passwords remain vulnerable to theft and hacking, demanding more secure alternatives. Biometric approaches address these weaknesses, yet unimodal systems like fingerprints or facial recognition are still prone to spoofing and environmental disturbances. This study aims to enhance biometric reliability through a multimodal framework integrating electrocardiogram (ECG) signals and fingerprint images. Fingerprint features were extracted using three deep convolutional networks—VGG16, ResNet50, and DenseNet121—while ECG signals were segmented around the first R-peak to produce feature vectors of varying dimensions. Both modalities were fused at the feature level using early fusion and classified with four deep learning algorithms: Multilayer Perceptron (MLP), Long Short-Term Memory (LSTM), Graph Convolutional Network (GCN), and Graph Attention Network (GAT). Experimental results demonstrated that the combination of VGG16 + LSTM and ResNet50 + LSTM achieved the highest identification accuracy of 98.75 %, while DenseNet121 + MLP yielded comparable performance. MLP and LSTM consistently outperformed GCN and GAT, confirming the suitability of sequential and feed-forward models for fused feature embeddings. By employing R-peak-based ECG segmentation and CNN-driven fingerprint features, the proposed system significantly improves classification stability and robustness. This multimodal biometric design strengthens protection against spoofing and impersonation, providing a scalable and secure authentication solution for high-security applications such as digital payments, healthcare, and IoT devices.
Co-Authors Abidin, Muhammad Ade Romadhony Adhan Mulya Rahmawan Adhyaksa, Resky Adi, Puput Dani Prasetyo Afandi, Rusdi Agung Toto Wibowo Ahmad Zatnika Purwalaksana, Ahmad Zatnika Al Farizy, Firnas Andi Farmadi Andre Sitompul Angga Rusdinar Aprianti Putri Sujana Bambang Pudjoatmodjo Bambang Pudjotatmodjo Bayu Erfianto Bramantya Purbaya Danu Hary Prakoso Darmawati, Irma Ditari Salsabila E. Dodi Wisaksono Sudiharto Dodon Turianto Nugrahadi Dwi Fitrizal Salim Edward Ferdian Ema Rachmawati Ema Rachmawati Ema Rachmawati Entik Insanudin Farid Hidayat Fat'hah Noor Prawira Fat’hah Noor Prawira Fat’hah Noor Prawira Fauzi, Roki Fazmah Arif Yulianto Febryanti Sthevanie Ferdian, Edward Furqoon, Naufal Sayyid Gamma Kosala Gibran, Hilal Gryaningrum Widi Pangestuti Hafidz Al Djohari Ifa, Rista Putri Nur Imamul Akhyar Irwan Budiman Ismail Ismail Koredianto Usman Labib, Fahdi Lindayani, Linlin Mahmud Dwi Sulistiyo Mahmud Imrona Marliani Harahap Muhammad Arzaki Muhammad Jendro Yuwono Muhammad Jendro Yuwono Muhammad Nurdin Muhammad Reza Faisal, Muhammad Reza Muhammad Shafhi Kasyfillah Mutiar, Astri Ngo, Luu Duc Pangestu, Arya Priyatama, Muhammad Abdhi Pudjoadmojo, Bambang Purbaya, Bramantya Putra, Bima Andika Putri, Pinkan Amanda Putu Harry Gunawan Rahmawan, Adhan Mulya Reza Dwi Ansari Rian Febrian Umbara Rikman Aherliwan Rudawan Rimba Whidiana Ciptasari Risnandar, Risnandar Rivan Ardyanto Sutoyo Selly Meliana Setyorini Setyorini Sonia Dian Maniswari Tito Prihambodo Tjokorda Agung Budi Wirayuda Umiatin, Umiatin Wirawan, Ilo Raditio Yuridikta Adha Muslim