ITEJ (Information Technology Engineering Journals)
Vol. 9 No. 2 (2024): December

Cross-Domain Transfer Learning: Enhancing Deep Neural Networks for Low-Resource Environments

Maria Elena Cruz (University of the Philippines Diliman)
David Miguel (University of the Philippines Diliman)



Article Info

Publish Date
31 Dec 2024

Abstract

Deep neural networks (DNNs) have achieved remarkable success in various domains; however, their performance often relies heavily on large-scale, high-quality labeled datasets, which are scarce in low-resource environments. Cross-domain transfer learning has emerged as a promising technique for adapting pre-trained models from data-rich source domains to low-resource target domains to address this limitation. This study explores innovative strategies to enhance the performance and applicability of DNNs through cross-domain transfer learning, focusing on challenges such as domain disparity, data scarcity, and computational constraints. We evaluate several transfer learning approaches, including feature-based transfer, parameter fine-tuning, and adversarial domain adaptation, across diverse healthcare, agriculture, and natural language processing applications. Experimental results demonstrate significant improvements in model accuracy and generalization in low-resource environments, with accuracy gains of up to 20% compared to models trained from scratch. Additionally, we analyze the impact of transfer learning on reducing training time and computational requirements, making it a viable solution for resource-constrained settings. Despite its potential, the study highlights critical challenges, including negative transfer, model interpretability, and ethical considerations in domain transfer. Addressing these issues, we propose a framework for selecting optimal source domains and enhancing model robustness through hybrid techniques and unsupervised learning. This research emphasizes the transformative potential of cross-domain transfer learning in bridging the gap between data-rich and low-resource environments, paving the way for more equitable and efficient applications of deep learning technologies worldwide.

Copyrights © 2024






Journal Info

Abbrev

itej

Publisher

Subject

Description

ITEj (Information Technology Engineering Journals) is a peer-reviewed journal that focuses on the Development of information systems, electronic-based learning, and the application of algorithms and methods in informatics engineering and software engineering. Besides that, the focus is also on ...