Journal of Future Artificial Intelligence and Technologies
Vol. 1 No. 3 (2024): December 2024

Comparative Analysis of Modified Q-Learning and DQN for Autonomous Robot Navigation

Khlif, Nessrine (Unknown)
Khraief, Nahla (Unknown)
Belghith, Safya (Unknown)



Article Info

Publish Date
14 Dec 2024

Abstract

Autonomous mobile robot navigation integrates localization, mapping, and path planning to enable effective operation in complex environments. This study compares a modified Q-learning algorithm with a Deep Q-Network (DQN) in a simulated gym environment, focusing on convergence speed, success rate, and computational efficiency. The modified Q-learning algorithm converged after 44 episodes, outperforming the DQN, which required 400 episodes. It achieved a success rate of 69.6% with a cumulative reward that surpassed the DQN in fewer episodes, while completing simulations in just 9 minutes compared to 400 minutes for the DQN. These results demonstrate the modified Q-learning’s efficiency in addressing the exploration-exploitation trade-off and navigating complex environments. This study highlights the potential of the modified Q-learning algorithm for real-world applications in robotics and autonomous navigation, providing a foundation for future research in intelligent path planning

Copyrights © 2024






Journal Info

Abbrev

FAITH

Publisher

Subject

Computer Science & IT

Description

Journal of Future Artificial Intelligence and Technologies E-ISSN: 3048-3719 is an international journal that delves into the comprehensive spectrum of artificial intelligence, focusing on its foundations, advanced theories, and applications. All accepted articles will be published online, receive a ...