International Journal of Electrical and Computer Engineering
Vol 15, No 3: June 2025

Indoor navigation for mobile robots based on deep reinforcement learning with convolutional neural network

Dang, Khoa Nguyen (Unknown)
Thi, Van Tran (Unknown)
Thang, Nguyen Van (Unknown)



Article Info

Publish Date
01 Jun 2025

Abstract

The mobile robot is an intelligent device that can achieve many tasks in life. For autonomous, navigation based on the line on the ground is often used because it helps the robot to move along a predefined path, simplifies the path planning, and reduces the computational load. This paper presents a method for navigating the four-wheel mobile robot to track a line based on a deep Q-network as a control algorithm to desire the action of the mobile robot and a camera as a feedback sensor to detect the line. The control algorithm uses a convolution neural network (CNN) to generate the mobile robot action, defined as an agent of deep Q-network. CNN uses images from the camera to define the state of the deep Q network. The simulations are performed based on Gazebo software which includes a 3D environment, mobile robot model, line, and Python programming. The results demonstrate the high-performance tracking of mobile robots with complex line trajectories, achieving errors of less than 100 px, which is compared with the traditional vision method (VNS), the MSE of the proposal method is 0.0264 lower than VNS with 0.0406. Showcases proved convincingly that effectiveness suggested a control approach.

Copyrights © 2025






Journal Info

Abbrev

IJECE

Publisher

Subject

Computer Science & IT Electrical & Electronics Engineering

Description

International Journal of Electrical and Computer Engineering (IJECE, ISSN: 2088-8708, a SCOPUS indexed Journal, SNIP: 1.001; SJR: 0.296; CiteScore: 0.99; SJR & CiteScore Q2 on both of the Electrical & Electronics Engineering, and Computer Science) is the official publication of the Institute of ...