Towards continuous control for mobile robot navigation: A reinforcement learning and slam based approach

K.A.A. Mustafa, N. Botteghi, B. Sirmacek, M. Poel, S. Stramigioli

    Research output: Contribution to journalConference articleAcademicpeer-review

    3 Citations (Scopus)
    77 Downloads (Pure)


    We introduce a new autonomous path planning algorithm for mobile robots for reaching target locations in an unknown environment where the robot relies on its on-board sensors. In particular, we describe the design and evaluation of a deep reinforcement learning motion planner with continuous linear and angular velocities to navigate to a desired target location based on deep deterministic policy gradient (DDPG). Additionally, the algorithm is enhanced by making use of the available knowledge of the environment provided by a grid-based SLAM with Rao-Blackwellized particle filter algorithm in order to shape the reward function in an attempt to improve the convergence rate, escape local optima and reduce the number of collisions with the obstacles. A comparison is made between a reward function shaped based on the map provided by the SLAM algorithm and a reward function when no knowledge of the map is available. Results show that the required learning time has been decreased in terms of number of episodes required to converge, which is 560 episodes compared to 1450 episodes in the standard RL algorithm, after adopting the proposed approach and the number of obstacle collision is reduced as well with a success ratio of 83% compared to 56% in the standard RL algorithm. The results are validated in a simulated experiment on a skid-steering mobile robot.

    Original languageEnglish
    Pages (from-to)857-863
    Number of pages7
    JournalInternational Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences - ISPRS Archives
    Issue number2/W13
    Publication statusPublished - 4 Jun 2019
    Event4th ISPRS Geospatial Week 2019 - University of Twente, Enschede, Netherlands
    Duration: 10 Jun 201914 Jun 2019
    Conference number: 4


    • Artificial intelligence
    • Deep reinforcement learning
    • Online path planning
    • SLAM
    • Unknown environments

    Fingerprint Dive into the research topics of 'Towards continuous control for mobile robot navigation: A reinforcement learning and slam based approach'. Together they form a unique fingerprint.

    Cite this