Please use this identifier to cite or link to this item:
Title: Danger-aware Adaptive Composition of DRL Agents for Self-navigation
Authors: Zhang, Wei 
Zhang, Yunfeng 
Liu, Ning 
Keywords: cs.RO
Issue Date: 2018
Citation: Zhang, Wei, Zhang, Yunfeng, Liu, Ning (2018). Danger-aware Adaptive Composition of DRL Agents for Self-navigation. ScholarBank@NUS Repository.
Abstract: Self-navigation, referred as the capability of automatically reaching the goal while avoiding collisions with obstacles, is a fundamental skill required for mobile robots. Recently, deep reinforcement learning (DRL) has shown great potential in the development of robot navigation algorithms. However, it is still difficult to train the robot to learn goal-reaching and obstacle-avoidance skills simultaneously. On the other hand, although many DRL-based obstacle-avoidance algorithms are proposed, few of them are reused for more complex navigation tasks. In this paper, a novel danger-aware adaptive composition (DAAC) framework is proposed to combine two individually DRL-trained agents, obstacle-avoidance and goal-reaching, to construct a navigation agent without any redesigning and retraining. The key to this adaptive composition approach is that the value function outputted by the obstacle-avoidance agent serves as an indicator for evaluating the risk level of the current situation, which in turn determines the contribution of these two agents for the next move. Simulation and real-world testing results show that the composed Navigation network can control the robot to accomplish difficult navigation tasks, e.g., reaching a series of successive goals in an unknown and complex environment safely and quickly.
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
1809.03847v2.pdf837.74 kBAdobe PDF



Page view(s)

checked on Oct 14, 2021


checked on Oct 14, 2021

Google ScholarTM


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.