Please use this identifier to cite or link to this item: https://scholarbank.nus.edu.sg/handle/10635/171890
Title: Danger-aware Adaptive Composition of DRL Agents for Self-navigation
Authors: Zhang, Wei 
Zhang, Yunfeng 
Liu, Ning 
Keywords: cs.RO
cs.RO
Issue Date: 2018
Citation: Zhang, Wei, Zhang, Yunfeng, Liu, Ning (2018). Danger-aware Adaptive Composition of DRL Agents for Self-navigation. ScholarBank@NUS Repository.
Abstract: Self-navigation, referred as the capability of automatically reaching the goal while avoiding collisions with obstacles, is a fundamental skill required for mobile robots. Recently, deep reinforcement learning (DRL) has shown great potential in the development of robot navigation algorithms. However, it is still difficult to train the robot to learn goal-reaching and obstacle-avoidance skills simultaneously. On the other hand, although many DRL-based obstacle-avoidance algorithms are proposed, few of them are reused for more complex navigation tasks. In this paper, a novel danger-aware adaptive composition (DAAC) framework is proposed to combine two individually DRL-trained agents, obstacle-avoidance and goal-reaching, to construct a navigation agent without any redesigning and retraining. The key to this adaptive composition approach is that the value function outputted by the obstacle-avoidance agent serves as an indicator for evaluating the risk level of the current situation, which in turn determines the contribution of these two agents for the next move. Simulation and real-world testing results show that the composed Navigation network can control the robot to accomplish difficult navigation tasks, e.g., reaching a series of successive goals in an unknown and complex environment safely and quickly.
URI: https://scholarbank.nus.edu.sg/handle/10635/171890
Appears in Collections:Staff Publications
Elements

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
1809.03847v2.pdf837.74 kBAdobe PDF

OPEN

Post-printView/Download

Page view(s)

107
checked on Oct 14, 2021

Download(s)

3
checked on Oct 14, 2021

Google ScholarTM

Check


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.