Please use this identifier to cite or link to this item: https://doi.org/10.1109/ICON.2006.302580
Title: Coordinated sensing coverage in sensor networks using distributed reinforcement learning
Authors: Renaud, J.-C.
Tham, C.-K. 
Keywords: Coordinated sensing coverage
Distributed reinforcement learning
Multi-agent systems
Sensor networks
Issue Date: 2006
Source: Renaud, J.-C.,Tham, C.-K. (2006). Coordinated sensing coverage in sensor networks using distributed reinforcement learning. Proceedings - 2006 IEEE International Conference on Networks, ICON 2006 - Networking-Challenges and Frontiers 1 : 180-185. ScholarBank@NUS Repository. https://doi.org/10.1109/ICON.2006.302580
Abstract: A multi-agent system (MAS) approach on wireless sensor networks (WSNs) comprising sensor-actuator nodes is very promising as it has the potential to tackle the resource constraints inherent in these networks by efficiently coordinating the activities among the nodes. In this paper, we consider the coordinated sensing coverage problem and study the behavior and performance of four distributed reinforcement learning (DRL) algorithms: (i) fully distributed Q-learning, (ii) Distributed Value Function (DVF), (iii) Optimistic DRL, and (iv) Frequency Maximum Q-learning (FMQ). We present results from simulation studies and actual implementation of these DRL algorithms on Crossbow Mica2 motes, and compare their performance in terms of incurred communication and computational costs, energy consumption and the achieved level of sensing coverage. Issues such as convergence to local or global optima, as well as speed of convergence are also considered. These implementation results show that the DVF agents outperform other agents in terms of both convergence and energy consumption. © 2006 IEEE.
Source Title: Proceedings - 2006 IEEE International Conference on Networks, ICON 2006 - Networking-Challenges and Frontiers
URI: http://scholarbank.nus.edu.sg/handle/10635/69750
ISBN: 0780397460
DOI: 10.1109/ICON.2006.302580
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

6
checked on Dec 13, 2017

Page view(s)

29
checked on Dec 16, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.