Please use this identifier to cite or link to this item:
https://doi.org/10.1109/WCNC.2005.1424864
Title: | Adaptive QoS provisioning in wireless ad hoc Networks: A semi-MDP approach | Authors: | Yagan, D. Tham, C.-K. |
Issue Date: | 2005 | Citation: | Yagan, D.,Tham, C.-K. (2005). Adaptive QoS provisioning in wireless ad hoc Networks: A semi-MDP approach. IEEE Wireless Communications and Networking Conference, WCNC 4 : 2238-2244. ScholarBank@NUS Repository. https://doi.org/10.1109/WCNC.2005.1424864 | Abstract: | This paper presents a joint bandwidth allocation and buffer management scheme for QoS provisioning in a Differentiated Services framework on a wireless ad hoc network. Our proposed scheme models the system as a Semi-Markov Decision Process (SMDP) and uses a novel model-free average reward Reinforcement Learning (RL) algorithm that considers maximizing average long term reward for our network and at the same time, minimizing QoS violations with respect to bandwidth, queueing delay and buffer loss. Due to the nature of the provisioning problem of having continuous and multi-dimensional state and action spaces, we also present a novel function approximation technique (Wire-fitted CMAC) that uses a linear tile-coding structure together with a wire-fitted interpolation. Using a linear approximator facilitates the convergence of our proposed RL algorithm. The Wire-fitted CMAC also generalizes both the state and action values. Simulation results show the effectiveness and convergence of the proposed provisioning scheme with respect to average long term reward. © 2005 IEEE. | Source Title: | IEEE Wireless Communications and Networking Conference, WCNC | URI: | http://scholarbank.nus.edu.sg/handle/10635/69218 | ISBN: | 0780389662 | ISSN: | 15253511 | DOI: | 10.1109/WCNC.2005.1424864 |
Appears in Collections: | Staff Publications |
Show full item record
Files in This Item:
There are no files associated with this item.
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.