Please use this identifier to cite or link to this item:
Title: Adaptive QoS provisioning in wireless ad hoc Networks: A semi-MDP approach
Authors: Yagan, D.
Tham, C.-K. 
Issue Date: 2005
Source: Yagan, D.,Tham, C.-K. (2005). Adaptive QoS provisioning in wireless ad hoc Networks: A semi-MDP approach. IEEE Wireless Communications and Networking Conference, WCNC 4 : 2238-2244. ScholarBank@NUS Repository.
Abstract: This paper presents a joint bandwidth allocation and buffer management scheme for QoS provisioning in a Differentiated Services framework on a wireless ad hoc network. Our proposed scheme models the system as a Semi-Markov Decision Process (SMDP) and uses a novel model-free average reward Reinforcement Learning (RL) algorithm that considers maximizing average long term reward for our network and at the same time, minimizing QoS violations with respect to bandwidth, queueing delay and buffer loss. Due to the nature of the provisioning problem of having continuous and multi-dimensional state and action spaces, we also present a novel function approximation technique (Wire-fitted CMAC) that uses a linear tile-coding structure together with a wire-fitted interpolation. Using a linear approximator facilitates the convergence of our proposed RL algorithm. The Wire-fitted CMAC also generalizes both the state and action values. Simulation results show the effectiveness and convergence of the proposed provisioning scheme with respect to average long term reward. © 2005 IEEE.
Source Title: IEEE Wireless Communications and Networking Conference, WCNC
ISBN: 0780389662
ISSN: 15253511
DOI: 10.1109/WCNC.2005.1424864
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Dec 13, 2017

Page view(s)

checked on Dec 9, 2017

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.