Adaptive Provisioning of Differentiated Services Networks Based on Reinforcement Learning
Hui, T.C.-K. Tham, C.-K.
Hui, T.C.-K.
Citations
Altmetric:
Alternative Title
Abstract
The issue of bandwidth provisioning for Per Hop Behavior (PHB) aggregates in Differentiated Services (DiffServ) networks has received a lot of attention from researchers. However, most proposed methods need to determine the amount of band-width to provision at the time of connection admission. This assumes that traffic in admitted flows always conforms to predefined specifications, which would need some form of traffic shaping or admission control before reaching the ingress of the domain. This paper proposes an adaptive provisioning mechanism based on reinforcement-learning principles, which determines at regular intervals the amount of bandwidth to provision to each PHB aggregate. The mechanism adjusts to maximize the amount of revenue earned from a usage-based pricing model. The novel use of a continuous-space, gradient-based learning algorithm, enables the mechanism to require neither accurate traffic specifications nor rigid admission control. Using ns-2 simulations, we demonstrate using Weighted Fair Queuing, how our mechanism can be implemented in a DiffServ network.
Keywords
Active networks, Adaptive bandwidth provisioning, Differentiated services, Quality-of-service, Reinforcement learning
Source Title
IEEE Transactions on Systems, Man and Cybernetics Part C: Applications and Reviews
Publisher
Series/Report No.
Collections
Rights
Date
2003-11
DOI
10.1109/TSMCC.2003.818472
Type
Article