Please use this identifier to cite or link to this item: https://doi.org/10.1109/JSAC.2019.2927062
Title: On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics
Authors: Aljoby, Walid
Wang, Xin 
Fu, Tom ZJ
Ma, Richard TB 
Keywords: Science & Technology
Technology
Engineering, Electrical & Electronic
Telecommunications
Engineering
Network resources allocation
bandwidth allocation
software-defined networking
distributed stream analytics
application-layer optimization
cross-layer design
Issue Date: 1-Aug-2019
Publisher: IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC
Citation: Aljoby, Walid, Wang, Xin, Fu, Tom ZJ, Ma, Richard TB (2019-08-01). On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS 37 (8) : 1688-1702. ScholarBank@NUS Repository. https://doi.org/10.1109/JSAC.2019.2927062
Abstract: © 2019 IEEE. Data communication in cloud-based distributed stream data analytics often involves a collection of parallel and pipelined TCP flows. As the standard TCP congestion control mechanism and its variants are designed for achieving 'fairness' among competing flows and are agnostic to the application layer contexts, the bandwidth allocation among a set of TCP flows traversing bottleneck links often leads to sub-optimal application-layer performance measures, e.g., stream processing throughput or average tuple complete latency. Motivated by this and enabled by the rapid development of the software-defined networking (SDN) techniques, in this paper, we re-investigate the design space of the bandwidth allocation problem and propose a cross-layer framework which utilizes the instantaneous information obtained from the application layer and provides on-the-fly and dynamic bandwidth adjustment algorithms for assisting the stream analytics applications achieving better performance during the runtime. We implement a prototype cross-layer bandwidth allocation framework based on a popular open-source distributed stream processing platform, Apache Storm, together with the OpenDaylight controller, and carry out extensive experiments with real-world analytical workloads on top of a local cluster consisting of ten workstations interconnected by a SDN-enabled fat-tree like testbed. The experiment results clearly validate the effectiveness and efficiency of our proposed framework and algorithms. Finally, we leverage the proposed cross-layer SDN framework and introduce an exemplary mechanism for bandwidth sharing and performance reasoning among multiple active applications and show a case of a point solution on how to approximate application-level fairness.
Source Title: IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS
URI: https://scholarbank.nus.edu.sg/handle/10635/169296
ISSN: 07338716
15580008
DOI: 10.1109/JSAC.2019.2927062
Appears in Collections:Elements
Staff Publications

Show full item record
Files in This Item:
File Description SizeFormatAccess SettingsVersion 
Manuscript.pdfAccepted version2.58 MBAdobe PDF

OPEN

Post-printView/Download

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.