Please use this identifier to cite or link to this item:
https://doi.org/10.1109/JSAC.2019.2927062
Title: | On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics | Authors: | Aljoby, Walid Wang, Xin Fu, Tom ZJ Ma, Richard TB |
Keywords: | Science & Technology Technology Engineering, Electrical & Electronic Telecommunications Engineering Network resources allocation bandwidth allocation software-defined networking distributed stream analytics application-layer optimization cross-layer design |
Issue Date: | 1-Aug-2019 | Publisher: | IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC | Citation: | Aljoby, Walid, Wang, Xin, Fu, Tom ZJ, Ma, Richard TB (2019-08-01). On SDN-Enabled Online and Dynamic Bandwidth Allocation for Stream Analytics. IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS 37 (8) : 1688-1702. ScholarBank@NUS Repository. https://doi.org/10.1109/JSAC.2019.2927062 | Abstract: | © 2019 IEEE. Data communication in cloud-based distributed stream data analytics often involves a collection of parallel and pipelined TCP flows. As the standard TCP congestion control mechanism and its variants are designed for achieving 'fairness' among competing flows and are agnostic to the application layer contexts, the bandwidth allocation among a set of TCP flows traversing bottleneck links often leads to sub-optimal application-layer performance measures, e.g., stream processing throughput or average tuple complete latency. Motivated by this and enabled by the rapid development of the software-defined networking (SDN) techniques, in this paper, we re-investigate the design space of the bandwidth allocation problem and propose a cross-layer framework which utilizes the instantaneous information obtained from the application layer and provides on-the-fly and dynamic bandwidth adjustment algorithms for assisting the stream analytics applications achieving better performance during the runtime. We implement a prototype cross-layer bandwidth allocation framework based on a popular open-source distributed stream processing platform, Apache Storm, together with the OpenDaylight controller, and carry out extensive experiments with real-world analytical workloads on top of a local cluster consisting of ten workstations interconnected by a SDN-enabled fat-tree like testbed. The experiment results clearly validate the effectiveness and efficiency of our proposed framework and algorithms. Finally, we leverage the proposed cross-layer SDN framework and introduce an exemplary mechanism for bandwidth sharing and performance reasoning among multiple active applications and show a case of a point solution on how to approximate application-level fairness. | Source Title: | IEEE JOURNAL ON SELECTED AREAS IN COMMUNICATIONS | URI: | https://scholarbank.nus.edu.sg/handle/10635/169296 | ISSN: | 07338716 15580008 |
DOI: | 10.1109/JSAC.2019.2927062 |
Appears in Collections: | Elements Staff Publications |
Show full item record
Files in This Item:
File | Description | Size | Format | Access Settings | Version | |
---|---|---|---|---|---|---|
Manuscript.pdf | Accepted version | 2.58 MB | Adobe PDF | OPEN | Post-print | View/Download |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.