Please use this identifier to cite or link to this item: https://doi.org/10.1016/j.is.2009.02.001
Title: Data-driven memory management for stream join
Authors: Wu, J.
Tan, K.-L. 
Zhou, Y.
Keywords: Data stream
Data-driven memory management
Stream join
Issue Date: 2009
Source: Wu, J., Tan, K.-L., Zhou, Y. (2009). Data-driven memory management for stream join. Information Systems 34 (4-5) : 454-467. ScholarBank@NUS Repository. https://doi.org/10.1016/j.is.2009.02.001
Abstract: Memory management is a critical issue in stream processing involving stateful operators such as join. Traditionally, the memory requirement for a stream join is query-driven: a query has to explicitly define a window for each (potentially unbounded) input. The window essentially bounds the size of the buffer allocated for that stream. However, output produced this way may not be desirable (if the window size is not part of the intended query semantic) due to the volatile input characteristics. We discover that when streams are ordered or partially ordered, it is possible to use a data-driven memory management scheme to improve the performance. In this work, we present a novel data-driven memory management scheme, called Window-Oblivious Join (WO-Join), which adaptively adjusts the state buffer size according to the input characteristics. Our performance study shows that, compared to traditional Window-Join (W-Join), WO-Join is more robust with respect to the dynamic input and therefore produces higher quality results with lower memory costs. © 2009 Elsevier B.V. All rights reserved.
Source Title: Information Systems
URI: http://scholarbank.nus.edu.sg/handle/10635/39263
ISSN: 03064379
DOI: 10.1016/j.is.2009.02.001
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

1
checked on Dec 6, 2017

WEB OF SCIENCETM
Citations

1
checked on Nov 22, 2017

Page view(s)

41
checked on Dec 10, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.