Please use this identifier to cite or link to this item: https://doi.org/10.1016/S0169-023X(01)00055-6
Title: Join and multi-join processing in data integration systems
Authors: Tan, K.-L. 
Kwang Eng, P. 
Chin Ooi, B. 
Zhang, M. 
Keywords: Blocking execution model
Data integration
Initial response time
Multi-join
Query processing
Symmetric hash join
Issue Date: 2002
Source: Tan, K.-L., Kwang Eng, P., Chin Ooi, B., Zhang, M. (2002). Join and multi-join processing in data integration systems. Data and Knowledge Engineering 40 (2) : 217-239. ScholarBank@NUS Repository. https://doi.org/10.1016/S0169-023X(01)00055-6
Abstract: Query processing in a data integration system is complicated by a lack of quality statistics about the data, unpredictable and bursty data transfer rates, and slow or unavailable data sources. Conventional query processing algorithms, which are based on a blocking execution model, are no longer attractive because of their long initial response time. Moreover, the execution engine may be stalled by slow data delivery rates or unavailable data sources. In this paper, we adopt a non-blocking execution model for evaluating queries. We propose a symmetric partition-based join algorithm, called AJoin, that can operate with small memory requirement, produce first few answer tuples quickly, and blocks only when all available data have been examined. We also examine heuristics to manage the partitions and address the memory management issues of AJoin. To evaluate multi-join query plans, we also proposed two new strategies, m-AJoin and Pm-AJoin. Both strategies evaluate each join operation using AJoin. While m-AJoin accesses data from remote sources in its entirety, Pm-AJoin accesses remote data in chunks of smaller partitions. Our performance study shows the effectiveness of the proposed approaches for join and multi-join processing in a multi-user data integration system. © 2002 Elsevier Science B.V. All rights reserved.
Source Title: Data and Knowledge Engineering
URI: http://scholarbank.nus.edu.sg/handle/10635/39103
ISSN: 0169023X
DOI: 10.1016/S0169-023X(01)00055-6
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

2
checked on Dec 6, 2017

WEB OF SCIENCETM
Citations

2
checked on Nov 22, 2017

Page view(s)

73
checked on Dec 17, 2017

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.