Please use this identifier to cite or link to this item:
Title: Join and multi-join processing in data integration systems
Authors: Tan, K.-L. 
Kwang Eng, P. 
Chin Ooi, B. 
Zhang, M. 
Keywords: Blocking execution model
Data integration
Initial response time
Query processing
Symmetric hash join
Issue Date: 2002
Citation: Tan, K.-L., Kwang Eng, P., Chin Ooi, B., Zhang, M. (2002). Join and multi-join processing in data integration systems. Data and Knowledge Engineering 40 (2) : 217-239. ScholarBank@NUS Repository.
Abstract: Query processing in a data integration system is complicated by a lack of quality statistics about the data, unpredictable and bursty data transfer rates, and slow or unavailable data sources. Conventional query processing algorithms, which are based on a blocking execution model, are no longer attractive because of their long initial response time. Moreover, the execution engine may be stalled by slow data delivery rates or unavailable data sources. In this paper, we adopt a non-blocking execution model for evaluating queries. We propose a symmetric partition-based join algorithm, called AJoin, that can operate with small memory requirement, produce first few answer tuples quickly, and blocks only when all available data have been examined. We also examine heuristics to manage the partitions and address the memory management issues of AJoin. To evaluate multi-join query plans, we also proposed two new strategies, m-AJoin and Pm-AJoin. Both strategies evaluate each join operation using AJoin. While m-AJoin accesses data from remote sources in its entirety, Pm-AJoin accesses remote data in chunks of smaller partitions. Our performance study shows the effectiveness of the proposed approaches for join and multi-join processing in a multi-user data integration system. © 2002 Elsevier Science B.V. All rights reserved.
Source Title: Data and Knowledge Engineering
ISSN: 0169023X
DOI: 10.1016/S0169-023X(01)00055-6
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.


checked on Jan 13, 2022


checked on Jan 13, 2022

Page view(s)

checked on Jan 13, 2022

Google ScholarTM



Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.