Please use this identifier to cite or link to this item: https://doi.org/10.1007/978-3-642-37450-0_1
Title: Shortest path computation over disk-resident large graphs based on extended bulk synchronous parallel methods
Authors: Wang, Z.
Gu, Y.
Zimmermann, R. 
Yu, G.
Issue Date: 2013
Source: Wang, Z.,Gu, Y.,Zimmermann, R.,Yu, G. (2013). Shortest path computation over disk-resident large graphs based on extended bulk synchronous parallel methods. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) 7826 LNCS (PART 2) : 1-15. ScholarBank@NUS Repository. https://doi.org/10.1007/978-3-642-37450-0_1
Abstract: The Single Source Shortest Path (SSSP) computation over large graphs has raised significant challenges to the memory capacity and processing efficiency. Utilizing disk-based parallel iterative computing is an economic solution. However, costs of disk I/O and communication affect the performance heavily. This paper proposes a state-transition model for SSSP and then designs two optimization strategies based on it. First, we introduce a tunable hash index to reduce the scale of wasteful data loaded from the disk. Second, we propose a new iterative mechanism and design an Across-step Message Pruning (ASMP) policy to deal with the communication bottleneck. The experimental results illustrate that our SSSP computation is 2 times faster than a basic Giraph (a memory-resident parallel framework) implementation. Compared with Hadoop and Hama (disk-resident parallel frameworks), the speedup is 21 to 43. © Springer-Verlag 2013.
Source Title: Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
URI: http://scholarbank.nus.edu.sg/handle/10635/78351
ISBN: 9783642374494
ISSN: 03029743
DOI: 10.1007/978-3-642-37450-0_1
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

Page view(s)

37
checked on Feb 17, 2018

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.