Please use this identifier to cite or link to this item: https://doi.org/10.1109/CLUSTER.2010.24
Title: CDRM: A cost-effective dynamic replication management scheme for cloud storage cluster
Authors: Wei, Q.
Veeravalli, B. 
Gong, B.
Zeng, L.
Feng, D.
Keywords: Cost-effective
Dynamic replication management
HDFS
Load balance
Issue Date: 2010
Source: Wei, Q.,Veeravalli, B.,Gong, B.,Zeng, L.,Feng, D. (2010). CDRM: A cost-effective dynamic replication management scheme for cloud storage cluster. Proceedings - IEEE International Conference on Cluster Computing, ICCC : 188-196. ScholarBank@NUS Repository. https://doi.org/10.1109/CLUSTER.2010.24
Abstract: Data replication has been widely used as a mean of increasing the data availability of large-scale cloud storage systems where failures are normal. Aiming to provide cost-effective availability, and improve performance and load-balancing of cloud storage, this paper presents a cost-effective dynamic replication management scheme referred to as CDRM. A novel model is proposed to capture the relationship between availability and replica number. CDRM leverages this model to calculate and maintain minimal replica number for a given availability requirement. Replica placement is based on capacity and blocking probability of data nodes. By adjusting replica number and location according to workload changing and node capacity, CDRM can dynamically redistribute workloads among data nodes in the heterogeneous cloud. We implemented CDRM in Hadoop Distributed File System (HDFS) and experiment results conclusively demonstrate that our CDRM is cost effective and outperforms default replication management of HDFS in terms of performance and load balancing for large-scale cloud storage. © 2010 IEEE.
Source Title: Proceedings - IEEE International Conference on Cluster Computing, ICCC
URI: http://scholarbank.nus.edu.sg/handle/10635/69572
ISBN: 9780769542201
ISSN: 15525244
DOI: 10.1109/CLUSTER.2010.24
Appears in Collections:Staff Publications

Show full item record
Files in This Item:
There are no files associated with this item.

SCOPUSTM   
Citations

105
checked on Feb 20, 2018

Page view(s)

39
checked on Feb 16, 2018

Google ScholarTM

Check

Altmetric


Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.