微信服务号

微信订阅号

2025-4-6- 7
Home > Archive>Volume 20, Issue 1, 2009 >80-95
PDF HTML XML Export Cite reminder
Efficient Data Maintenance Scheme for Peer-to-Peer Storage Systems
Author:
Affiliation:

  • Article
    • | |
  • Metrics
    • |
  • Reference [26]
    • |
  • Related [20]
    • |
  • Cited by [2]
    • | |
  • Comments
    Abstract:

    This paper presents a new scheme based on the dynamical characteristics of P2P systems. First, the differences in node availability are taken into consideration, and a new data placement algorithm using less redundancy to guarantee target data availability is proposed. Second, permanent failure detector is used to distinguish between permanent and transient failures, which can reduce data recovery cost by decreasing the number of unnecessary repairs. Results from a trace-driven simulation suggest that this scheme can reduce about 80% maintenance bandwidth, compared with traditional methods.

    Reference
    [1] Bhagwan R, Tati K, Cheng Y, Savage S, Voelker G. Total Recall: System support for automated availability management. In: Proc. of the 1st ACM/Usenix Symp. on Networked Systems Design and Implementation (NSDI). 2004. http://www.usenix.org/events /nsdi04/
    [2] Stribling J. OverCite: A cooperative digital research library. In: Proc. of the 4th Int'l Workshop on Peer-to-Peer Systems. 2005. http://www.springerlink.com/content/l05n13078786nt15/
    [3] Adya A, Wattenhofer R, Bolosky W, Castro M, Cermak G, Chaiken R, Douceur J, Howell J, Lorch J, Theimer M. Farsite: Federated, available, and reliable storage for an incompletely trusted environment. In: ACM SIGOPS Operating Systems Review. 2002. http://www.usenix.org/events/osdi02/
    [4] Kubiatowicz J, Wells C, Zhao B, Bindel D, Chen Y, Czerwinski S, Eaton P, Geels D, Gummadi R, Rhea S. OceanStore: An architecture for global-scale persistent storage. In: Proc. of the 9th Int'l Conf. on Architectural Support for Programming Languages and Operating Systems. 2000. 190-201. http://foothill.lcs.mit.edu/asplos2k/
    [5] Dabek F, Kaashoek M, Karger D, Morris R, Stoica I. Wide-Area cooperative storage with CFS. In: Proc. of the 18th ACM Symp. on Operating Systems Principles (SOSP 2001). 2001. http://portal.acm.org/citation.cfm?id=502059.502054
    [6] Blake C, Rodrigues R. High availability, scalable storage, dynamic peer networks: Pick two. In: Proc. of the 9th Workshop on Hot Topics in Operating Systems. 2003. http://www.usenix.org/events/hotos03/
    [7] Tati K, Voelker G. On object maintenance in peer-to-peer systems. In: Proc. of the 5th Int'l Workshop on Peer-to-Peer Systems. 2006. http://iptps06.cs.ucsb.edu/
    [8] Tian J, Dai Y. Understanding the dynamic of peer-to-peer systems. In: Proc. of the 6th Int'l Workshop on Peer-to-Peer Systems. 2007. http://www.iptps.org/papers-2007/TianDai.pdf
    [9] Bhagwan R, Savage S, Voelker G. Understanding availability. In: Proc. of the 2nd Int'l Workshop on Peer-to-Peer Systems (IPTPS 2003). 2003. http://www.springerlink.com/index/EHCFGW36N3J1YPR6.pdf
    [10] Saroiu S, Gummadi P, Gribble S. A measurement study of peer-to-peer file sharing systems. In: Proc. of the Multimedia Computing and Networking 2002 (MMCN 2002). 2002. http://www.cs.princeton.edu/courses/archive/fall02/cs597C/P2P/PerfScalability/
    [11] Weatherspoon H, Chun B, So C, Kubiatowicz J. Long-Term data maintenance in wide-area storage systems: A quantitative approach. Computer, 2005. http://www.eecs.berkeley.edu/～bgchun/csd-05-1404.pdf
    [12] Weatherspoon H, Kubiatowicz J. Erasure coding vs. replication: A quantitative comparison. Proc. of the IPTPS, 2002,2.
    [13] Lin W, Chiu D, Lee Y. Erasure code replication revisited. In: Proc. of the 4th Int'l Conf. on Peer-to-Peer Computing. 2004. 90-97.
    [14] Utard G, Vernois A. Data durability in peer to peer storage systems. In: Proc. of the IEEE Int'l Symp. on Cluster Computing and the Grid. 2004. http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=1336553
    [15] Rodrigues R, Liskov B. High availability in DHTs: Erasure coding vs. replication. In: Proc. of the 4th Int'l Workshop on Peer-to-Peer Systems. 2005. http://www.informatik.uni-trier.de/～ley/db/conf/iptps/iptps2005.html
    [16] Bhagwan R, Savage S, Voelker G. Replication strategies for highly available peer-to-peer storage systems. In: Proc. of the FuDiCo: Future Directions in Distributed Computing. 2002. http://sysnet.ucsd.edu/projects/recall/papers/rep-p2p.pdf
    [17] Douceur J, Wattenhofer R. Competitive hill-climbing strategies for replica placement in a distributed file system. In: Proc. of the 15th DISC. 2001. 48-62. http://www.informatik.uni-trier.de/～ley/db/conf/icdcs/
    [18] Ramanathan M. Increasing object availability in peer-to-peer systems. In: Proc. of the Parallel and Distributed Process Symp. 2004. http://doi.ieeecomputersociety.org/10.1109/IPDPS.2004.1303097
    [19] Schwarz TJE, Xin Q, Miller EL. Availability in global peer-to-peer storage systems. In: Proc. of the 6th Workshop on Distributed Data and Structures (WDAS). 2004. http://lsirwww.epfl.ch/wdas2004/
    [20] Lin WK, Ye C, Chiu DM. Decentralized replication algorithms for improving file availability in P2P networks. In: Proc. of the IWQos 2007. 2007. http://home.ie.cuhk.edu.hk/～dmchiu/iwqos07_cye.pdf
    [21] Chun B, Dabek F, Haeberlen A, Sit E, Weatherspoon H, Kaashoek M, Kubiatowicz J, Morris R. Efficient replica maintenance for distributed storage systems. In: Proc. of the 3rd Symp. on Networked Systems Design and Implementation. 2006. http://www.cise. ufl.edu/～lzhong/Papers/EfficientReplicaMaintenance4DistributedStorageSysstems.pdf
    [22] Cates J. Robust and efficient data management for a distributed hash table [MS. Thesis]. MIT, 2003.
    [23] Duminuco A, Biersack E, En-Najjary T. Proactive replication in distributed storage systems using machine availability estimation. In: Proc. of the Int'l Conf. on Emerging Networking Experiments and Technologies (CoNEXT). 2007.
    [24] The Maze Web site. 2002. http://maze.pku.edu.cn
    [25] Bolosky W, Douceur J, Ely D, Theimer M. Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs. In: Proc. of the 2000 ACM SIGMETRICS Int'l Conf. on Measurement and Modeling of Computer Systems. 2000. 34-43. http://portal.acm.org/citation.cfm?doid=339331.339345
    [26] Kao EPC. An Introduction to Stochastic Processes. Wadsworth Publishing Company, 1997.
    Comments
    Comments
    分享到微博
    Submit
Get Citation

杨 智,朱 君,代亚非. Peer-to-Peer存储系统中一种高效的数据维护方案.软件学报,2009,20(1):80-95

Copy
Share
Article Metrics
  • Abstract:5889
  • PDF: 7173
  • HTML: 0
  • Cited by: 0
History
  • Received:January 29,2008
  • Revised:April 30,2008
Links:Institute of Software, CASChina Computer FederationCASNSFC
You are the first2033305Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address：4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code：100190
Phone：010-62562563 Fax：010-62562533 Email：jos@iscas.ac.cn
Technical Support：Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063