基于动态区间映射的数据对象布局算法
作者:
基金项目:

Supported by the National Natural Science Foundation of China under Grant No.60503042(国家自然科学基金)


A Data Object Placement Algorithm Based on Dynamic Interval Mapping
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献 [11]
  • |
  • 相似文献 [20]
  • |
  • 引证文献
  • | |
  • 文章评论
    摘要:

    高效、可伸缩的数据管理在大规模分布存储系统中日益重要,关键是需要一种能够自动适应存储节点增加或减少的灵活、均衡和可伸缩的数据对象布局与定位方法.提出了一种基于动态区间映射的数据对象布局算法,在均衡数据分配和最少迁移数据方面都是统计意义上最优的,并且支持按照存储节点的权重分配数据和任意的数据对象副本.

    Abstract:

    Efficient and scalable data management becomes increasingly important in large-scale distributed storage systems. A key enabling technique is a flexible, balancing and scalable data object placement and location scheme that automatically adapts to the additions or departures of storage nodes. In this paper, a data object placement algorithm based on dynamic interval mapping is proposed, which is probabilistically optimal in both distributing data evenly and minimizing data movement when storage nodes is changed. Moreover, this algorithm supports weighted allocation of the storage nodes and variable levels of the object replication.

    参考文献
    [1]Ghemawat S,Gobioff H,Leung ST.The google file system.In:Larry P,ed.Proc.of the 19th ACM Symp.on Operating Systems Principles.New York:ACM Press,2003.19-22.
    [2]Xin Q,Miller EL,Long DDE,Brandt SA,Schwarz T,Litwin W.Reliability mechanisms for very large storage systems.In:Moore R,eds.Proc.of the 20th IEEE/the 11th NASA Goddard Conf.on Mass Storage Systems and Technologies.Washington:IEEE Computer Society,2003.146-156.
    [3]Litwin W,Neimat MA,Schneider DA.LH*-A scalable,distributed data structure.ACM Trans.On Database Systems,1996,21(4):480-525.
    [4]Choy DM,Fagin R,Stockmeyer L.Efficiently extendible mappings for balanced data distribution.Algorithmica,1996,16(2):215-232.
    [5]Brinkmann A,Salzwedel K,Scheideler C.Efficient,distributed data placement strategies for storage area networks.In:Miller G,ed.Proc.of the 12th ACM Symp.on Parallel Algorithms and Architectures (SPAA).New York:ACM Press,2000.119-128.
    [6]Brinkmann A,Salzwedel K,Scheideler C.Compact,adaptive placement schemes for non-uniform capacities.In:Maggs B,ed.Proc.of the 14th ACM Symp.on Parallel Algorithms and Architectures (SPAA).New York:ACM Press,2002.53-62.
    [7]Honicky RJ,Miller EL.A fast algorithm for online placement and reorganization of replicated data.In:Dongarra J,ed.Proc.of the17th Int'l Parallel & Distributed Processing Symp.Nice:IEEE Computer Society,2003.
    [8]Weber RO.Information technology-SCSI object-based storage device commands (OSD).Technical Council Proposal Document T10/1355-D,Technical Committee T10,2004.http://www.t10.org/ftp/t10/drafts/osd/osd-r10.pdf
    [9]Zhang YH,Zheng WM.A cluster storage architecture on network-attached object-based devices.Journal of Software,2003,14(2):293-299 (in Chinese with English abstract).http://www.jos.org.cn/1000-9825/14/293.htm
    [10]Matsumoto M,Nishimura T.Mersenne Twister:A 623-dimensionally equidistributed uniform pseudorandom number generator.ACM Trans.on Modeling and Computer Simulation,1998,8(1):3-30.
    [9]张悠慧,郑纬民.基于网络附属对象设备的集群存储体系结构.软件学报,2003,14(2):293-299.http:∥www.jos.org.cn/1000-9825/14/293.htm
引用本文

刘仲,周兴铭.基于动态区间映射的数据对象布局算法.软件学报,2005,16(11):1886-1893

复制
分享
文章指标
  • 点击次数:
  • 下载次数:
  • HTML阅读次数:
  • 引用次数:
历史
  • 收稿日期:2004-09-21
  • 最后修改日期:2005-05-31
文章二维码
您是第位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号