支持高并发度的大容量媒体库
作者:
基金项目:

Supported by the National Natural Science Foundation of China under Grant Nos.60373004, 60373005, 90412006, 90412011, 60573110 (国家自然科学基金); the National Grand Fundamental Research 973 of China under Grant No.2004CB318000, 2003CB316907 (国家重点基础研究发展规划(973))


Large-Capacity Media Library Supporting Highly Simultaneous Access
  • 摘要
  • | |
  • 访问统计
  • |
  • 参考文献 [17]
  • |
  • 相似文献 [20]
  • |
  • 引证文献
  • | |
  • 文章评论
    摘要:

    支持大容量和高并发度的媒体库越来越流行.利用传统的基于纯粹的服务器/客户端、对等网络或网格的方法构造这种类型的媒体库,难以同时满足高并发度和可靠服务的要求.提出了一种结合了网格和对等网络(peer-to-peer)的媒体库架构--NeoMedia.专用的和志愿参与服务的节点在系统服务器的支持下,形成了一个大容量的虚拟媒体存储池,请求服务的节点在从媒体存储池下载媒体文件的同时,在系统服务器的协调下,采用对等网络的方式相互提供服务,从而进一步提升系统的性能.系统服务器还根据虚拟媒体池的负载模式和强度的变化自动调整服务的资源分配,自适应地优化系统的性能.NeoMedia面向的是下载完毕再观看这种可以充分利用服务器的带宽和客户机能力的模式.理论分析表明:系统能够在使用较少的系统带宽的情况下,支持巨大的并发的用户请求,并且提供非平凡服务.

    Abstract:

    Large-Capacity media libraries supporting highly simultaneous access are more and more popular. Media libraries based on traditional client/server mode, or pure Grid or P2P can hardly meet the requirements of both high concurrency and reliable service. This paper proposes a new architecture combining Grid and P2P for media library—NeoMedia. It consists of the dedicated and volunteered nodes supported by the system server and forms a virtual media pool of large capacity. Coordinated by the system server, nodes requesting files from the media pool serve each other in the style of P2P, which further enhances the system’s performance. According to access pattern and intensity, the system server automatically adjusts the allocation of resources, adaptively optimizing the system’s overall performance. NeoMedia targets at view-after-downloading, which can efficiently utilize servers’ precious bandwidth and clients’ power. Theoretical analysis demonstrates that NeoMedia is able to support hugely simultaneous requests and provide non-trivial services at the same time with relatively low server-side bandwidth consumption.

    参考文献
    [1]Ge ZH,Ji P,Shenoy PJ.A demand adaptive and locality aware (DALA) streaming media server cluster architecture.In:Proc.of the 13th Int'l Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2002).Miami:ACM Press,2002.139-146.http://portal.acm.org/citation.cfm-id=507690&coll=Portal&dl=GUIDE&CFID=67945259&CFTOKEN= 25416258
    [2]Acharya S,Corporation I,Smith B.MiddleMan:A video caching proxy server.In:Proc.of the 10th Int'l Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV 2002).Chapel Hill:ACM Press,2000.121-130.http://www.nossdav.org/2000/abstracts/16.html
    [3]Hua KA,Cai Y,Sheu S.Patching:A multicast technique for true video-on-demand services.In:Proc.of the ACM Multimedia'98.Bristol:ACM Press,1998.191-200.http://portal.acm.org/citation.cfm-id=290771&coll=Portal&dl=ACM&CFID=67945259& CFTOKEN=25416258
    [4]Gao LX,Towsley D.Supplying instantaneous video-on-demand services using controlled multicast.In:Proc.of the IEEE Int'l Conf.on Multimedia Computing and Systems.Washington:IEEE Computer Society,1999,II-2-2,117-121.http://ieeexplore.ieee.org/search/selected.jsp-qry=%28supplying+instantaneous+video-on-demand+services+using+controlled+multicast%3Cin%3Emetadata%29&srch=1&resset=1331196&imageField.x=69&imageField.y=11&imageField=View+Selected+Items&chklist=778179%40ieeecnfs
    [5]Eager D,Vernon M,Zahorjan J.Minimizing bandwidth requirements for on-demand data delivery.IEEE Trans.on Knowledge and Data Engineering,2001,13(5):742-757.
    [6]Cui Y,Li BC,Nahrstedt K.oStream:Asynchronous streaming multicast in application-layer overlay networks.IEEE Journal on Selected Areas in Communications,Special Issue on Recent Advances in Service Overlays,2004,1(22):91-106.
    [7]Castro M,Druschel P,Kermarrec AM,Nandi A,Rowstron A,Singh A.SplitStream:High-Bandwidth multicast in cooperative environments.In:Proc.of the 19th ACM SOSP.Bolton Landing:ACM Press,2003.298-313.http://portal.acm.org/citation.cfm-id=945474&coll=Portal&dl=ACM&CFID=67945259&CFTOKEN=25416258
    [8]Kostic D,Rodriguez A,Albrecht J,Vahdat A.Bullet:High bandwidth data dissemination using an overlay mesh.In:Proc.of the 19th ACM SOSP.Bolton Landing:ACM Press,2003.282-297.http://portal.acm.org/citation.cfm-id=945473&coll=Portal&dl= ACM&CFID=67945259&CFTOKEN=25416258
    [9]Sherwood R,Braud R,Bhattacharjee B.Slurpie:A cooperative bulk data transfer protocol.In:Proc.of the IEEE Infocom 2004.Hong Kong,2004.941-951.http://ieeexplore.ieee.org/search/selected.jsp-qry=%28slurpie%3A+a+cooperative+bulk+data+transfer +protocol%3Cin%3Emetadata%29&srch=1&resset=1331196&imageField.x=62&imageField.y=15&imageField=View+Selected+Items&chklist=1356981%40ieeecnfs
    [10]Bit Torrent.2004.http://bitconjurer.org/BitTorrent
    [11]KaZaA.2004.http://www.kazaa.com/
    [12]Gnutella.2004.http://www.gnutella.com/
    [13]Saroiu S,Gummadi PK,Gribble SD.A measurement study of peer-to-peer file sharing systems.In:Proc.of the Multimedia Computing and Networking Conf.(MMCN) 2002.San Jose:ACM Press,2002.82.http://www.cs.washington.edu/homes/gribble/ papers/mmcn.pdf
    [14]Qiu DY,Srikant R.Modeling and performance analysis of bit torrent-like peer-to-peer networks.In:Proc.of the SIGCOMM 2004.Portland:ACM Press,2004.367-378.http://portal.acm.org/citation.cfm-id=1015508&coll=Portal&dl=ACM&CFID=67945259& CFTOKEN=25416258
    [15]Ghemawat S,Gobioff H,Leung ST.The Google file system.In:Proc.of the 19th ACM SOSP 2003.Bolton Landing:ACM Press,2003.29-43.http://portal.acm.org/citation.cfm-id=945450&coll=Portal&dl=ACM&CFID=67945259&CFTOKEN=25416258
    [16]Hua KA,Lee C,Hua CM.Dynamic load balancing in Multicomputer database systems using partition tuning.IEEE Trans.on Knowledge and Data Engineering,1995,7(6):968-983.
    [17]Aggarwal CC,Wolf JL,Yu PS.On optimal batching policies for video-on-demand storage server.In:Proc.of the IEEE ICMCS'96.Hiroshima:IEEE Computer Society,1996.253-258.http://ieeexplore.ieee.org/search/selected.jsp-qry=%28+on+optimal+batching policies+for+video-on-demand+storage+server%3Cin%3Emetadata%29&srch=1&resset=1331196&imageField.x=67&imageField.y=8&imageField=View+Selected+Items&chklist=534983%40ieeecnfs
    网友评论
    网友评论
    分享到微博
    发 布
引用本文

陈明,杨广文,王鼎.支持高并发度的大容量媒体库.软件学报,2006,17(4):915-924

复制
分享
文章指标
  • 点击次数:4501
  • 下载次数: 4974
  • HTML阅读次数: 0
  • 引用次数: 0
历史
  • 收稿日期:2005-04-04
  • 最后修改日期:2005-08-03
文章二维码
您是第19763193位访问者
版权所有:中国科学院软件研究所 京ICP备05046678号-3
地址:北京市海淀区中关村南四街4号,邮政编码:100190
电话:010-62562563 传真:010-62562533 Email:jos@iscas.ac.cn
技术支持:北京勤云科技发展有限公司

京公网安备 11040202500063号