Modular Network Structure for Building Mega-Modular Data Center
Author:
Affiliation:

Fund Project:

National High-Tech R&D Program of China (863) (2013AA01A21)

  • Article
  • | |
  • Metrics
  • |
  • Reference [27]
  • |
  • Related
  • | | |
  • Comments
    Abstract:

    The modular data center networks comprise inter-and intra-module networks. The structure and routing of inter-module networks take charge of organizing modules, and communicating among servers in different modules. Thus, it is the most important issue to design an inter-module structure with high bandwidth, high fault-tolerance, and flexible scalability to build the mega-modular data center. In this paper, an inter-module network structure called MDKautz is proposed for building the mega-modular data center. MDKautz uses Kautz as the basic interconnection topology among modules, and builds the mega-modular data center network with high bandwidth, high fault tolerance and good scalability without the need of any additional high end switches. The method for how to constructing, routing and expanding in MDKautz are analyzed. Mathematical analysis and experiment results show that MDKautz has a good topology characteristic and communication performance, and can effectively support the typical applications with high bandwidth and high fault tolerance in data center.

    Reference
    [1] Katz RH. Tech titans building boom. IEEE Spectrum, 2009,46(2):40-54.[doi:10.1109/MSPEC.2009.4768855]
    [2] Ghemawat S, Gobioff H, Leung S. The google file system. In:Proc. of the SOSP 2003. New York:ACM Press, 2003. 29-43.[doi:10.1145/945445.945450]
    [3] Shvachko K, Kuang H, Radia S, Chansler R. The hadoop distributed file system. In:Proc. of the MSST 2010. Washington:IEEE Computer Society, 2010. 1-10.[doi:10.1109/MSST.2010.5496972]
    [4] Weil SA, Brandt SA, Miller EL, Long DDE, Maltzahn C. Ceph:A scalable, high-performance distributed file system. In:Proc. of the OSDI 2006. Berkeley:USENIX Association, 2006. 307-320.
    [5] Dean J, Ghemawat S. MapReduce:Simplified data processing on large clusters. In:Proc. of the OSDI 2004. Berkeley:USENIX Association, 2004. 27-39.[doi:10.1145/1327452.1327492]
    [6] Isard M, Budiu M, Yu Y, Birrell A, Fetterly D. Dryad:Distributed data-parallel programs from sequential building blocks. In:Proc. of the EuroSys 2007. New York:ACM Press, 2007. 59-72.[doi:10.1145/1272996.1273005]
    [7] Meisner D, Sadler CM, Barroso LA, Weber WD, Wenish TF. Power management of online data-intensive service. SIGARCH Computer Architecture News, 2011,39(3):319-330.[doi:10.1145/2000064.2000103]
    [8] Wu H, Lu G, Li D, Guo C, Zhang Y. MDCube:A high performance network structure for modular data center interconnection. In:Proc. of the CoNEXT 2009. New York:ACM Press, 2009. 25-36.[doi:10.1145/1658939.1658943]
    [9] Bhuyan LN, Agrawal DP. Design and performance of generalized interconnection networks. IEEE Trans. on Computers, 1983, c-32(12):1081-1090.[doi:10.1109/TC.1983.1676168]
    [10] Dally WJ, Towles B. Principles and Practices of Interconnection Networks. San Francisco:Morgan Kaufmann Publishers Inc., 2003.
    [11] Al-Fares M, Loukissas A, Vahdat A. A scalable, commodity data center network architecture. In:Proc. of the SIGCOMM 2008. New York:ACM Press, 2008. 63-74.[doi:10.1145/1402958.1402967]
    [12] Massively Scalable Data Center (MSDC) Design and Implementation Guide. Cisco Systems, Inc., 2014.
    [13] Niranjan MR, Pamboris A, Farrington N, Huang N, Miri P, Radhakrishnan S, Subramanya V, Vahdat A. PortLand:A scalable fault-tolerant layer 2 data center network fabric. SIGCOMM Computer Communication Review, 2009,39(4):39-50.[doi:10.1145/1594977.1592575]
    [14] Greenberg A, Hamilton JR, Jain N, Kandula S, Kim C, Lahiri P, Maltz DA, Patel P, Sengupta S. VL2:A scalable and flexible data center network. Communications of the ACM, 2011,54(3):95-104.[doi:10.1145/1897852.1897877]
    [15] Ramachandran K, Kokku R, Mahindra R, Rangarajan S. 60GHz Data-Center networking:Wirless⇒Worry less? Technical Report, Princeton:NEC Laboratories America, 2008.
    [16] Wang G, Andersen DG, Kaminsky M, Papagiannaki K, Ng TSE, Kozuch M, Ryan M. c-Through:Part-Time optics in data centers. SIGCOMM Computer Communication Review, 2010,40(4):327-338.[doi:10.1145/1851275.1851222]
    [17] Farrington N, Porter G, Radhakrishnan S, Bazzaz HH, Subramanya V, Fainman Y, Papen G, Vahdat A. Helios:A hybrid electrical/optical switch architecture for modular data centers. In:Proc. of the SIGCOMM 2010. New York:ACM Press, 2010. 339-350.[doi:10.1145/1851182.1851223]
    [18] Guo C, Wu H, Tan K, Shi L, Zhang Y, Lu S. DCell:A scalable and fault-tolerant network structure for data centers. In:Proc. of the SIGCOMM 2008. New York:ACM Press, 2008. 75-86.[doi:10.1145/1402958.1402968]
    [19] Li D, Guo C, Wu H, Tan K, Zhang Y, Lu S, Wu J. Scalable and cost-effective interconnection of data-center servers using dual server ports. IEEE/ACM Trans. on Networking, 2011,19(1):102-114.[doi:10.1109/TNET.2010.2053718]
    [20] Guo C, Lu G, Li D, Wu H, Zhang X, Shi Y, Tian C, Zhang Y, Lu S. BCube:A high performance, server-centric network architecture for modular data centers. SIGCOMM Computer Communication Review, 2009,39(4):63-74.[doi:10.1145/1594977.1592577]
    [21] Huang F, Lu X, Li D, Zhang Y. A fault-tolerant network architecture for modular datacenter. Int'l Journal of Software Engineering and Its Applications, 2012,6(2):93-106.
    [22] Bhuyan LN, Agrawal DP. Generalized hypercube and hyperbus structures for a computer network. IEEE Trans. on Computers, 1984,c-33(4):323-333.[doi:10.1109/TC.1984.1676437]
    [23] Li D, Xu M, Zhao H, Fu X. Building mega data center from heterogeneous containers. In:Proc. of the ICNP 2011. Washington:IEEE Computer Society, 2011. 256-265.[doi:10.1109/ICNP.2011.6089059]
    [24] Lu FF, Luo XG, Xie XH, Zhu GM, Pu XC. Researching on constant degree network for massively data center. Journal of Computer Research and Development, 2014,51(11):2437-2447(in Chinese with English abstract).[doi:10.7544/issn1000-1239.2014.20130165]
    [25] Zhang Y, Lu X, Li D. SKY:Efficient peer-to-peer networks based on distributed Kautz graphs. Science in China Series F:Information Sciences, 2009,52(4):588-601.[doi:10.1007/s11432-009-0016-x]
    附中文参考文献:
    [24] 陆菲菲,罗兴国,谢向辉,朱桂明,濮小川.面向大规模数据中心的常量度数互连网络研究.计算机研究与发展,2014,51(11):2437-2447.[doi:10.7544/issn1000-1239.2014.20130165]
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

陆菲菲,谢向辉,郭得科,朱桂明.一种构建超大规模数据中心的模块化网络结构.软件学报,2017,28(8):2196-2213

Copy
Share
Article Metrics
  • Abstract:2638
  • PDF: 4132
  • HTML: 1530
  • Cited by: 0
History
  • Received:February 18,2014
  • Revised:August 27,2014
  • Online: August 15,2017
You are the first2033294Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063