Self-Adaptive SSD Caching System for Multiobjective Optimization in Virtualization Environment
Author:
Affiliation:

Fund Project:

National Key Research and Development Program of China (2016YFB1000103); National Natural Science Foundation of China (61572480); Youth Innovation Promotion Association, the Chinese Academy of Sciences (2015088)

  • Article
  • | |
  • Metrics
  • |
  • Reference [27]
  • |
  • Related [20]
  • | | |
  • Comments
    Abstract:

    As a new type of storage media, solid state drive (SSD) is widely used in virtualization environment. SSD is usually used as the read and write cache of the virtual machine (VM) storage to improve the disk I/O performance of the VMs. Existing SSD caching schemes mostly focus on the capacity planning of the SSD cache and use metrics such as cache hit rate to evaluate the effect of SSD cache allocation. Since they do not consider the limitations of service capabilities of SSD, which may lead to the contention of cache resource and the performance degradation and violations among VMs, they are not suitable to be used with some typical distributed applications. This article proposes a self-adaptive SSD caching system for multiobjective optimization in virtualization environment, to reduce the resource contention, and take the limitations of service capabilities of SSD into consideration. With the help of closed loop adaption, it can dynamically detect the status of VMs and applications. Moreover, it continuously detects the contention of SSD cache, generates the migration plan using clustering algorithm and decides the timing and order of the VM migrations according to the capabilities of SSD as well as the characteristics and requirements of applications. The evaluation shows that when facing the scenarios of using some typical distributed applications, the contention of SSD cache resource is reduced and the requirements of applications are considered, which lead to the improvement of performance and reliability of applications. For Hadoop applications, the execution time of jobs is reduced by 25% on average, and the throughput for I/O sensitive applications is improved by 39%. For ZooKeeper applications, the service outage caused by the single point of fault of the hypervisor can be handled at the cost of less than 5% of performance degradation.

    Reference
    [1] Gulati A, Shanmuganathan G, Zhang X, Varman P. Demand based hierarchical QoS using storage resource pools. In:Proc. of the 2012 USENIX Conf. on Annual Technical Conf. Boston:USENIX Association, 2012. 1-13.
    [2] Hansen JG, Jul E. Lithium:Virtual machine storage for the cloud. In:Proc. of the 1st ACM Symp. on Cloud Computing. Indianapolis:ACM Press, 2010. 15-26.[doi:10.1145/1807128.1807134]
    [3] Ye L, Lu G, Kumar S, Gniady C, Hartman JH. Energy-Efficient storage in virtual machine environments. In:Proc. of the 6th ACM SIGPLAN/SIGOPS Int'l Conf. on Virtual Execution Environments. Pittsburgh:ACM Press, 2010. 75-84.
    [4] Lu L, Pillai TS, Arpaci-Dusseau AC, Arpaci-Dusseau RH. WiscKey:Separating keys from values in SSD-conscious storage. In:Proc. of the 14th USENIX Conf. on File and Storage Technologies. Santa Clara:USENIX Association, 2016. 133-148.[doi:10. 1145/3033273]
    [5] Kim J, Lee D, Noh S H. Towards SLO complying SSDs through OPS isolation. In:Proc. of the 13th USENIX Conf. on File and Storage Technologies. Santa Clara:USENIX Association, 2015. 183-189.
    [6] Koller R, Mashtizadeh AJ, Rangaswami R. Centaur:Host-Side SSD caching for storage performance control. In:Proc. of the 2015 IEEE Int'l Conf. on Autonomic Computing. Wurzburg:IEEE Computer Society, 2015. 51-60.[doi:10.1109/ICAC.2015.44]
    [7] Oh Y, Lee E, Hyun C, Choi J, Lee D, Noh S H. Enabling cost-effective flash based caching with an array of commodity SSDs. In:Proc. of the 16th Annual Middleware Conf. Vancouver:ACM Press, 2015. 63-74.[doi:10.1145/2814576.2814814]
    [8] Arteaga D, Cabrera J, Xu J, Zhao M. CloudCache:On-Demand flash cache management for cloud computing. In:Proc. of the 14th USENIX Conf. on File and Storage Technologies. Santa Clara:USENIX Association, 2016. 355-369.
    [9] Luo T, Ma S, Lee R, Zhang X, Liu D, Zhou L. S-CAVE:Effective SSD caching to improve virtual machine storage performance. In:Proc. of the 22nd Int'l Conf. on Parallel Architectures and Compilation Techniques. Edinburgh:IEEE Computer Society, 2013. 103-112.[doi:10.1109/PACT.2013.6618808]
    [10] Shvachko K, Hairong K, Radia S, Chansler R. The hadoop distributed file system. In:Proc. of 2010 IEEE the 26th Symp. on Mass Storage Systems and Technologies (MSST). Incline Village:IEEE Computer Society, 2010. 1-10.[doi:10.1109/MSST.2010.5496972]
    [11] Vavilapalli VK, Murthy AC, Douglas C, Agarwal S, Konar M, Evans R, Graves T, Lowe J, Shah H, Seth S, Saha B, Curino C, O'Malley O, Radia S, Reed B, Baldeschwieler E. Apache hadoop YARN:Yet another resource negotiator. In:Proc. of the 4th Annual Symp. on Cloud Computing. Santa Clara:ACM Press, 2013. 1-16.[doi:10.1145/2523616.2523633]
    [12] Junqueira FP, Reed BC, Serafini M. Zab:High-Performance broadcast for primary-backup systems. In:Proc. of the 2011 IEEE/IFIP 41st Int'l Conf. on Dependable Systems&Networks. Hong Kong:IEEE Computer Society, 2011. 245-56.[doi:10.1109/DSN. 2011.5958223]
    [13] Hunt P, Konar M, Junqueira FP, Reed B. ZooKeeper:Wait-Free coordination for Internet-scale systems. In:Proc. of the 2010 USENIX Conf. on USENIX Annual Technical Conf. Boston:USENIX Association, 2010. 11-24.
    [14] Intel. Intel solid state drive 750 series. 2016. http://www.intel.com/content/dam/www/public/us/en/documents/product-specifications/ssd-750-spec.pdf
    [15] WD. WD black PC HD series specification sheet. 2016. https://www.wdc.com/content/dam/wdc/website/downloadable_assets/eng/spec_data_sheet/2879-771434.pdf
    [16] Barham P, Dragovic B, Fraser K, Hand S, Harris T, Ho A, Neugebauer R, Pratt I, Warfield A. Xen and the art of virtualization. In:Proc. of the 19th ACM Symp. on Operating Systems Principles. Bolton Landing:ACM Press, 2003. 164-177.[doi:10.1145/945445.945462]
    [17] Hunt P. ZooKeeper smoketest. 2016. https://github.com/phunt/zk-smoketest
    [18] Yang PY, Jin PQ, Yue LH. A time-sensitive and efficient hybrid storage model involving SSD and HDD. Chinese Journal of Computers, 2012,35(11):2294-2305(in Chinese with English abstract).[doi:10.3724/SP.J.1016.2012.02294]
    [19] Yin Y, Liu ZJ, Xu L. Cache system based on disk media for network storage. Ruan Jian Xue Bao/Journal of Software, 2009,20(10):2752-65(in Chinese with English abstract). http://www.jos.org.cn/1000-9825/3427.htm[doi:10.3724/SP.J.1001.2009.03427]
    [20] Liu Y. Research on caching and prefetching technologies for hierarchical hybrid storage systems[Ph.D. Thesis]. Wuhan:Huazhong University of Science and Technology, 2013(in Chinese with English abstract).[doi:10.7666/d.D608789]
    [21] Meng F, Zhou L, Ma X, Uttamchandani S, Liu D. vCacheShare:Automated server flash cache space management in a virtualization environment. In:Proc. of the 2014 USENIX Conf. on USENIX Annual Technical Conf. Philadelphia:USENIX Association, 2014. 133-144.
    [22] Shamma M, Meyer DT, Wires J, Ivanova M, Hutchinson NC, Warfield A. Capo:Recapitulating storage for virtual desktops. In:Proc. of the 9th USENIX Conf. on File and Stroage Technologies. San Jose:USENIX Association, 2011. 3-17.
    [23] Mesnier M, Chen F, Luo T, Akers JB. Differentiated storage services. In:Proc. of the 23rd ACM Symp. on Operating Systems Principles. Cascais:ACM Press, 2011. 57-70.[doi:10.1145/2043556.2043563]
    附中文参考文献:
    [18] 杨濮源,金培权,岳丽华.一种时间敏感的SSD和HDD高效混合存储模型.计算机学报,2012,35(11):2294-2305.[doi:10.3724/SP. J.1016.2012.02294]
    [19] 尹洋,刘振军,许鲁.一种基于磁盘介质的网络存储系统缓存.软件学报,2009,20(10):2752-2765. http://www.jos.org.cn/1000-9825/3427.htm[doi:10.3724/SP.J.1001.2009.03427]
    [20] 刘洋.层次混合存储系统中缓存和预取技术研究[博士学位论文].武汉:华中科技大学,2013.[doi:10.7666/d.D608789]
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

唐震,吴恒,王伟,魏峻,黄涛.虚拟化环境下面向多目标优化的自适应SSD缓存系统.软件学报,2017,28(8):1982-1998

Copy
Share
Article Metrics
  • Abstract:4013
  • PDF: 6272
  • HTML: 3497
  • Cited by: 0
History
  • Received:June 20,2016
  • Revised:September 21,2016
  • Online: August 15,2017
You are the first2051267Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063