Efficient Disk I/O Characteristics Analysis Method Based on Virtual Machine Technology
Affiliation:

  • Article
  • | |
  • Metrics
  • |
  • Reference [16]
  • |
  • Related [20]
  • |
  • Cited by [1]
  • | |
  • Comments
    Abstract:

    Disk I/O may be the bottleneck in computer systems because of the mechanism characters in disk system. In order to tune the system performance effectively, the collection of the disk I/O workload characteristics will be the essential step for the performance optimization. Compared with other I/O characteristics collection methods, this paper presents an on-line I/O characteristics analysis method based on Xen 3.0 virtual machine system. In virtual machine environments, this method can be transparent to the unmodified operating system. With this method, several essential I/O characteristics metrics can be collected, such as disk I/O block size, I/O latency, I/O arrival interval, I/O spatial locality statistics, I/O time locality statistics and the I/O operation hotspot distribution. Through the testing and analysis, this method is found to have little system overhead and impact on the application system I/O performance. In addition, the I/O characteristics analysis results are demonstrated on the large file copy workload and the Filebench benchmark workload generated by the filemicro and varmail personalities.

    Reference
    [1] Roselli D, Anderson TE. Characteristics of file system workloads. Technical Report, CSD-98-1029, Berkeley: University of California, 1998.
    [2] Liu J, Yang XJ, Tang YH, Wang YX. The optimal strip unit size of heterogeneous disk array. Chinese Journal of Computers, 2004,27(6):819-827 (in Chinese with English abstract). http://cjc.ict.ac.cn/qwjs/view.asp?id=1612
    [3] Agrawal N, Bolosky WJ, Douceur JR, Lorch JR. A five-year study of file-system metadata. In: Proc. of the 5th Conf. on File and Storage Technologies (FAST 2007). San Jose: USENIX, 2007. 31-45. http://www.usenix.org/event/fast07/
    [4] Prabhakaran V, Arpaci-Dusseau AC, Arpaci-Dusseau RH. Analysis and evolution of journaling file systems. In: Proc. of the USENIX 2005 Annual Technical Conf. Anaheim: USENIX, 2005. 105-120. http://www.usenix.org/publications/library/ proceedings/usenix05/
    [5] Pratt I, Fraser K, Hand S, Limpach C, Warfield A. Xen 3.0 and the art of virtualization. In: Proc. of the Linux Symp., Vol.2. Ottawa, 2005. 65-77. http://www.linuxsymposium.org/2005/
    [6] Uhlig R, Neiger G, Rodgers D, Santoni AL, Martins FCM, Anderson AV, Bennett SM, Kagi A, Leung FH, Smith L. Intel virtualization technology. IEEE Computer, 2005,38(5):48-56.
    [7] Waldspurger CA. Memory resource management in VMware ESX server. In: Proc. of the 5th Symp. on Operating Systems Design and Implementation (OSDI 2002). Boston: USENIX, 2002. 181-194. http://www.usenix.org/events/osdi02/
    [8] Huai JP, Li Q, Hu CM. Research and design on hypervisor based virtual computing environment. Journal of Software, 2007,18(8): 2016-2026 (in Chinese with English abstract). http://www.jos.org.cn/1000-9825/18/2016.htm
    [9] Clark B, Deshane T, Dow E, Evanchik S, Finlayson M, Herne J, Matthews JN. Xen and the art of repeated research. In: Proc. of the USENIX 2004 Annual Technical Conf.: Free and Open Source Software (FREENIX) Track. Boston: USENIX, 2004. 135-144. http://www.usenix.org/events/usenix04/cfp/freenix.html
    [10] Moilanen J. I/O workload fingerprinting in the genetic-library. In: Proc. of the Linux Symp., Vol.2. Ottawa, 2006. 165-172. http://www.linuxsymposium.org/2006/linuxsymposium_procv2.pdf
    [11] Falk E. Introduce block I/O performance histograms. 2006. http://lwn.net/Articles/209770/
    [12] Reed DA, Aydt RA, Madhyastha TM, Noe RJ, Shields KA, Schwartz BW. An overview of the Pablo performance analysis environment. 1992. http://citeseerx.ist.psu.edu/viewdoc/summary?doi=10.1.1.37.2102
    [13] Parziale L, Belardi M, Held M, Ma LY, Peckover L, Reed K. Linux on IBM system z: Performance measurement and Tuning. 2008. http://www.redbooks.ibm.com/redbooks/pdfs/sg246926.pdf
    [14] Ahmad I. Easy and efficient disk I/O workload characterization in VMware ESX server. In: Proc. of the 2007 IEEE Int’l Symp. on Workload Characterization (IISWC 2007). Boston: IEEE, 2007. 149-158. http://iiswc.org/iiswc2007/
    附中文参考文献: [2] 刘军,杨学军,唐玉华,王勇献.异构盘阵中最优Strip Unit Size选择技术.计算机学报,2004,27(6):819-827. http://cjc.ict.ac.cn/qwjs/
    view.asp?id=1612 [8] 怀进鹏,李沁,胡春明.基于虚拟机的虚拟计算环境研究与设计.软件学报,2007,18(8):2016-2026. http://www.jos.org.cn/1000-9825/ 18/2016.htm
    Comments
    Comments
    分享到微博
    Submit
Get Citation

沈玉良,许鲁.一种基于虚拟机的高效磁盘I/O特征分析方法.软件学报,2010,21(4):849-862

Copy
Share
Article Metrics
  • Abstract:5708
  • PDF: 9993
  • HTML: 0
  • Cited by: 0
History
  • Received:March 07,2008
  • Revised:June 05,2009
You are the first2044646Visitors
Copyright: Institute of Software, Chinese Academy of Sciences Beijing ICP No. 05046678-4
Address:4# South Fourth Street, Zhong Guan Cun, Beijing 100190,Postal Code:100190
Phone:010-62562563 Fax:010-62562533 Email:jos@iscas.ac.cn
Technical Support:Beijing Qinyun Technology Development Co., Ltd.

Beijing Public Network Security No. 11040202500063