Prospects for virtualization of high-performance x64 systems | Programming and Computer Software Skip to main content
Springer Nature Link
Log in

Prospects for virtualization of high-performance x64 systems

  • Published:
Programming and Computer Software Aims and scope Submit manuscript

Abstract

Prospects for applying virtualization technology in high-performance computations on the x64 systems are studied. Principal reasons for performance degradation when parallel programs are running in virtual environments are considered. The KVM/QEMU and Palacios virtualization systems are considered in detail, with the HPC Challenge and NAS Parallel Benchmarks used as benchmarks. A modern computing cluster built on the Infiniband high-speed interconnect is used in testing. The results of the study show that, in general, virtualization is reasonable for a wide class of high-performance applications. Fine tuning of the virtualization systems involved made it possible to reduce overheads from 10–60% to 1–5% on the majority of tests from the HPC Challenge and NAS Parallel Benchmarks suites. The main bottlenecks of virtualization systems are reduced performance of the memory system (which is critical only for a narrow class of problems), costs associated with hardware virtualization, and the increased noise caused by the host operating system and hypervisor. Noise can have a negative effect on performance and scalability of fine-grained applications (applications with frequent small-scale communications). The influence of noise significantly increases as the number of nodes in the system grows.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  1. Younge, A.J., Henschel, R., Brown, J., von Laszewski, G., Qiu, J., and Fox, G.C., Analysis of virtualization technologies for high performance computing environments, Proc. of the 4th Int. Conf. on Cloud Computing (IEEE CLOUD 2011), July 2011.

    Google Scholar 

  2. Gavrilovska, A., Kumar, S., Raj, H., Schwan, K., Gupta, V., Nathuji, R., Niranjan, R., Ranadive, A., and Saraiya, P., Abstract high-performance hypervisor architectures: virtualization in HPC systems, 1st Workshop on System-Level Virtualization for High Performance Computing (HPCVirt), in conjunction with EuroSys, 2007.

    Google Scholar 

  3. Kivity, A., Kamay, Y., Laor, D., Lublin, U., and Liguori, A., KVM: the Linux virtual machine monitor, OLS’ 07: The 2007 Ottawa Linux Symposium, July 2007, pp. 225–230.

    Google Scholar 

  4. Lange, J.R., Pedretti, K., Dinda, P., Bridges, P.G., Bae, C., Soltero, P., and Merritt, A., Minimal-overhead virtualization of a large scale supercomputer, Proc. of the 7th ACM SIGPLAN/SIGOPS Int. Conf. on Virtual Execution Environments, VEE’ 11, 2011, pp. 169–180.

    Google Scholar 

  5. Luszczek, P.R., Bailey, D.H., Dongarra, J.J., Kepner, J., Lucas, R.F., Rabenseifner, R., Takahashi, D., The HPC challenge (HPCC) benchmark suite, Proc. of the 2006 ACM/IEEE Conf. on Supercomputing, SC’06, 2006.

    Google Scholar 

  6. Bailey, D., Harris, T., Saphir, W., van der Wijngaart, R., Woo, A., and Yarrow, M., The NAS parallel benchmarks 2.0, Technical Report NAS-95-020, NASA Ames Research Center, December 1995.

    Google Scholar 

  7. Silakov D.V. The use of hardware virtualization in the context of information security, Proc. of the Institute for System Programming of the Russian Academy of Sciences, vol. 20, 2011, pp. 25–3

    Google Scholar 

  8. Dovgalyuk, P., Deterministic replay of system’s execution with multi-target QEMU simulator for dynamic analysis and reverse debugging, Proc. of the Institute for System Programming of the Russian Academy of Sciences, vol. 21, 2011, pp. 123–132.

    Google Scholar 

  9. Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., and Warfield. A., Xen and the art of virtualization, SIGOPS Oper. Syst. Rev., vol. 37, October 2003, pp. 164–177.

    Article  Google Scholar 

  10. Watson., J., VirtualBox: bits and bytes masquerading as machines, Linux Journal, February 2008.

    Google Scholar 

  11. Batuzov, K. and Merkulov, A., Optimization of dynamic binary translation, Proc. of the Institute for System Programming of the Russian Academy of Sciences, vol. 20, 2011, pp. 37–50.

    Google Scholar 

  12. Regola, N. and Ducom, J.-C., Recommendations for virtualization technologies in high performance computing, Proc. of the 2010 IEEE 2nd Int. Conf. on Cloud Computing Technology and Science, CLOUDCOM’10, 2010, pp. 409–416,.

    Chapter  Google Scholar 

  13. OpenVZ: container-based virtualization for Linux, http://openvz.org/.

  14. Gordon, A., Amit, N., Har’El, N., Ben-Yehuda, M., Landau, A., Schuster, A., and Tsafrir, D., ELI: bare-metal performance for I/O virtualization, Proc. of the 17th Int. Conf. on Architectural Support for Programming Languages and Operating Systems (ASPLOS 2012), 2012.

    Google Scholar 

  15. Ibrahim, K.Z., Hofmeyr, S., and Iancu, C., Characterizing the performance of parallel applications on multisocket virtual machines, Proc. of the 2011 11th IEEE/ACM Int. Symp. on Cluster, Cloud and Grid Computing, CCGRID’11, 2011, pp. 1–12.

    Chapter  Google Scholar 

  16. Lange, J., Pedretti, K., Hudson, T., Dinda, P., Cui, Z., Xia, L., Bridges, P., Gocke, A., Jaconette, S., Levenhagen, M., and Brightwell, R., Palacios and Kitten: new high performance operating systems for scalable virtualized and native supercomputing, 2010 IEEE Int. Symp. on Parallel Distributed Processing (IPDPS), April 2010, pp. 1–12.

    Chapter  Google Scholar 

  17. V3VEE: An Open Source Virtual Machine Monitor Framework for Modern Architectures, http://v3vee.org/.

  18. Ferreira, K., Bridges, P., and Brightwell, R., Characterizing application sensitivity to OS interference using kernel-level noise injection, Int. Conf. for High Performance Computing, Networking, Storage and Analysis, 2008, November 2008, pp. 1–12.

    Chapter  Google Scholar 

  19. Petrini, F., Kerbyson, D., and Pakin, S., The case of the missing supercomputer performance: achieving optimal performance on the 8,192 processors of ASCI Q, 2003 ACM/IEEE Conf. on Supercomputing, November 2003, p. 55.

    Chapter  Google Scholar 

  20. Arcangeli, A., Transparent Hugepage Support, http://www.linuxkvm.org/wiki/images/9/9e/2010-forumthp.pdf. KVM Forum 2010.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute for System Programming, Russian Academy of Sciences, ul. A. Solzhenitsyna 25, Moscow, 109004, Russia

    A. O. Kudryavtsev, V. K. Koshelev & A. I. Avetisyan

Authors
  1. A. O. Kudryavtsev
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. V. K. Koshelev
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. A. I. Avetisyan
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to A. O. Kudryavtsev.

Additional information

Original Russian Text © A.O. Kudryavtsev, V.K. Koshelev, A.I. Avetisyan, 2013, published in Proc. of the Institute of System Programming, RAS, 2012, vol. 22.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kudryavtsev, A.O., Koshelev, V.K. & Avetisyan, A.I. Prospects for virtualization of high-performance x64 systems. Program Comput Soft 39, 285–294 (2013). https://doi.org/10.1134/S0361768813060042

Download citation

  • Received:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1134/S0361768813060042

Keywords

Search

Navigation