Improvement in interactive remote in situ visualization using SIMD-aware function parser and asynchronous data I/O | Journal of Visualization Skip to main content
Springer Nature Link
Log in

Improvement in interactive remote in situ visualization using SIMD-aware function parser and asynchronous data I/O

  • Regular Paper
  • Published:
Journal of Visualization Aims and scope Submit manuscript

Abstract

An in situ visualization system based on the particle-based volume rendering offers a highly scalable and flexible visual analytics environment based on multivariate volume rendering. Although it showed excellent computational performance on the conventional CPU platforms, accelerated computation on the latest many core platforms revealed performance bottlenecks related to a function parser and particles I/O. The function parsers handle multidimensional transfer functions, but conventional implementation was not optimized for wide SIMD widths. The I/O bottleneck comes from the latency of output of particle data files. In this paper, we develop a new SIMD-aware function parser and an asynchronous data I/O method based on task-based thread parallelization. The particle generation process is optimized by loop blocking to take advantage of the new function parser. Numerical experiments on the Oakforest-PACS, which consists of 8208 Intel Xeon Phi7250 (Knights Landing) processors, demonstrate an order of magnitude speedup with keeping improved strong scaling up to \(\sim 100\,\hbox {k}\) cores.

Graphic abstract

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
¥17,985 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Japan)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

Similar content being viewed by others

References

  • Ayachit U, Bauer A, Duque EPN, Eisenhauer G, Ferrier N, Gu J, Jansen KE, Loring B, Lukić Z, Menon S, Morozov D, O’Leary P, Ranjan R, Rasquin M, Stone CP, Vishwanath V, Weber GH, Whitlock B, Wolf M, Wu KJ, Bethel EW (2016) In: Proceedings of the international conference for high performance computing, networking, storage and analysis, IEEE Press. Piscataway, NJ, USA, SC ’16. pp 79:1–79:12. URL http://dl.acm.org/citation.cfm?id=3014904.3015010

  • Fabian N, Moreland K, Thompson D, Bauer AC, Marion P, Gevecik B, Rasquin M, Jansen KE (2011) In: 2011 IEEE symposium on large data analysis and visualization (IEEE). https://doi.org/10.1109/ldav.2011.6092322

  • Kawamura T, Sakamoto N, Koyamada K (2010) Level-of-detail rendering of large-scale irregular volume datasets using particles. J Comput Sci Technol 25(5):905

    Article  Google Scholar 

  • Kawamura T, Idomura Y, Hiroko (Nakamura) Miyamura HT (2016) Algebraic design of multi-dimensional transfer function using transfer function synthesizer. J Vis 20(1):151

    Article  Google Scholar 

  • Kawamura T, Noda T, Idomura Y (2017) Supercomputing frontiers and innovations. Int J 4(3):43

    Google Scholar 

  • Kawamura T, Idomura Y, Miyamura H, Takemiya H, Sakamoto N, Koyamada K (2015) In: Proceedings of the conference on VDA. Visualization and data analysis 2015 (SPIE). https://doi.org/10.1117/12.2083501

  • Kawamura T, Noda T, Idomura Y (2016) In: Proceedings of the 2nd workshop on in situ infrastructures for enabling extreme-scale analysis and visualization. IEEE Press, Piscataway, NJ, USA, ISAV ’16. pp 18–22. https://doi.org/10.1109/ISAV.2016.9

  • Larsen M, Brugger E, Childs H, Eliot J, Griffin K, Harrison C (2015) In: Proceedings of the first workshop on in situ infrastructures for enabling extreme-scale analysis and visualization (ISAV), held in conjunction with SC15. TX, Austin. pp 30–35

  • Liu Q, Logan J, Tian Y, Abbasi H, Podhorszki N, Choi JY, Klasky S, Tchoua R, Lofstead J, Oldfield R, Parashar M, Samatova N, Schwan K, Shoshani A, Wolf M, Wu K, Yu W (2014) Hello ADIOS: the challenges and lessons of developing leadership class I/O frameworks. Concurr Comput Pract Exp 26:1453–1473

    Article  Google Scholar 

  • Moreland K, Sewell C, Usher W, ta Lo L, Meredith J, Pugmire D, Kress J, Schroots H, Ma KL, Childs H, Larsen M, Chen CM, Maynard R, Geveci B (2016) VTK-m: Accelerating the visualization toolkit for massively threaded architectures. IEEE Comput Graph Appl 36(3):48. https://doi.org/10.1109/MCG.2016.48

    Article  Google Scholar 

  • Porter DH, Woodward PR, Iyer A (2005) In: Erbacher RF, Roberts JC, Gröhn MT, Börner K (eds) Visualization and data analysis, SPIE proceedings, vol 5669, (SPIE, 2005). pp 115–125

  • Sakamoto N, Kawamura T, Koyamada K (2010) Improvement of particle-based volume rendering for visualizing irregular volume data sets. J Comput Graph 34(1):34

    Article  Google Scholar 

  • Sakamoto N, Maeda N, Kawamura T, Koyamada K (2013) High-quality particle-based volume rendering for large-scale unstructured volume datasets. J Vis 16(2):153. https://doi.org/10.1007/s12650-013-0158-1

    Article  Google Scholar 

  • Tu T, Yu H, Bielak J, Ghattas O, López JC, Ma K, O’Hallaron DR, Ramírez-Guzmán L, Stone N, Taborda-Rios R, Urbanic J (2006) In: Proceedings of the ACM/IEEE SC2006 conference on high performance networking and computing, November 11–17, 2006, Tampa, FL, USA. p 297. https://doi.org/10.1145/1188455.1188767

  • Tu T, Yu H, Ramirez-Guzman L, Bielak J, Ghattas O, Ma KL, O’Hallaro DR (2006) In: Proceedings of the 2006 ACM/IEEE conference on supercomputing. ACM, New York, NY, USA, SC ’06. https://doi.org/10.1145/1188455.1188551

  • Whitlock B, Favre JM, Meredith JS (2011) In: Proceedings of the 11th eurographics conference on parallel graphics and visualization. eurographics association, Aire-la-Ville, Switzerland, Switzerland. EGPGV ’11. pp 101–109. https://doi.org/10.2312/EGPGV/EGPGV11/101-109

  • Yamashita S, Ina T, Idomura Y, Yoshida H (2017) A numerical simulation method for molten material behavior in nuclear reactors. Nucl Eng Des 322:301. https://doi.org/10.1016/j.nucengdes.2017.06.032

    Article  Google Scholar 

Download references

Acknowledgements

This work is partially supported by “Joint Usage/Research Center for Interdisciplinary Large-scale Information Infrastructures” and “High Performance Computing Infrastructure” in Japan. This research was supported by MEXT as “Post-K priority issue No.6: Development of Innovative Clean Energy.” This research used the supercomputer system ICEX belonging to Japan Atomic Energy Agency.

Author information

Authors and Affiliations

  1. Center for Computational Science and e-Systems, Japan Atomic Energy Agency, 178-4 Wakashiba, Kashiwa-shi, Chiba, Japan

    Takuma Kawamura & Yasuhiro Idomura

Authors
  1. Takuma Kawamura
    View author publications

    You can also search for this author inPubMed Google Scholar

  2. Yasuhiro Idomura
    View author publications

    You can also search for this author inPubMed Google Scholar

Corresponding author

Correspondence to Takuma Kawamura.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Kawamura, T., Idomura, Y. Improvement in interactive remote in situ visualization using SIMD-aware function parser and asynchronous data I/O. J Vis 23, 695–706 (2020). https://doi.org/10.1007/s12650-020-00652-z

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12650-020-00652-z

Keywords