Abstract.
OpenMP is the current standard for shared-memory programming. While providing ease of parallel programming, the OpenMP programming model also has limitations which often effect the scalability of applications. Examples for these limitations are work distribution and point-to-point synchronization among threads. We propose extensions to the OpenMP programming model which allow the user to easily distribute the work in multiple dimensions and synchronize the workflow among the threads. The proposed extensions include four new constructs and the associated runtime library. They do not require changes to the source code and can be implemented based on the existing OpenMP standard. We illustrate the concept in a prototype translator and test with benchmark codes and a cloud modeling code.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Ayguadé, E., Martorell, X., Labarta, J., Gonzalez, M., Navarro, N.: Exploiting Multiple Levels of Parallelism in OpenMP: A Case Study. In: Proc. Of the 1999 International Conference on Parallel Processing, Ajzu, Japan (September 1999)
Bailey, D., Harris, T., Saphir, W., Van der Wijngaart, R., Woo, A., Yarrow, M.: The NAS Parallel Benchmarks 2.0. RNR-95-020, NASA Ames Research Center, NPB2.3 (1995), http://www.nas.nasa.gov/Software/NPB/
Gonzalez, M., Ayguadé, E., Martorell, X., Labarta, J., Navarro, N., Oliver, J.: NanosCompiler: Supporting Flexible Multilevel Parallelism in OpenMP. Concurrency: Practice and Experience. Special issue on OpenMP 12(12), 1205–1218 (2000)
Gonzalez, M., Ayguadé, E., Martorell, X., Labarta, J.: Defining and Supporting Pipelined Executions in OpenMP. In: 2nd International Workshop on OpenMP Applications and Tools (July 2001)
Jin, H., Frumkin, M., Yan, J.: The OpenMP Implementations of NAS Parallel Benchmarks and Its Performance. NAS Technical Report NAS-99-011, NASA Ames Research Center (1999)
Jin, H., Jost, G., Johnson, D., Tao, W.-K.: Experience on the Parallelization of a Cloud Modeling Code Using Computer-Aided Tools. NAS Technical Report NAS-03-006, NASA Ames Research Center (March 2003)
Jin, H., Jost, G., Yan, J., Ayguadé, E., Gonzalez, M., Martorell, X.: Automatic Multilevel Parallelization Using OpenMP. In: 3rd European Workshop on OpenMP (EWOMP 2001), Barcelona, Spain (September 2001)
Jost, G., Jin, H., Labarta, J., Gimenez, J., Caubet, J.: Performance Analysis of Multi-level Parallel Programs on Shared Memory Computer Architectures. In: Proceedings of the 17th International Parallel and Distributed Processing Symposium (IPDPS 2003), Nice, France (April 2003)
Martorell, X., Ayguadé, E., Navarro, N., Corbalan, J., Gonzalez, M., Labarta, J.: Thread Fork/join Techniques for Multi-level Parallelism Exploitation in NUMA Multiprocessors. In: 13th International Conference on Supercomputing (ICS 1999), Rhodes, Greece, (June 1999), pp. 294-301 (1999)
MIPSPro 7 Fortran 90 Commands and Directives Reference Manual, 007-3696-03, http://techpubs.sgi.com/
OpenMP Fortran/C Application Program Interface, http://www.openmp.org/
Paraver, http://www.cepba.upc.es/paraver/
Tao, W.-K.: Goddard Cumulus Ensemble (GCE) Model: Application for Understanding Precipitation Processes, AMS Meteorological Monographs. In: Symposium on Cloud Systems, Hurricanes and TRMM (2002)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2003 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Jin, H., Jost, G. (2003). Support of Multidimensional Parallelism in the OpenMP Programming Model. In: Veidenbaum, A., Joe, K., Amano, H., Aiso, H. (eds) High Performance Computing. ISHPC 2003. Lecture Notes in Computer Science, vol 2858. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-39707-6_46
Download citation
DOI: https://doi.org/10.1007/978-3-540-39707-6_46
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-20359-9
Online ISBN: 978-3-540-39707-6
eBook Packages: Springer Book Archive