Abstract
The combined computing capacity of the workstations that are present in many organisations nowadays is often under-utilised, as the performance for parallel programs is unpredictable. Load balancing through dynamic task re-allocation can help to obtain a more reliable performance. The Esprit project Dynamite1 provides such an automated load balancing system. It can migrate tasks that are part of a parallel program using a message passing library. Currently Dynamite supports PVM only, but it is being extended to support MPI as well. The Dynamite package is completely transparent, i.e. neither system (kernel) nor application source code need to be modified. Dynamite supports migration of tasks using dynamically linked libraries, open files and both direct and indirect PVM communication. Monitors and a scheduler are included. In this paper, we first briefly describe the Dynamite system. Next we describe how migration decisions are made and report on some performance measurements.
Dynamite is a collaborative project, funded by the European Union as Esprit project 23499. Of the many people that have contributed, we can mention only a few: A. Streit, F. van der Linden, J. Clinckemaillie, A. H. L. Emmen.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Albada, G. D.van, Clinckemaillie, J., Emmen, A. H. L., Gehring, J., Heinz, O., Linden, F. van der, Overeinder, B. J., Reinefeld, A., Sloot, P. M. A.: Dynamite-blasting obstacles to parallel cluster computing. in Sloot, P. M. A., Bubak, M., Hoekstra, A. G., Hertzberger, L. O., editors, High-Performance Computing and Networking (HPCN Europe’ 99), LNCS 1593 300–310
Casas, J., Clark, D. L., Konuru, R., Otto, S. W., Prouty, R. M., Walpole, J.: MPVM A Migration Transparant Version of PVM. Computer Systems 8 nr 2 (1995) 171–216
Czarnul, P., Krawczyk, H.: Dynamic Allocation with Process Migration in Distributed Environments. in Dongarra, J. J., Luque, E., Margalef, T., editors, Recent Advances in Parallel Virtual Machine and Message Passing Interface: 6th European PVM/MPI Users’ Group Meeting, LNCS 1697 (1999) 509–516
Dan, P., Dongsheng, W., Youhui, Z., Meiming, S.: Quasi-asynchronous Migration: A Novel Migration Protocol for PVM Tasks. Operating Systems Review 33 nr 2 (1999) 5–14
Geist, A., Beguelin, A., Dongarra, J., Jiang, W., Mancheck, R., Sunderam, V.: PVM: Parallel Virtual Machine. A Users’ Guide and Tutorial for Networked Parallel Computing. MIT Press, Cambridge, Massachusetts (1994) http://www.epm.ornl.gov/pvm/
Iskra, K. A., Hendrikse, Z. W., Albada, G. D. van, Overeinder, B. J., Sloot, P. M. A.: Experiments with Migration of PVM Tasks. in ISThmus 2000, Research and Development for the Information Society, Conference Proceedings, Poznan, Poland (2000) 295–304
Iskra, K. A., Hendrikse, Z. W., Albada, G. D. van, Overeinder, B. J., Sloot, P. M. A.: Performance Measurements on Dynamite/DPVM. in Dongarra, J., Kacsuk, P., Podhorszki, N., editors, Recent Advances in PVM and MPI. 7th European PVM/MPI User’s Group Meeting, LNCS 1908 (2000) (in press)
Iskra, K. A., Linden, F. van der, Hendrikse, Z. W., Albada, G. D. van, Overeinder, B. J., Sloot, P. M. A.: The implementation of Dynamite-an environment for migrating PVM tasks. Operating Systems Review nr 3 (2000) 40–55
Litzkow, M., Tannenbaum, T., Basney, J., Livny, M.: Checkpoint and migration of Unix processes in the Condor distributed processing system. Technical Report 1346, University of Wisconsin, WI, USA (1997)
Livny, M., Pruyne, J.: Managing Checkpoints for Parallel Programs, in Rudolph, L., Feitelson, D. G. editors: Proceedings IPPS Second Workshop on Job Scheduling Strategies for Parallel Processing, LNCS 1162 (1996) 140–154
Overeinder, B. J., Sloot, P. M. A., Heederik, R. N., Hertzberger, L. O.: A dynamic load balancing system for parallel cluster computing. Future Generation Computer Systems 12 (1996) 101–115
Robinson, J., Russ, S. H., Flachs, B., Heckel, B.: A task migration implementation of the Message Passing Interface. Proceedings of the 5th IEEE international symposium on high performance distributed computing (1996) 61–68
Ronde, J. F. de, Albada, G. D. van, Sloot, P. M. A.: High Performance Simulation of Gravitational Radiation Antennas, in L. O. Hertzberger, P. M. A. Sloot, editors, High Performance Computing and Networking, LNCS 1225 (1997) 200–212
Ronde, J. F. de, Albada, G. D. van, Sloot, P. M. A.: Simulation of GravitationalWave Detectors. Computers in Physics, 11 nr 5 (1997) 484–497
Tan, C. P., Wong, W. F., Yuen, C. K.: Task Migratable PVM. Proceedings of the 2nd Merged Symposium IPPS/SPDP. (1999) 196–202
MPI: A Message-Passing Interface Standard, Version 1.1. Technical Report, University of Tennessee, Knoxville (1995) http://www-unix.mcs.anl.gov/mpi/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2000 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Iskra, K.A., Hendrikse, Z.W., van Albada, G.D., Overeinder, B.J., Sloot, P.M.A., Gehring, J. (2000). Experiments with Migration of Message-Passing Tasks. In: Buyya, R., Baker, M. (eds) Grid Computing — GRID 2000. GRID 2000. Lecture Notes in Computer Science, vol 1971. Springer, Berlin, Heidelberg. https://doi.org/10.1007/3-540-44444-0_19
Download citation
DOI: https://doi.org/10.1007/3-540-44444-0_19
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-41403-2
Online ISBN: 978-3-540-44444-2
eBook Packages: Springer Book Archive