Abstract
Data replication is a critical issue in distributed computing where a large amount of data sets are frequently shared among geographically distributed scientists. The usual way of managing consistent data replicas between distributed sites is to periodically update the remotely located data replicas. However, this method doesn’t guarantee the replica consistency in such a case that remote clients who retain the replicas irregularly update or modify their replicas. In this paper, we introduce two kinds of data replication techniques, called owner-initiated data replication and client-initiated data replication, that are developed to support data replica consistency without requiring any special file system-level locking functions. Also, we present performance results on Linux clusters located at Sejong University.
This work was supported in part by a Seoul R&BD program.
This is a preview of subscription content, log in via an institution to check access.
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Allcock, B., Foster, I., Nefedova, V., Chervenak, A., Deelman, E., Kesselman, C., Leigh, J., Sim, A., Shoshani, A., Drach, B., Williams, D.: High-Performance Remote Access to Climate Simulation Data: A Challenge Problem for Data Grid Technologies. In: SC 2001 (November 2001)
Moore, R., Rajasekar, A.: Data and Metadata Collections for Scientific Applications. In: High Performance Computing and Networking (HPCN 2001), Amsterdam, NL (June 2001)
Chervenak, A., Deelman, E., Kesselman, C., Pearlman, L., Singh, G.: A Metadata Catalog Service for Data Intensive Applications. GriPhyN technical report (2002)
Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration WG. In: Global Grid Forum, June 22 (2002)
Chervenak, A., Foster, I., Kesselman, C., Salisbury, C., Tuecke, S.: The Data Grid: Towards an Architecture for the Distributed Management and Analysis of Large Scientific Datasets. Journal of Network and Computer Applications 23, 187–200 (2001)
Chervenak, A., Schuler, R., Kesselman, C., Koranda, S., Moe, B.: Wide Area Data Replication for Scientific Collaborations. In: Proceedings of 6th IEEE/ACM International Workshop on Grid Computing (Grid 2005) (November 2005)
Cai, M., Chervenak, A., Frank, M.: A Peer-to-Peer Replica Location Service Based on A Distributed Hash Table. In: Proceedings of the SC2004 Conference (SC 2004) (November 2004)
Allcock, W., Bresnahan, J., Kettimuthu, R., Link, M., Dumitrescu, C., Raicu, I., Foster, I.: The Globus Striped GridFTP Framework and Server. In: Proceedings of Super Computing 2005 (SC 2005) (November 2005)
No, J., Park, H.: GEDAS: A Data Management System for Data Grid Environments. In: Proceedings of International Conference on Computational Science, pp. 485–492 (2005)
No, J., Thakur, R., Choudhary, A.: High-Performance Scientific Data Management System. Journal of Parallel and Distributed Computing 4(64), 434–447 (2003)
Thekkath, C.A., Mann, T., Lee, E.K.: Frangipani: A Scalable Distributed File System. In: Proceedings of the Symposium on Operating Systems Principles, pp. 224–237 (1997)
Preslan, K.W., Barry, A.P., Brassow, J.E., Erickson, G.M., Nygaard, E., Sabol, C.J., Soltis, S.R., Teigland, D.C., O’Keefe, M.T.: A 64-bit Shared Disk File System for Linux. In: Proceedings of Sixteenth IEEE Mass Storage Systems Symposium Seventh NASA Goddard Conference on Mass Storage Systems & Technologies, March 15-18 (1999)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
No, J., Park, C.W., Park, S.S. (2006). The Replica Management for Wide-Area Distributed Computing Environments. In: Etzion, O., Kuflik, T., Motro, A. (eds) Next Generation Information Technologies and Systems. NGITS 2006. Lecture Notes in Computer Science, vol 4032. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11780991_21
Download citation
DOI: https://doi.org/10.1007/11780991_21
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-35472-7
Online ISBN: 978-3-540-35473-4
eBook Packages: Computer ScienceComputer Science (R0)