Abstract
With modern operating systems, it is becoming easier to implement single level stores using memory management techniques to manage memory pages or slot segments between virtual memory and local disk. In this paper, we describe the ptool management system, which, in addition, gathers physical collections of segments into UNIX files we call folios. Ptool can cache and migrate folios from a hierarchical storage system, between nodes in a high performance cluster, or between nodes in a wide area network. We describe our experience to date using ptool for the analysis of high energy physics data, aeronautics data, and financial data.
This research was supported in part by NASA grant NAG2-513, DOE grant DE-FG02- 92ER25133, and NSF grants IRI 9224605 and CDA-9303433. For more information, contact Robert Grossman, Laboratory for Advanced Computing, m/c 249, University of Illinois at Chicago, 851 South Morgan Street, Chicago, IL 60607, grossman@uic.edu.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
N. Araujo, K. Denisenko, M. Fischler, M. Galli, R. Grossman, D. Hanley, D. Malon, E. May, and W. Xu, “Data Mining High Energy Physics Data Using a Persistent Object Manager: A Case Study,” Laboratory for Advanced Computing Technical Report Number 95-R1, University of Illinois at Chicago, 1994, submitted for publication.
T. Atwood, “Two Approaches to Adding Persistence to C++,” in Implementing Persistent Object Bases: Principles and Practice, A. Dearie, G. M. Shaw, and S. B. Zdonik, editors, Morgan-Kauffmann Publishers, San Mateo, California, 1991.
A. Baden and R. Grossman, “Database computing and high energy physics,” Computing in High-Energy Physics 1991, edited by Y. Watase and F. Abe, Universal Academy Press, Inc., Tokyo, 1991, pp. 59–66.
C. T. Day, S. Loken, J. F. MacFarlane, E. May, D. Lifka, E. Lusk, L. E. Price, A. Baden, R. Grossman, X. Qin, L. Cormell, P. Leibold, D. Liu, U. Nixdorf, B. Scipioni, T. Song, “Database Computing in HEP — Progress Report,” Proceedings of the International Conference on Computing in High Energy Physics’ 92, C. Verkerk and W. Wojcik, editors, CERN-Service d’Information Scientifique, 1992, ISSN 0007-8328, pp. 557–560.
M. J. Carey, L. M. Haas, and M. Livny, “Tapes Hold Data Too: Challenges of Tuples on Tertiary Storage,” in Proceedings of the 1993 ACM SIGMOD, SIGMOD Record, Volume 22, ACM, New York, 1993, pp. 413–417.
R. G. G. Cattell, The Object Database Standard: ODMG-93 Morgan Kaufmann Publishers, 1993.
S. S. Coleman, editor, Proceedings of the Twelfth IEEE Symposium on Mass Storage Systems, IEEE Press, Los Alamites, 1993.
J. Dozier, “Access to Data in NASA’s Earth Observing System,” in Proceedings of the 1992 ACM SIGMOD, SIGMOD Record, Volume 21, ACM, New York, 1992, page 1.
EXODUS Project Group, “EXODUS Storage Manager Architectural Overview,” EXODUS Project Document, University of Wisconsin, Madison, 1991.
W. E. Farrell and Jean Anderson, “Very Large Databases and Mass Storage Technology,” Digest of Papers: Eleventh IEEE Symposium on Mass Storage Systems, IEEE Press, Los Alamites, 1991, pp. 61–62.
W. Gropp, “Early experiences with the IBM SP-1 and the High-Performance Switch,” Argonne National Laboratory Technical Report, ANL-93/41, 1993.
R. L. Grossman, D. Valsamis and X. Qin, “Persistent stores and Hybrid Systems,” Proceedings of the 32st IEEE Conference on Decision and Control, IEEE Press, 1993, pp. 2298–2302.
R. L. Grossman, D. Likfa, and X. Qin, “An object manager utilizing hierarchical storage,” Twelfth IEEE Symposium on Mass Storage Systems, IEEE Press, Los Alamites, 1993, pp. 209–214.
R. L. Grossman and X. Qin, “Ptool: a scalable persistent object manager,” Proceedings of SIGMOD 94, ACM, 1994, page 510.
R. L. Grossman, X. Qin, D. Valsamis, W. Xu, C. T. Day, S. Loken, J. F. MacFarlane, D. Quarrie, E. May, D. Lifka, D. Malon, L. Price, “Analyzing High Energy Physics Data Using A Persistent Object Manager,” Proceedings of the Seventh International Working Conference on Scientific and Statistical Database Management, IEEE Press, 1994, to appear.
R. L. Grossman, “Working With Object Stores of Events Using ptool,” in Proceedings of the Cern Summer School in Computing, C. Verkerk, editor, CERN-Service d’Information Scientifique, 1994, to appear.
R. L. Grossman, A. Sundaram, H. Ramamoorthy, M. Wu, S. Hogan, J. Shuler and O. Wolfson, “Viewing the U.S. Government Budget as a Digital Library,” Proceedings of Digital Libraries 1994: Conference on the Theory and Practice of Digital Libraries, ACM, 1994, to appear.
D. Malon, D. Lifka, E. May R. Grossman, X. Qin, W. Xu “Parallel Query Processing for Event Store Data,” Proceedings of Computing in High Energy Physics 1994, to appear.
E. N. May, D. Lifka, D. Malon, L. E. Price L. Cormell, A. Gauthier, J. Marsteller, S. Mestad, U. Nixdorf R. Grossman, X. Qin, D. Valsamis, M. Wu, W. Xu “A Demonstration of a Multi-level Object Store and its Application to the Analysis of High Energy Physics Data,” Proceedings of Computing in High Energy Physics 1994, to appear.
R. L. Grossman, S. Mehta, X. Qin, “Path planning by querying persistent stores of trajectory segments,” Laboratory for Advanced Computing Technical Report Number 93-R3, University of Illinois at Chicago, 1993, to appear.
R. L. Grossman, X. Qin, and D. Valsamis, and D. Lifka, E. May, and D. Malon, and L. Price, “The Architecture of a Multi-level Object Store and its Application to the Analysis of High Energy Physics Data,” Laboratory for Advanced Computing Technical Report, Number LAC 94-R8, University of Illinois at Chicago. December, 1993.
R. L. Grossman, D. Lifka, D. Malon, E. May, X. Qin, D. Valsamis, W. Xu, “High performance object stores,” Laboratory for Advanced Computing Technical Report, Number LAC 94-R12, University of Illinois at Chicago. January, 1994.
D. Isaac, “Hierarchical Storage Management for Relational Databases,” Twelfth IEEE Symposium on Mass Storage Systems, IEEE Press, Los Alamites, 1993, pp. 139–144.
C. Lamb, G. Landis, J. Orenstein, and D. Weinreb, “The ObjectStore Database System,” Communications of the ACM, Volume 34, 1991.
“Mass Storage System Reference Model, Version 4” edited by Sam Coleman and Steve Miller, IEEE. to appear.
M. N. Nelson, B. B. Welch, and J. K. Ousterhout, “Caching in the Sprite Network File System,” ACM Transactions on Computer Systems, Volume 6, 1988, pp. 134–154.
M Stonebraker, “Managing persistent objects in a multi-level store,” in Proceedings of the 1991 ACM SIGMOD, SIGMOD Record, Volume 20, ACM, New York, 1991, pp. 2–11.
Object Management Group, The Common Object Request Broker: Architecture and Spécification, Revision 1.1, OMG TC Document 92.12.1, 1991.
M. Satyanarayanan, J. H. Howard, D. A. Nichols, R. N. Sidebotham, A. Z. Spector, and M. J. West, “The ITC Distributed File System: Principles and Design,” in Proceedings of the 10th Symposium on Operating Systems Principles, ACM Press, New York, 1985, pp. 35–50.
E. Shekita and M. Zwilling, “Cricket: A Mappled, Persistent Object Store,” in Implementing Persistent Object Bases: Principles and Practice, A. Dearie, G. M. Shaw, and S. B. Zdonik, editors, Morgan-Kauffmann Publishers, San Mateo, California, 1991.
http://info.cern.ch/hypertext/www/LineMode/Defaults/Default.html
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 1995 British Computer Society
About this paper
Cite this paper
Grossman, R.L., Araujo, N., Qin, X., Xu, W. (1995). Managing Physical Folios of Objects Between Nodes. In: Atkinson, M., Maier, D., Benzaken, V. (eds) Persistent Object Systems. Workshops in Computing. Springer, London. https://doi.org/10.1007/978-1-4471-2122-0_19
Download citation
DOI: https://doi.org/10.1007/978-1-4471-2122-0_19
Publisher Name: Springer, London
Print ISBN: 978-3-540-19912-0
Online ISBN: 978-1-4471-2122-0
eBook Packages: Springer Book Archive