Peer-to-Peer Metadata Management for Knowledge Discovery Applications in Grids
Computational Grids are powerful platforms gathering computational power and storage space from thousands of geographically distributed resources. The applications running on such platforms need to efficiently and reliably access the various and heterogeneous distributed resources they offer. This can be achieved by using metadata information describing all available resources. It is therefore crucial to provide efficient metadata management architectures and frameworks. In this paper we describe the design of a Grid metadata management service. We focus on a particular use case: the Knowledge Grid architecture which provides high-level Grid services for distributed knowledge discovery applications. Taking advantage of an existing Grid data-sharing service, namely JuxMem, the proposed solution lies at the border between peer-to-peer systems and Web services.
KeywordsGrid knowledge discovery metadata management peer-to-peer
Unable to display preview. Download preview PDF.
- B. Allcock, J. Bester, J. Bresnahan, A. L. Chervenak, C. Kesselman, S. Meder, V. Nefe-dova, D. Quesnel, S. Tuecke, and I. Foster. Secure, Efficient Data Transport and Replica Management for High-Performance Data-Intensive Computing. In Proc. 18th IEEE Sym-posium on Mass Storage Systems (MSS 2001), San Diego, USA, 2001.Google Scholar
- G. Antoniu, M. Bertier, E. Caron, F. Desprez, L. Bougé, M. Jan, S. Monnet, and P. Sens. GDS: An Architecture Proposal for a Grid Data-Sharing Service. In Future Generation Grids, V. Getov, D. Laforenza, A. Reinefeld (Eds.), pages 133-152, Springer, 2006.Google Scholar
- G. Antoniu, L. Cudennec, and S. Monnet. Extending the entry consistency model to enable efficient visualization for code-coupling grid applications. In Proc. 6th IEEE/ACM International Symposium on Cluster Computing and the Grid (CCGrid 2006), pages 552-555, Singapore, 2006.Google Scholar
- G. Antoniu, M. Jan, and D. A. Noblet. Enabling the P2P JXTA Platform for High-Performance Networking Grid Infrastructures. In Proc. 1st International Conference on High Performance Computing and Communications (HPCC’05), pages 429-440, Sor-rento, Italy, 2005.Google Scholar
- F. Cappello, E. Caron, M. Dayde, F. Desprez, E. Jeannot, Y. Jegou, S. Lanteri, J. Leduc, N. Melab, G. Mornet, R. Namyst, P. Primet, and O. Richard. Grid’5000: A Large Scale, Reconfigurable, Controlable and Monitorable Grid Platform. In Proc. 6th IEEE/ACM International Workshop on Grid Computing (Grid’05), Seattle, USA, 2005.Google Scholar
- A. Congiusta, D. Talia, and P. Trunfio. VEGA: A Visual Environment for Developing Complex Grid Applications. In Proc. 1st International Workshop on Knowledge Grid and Grid Intelligence (KGGI 2003), pages 56-66, Halifax, Canada, 2003.Google Scholar
- K. Czajkowski, S. Fitzgerald, I. Foster, and C. Kesselman. Grid Information Services for Distributed Resource Sharing. In Proc. 10th IEEE International Symposium on HighPerformance Distributed Computing, pages 181-184, San Francisco, USA, 2001.Google Scholar
- K. Czajkowski, I. Foster, N. Karonis, C. Kesselman, S. Martin, W. Smith, and S. Tuecke. Resource Management Architecture for Metacomputing Systems. In Proc. IPPS/SPDP: Workshop on Job Scheduling Strategies for Parallel Processing, pages 62-82, 1998.Google Scholar
- J. Hodges and R. Morgan. Lightweight Directory Access Protocol (v3): Technical Spec- ification. IETF Request For Comment 3377, Network Working Group, 2002.Google Scholar
- C. Kesselman and I. Foster. The Grid: Blueprint for a New Computing Infrastructure. Morgan Kaufmann Publishers, 1998.Google Scholar
- B. Traversat, A. Arora, M. Abdelaziz, M. Duigou, C. Haywood, J.-C. Hugly, E. Pouyoul, and B. Yeager. Project JXTA 2.0 Super-Peer Virtual Network. http://www.jxta.org/project/www/docs/JXTA2.0protocols1.pdf, 2003.
- Grid’5000. http://www.grid5000.org.
- MySQL. http://www.mysql.com.