DILIGENT: integrating digital library and Grid technologies for a new Earth observation research infrastructure

  • Leonardo Candela
  • Fuat Akal
  • Henri Avancini
  • Donatella Castelli
  • Luigi Fusco
  • Veronica Guidetti
  • Christoph Langguth
  • Andrea Manzi
  • Pasquale Pagano
  • Heiko Schuldt
  • Manuele Simi
  • Michael Springmann
  • Laura Voicu


This paper introduces DILIGENT, a digital library infrastructure built by integrating digital library and Grid technologies and resources. This infrastructure allows different communities to dynamically build specialised digital libraries capable to support the entire e-Science knowledge production and consumption life-cycle by using shared computing, storage, content, and application resources. The paper presents some of the main software services that implement the DILIGENT system. Moreover, it exemplifies the provided features by presenting how the DILIGENT infrastructure is being exploited in supporting the activity of user communities working in the Earth Science Environmental sector.


Digital libraries Grid Earth science 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    DIGITAL LIBRARIES: Future Directions for a European Research Programme. Brainstorming report, DELOS, San Cassiano, Alta Badia, Italy (2001)Google Scholar
  2. 2.
    Altintas, I., Berkley, C., Jaeger, E., Jones, M., Ludäscher, B., Mock, S.: Kepler: An Extensible System for Design and Execution of Scientific Workflows. In: Franklin, M.J., Moon, B., Ailamaki, A. (eds.) Proc. of the 16th Intl. Conf. on Scientific and Statistical Database Management (SSDBM’04), Santorini Island, Greece, June 21–23 (2004)Google Scholar
  3. 3.
    Arms, W.Y.: Digital Libraries. The MIT Press (2001)Google Scholar
  4. 4.
    Atkins, D.E., Droegemeier, K.K., Feldman, S.I., Garcia- Molina, H., Klein, M.L., Messerschmitt, D.G., Messina, P., Ostriker, J.P., Wright, M.H.: Revolutionizing science and engineering through cyberinfrastructure. Report of the National Science Foundation Blue-Ribbon Advisory Panel on Cyberinfrastructure (2003)Google Scholar
  5. 5.
    Banks, T.: Web Services Resource Framework (WSRF)—Primer. Committee draft 01, OASIS (2005). Scholar
  6. 6.
    Booth, D., Haas, H., McCabe, F., Newcomer, E., Champion, M., Ferris, C., Orchard, D.: Web Services Architecture. Tech. rep., W3C (2004). URL: W3C Working Group NoteGoogle Scholar
  7. 7.
    Bush V. (1945). As we may think. The Atlantic Monthly 176(1): 101–108 Google Scholar
  8. 8.
    Candela, L., Castelli, D., Pagano, P., Simi, M.: Moving digital Library Service Systems to the Grid. In: Türker, C., Agosti, M., Schek, H.J. (eds.) Peer-to-Peer, Grid, and Service-Orientation in Digital Library Architectures, no. 3664 in Lecture Notes in Computer Science, pp. 236–259. Springer, Heidelberg (2005)Google Scholar
  9. 9.
    Candela, L., Castelli, D., Pagano, P., Simi, M.: OpenDLibG: Extending OpenDLib by exploiting a gLite Grid Infrastructure. In: 10th European Conference on Research and Advanced Technology for Digital Libraries, ECDL 2006 (2006)Google Scholar
  10. 10.
    Castelli, D., Candela, L., Pagano, P., Simi, M.: DILIGENT: A DL Infrastructure for Supporting Joint Research. In: Society, I.C. (ed.) 2nd IEEE-CS International Symposium Global Data Interoperability—Challenges and Technologies, pp. 56–69 (2005)Google Scholar
  11. 11.
    Czajkowski, K., Fitzgerald, S., Foster, I., Kesselman, C.: Grid information services for distributed resource sharing. In: Proceedings of the Tenth IEEE International Symposium on High-Performance Distributed Computing (HPDC-10). IEEE Press (2001)Google Scholar
  12. 12.
    DILIGENT: A DIgital Library Infrastructure on Grid ENabled Technology. IST-2003-004260Google Scholar
  13. 13.
    Droegemeier, K.K., Chandrasekar, V., Clark, R., Gannon, D., Graves, S., Joseph, E., Ramamurthy, M., Wilhelmson, R., Brewster, K., DOmenico, B., Leyton, T., Morris, V., Murray, D., Plate, B., Ramachandran, R., Reed, D., Rushing, J., Weber, D., Wilson, A., Xue, M., Yalda, S.: Linked environments for atmospheric discovery (lead): a cyberinfrastructure for mesoscale meteorology research and education. In: 20th Conf. on Interactive Info. Processing Systems for Meteorology, Oceanography, and Hydrology, Seattle. Am. Meteor. Soc. (2004)Google Scholar
  14. 14.
    EGEE: Enabling Grids for E-sciencE. INFSO 508833Google Scholar
  15. 15.
    EGEE: gLite: Lightweight middleware for Grid computing. Scholar
  16. 16.
    Foster, I.: What is the Grid? A three point checklist. GRIDtoday 1(6) (2002)Google Scholar
  17. 17.
    Foster, I., Kesselman, C.: The Grid: Blueprint for a Future Computing Infrastructure. Morgan-Kaufmann (2004)Google Scholar
  18. 18.
    Foster, I., Kesselman, C., Nick, J., Tuecke, S.: The Physiology of the Grid: An Open Grid Services Architecture for Distributed Systems Integration. Open Grid Service Infrastructure WG, Global Grid Forum (2002)Google Scholar
  19. 19.
    Foster I., Kesselman C. and Tuecke S. (2001). The anatomy of the Grid: enabling scalable virtual organization. Int. J. High Perform. Comput. Appl. 15(3): 200–222 CrossRefGoogle Scholar
  20. 20.
    Fox E.A., Akscyn R.M., Furuta R. and Leggett J.J. (1995). Digital Libraries. Commun. ACM 38(4): 23–28 Google Scholar
  21. 21.
    Fox E.A. and Marchionini G. (1998). Toward a worldwide Digital Library. Commun. ACM 41(4): 29–32 CrossRefGoogle Scholar
  22. 22.
    Geisler, G., Giersch, S., McArthur, D., McClelland, M.: Creating virtual collections in Digital Libraries: Benefits and Implementation Issues. In: Proceedings of the Second ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 210–218. ACM Press (2002). DOI: Scholar
  23. 23.
    Gillmann, M., Weikum, G., Wonner, W.: Workflow management with service quality guarantees. In: Franklin, M.J., Moon, B., Ailamaki, A. (eds.) Proc. of the 2002 ACM SIGMOD Int. Conf. on Management of Data, Madison, June 3–6, pp. 228–239. ACM Press (2002)Google Scholar
  24. 24.
    Globus Alliance: The Globus Alliance Website. Scholar
  25. 25.
    Ioannidis Y. (2005). Digital libraries at a crossroads. Int. J. Digital Libraries 5(4): 255–265 CrossRefMathSciNetGoogle Scholar
  26. 26.
    Ioannidis Y., Maier D., Abiteboul S., Buneman P., Davidson S., Fox E., Halevy A., Knoblock C., Rabitti F., Schek H. and Weikum G. (2005). Digital library information-technology infrastructures. Int. J. Digital Libraries 5(4): 266–274 CrossRefGoogle Scholar
  27. 27.
    Lagoze, C., Arms, W., Gan, S., Hillmann, D., Ingram, C., Krafft, D., Marisa, R., Phipps, J., Saylor, J., Terrizzi, C., Hoehn, W., Millman, D., Allan, J., Guzman-Lara, S., Kalt, T.: Core services in the architecture of the national science digital library (NSDL). In: Proceedings of the second ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 201–209. ACM Press (2002). DOI: Scholar
  28. 28.
    Lagoze, C., Krafft, D.B., Payette, S., Jesuroga, S.: What is a Digital Library anyway? D-Lib Magaz. 11(11) (2005)Google Scholar
  29. 29.
    Lagoze, C., Payette, S., Shin, E., Wilper, C.: Fedora: An architecture for complex objects and their relationships. J. Digital Libraries, Special Issue on Complex Objects (2005)Google Scholar
  30. 30.
    Lagoze, C., Van de Sompel, H.: The OAI Protocol for Metadata Harvesting. Scholar
  31. 31.
    Lagoze, C., Van de Sompel, H.: The open archives initiative: building a low-barrier interoperability framework. In: Proceedings of the first ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 54–62. ACM Press (2001). DOI: Scholar
  32. 32.
    Larson, R.R., Sanderson, R.: Grid-based digital libraries: Cheshire3 and distributed retrieval. In: JCDL ’05: Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 112–113. ACM Press, New York, (2005)Google Scholar
  33. 33.
    Lazcano A., Schuldt H., Alonso G. and Schek H.J. (2001). WISE: Process based E-Commerce. Bull. IEEE Tech. Committ. Data Eng. 24(1): 46–51 Google Scholar
  34. 34.
    Lesk, M.: Expanding Digital Library research: media, genre, place and subjects. In: Proceedings of the International Symposium on Digital Library 1999: ISDL’99, pp. 51–57. Tsukuba, (1999)Google Scholar
  35. 35.
    Licklider, J.C.R.: Libraries of the Future. MIT Press (1965)Google Scholar
  36. 36.
    Lomow, G., Newcomer, E.: Understanding SOA with Web Services. Independent Technology Guides. Addison Wesley Professional (2005)Google Scholar
  37. 37.
    MacKenzie, C.M., Laskey, K., McCabe, F., Brown, P., Metz, R.: Reference Model for Service Oriented Architecture 1.0. Tech. rep., OASIS (2006). Public Review Draft 1.0Google Scholar
  38. 38.
    Metha B., Levy M., Meredith G., Andrews T., Beckman B., Klein J. and Mital A. (2001). BizTalk Server 2000 Business Process Orchestration. IEEE Data Eng. Bull. 24(1): 35–39 Google Scholar
  39. 39.
    Moore, R.W., Marciano, R.: Building preservation environments. In: Proceedings of the 5th ACM/IEEE-CS Joint Conference on Digital Libraries (JCDL 2005), p. 424 (2005)Google Scholar
  40. 40.
    Old Dominion University Digital Library Research Group: Digital Library GRID Project. Scholar
  41. 41.
    Qi, L., Jin, H., Foster, I., Gawor, J.: HAND: Highly Available Dynamic Deployment Infrastructure for Globus Toolkit 4. Submitted for Publication (2006)Google Scholar
  42. 42.
    Rajasekar, A., Moore, R., Berman, F., Schottlaender, B.: From digital preservation lifecycle management for multi-media collections. In: 8th International Conference on Asian Digital Libraries, ICADL 2005, Bangkok, December 2005, pp. 380–384. Springer, Heidelberg (2005)Google Scholar
  43. 43.
    Rajasekar A., Wan M., Moore R., Schroeder W., Kremenek G., Jagatheesan A., Cowart C., Zhu B., Chen S.Y. and Olschanowsky R. (2003). Storage resource broker—managing distributed data in a Grid. Comput. Soc. India J. Spec. Issue SAN 33(4): 42–54 Google Scholar
  44. 44.
    Schuldt H., Alonso G., Beeri C. and Schek H.J. (2002). Atomicity and isolation for transactional processes. ACM Trans. Database Systems (TODS) 27(1): 63–116 CrossRefGoogle Scholar
  45. 45.
    Schuler C., Schuldt H., Türker C., Weber R. and Schek H.J. (2005). Peer-to-Peer execution of (transactional) processes. Int. J. Cooperative Inf. Systems (IJCIS) 14(4): 377–405 CrossRefGoogle Scholar
  46. 46.
    Schuler, C., Weber, R., Schuldt, H., Schek, H.J.: Scalable Peer-to-Peer process management—The OSIRIS approach. In: Proceedings of the 2nd International Conference on Web Services (ICWS’2004), pp. 26–34. IEEE Computer Society, San Diego (2004)Google Scholar
  47. 47.
    Tansley, R., Bass, M., Smith, M.: DSpace as an open archival information system: current status and future directions. In: Koch, T., Sølvberg, I. (eds.) Research and Advanced Technology for Digital Libraries, 7th European Conference, ECDL 2003, Trondheim, August 17–22, 2003, Proceedings, Lecture Notes in Computer Science, pp. 446–460. Springer, Heidelberg (2003)Google Scholar
  48. 48.
    Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R.: A Grid Monitoring Architecture. Tech. Rep. GFD.6, Global Grid Forum Document Series (2002)Google Scholar
  49. 49.
    Unidata: Providing data, tools, and community leadership for enhanced earth-system education and research web page. http://www.unidata.ucar.eduGoogle Scholar
  50. 50.
    IBM WebSphere Application Server Enterprise Process Choreographer. htmlGoogle Scholar
  51. 51.
    Wiederhold G., Wegner P. and Ceri S. (1992). Towards megaprogramming. Commun. ACM 35(11): 89–99 CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2007

Authors and Affiliations

  • Leonardo Candela
    • 1
  • Fuat Akal
    • 2
  • Henri Avancini
    • 1
  • Donatella Castelli
    • 1
  • Luigi Fusco
    • 3
  • Veronica Guidetti
    • 3
  • Christoph Langguth
    • 2
  • Andrea Manzi
    • 1
  • Pasquale Pagano
    • 1
  • Heiko Schuldt
    • 2
  • Manuele Simi
    • 1
  • Michael Springmann
    • 2
  • Laura Voicu
    • 2
  1. 1.Institute of Information Science and Technologies (ISTI)Italian National Research Council (CNR)PisaItaly
  2. 2.Department of Computer ScienceUniversity of BaselBaselSwitzerland
  3. 3.European Space Agency (ESA)European Space Research Institute (ESRIN)Frascati (RM)Italy

Personalised recommendations