CLEPSYDRA Data Aggregation and Enrichment Framework: Design, Implementation and Deployment in the PIONIER Network Digital Libraries Federation

  • Cezary Mazurek
  • Marcin Mielnicki
  • Aleksandra Nowak
  • Krzysztof Sielski
  • Maciej Stroiński
  • Marcin Werla
  • Jan Węglarz
Chapter
Part of the Studies in Computational Intelligence book series (SCI, volume 541)

Abstract

During 3 years of the SYNAT project PSNC was working on the architecture for aggregation, processing and provisioning of data from heterogeneous scientific information services. The implementation of this architecture was named CLEPSYDRA and was published as an open source project. This chapter contains overview of the CLEPSYDRA system design and implementation. It also presents the test deployment of CLEPSYDRA for the purpose of the PIONIER Network Digital Libraries Federation, focusing on aspect such as agent-based data aggregation, data normalization and data enrichment. Finally the chapter includes several scenarios for future use of the system in the national and international context.

Keywords

Data aggregation Data enrichment Metadata processing REST architecture Distributed systems 

Notes

Acknowledgements

Works described in this chapter are financed as a part of the SYNAT project, which is a national research project aimed at the creation of universal open repository platform for hosting and communication of networked resources of knowledge for science, education, and open society of knowledge. It is funded by the Polish National Center for Research and Development (grant no SP/I/1/77065/10).

References

  1. 1.
    Mazurek, C., Parkoła, T., Werla, M.: Distributed digital libraries platform in the PIONIER network. In: Red. Gonzalo, J., Thanos, C., Verdejo, M.F., Carrasco, R.C. (eds.) Lecture Notes in Computer Science, LNCS vol. 4172. Springer, Berlin (2006). ISBN 3-540-44636-2. ECDL 2006: Research and Advanced Technology for Digital Libraries, Alicante, Spain, 17–22 Wrzesień, pp. 488–491 (2006)Google Scholar
  2. 2.
    Górny, M., Gruszczyński, P., Mazurek, C., Nikisch, J.A., Stroiński, M., Swędrzyński, A.: Zastosowanie oprogramowania dLibra do budowy Wielkopolskiej Biblioteki Cyfrowej. SBP KWE, Warszawa (2003). ISBN 83-915689-5-4. Internet w bibliotekach II, Wrocław, 23–26 Wrzesień (2003)Google Scholar
  3. 3.
    Lewandowska, A., Mazurek, C., Werla, M.: Enrichment of European digital resources by federating regional digital libraries in Poland. In: Research and Advanced Technology for Digital Libraries, Proceedings of the 12th European Conference (ECDL 2008), LNCS vol. 5173, pp. 256–259. Aarhus, Denmark, 14–19 Września (2008)Google Scholar
  4. 4.
    Mazurek, C., Mielnicki, M., Nowak, A., Stroiński, M., Werla, M., Węglarz, J.: Architecture for aggregation, processing and provisioning of data from heterogeneous scientific information services. In: Bembenik, R., Skonieczny, Ł., Rybiński, H., Kryszkiewicz, M., Niezgódka, M. (eds.) Intelligent Tools for Building a Scientific Information Platform: Advanced Architectures and Solutions. Springer, Berlin, pp. 529–546. ISBN 978-3-642-35646-9 (2013)Google Scholar
  5. 5.
    Akhshabi, Saamer, Dovrolis, Constantine: The evolution of layered protocol stacks leads to an hourglass-shaped architecture. SIGCOMM-Comput. Commun. Rev. 41(4), 206 (2011)CrossRefGoogle Scholar
  6. 6.
    Mazurek, C., Stroiński, M., Werla, M., Węglarz, J.: Distributed services and metadata flow in the polish federation of digital. In: International Conference on Information Society (i-Society), pp. 39–46. ISBN 978-0-9564263-8-3 (2011)Google Scholar
  7. 7.
    Europeana Semantic Elements Specification Version 3.4.1. http://pro.europeana.eu/documents/900548/dc80802e-6efb-4127-a98e-c27c95396d57

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Cezary Mazurek
    • 1
  • Marcin Mielnicki
    • 1
  • Aleksandra Nowak
    • 1
  • Krzysztof Sielski
    • 1
  • Maciej Stroiński
    • 1
  • Marcin Werla
    • 1
  • Jan Węglarz
    • 1
  1. 1.Poznań Supercomputing and Networking CenterPoznańPoland

Personalised recommendations