Skip to main content

Architecture for Aggregation, Processing and Provisioning of Data from Heterogeneous Scientific Information Services

  • Chapter
Intelligent Tools for Building a Scientific Information Platform

Abstract

One of the tasks undertaken in PSNC in the frame of the SYNAT project is the design of architecture for the scientific information system allowing to integrate heterogeneous distributed services necessary to build knowledge base and innovative applications based on it. This paper contains overall description of the designed architecture with the analysis of its most important technical aspects, features and possible weak points. It also presents initial results from the test deployment of the first prototype of several architecture components, including initial aggregation and processing of several millions of metadata records from several tenths of network services.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Górny, M., Gruszczyński, P., Mazurek, C., Nikisch, J.A., Stroiński, M., Swędrzyński, A.: Zastosowanie oprogramowania dLibra do budowy Wielkopolskiej Biblioteki Cyfrowej. In: Zeszyty Naukowe Wydziału ETI Politechniki Gdańskiej. Technologie Informacyjne, May 18-21. I Krajowa Konferencja Technologie Informacyjne, pp. 109–117. Wydawnictwo Politechniki Gdańskiej, Gdańsk (2003)

    Google Scholar 

  2. Mazurek, C., Stroiński, M., Werla, M.: Wdrażanie regionalnych bibliotek cyfrowych w sieci PIONIER w oparciu o środowisko dLibra. In: INFOBAZY 2005 – Bazy Danych dla Nauki, Gdańsk, September 25-27, pp. 58–64. Centrum Informatyczne TASK, Gdańsk (2005) ISBN 83-908112-3-5

    Google Scholar 

  3. Lewandowska, A., Mazurek, C., Werla, M.: Enrichment of European Digital Resources by Federating Regional Digital Libraries in Poland. In: Christensen-Dalsgaard, B., Castelli, D., Ammitzbøll Jurik, B., Lippincott, J. (eds.) ECDL 2008. LNCS, vol. 5173, pp. 256–259. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  4. Dudczak, A., Mazurek, C., Werla, M.: RESTful Atomic Services for Distributed Digital Libraries. In: 1st International Conference on Information Technology, Gdańsk, May 18-21, pp. 267–270 (2008) ISBN 978-1-4244-244-9

    Google Scholar 

  5. Kazman, R., et al.: The architecture tradeoff analysis method. In: Proceedings of Fourth IEEE International Conference on Engineering of Complex Computer Systems, ICECCS 1998, pp. 68–78 (1998) ISBN 0-8186-8597-2

    Google Scholar 

  6. Mazurek, C., Mielnicki, M., Werla, M.: Selective harvesting of regional digital libraries and national metadata aggregators. In: The Proceedings of 9th ACM/IEEE-CS Joint Conference on Digital Libraries, Austin, TX, USA, June 15-19 (2009) ISBN 978-1-60558-322-8

    Google Scholar 

  7. Mazurek, C., Parkoła, T., Werla, M.: Building Federation of Digital Libraries Basing on Concept of Atomic Services. In: ACM/IEEE Joint Conference on Digital Libraries, JCDL 2008, Pittsburgh, PA, USA, June 16-20. ACM (2008) ISBN 978-1-59593-998-2

    Google Scholar 

  8. Lagoze, C., et al.: The Open Archives Initiative Protocol for Metadata Harvesting (2002), http://www.openarchives.org/OAI/openarchivesprotocol.html

  9. Dublin Core Metadata Terms, http://dublincore.org/documents/dcmi-terms/

  10. PLMET Metadata schema, http://dl.psnc.pl/community/display/FBCMETGUIDE

  11. Europeana Semantic Elements Specification (ver. 3.4) (2011), http://version1.europeana.eu/c/document_library/get_file?uuid=77376831-67cf-4cff-a7a2-7718388eec1d&groupId=10128

  12. ETD-MS: an Interoperability Metadata Standard for Electronic Theses and Dissertations version 1.00, rev. 2, http://www.ndltd.org/standards/metadata/etd-ms-v1.00-rev2.html

  13. Rosenberg, J., Mateos, A.: The Cloud at Your Service. The when, how, and why of enterprise cloud computing (November 2010) ISBN 9781935182528

    Google Scholar 

  14. Open Archives Initiative - Object Reuse and Exchange. ORE Specifications and User Guides - Table of Contents, http://www.openarchives.org/ore/1.0/toc.html

  15. ISO/IEC 9126 Standard: Software engineering – Product quality – Part 1: Quality model, http://www.iso.org/iso/iso_catalogue/catalogue_tc/catalogue_detail.htm?csnumber=22749

  16. Kruchten, P., Lago, P., van Vliet, H.: Building Up and Reasoning About Architectural Knowledge. In: Hofmeister, C., Crnković, I., Reussner, R. (eds.) QoSA 2006. LNCS, vol. 4214, pp. 43–58. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  17. Mirkovic, J., Reiher, P.: A taxonomy of DDoS attack and DDoS defense mechanisms. ACM SIGCOMM Computer Communication Review 34(2), 39–53 (2004)

    Article  Google Scholar 

  18. Werla, M.: Możliwości wykorzystania katalogu centralnego w sieci rozproszonych bibliotek cyfrowych. In: Konferencja Rola Katalogu Centralnego NUKAT w Kształtowaniu Społeczeństwa Wiedzy w Polsce, Warszawa, January 23-25 (2008)

    Google Scholar 

  19. Apache Cassandra project website, http://cassandra.apache.org/

  20. Mazurek, C., Sielski, K., Stroiński, M., Walkowska, J., Werla, M., Węglarz, J.: Transforming a Flat Metadata Schema to a Semantic Web Ontology: The Polish Digital Libraries Federation and CIDOC CRM Case Study. In: Bembenik, R., Skonieczny, L., Rybiński, H., Niezgodka, M. (eds.) Intelligent Tools for Building a Scient. Info. Plat. SCI, vol. 390, pp. 153–177. Springer, Heidelberg (2012)

    Chapter  Google Scholar 

  21. Apach Solr project website, http://lucene.apache.org/solr/

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cezary Mazurek .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2013 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Mazurek, C., Mielnicki, M., Nowak, A., Stroiński, M., Werla, M., Węglarz, J. (2013). Architecture for Aggregation, Processing and Provisioning of Data from Heterogeneous Scientific Information Services. In: Bembenik, R., Skonieczny, L., Rybinski, H., Kryszkiewicz, M., Niezgodka, M. (eds) Intelligent Tools for Building a Scientific Information Platform. Studies in Computational Intelligence, vol 467. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-35647-6_32

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-35647-6_32

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-35646-9

  • Online ISBN: 978-3-642-35647-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics