Skip to main content
SpringerLink
Log in

Data Pipeline Architecture for Serverless Platform

  • Conference paper
  • First Online:
Software Architecture (ECSA 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1269))

Included in the following conference series:

Abstract

To provide cost effective cloud resources with high QoS, serverless platform is introduced that allows to pay for the exact amount of resource usage. On the other hand, a number of data management tools are developed to handle the data from a large number of IoT sensing devices. However, the modern data-intensive cloud applications require the power that comes from integrating data management tools with serverless platforms. This paper proposes a novel data pipeline architecture for serverless platform for providing an environment to develop applications that can be broken into independently deployable, schedulable, scalable, and re-usable modules and efficiently manage the flow of data between different environments.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Apache NiFi (2019). https://nifi.apache.org/. Accessed 21 October 2019

  2. D5.5-Data-Pipeline-Orchestration-I, 16 July 2020 (2019). http://radon-h2020.eu/wp-content/uploads/2020/01/D5.5-Data-Pipeline-Orchestration-I.pdf

  3. AWS data pipeline documentation (2020). https://docs.aws.amazon.com/data-pipeline/. Accessed 24 January 2020

  4. Beam overview, 16 July 2020 (2020). https://beam.apache.org/

  5. Topology and orchestration specification for cloud applications (TOSCA) standard v1.3 26 February 2020 (2020). https://docs.oasis-open.org/tosca/TOSCA-Simple-Profile-YAML/v1.3/TOSCA-Simple-Profile-YAML-v1.3.html

  6. Viarota - enhance the travel experience of your visitors 25 June 2020 (2020). https://viarota.com/

  7. Casale, et al.: Radon: rational decomposition and orchestration for serverless computing. SICS Softw. Intensive Cyber-Phys. Syst, August 2019

    Google Scholar 

  8. Kopp, O., Binz, T., Breitenbücher, U., Leymann, F.: Winery – a modeling tool for TOSCA-based cloud applications. In: Basu, S., Pautasso, C., Zhang, L., Fu, X. (eds.) ICSOC 2013. LNCS, vol. 8274, pp. 700–704. Springer, Heidelberg (2013). https://doi.org/10.1007/978-3-642-45005-1_64

    Chapter  Google Scholar 

Download references

Acknowledgment

This work is partially funded by the European Union’s Horizon 2020 research and innovation project RADON (825040).

Author information

Authors and Affiliations

  1. University of Tartu, Tartu, Estonia

    Chinmaya Dehury, Pelle Jakovits & Satish Narayana Srirama

  2. Athens Technology Center S.A., Athens, Greece

    Vasilis Tountopoulos & Giorgos Giotis

Authors
  1. Chinmaya Dehury
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pelle Jakovits
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Satish Narayana Srirama
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Vasilis Tountopoulos
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giorgos Giotis
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Chinmaya Dehury .

Editor information

Editors and Affiliations

  1. University of L’Aquila, L’Aquila, Italy

    Henry Muccini

  2. University of Groningen, Groningen, The Netherlands

    Paris Avgeriou

  3. Faculty of Informatics, Masaryk University, Brno, Czech Republic

    Barbora Buhnova

  4. Department of Computer Science, University of York, York, UK

    Javier Camara

  5. Department of Computer Science, Linnaeus University, Växjö, Sweden

    Mauro Caporuscio

  6. University of L’Aquila, L’Aquila, Italy

    Mirco Franzago

  7. Karlsruhe Institute of Technology, Karlsruhe, Germany

    Anne Koziolek

  8. University of Bergamo, Dalmine, Italy

    Patrizia Scandurra

  9. Gran Sasso Science Institute, L’Aquila, Italy

    Catia Trubiani

  10. Department of Computer Science, KU Leuven, Leuven, Belgium

    Danny Weyns

  11. Faculty of Computer Science, University of Vienna, Vienna, Austria

    Uwe Zdun

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Dehury, C., Jakovits, P., Srirama, S.N., Tountopoulos, V., Giotis, G. (2020). Data Pipeline Architecture for Serverless Platform. In: Muccini, H., et al. Software Architecture. ECSA 2020. Communications in Computer and Information Science, vol 1269. Springer, Cham. https://doi.org/10.1007/978-3-030-59155-7_18

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-59155-7_18

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-59154-0

  • Online ISBN: 978-3-030-59155-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation