Skip to main content

FaaSter, Better, Cheaper: The Prospect of Serverless Scientific Computing and HPC

  • Conference paper
  • First Online:
High Performance Computing (CARLA 2017)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 796))

Included in the following conference series:

Abstract

The adoption of cloud computing facilities and programming models differs vastly between different application domains. Scalable web applications, low-latency mobile backends and on-demand provisioned databases are typical cases for which cloud services on the platform or infrastructure level exist and are convincing when considering technical and economical arguments. Applications with specific processing demands, including high-performance computing, high-throughput computing and certain flavours of scientific computing, have historically required special configurations such as compute- or memory-optimised virtual machine instances. With the rise of function-level compute instances through Function-as-a-Service (FaaS) models, the fitness of generic configurations needs to be re-evaluated for these applications. We analyse several demanding computing tasks with regards to how FaaS models compare against conventional monolithic algorithm execution. Beside the comparison, we contribute a refined FaaSification process for legacy software and provide a roadmap for future work.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Subscribe and save

Springer+ Basic
EUR 32.99 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Baldini, I., Castro, P., Chang, K., Cheng, P., Fink, S., Ishakian, V., Mitchell, N., Muthusamy, V., Rabbah, R., Slominski, A., Suter, P.: Serverless Computing: Current Trends and Open Problems. arXiv:1706.03178, June 2017

  2. Berg, T.L., Berg, A.C., Edwards, J., Forsyth, D.A.: Who’s in the picture. In: Neural Information Processing Systems (NIPS), Vancouver, British Columbia, Canada, pp. 137–144, December 2004

    Google Scholar 

  3. Calvert, P.: Parallelisation of Java for graphics processors. Ph.D. thesis, Trinity College, May 2010

    Google Scholar 

  4. Duan, Y., Fu, G., Zhou, N., Sun, X., Narendra, N.C., Hu, B.: Everything as a service (XaaS) on the cloud: origins, current and future trends. In: 8th IEEE International Conference on Cloud Computing (CLOUD), New York City, New York, USA, pp. 621–628, June 2015

    Google Scholar 

  5. Glikson, A., Nastic, S., Dustdar, S.: Deviceless edge computing: extending serverless computing to the edge of the network. In: 10th ACM International Systems and Storage Conference (SYSTOR), Haifa, Israel, May 2017

    Google Scholar 

  6. Hendrickson, S., Sturdevant, S., Harter, T., Venkataramani, V., Arpaci-Dusseau, A.C., Arpaci-Dusseau, R.H.: Serverless computation with OpenLambda. In: 8th USENIX Workshop on Hot Topics in Cloud Computing (HotCloud), Denver, Colorado, USA, June 2016

    Google Scholar 

  7. Hummer, W.: A fully functional local AWS cloud stack, July 2017. https://github.com/localstack/localstack

  8. Jonas, E., Venkataraman, S., Stoica, I., Recht, B.: Occupy the Cloud: Distributed Computing for the 99%. Preprint at arXiv:1702.04024, February 2017

  9. Mallya, S., Li, H.M.: Serverless Reference Architecture: MapReduce, October 2016. https://github.com/awslabs/lambda-refarch-mapreduce

  10. Müller, S.C., Alonso, G., Amara, A., Csillaghy, A.: Pydron: semi-automatic parallelization for multi-core and the cloud. In: 11th USENIX Symposium on Operating Systems Design and Implementation (OSDI), Broomfield, Colorado, USA, pp. 645–659, October 2014

    Google Scholar 

  11. Rao, D., Ng, W.K.: Information pricing: a utility based pricing mechanism. In: 14th IEEE International Conference on Dependable, Autonomic and Secure Computing, Auckland, New Zealand, pp. 754–760, August 2016

    Google Scholar 

  12. Ricci, R., Eide, E.: Introducing CloudLab: scientific infrastructure for advancing cloud architectures and applications. ;login: Usenix Mag. 39(6), 36–38 (2014)

    Google Scholar 

  13. Spillner, J.: Transformation of Python Applications into Function-as-a-Service Deployments. arXiv:1705.08169, May 2017

  14. Spillner, J.: Snafu: Function-as-a-Service (FaaS) Runtime Design and Implementation. arXiv:1703.07562, March 2017

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Josef Spillner .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Spillner, J., Mateos, C., Monge, D.A. (2018). FaaSter, Better, Cheaper: The Prospect of Serverless Scientific Computing and HPC. In: Mocskos, E., Nesmachnow, S. (eds) High Performance Computing. CARLA 2017. Communications in Computer and Information Science, vol 796. Springer, Cham. https://doi.org/10.1007/978-3-319-73353-1_11

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-73353-1_11

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-73352-4

  • Online ISBN: 978-3-319-73353-1

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics