Skip to main content

Reversed Amdahl’s Law for Hybrid Parallel Computing

  • Conference paper
  • First Online:
Computer Aided Systems Theory – EUROCAST 2017 (EUROCAST 2017)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 10671))

Included in the following conference series:

  • 1083 Accesses

Abstract

The paper presents a certain version of Amdahl’s law intended for use with heterogeneous systems of parallel computation, which can be used to compare different technologies and configurations of parallel systems in a better way than a simple comparison of achieved speedups. A mathematical formulation of the law, derived from the known Amdahl’s law is presented. Next, the proposed law is used in simple comparison of performance of several computation devices. Finally, we use the law to estimate the performance limit of a certain heterogeneous parallel system equipped with GPU device and employing vector processing techniques.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Amdahl, G.M.: Validity of the single processor approach to achieving large scale computing capabilities. In: Proceedings of the Spring Joint Computer Conference, AFIPS 1967 (Spring), pp. 483–485. ACM, New York (1967)

    Google Scholar 

  2. Bożejko, W.: On single-walk parallelization of the job shop problem solving algorithms. Comput. Oper. Res. 39(9), 2258–2264 (2012). https://doi.org/10.1016/j.cor.2011.11.009

    Article  MathSciNet  MATH  Google Scholar 

  3. Bożejko, W.: Solving the flow shop problem by parallel programming. J. Parallel Distrib. Comput. 69(5), 470–481 (2009). http://www.sciencedirect.com/science/article/pii/S0743731509000215

  4. Hill, M.D., Marty, M.R.: Amdahl’s law in the multicore era. Computer 41(7), 33–38 (2008). https://doi.org/10.1109/MC.2008.209

    Article  Google Scholar 

  5. Meng, C., Wang, L., Cao, Z., Feng, L.L., Zhu, W.: Large-scale parallelization based on CPU and GPU cluster for cosmological fluid simulations. Comput. Fluids 110, 152–158 (2015). parCFD 2013

    Article  MathSciNet  Google Scholar 

  6. Moncrieff, D., Overill, R.E., Wilson, S.: Heterogeneous computing machines and Amdahl’s law. Parallel Comput. 22(3), 407–413 (1996)

    Article  MATH  Google Scholar 

  7. Piao, X., Kim, C., Oh, Y., Li, H., Kim, J., Kim, H., Lee, J.W.: Jaws: a javascript framework for adaptive CPU-GPU work sharing. In: Proceedings of the 20th ACM SIGPLAN Symposium on Principles and Practice of Parallel Programming, pp. 251–252. ACM, New York (2015). http://doi.acm.org/10.1145/2688500.2688525

  8. Rudy, J., Żelazny, D.: GACO: a parallel evolutionary approach to multi-objective scheduling. In: Gaspar-Cunha, A., Henggeler Antunes, C., Coello, C.C. (eds.) EMO 2015. LNCS, vol. 9018, pp. 307–320. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-15934-8_21

    Google Scholar 

  9. Vialle, S., Contassot-Vivier, S.: Algorithmic scheme for hybrid computing with CPU, Xeon-Phi/MIC and GPU devices on a single machine. In: International Conference on Parallel Computing (ParCo 2015), Edinburgh, pp. 25–34 (2015)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jarosław Rudy .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Rudy, J., Bożejko, W. (2018). Reversed Amdahl’s Law for Hybrid Parallel Computing. In: Moreno-Díaz, R., Pichler, F., Quesada-Arencibia, A. (eds) Computer Aided Systems Theory – EUROCAST 2017. EUROCAST 2017. Lecture Notes in Computer Science(), vol 10671. Springer, Cham. https://doi.org/10.1007/978-3-319-74718-7_12

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-74718-7_12

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-74717-0

  • Online ISBN: 978-3-319-74718-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics