Skip to main content

Advertisement

SpringerLink
Log in
Menu
Find a journal Publish with us
Search
Cart
Book cover

European Conference on Parallel Processing

Euro-Par 2011: Euro-Par 2011: Parallel Processing Workshops pp 491–501Cite as

  1. Home
  2. Euro-Par 2011: Parallel Processing Workshops
  3. Conference paper
Scheduling Divisible Loads on Heterogeneous Desktop Systems with Limited Memory

Scheduling Divisible Loads on Heterogeneous Desktop Systems with Limited Memory

  • Aleksandar Ilic30 &
  • Leonel Sousa30 
  • Conference paper
  • 1314 Accesses

  • 1 Citations

Part of the Lecture Notes in Computer Science book series (LNTCS,volume 7155)

Abstract

This paper addresses the problem of scheduling discretely divisible applications in heterogeneous desktop systems with limited memory by relying on realistic performance models for computation and communication, through bidirectional asymmetric full-duplex buses. We propose an algorithm for multi-installment processing with multi-distributions that allows to efficiently overlap computation and communication at the device level in respect to the supported concurrency. The presented approach was experimentally evaluated for a real application; 2D FFT batch collaboratively executed on a Graphic Processing Unit and a multi-core CPU. The experimental results obtained show the ability of the proposed approach to outperform the optimal implementation for about 4 times, whereas it is not possible with the current state of the art approaches to determine a load balanced distribution.

Keywords

  • Scheduling
  • divisible loads
  • heterogeneous desktop systems
  • multiple installments
  • memory constraints

Download conference paper PDF

References

  1. Barlas, G.D., Hassan, A., Jundi, Y.A.: An Analytical Approach to the Design of Parallel Block Cipher Encryption/Decryption: A CPU/GPU Case Study. In: PDP, pp. 247–251 (2011)

    Google Scholar 

  2. Beaumont, O., et al.: Scheduling divisible loads on star and tree networks: results and open problems. IEEE Trans. Parallel Distributed Systems 16, 2005 (2003)

    Google Scholar 

  3. Berlińska, J., Drozdowski, M.: Heuristics for multi-round divisible loads scheduling with limited memory. Parallel Comput. 36, 199–211 (2010)

    CrossRef  MATH  Google Scholar 

  4. Clarke, D., Lastovetsky, A., Rychkov, V.: Dynamic load balancing of parallel computational iterative routines on platforms with memory heterogeneity. In: HeteroPar 2010 (2010)

    Google Scholar 

  5. Drozdowski, M., Lawenda, M.: A New Model of Multi-installment Divisible Loads Processing in Systems with Limited Memory. In: Wyrzykowski, R., Dongarra, J., Karczewski, K., Wasniewski, J. (eds.) PPAM 2007. LNCS, vol. 4967, pp. 1009–1018. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  6. Galindo, I., Almeida, F., Badía-Contelles, J.M.: Dynamic Load Balancing on Dedicated Heterogeneous Systems. In: Lastovetsky, A., Kechadi, T., Dongarra, J. (eds.) EuroPVM/MPI 2008. LNCS, vol. 5205, pp. 64–74. Springer, Heidelberg (2008)

    CrossRef  Google Scholar 

  7. Ghatpande, A., Nakazato, H., Watanabe, H., Beaumont, O.: Divisible load scheduling with result collection on heterogeneous systems. In: IPDPS, pp. 1–8 (2008)

    Google Scholar 

  8. Ilic, A., Sousa, L.: Algorithm for divisible load scheduling on heterogeneous systems with realistic performance models. Tech. rep., INESC-ID (May 2011)

    Google Scholar 

  9. Ilic, A., Sousa, L.: Collaborative execution environment for heterogeneous parallel systems. In: APDCM/IPDPS 2010 (2010)

    Google Scholar 

  10. Lastovetsky, A., Reddy, R.: Data partitioning with a functional performance model of heterogeneous processors. Int. J. High Perform. Comput. Appl. 21, 76–90 (2007)

    CrossRef  Google Scholar 

  11. Shokripour, A., Othman, M.: Survey on divisible load theory and its applications. In: ICIME 2009, pp. 300–304 (2009)

    Google Scholar 

  12. Veeravalli, B., Ghose, D., Robertazzi, T.G.: Divisible load theory: A new paradigm for load scheduling in distributed systems. Cluster Computing 6, 7–17 (2003)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. INESC-ID, IST/UTLisbon, Rua Alves Redol, 9, 1000-029, Lisbon, Portugal

    Aleksandar Ilic & Leonel Sousa

Authors
  1. Aleksandar Ilic
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Leonel Sousa
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Scilytics, Koellnerhofgasse 3/15A, 1010, Vienna, Austria

    Michael Alexander

  2. ICAR-CNR, Via P. Castellino, 111, 80131, Napoli, Italy

    Pasqua D’Ambra

  3. University of Amsterdam, 1090, Amsterdam, Netherlands

    Adam Belloum

  4. Innovative Computing Laboratory, The University of Tennessee, USA

    George Bosilca

  5. Department of Experimental Medicine and Clinic, University Magna Græcia, 88100, Catanzaro, Italy

    Mario Cannataro

  6. Computer Science Department, University of Pisa, Italy

    Marco Danelutto

  7. Second University of Naples, Italy

    Beniamino Di Martino

  8. TU München, Boltzmannstr. 3, 85748, Garching, Germany

    Michael Gerndt

  9. Equipe Runtime, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Emmanuel Jeannot & Raymond Namyst & 

  10. Equipe HIEPACS, INRIA Bordeaux Sud-Ouest, 33405, Talence Cedex, France

    Jean Roman

  11. Oak Ridge National Laboratory, Computer Science and Mathematics Division, 37831-6164, Oak Ridge, TN, USA

    Stephen L. Scott

  12. Department of Scientific Computing, University of Vienna, Nordbergstr. 15/3C, 1090, Vienna, Austrial

    Jesper Larsson Traff

  13. Computer Science and Mathematics Division, Oak Ridge National Laboratory, 37831, Oak Ridge, TN, USA

    Geoffroy Vallée

  14. Technische Universität München, Germany

    Josef Weidendorfer

Rights and permissions

Reprints and Permissions

Copyright information

© 2012 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Ilic, A., Sousa, L. (2012). Scheduling Divisible Loads on Heterogeneous Desktop Systems with Limited Memory. In: Alexander, M., et al. Euro-Par 2011: Parallel Processing Workshops. Euro-Par 2011. Lecture Notes in Computer Science, vol 7155. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-29737-3_54

Download citation

  • .RIS
  • .ENW
  • .BIB
  • DOI: https://doi.org/10.1007/978-3-642-29737-3_54

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-29736-6

  • Online ISBN: 978-3-642-29737-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Share this paper

Anyone you share the following link with will be able to read this content:

Sorry, a shareable link is not currently available for this article.

Provided by the Springer Nature SharedIt content-sharing initiative

Search

Navigation

  • Find a journal
  • Publish with us

Discover content

  • Journals A-Z
  • Books A-Z

Publish with us

  • Publish your research
  • Open access publishing

Products and services

  • Our products
  • Librarians
  • Societies
  • Partners and advertisers

Our imprints

  • Springer
  • Nature Portfolio
  • BMC
  • Palgrave Macmillan
  • Apress
  • Your US state privacy rights
  • Accessibility statement
  • Terms and conditions
  • Privacy policy
  • Help and support

167.114.118.210

Not affiliated

Springer Nature

© 2023 Springer Nature