Skip to main content
SpringerLink
Log in

Implementation of a Performance-Based Loop Scheduling on Heterogeneous Clusters

  • Conference paper
Algorithms and Architectures for Parallel Processing (ICA3PP 2009)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 5574))

Abstract

Cluster computing systems usually connect several commodity computers in local-area networks to form a single, unified resource for parallel computing. Loop scheduling and load balancing on parallel and distributed systems are critical problems that are difficult to cope with, especially on the emerging heterogeneous clusters. In this aspect, an important issue is how to assign tasks to nodes so that the nodes’ loads are well balanced. In this paper, we propose a performance-based approach that partitions loop iterations according to the performance weighting of cluster nodes. A heterogeneous cluster was built to verify the proposed approach, and two kinds of application program were implemented for execution on this testbed. Experimental results show that the proposed approach performs better than previous schemes.

This work is supported in part by National Science Council, Taiwan R.O.C., under grants no. NSC 96-2221-E-029-019-MY3 and NSC 97-2622-E-029-003-CC2.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Introduction To The Mandelbrot Set, http://www.ddewey.net/mandelbrot/

  2. The Scalable Computing Laboratory (SCL), http://www.scl.ameslab.gov/

  3. HPC Challenge Benchmark, http://icl.cs.utk.edu/hpcc/

  4. Baker, M., Buyya, R.: Cluster Computing: The Commodity Supercomputer. International Journal of Software Practice and Experience 29(6), 551–575 (1999) (2002)

    Article  Google Scholar 

  5. Beaumont, O., Casanova, H., Legrand, A., Robert, Y., Yang, Y.: Scheduling divisible loads on star and tree networks: results and open problems. IEEE Transactions on Parallel and Distributed Systems 16, 207–218 (2005)

    Article  Google Scholar 

  6. Bennett, B.H., Davis, E., Kunau, T., Wren, W.: Beowulf Parallel Processing for Dynamic Load-balancing. In: Proceedings on IEEE Aerospace Conference, vol. 4, pp. 389–395 (2000)

    Google Scholar 

  7. Bohn, C.A., Lamont, G.B.: Load balancing for heterogeneous clusters of PCs. Future Generation Computer Systems 18, 389–400 (2002)

    Article  Google Scholar 

  8. Cheng, K.-W., Yang, C.-T., Lai, C.-L., Chang, S.-C.: A Parallel Loop Self-Scheduling on Grid Computing Environments. In: Proceedings of the 2004 IEEE International Symposium on Parallel Architectures, Algorithms and Networks, KH, China, May 2004, pp. 409–414 (2004)

    Google Scholar 

  9. Chronopoulos, A.T., Andonie, R., Benche, M., Grosu, D.: A Class of Loop Self-Scheduling for Heterogeneous Clusters. In: Proceedings of the 2001 IEEE International Conference on Cluster Computing, pp. 282–291 (2001)

    Google Scholar 

  10. Hummel, S.F., Schonberg, E., Flynn, L.E.: Factoring: a method scheme for scheduling parallel loops. Communications of the ACM 35, 90–101 (1992)

    Article  Google Scholar 

  11. Li, H., Tandri, S., Stumm, M., Sevcik, K.C.: Locality and Loop Scheduling on NUMA Multiprocessors. In: Proceedings of the 1993 International Conference on Parallel Processing, vol. II, pp. 140–147 (1993)

    Google Scholar 

  12. Polychronopoulos, C.D., Kuck, D.: Guided Self-Scheduling: a Practical Scheduling Scheme for Parallel Supercomputers. IEEE Trans. on Computers 36(12), 1425–1439 (1987)

    Article  Google Scholar 

  13. Post, E., Goosen, H.A.: Evaluation the parallel performance of a heterogeneous system. In: Proceedings of 5th International Conference and Exhibition on High-Performance Computing in the Asia-Pacific Region (HPC Asia 2001) (2001)

    Google Scholar 

  14. Sterling, T., Bell, G., Kowalik, J.S.: Beowulf Cluster Computing with Linux. MIT Press, Cambridge (2002)

    Google Scholar 

  15. Shih, W.-C., Yang, C.-T., Tseng, S.-S.: A Performance-based Parallel Loop Scheduling on Grid Environments. The Journal of Supercomputing 41(3), 247–267 (2007)

    Article  Google Scholar 

  16. Shih, W.-C., Yang, C.-T., Tseng, S.-S.: A Performance-Based Parallel Loop Self-Scheduling on Grid Environments. In: Jin, H., Reed, D., Jiang, W. (eds.) NPC 2005. LNCS, vol. 3779, pp. 48–55. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  17. Shih, W.-C., Yang, C.-T., Tseng, S.-S.: A Hybrid Parallel Loop Scheduling Scheme on Grid Environments. In: Zhuge, H., Fox, G.C. (eds.) GCC 2005. LNCS, vol. 3795, pp. 370–381. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  18. Shih, W.-C., Yang, C.-T., Tseng, S.-S.: A Performance-Based Approach to Dynamic Workload Distribution for Master-Slave Applications on Grid Environments. In: Chung, Y.-C., Moreira, J.E. (eds.) GPC 2006. LNCS, vol. 3947, pp. 73–82. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  19. Shih, W.-C., Yang, C.-T., Tseng, S.-S.: A Hybrid Parallel Loop Scheduling Scheme on Heterogeneous PC Clusters. In: Proceedings of the 6th International Conference on Parallel and Distributed Computing, Applications and Technologies (PDCAT 2005), December 5-8, 2005, pp. 56–58 (2005)

    Google Scholar 

  20. Tang, P., Yew, P.C.: Processor self-scheduling for multiple-nested parallel loops. In: Proceedings of the 1986 International Conference on Parallel Processing, pp. 528–535 (1986)

    Google Scholar 

  21. Tzen, T.H., Ni, L.M.: Trapezoid self-scheduling: a practical scheduling scheme for parallel compilers. IEEE Transactions on Parallel and Distributed Systems 4, 87–98 (1993)

    Article  Google Scholar 

  22. Yang, C.-T., Chang, S.-C.: A Parallel Loop Self-Scheduling on Extremely Heterogeneous PC Clusters. Journal of Information Science and Engineering 20(2), 263–273 (2004)

    Google Scholar 

  23. Yang, C.-T., Cheng, K.-W., Shih, W.-C.: On Development of an Efficient Parallel Loop Self-Scheduling for Grid Computing Environments. Parallel Computing 33(7-8), 467–487 (2007)

    Article  Google Scholar 

  24. Yang, C.-T., Cheng, K.-W., Li, K.-C.: An Enhanced Parallel Loop Self-Scheduling Scheme for Cluster Environments. The Journal of Supercomputing 34(3), 315–335 (2005)

    Article  Google Scholar 

  25. Yang, C.-T., Cheng, K.-W., Li, K.-C.: An Efficient Parallel Loop Self-Scheduling on Grid Environments. In: Jin, H., Gao, G.R., Xu, Z., Chen, H. (eds.) NPC 2004. LNCS, vol. 3222, pp. 92–100. Springer, Heidelberg (2004)

    Chapter  Google Scholar 

  26. Yang, C.-T., Shih, W.-C., Tseng, S.-S.: Dynamic Partitioning of Loop Iterations on Heterogeneous PC Clusters. The Journal of Supercomputing 44(1), 1–23 (2007)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. High-Performance Computing Laboratory Department of Computer Science, Tunghai University, Taichung, 40704, Taiwan ROC

    Chao-Tung Yang & Lung-Hsing Cheng

Authors
  1. Chao-Tung Yang
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Lung-Hsing Cheng
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science and Information Engineering, National Taiwan University of Science and Technology, 106, Taipei City, Taiwan, ROC

    Arrems Hua  & Shih-Liang Chang  & 

Rights and permissions

Reprints and permissions

Copyright information

© 2009 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Yang, CT., Cheng, LH. (2009). Implementation of a Performance-Based Loop Scheduling on Heterogeneous Clusters. In: Hua, A., Chang, SL. (eds) Algorithms and Architectures for Parallel Processing. ICA3PP 2009. Lecture Notes in Computer Science, vol 5574. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-03095-6_5

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-03095-6_5

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-03094-9

  • Online ISBN: 978-3-642-03095-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation