Skip to main content
SpringerLink
Log in

Wave Scheduler: Scheduling for Faster Turnaround Time in Peer-Based Desktop Grid Systems

  • Conference paper
Job Scheduling Strategies for Parallel Processing (JSSPP 2005)

Part of the book series: Lecture Notes in Computer Science ((LNTCS,volume 3834))

Included in the following conference series:

Abstract

The recent success of Internet-based computing projects, coupled with rapid developments in peer-to-peer systems, has stimulated interest in the notion of harvesting idle cycles under a peer-to-peer model. The problem we address in this paper is the development of scheduling strategies to achieve faster turnaround time in an open peer-based desktop grid system. The challenges for this problem are two-fold: How does the scheduler quickly discover idle cycles in the absence of global information about host availability? And how can faster turnaround time be achieved within the opportunistic scheduling environment offered by volunteer hosts? We propose a novel peer-based scheduling method, Wave Scheduler, which allows peers to self organize into a timezone-aware overlay network using structured overlay network. The Wave Scheduler then exploits large blocks of idle night-time cycles by migrating jobs to hosts located in night-time zones around the globe, which are discovered by scalable resource discovery methods.

Simulation results show that the slowdown factors of all migration schemes are consistently lower than the slowdown factors of the non-migration schemes. Compared to traditional migration strategies we tested, the Wave Scheduler performs best. However under heavy load conditions, there is contention for those night-time hosts. Therefore, we propose an adaptive migration strategy for Wave Scheduler to further improve performance.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Anderson, D., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: An experiment in public-resource computing. Communications of the ACM 45 (2002)

    Google Scholar 

  2. Folding@home, http://folding.stanford.edu/

  3. Andrade, N., Cirne, W., Brasileiro, F., Roisenberg, P.: OurGrid: An approach to easily assemble grids with equitable resource sharing. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 61–86. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  4. Butt, A., Zhang, R., Hu, Y.: A self-organizing flock of condors. In: Proceedings of SC 2003 (2003)

    Google Scholar 

  5. Lo, V., Zappala, D., Zhou, D., Liu, Y., Zhao, S.: Cluster Computing on the Fly: P2P scheduling of idle cycles in the Internet. In: Voelker, G.M., Shenker, S. (eds.) IPTPS 2004. LNCS, vol. 3279, pp. 227–236. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  6. Gupta, R., Somani, A.: Compup2p: An architecture for sharing of computing resources in peer-to-peer networks with selfish nodes. In: Proceedings of second Workshop on the Economics of peer-to-peer systems (2004)

    Google Scholar 

  7. Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing 11 (1997)

    Google Scholar 

  8. Thain, D., Tannenbaum, T., Livny, M.: Condor and the grid. In: Berman, F., Fox, G., Hey, T. (eds.) Grid Computng: Making the Global Infrastructure a Reality. John Wiley & Sons Inc., Chichester (2002)

    Google Scholar 

  9. Legion, http://www.cs.virginia.edu/~legion/

  10. Litzkow, M., Livny, M., Mutka, M.: Condor -a hunter of idle workstations. In: The 8th International Conference on Distributed Computing Systems (1988)

    Google Scholar 

  11. Zhou, S., Zheng, X., Wang, J., Delisle, P.: Utopia: a load sharing facility for large, heterogeneous distributed computer systems. Software - Practice and Experience 23(12) (1993)

    Google Scholar 

  12. Ghormley, D., Petrou, D., Rodrigues, S., Vahdat, A., Anderson, T.: GLUnix:a global layer unix of a network of workstations. Software-Practice and Experience 28(9) (1998)

    Google Scholar 

  13. LSF load sharing facility, http://accl.grc.nasa.gov/lsf/aboutlsf.html

  14. BOINC: Berkeley open infrastructure for network computing, http://boinc.berkeley.edu/

  15. Camiel, N., London, S., Nisan, N., Regev, O.: The popcorn project: Distributed computation over the Internet in java. In: Proceedings of The 6th International World Wide Web Conference (1997)

    Google Scholar 

  16. Baratloo, B., Karaul, M., Kedem, Z., Wyckoff, P.: Charlotte: Metacomputing on the web. In: Proceedings of the 9th International Conference on Paralel and Distributed Computing Systems (1996)

    Google Scholar 

  17. Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content addressable network. In: Proc. ACM SIGCOMM (2001)

    Google Scholar 

  18. Stoica, I., Morris, R., Karger, D., Kaashoek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup service for internet applications. In: Proc. ACM SIGCOMM (2001)

    Google Scholar 

  19. Rowstron, A., Druschel, P.: Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, p. 329. Springer, Heidelberg (2001)

    Chapter  Google Scholar 

  20. Iamnitchi, A., Foster, I.: A peer-to-peer approach to resource location in grid environments. In: Weglarz, J., Nabrzyski, J., Schopf, J., Stroinski, M. (eds.) Grid Resource Management (2003)

    Google Scholar 

  21. Zhou, D., Lo, V.: Cluster Computing on the Fly: resource discovery in a cycle sharing peer-to-peer system. In: Proceedings of the 4th International Workshop on Global and P2P Computing, GP2PC 2004 (2004)

    Google Scholar 

  22. The Gnutella protocol specification (version 0.6)

    Google Scholar 

  23. Raman, R., Livny, M., Solomon, M.: Matchmaking: Distributed resource management for high throughput computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC7) (1998)

    Google Scholar 

  24. Lo, V., Mache, J.: Job scheduling for prime time vs. non-prime time. In: Proc. 4th IEEE International Conference on Cluster Computing, CLUSTER 2002 (2002)

    Google Scholar 

  25. Eager, D., Lazowska, E., Zahorjan, J.: Adaptive load sharing in homogeneous distributed systems. IEEE Trans. on Software Engineering 12(5) (1986)

    Google Scholar 

  26. Shivaratri, N., Krueger, P., Singhal, M.: Load distributing for locally distributed systems. Computer 25(12) (1992)

    Google Scholar 

  27. Brevik, J., Nurmi, D.: Quantifying machine availability in networked and desktop grid systems. UCSB, Tech. Rep. CS2003-37

    Google Scholar 

  28. Yang, L., Foster, I., Schopf, J.: Homeostatic and tendency-based CPU load predictions. In: Guo, M. (ed.) ISPA 2003. LNCS, vol. 2745. Springer, Heidelberg (2003)

    Chapter  Google Scholar 

  29. Dinda, P.: The statistical properties of host load. Scientific Programming 7(3–4) (1999)

    Google Scholar 

  30. Ns, http://www.isi.edu/nsnam/ns/

  31. Kondo, D., Chien, A., Casanova, H.: Resource management for rapid application turnaround on enterprise desktop grids. In: Proceedings of SC 2004 (2004)

    Google Scholar 

  32. Planetlab, http://www.planet-lab.org/

  33. Lodygensky, O., Fedak, G., Neri, V., Cappello, F., Thain, D., Livny, M.: Xtremweb & condor: sharing resources between internet connected condor pool. In: Proceedings of GP2PC 2003 (Global and Peer-to-Peer computing on large scale distributed systems) (2003)

    Google Scholar 

  34. Entropia, inc., http://www.entropia.com

Download references

Author information

Authors and Affiliations

  1. University of Oregon, Eugene, OR, 97402, USA

    Dayi Zhou & Virginia Lo

Authors
  1. Dayi Zhou
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Virginia Lo
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Editors and Affiliations

  1. Department of Computer Science, The Hebrew University of Jerusalem,  

    Dror Feitelson

  2. Powerset, Inc.,,  

    Eitan Frachtenberg

  3. Massachusetts Institute of Technology, 77 Massachusetts Avenue, MA 02139, Cambridge, USA

    Larry Rudolph

  4. No Affiliations,,  

    Uwe Schwiegelshohn

Rights and permissions

Reprints and permissions

Copyright information

© 2005 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Zhou, D., Lo, V. (2005). Wave Scheduler: Scheduling for Faster Turnaround Time in Peer-Based Desktop Grid Systems. In: Feitelson, D., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP 2005. Lecture Notes in Computer Science, vol 3834. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11605300_10

Download citation

  • DOI: https://doi.org/10.1007/11605300_10

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-31024-2

  • Online ISBN: 978-3-540-31617-6

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation