Abstract
The recent success of Internet-based computing projects, coupled with rapid developments in peer-to-peer systems, has stimulated interest in the notion of harvesting idle cycles under a peer-to-peer model. The problem we address in this paper is the development of scheduling strategies to achieve faster turnaround time in an open peer-based desktop grid system. The challenges for this problem are two-fold: How does the scheduler quickly discover idle cycles in the absence of global information about host availability? And how can faster turnaround time be achieved within the opportunistic scheduling environment offered by volunteer hosts? We propose a novel peer-based scheduling method, Wave Scheduler, which allows peers to self organize into a timezone-aware overlay network using structured overlay network. The Wave Scheduler then exploits large blocks of idle night-time cycles by migrating jobs to hosts located in night-time zones around the globe, which are discovered by scalable resource discovery methods.
Simulation results show that the slowdown factors of all migration schemes are consistently lower than the slowdown factors of the non-migration schemes. Compared to traditional migration strategies we tested, the Wave Scheduler performs best. However under heavy load conditions, there is contention for those night-time hosts. Therefore, we propose an adaptive migration strategy for Wave Scheduler to further improve performance.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
Similar content being viewed by others
References
Anderson, D., Cobb, J., Korpela, E., Lebofsky, M., Werthimer, D.: SETI@home: An experiment in public-resource computing. Communications of the ACMÂ 45 (2002)
Folding@home, http://folding.stanford.edu/
Andrade, N., Cirne, W., Brasileiro, F., Roisenberg, P.: OurGrid: An approach to easily assemble grids with equitable resource sharing. In: Feitelson, D.G., Rudolph, L., Schwiegelshohn, U. (eds.) JSSPP 2003. LNCS, vol. 2862, pp. 61–86. Springer, Heidelberg (2003)
Butt, A., Zhang, R., Hu, Y.: A self-organizing flock of condors. In: Proceedings of SC 2003 (2003)
Lo, V., Zappala, D., Zhou, D., Liu, Y., Zhao, S.: Cluster Computing on the Fly: P2P scheduling of idle cycles in the Internet. In: Voelker, G.M., Shenker, S. (eds.) IPTPS 2004. LNCS, vol. 3279, pp. 227–236. Springer, Heidelberg (2005)
Gupta, R., Somani, A.: Compup2p: An architecture for sharing of computing resources in peer-to-peer networks with selfish nodes. In: Proceedings of second Workshop on the Economics of peer-to-peer systems (2004)
Foster, I., Kesselman, C.: Globus: A metacomputing infrastructure toolkit. The International Journal of Supercomputer Applications and High Performance Computing 11 (1997)
Thain, D., Tannenbaum, T., Livny, M.: Condor and the grid. In: Berman, F., Fox, G., Hey, T. (eds.) Grid Computng: Making the Global Infrastructure a Reality. John Wiley & Sons Inc., Chichester (2002)
Litzkow, M., Livny, M., Mutka, M.: Condor -a hunter of idle workstations. In: The 8th International Conference on Distributed Computing Systems (1988)
Zhou, S., Zheng, X., Wang, J., Delisle, P.: Utopia: a load sharing facility for large, heterogeneous distributed computer systems. Software - Practice and Experience 23(12) (1993)
Ghormley, D., Petrou, D., Rodrigues, S., Vahdat, A., Anderson, T.: GLUnix:a global layer unix of a network of workstations. Software-Practice and Experience 28(9) (1998)
LSF load sharing facility, http://accl.grc.nasa.gov/lsf/aboutlsf.html
BOINC: Berkeley open infrastructure for network computing, http://boinc.berkeley.edu/
Camiel, N., London, S., Nisan, N., Regev, O.: The popcorn project: Distributed computation over the Internet in java. In: Proceedings of The 6th International World Wide Web Conference (1997)
Baratloo, B., Karaul, M., Kedem, Z., Wyckoff, P.: Charlotte: Metacomputing on the web. In: Proceedings of the 9th International Conference on Paralel and Distributed Computing Systems (1996)
Ratnasamy, S., Francis, P., Handley, M., Karp, R., Shenker, S.: A scalable content addressable network. In: Proc. ACM SIGCOMM (2001)
Stoica, I., Morris, R., Karger, D., Kaashoek, F., Balakrishnan, H.: Chord: a scalable peer-to-peer lookup service for internet applications. In: Proc. ACM SIGCOMM (2001)
Rowstron, A., Druschel, P.: Pastry: scalable, decentralized object location, and routing for large-scale peer-to-peer systems. In: Guerraoui, R. (ed.) Middleware 2001. LNCS, vol. 2218, p. 329. Springer, Heidelberg (2001)
Iamnitchi, A., Foster, I.: A peer-to-peer approach to resource location in grid environments. In: Weglarz, J., Nabrzyski, J., Schopf, J., Stroinski, M. (eds.) Grid Resource Management (2003)
Zhou, D., Lo, V.: Cluster Computing on the Fly: resource discovery in a cycle sharing peer-to-peer system. In: Proceedings of the 4th International Workshop on Global and P2P Computing, GP2PC 2004 (2004)
The Gnutella protocol specification (version 0.6)
Raman, R., Livny, M., Solomon, M.: Matchmaking: Distributed resource management for high throughput computing. In: Proceedings of the Seventh IEEE International Symposium on High Performance Distributed Computing (HPDC7) (1998)
Lo, V., Mache, J.: Job scheduling for prime time vs. non-prime time. In: Proc. 4th IEEE International Conference on Cluster Computing, CLUSTER 2002 (2002)
Eager, D., Lazowska, E., Zahorjan, J.: Adaptive load sharing in homogeneous distributed systems. IEEE Trans. on Software Engineering 12(5) (1986)
Shivaratri, N., Krueger, P., Singhal, M.: Load distributing for locally distributed systems. Computer 25(12) (1992)
Brevik, J., Nurmi, D.: Quantifying machine availability in networked and desktop grid systems. UCSB, Tech. Rep. CS2003-37
Yang, L., Foster, I., Schopf, J.: Homeostatic and tendency-based CPU load predictions. In: Guo, M. (ed.) ISPA 2003. LNCS, vol. 2745. Springer, Heidelberg (2003)
Dinda, P.: The statistical properties of host load. Scientific Programming 7(3–4) (1999)
Kondo, D., Chien, A., Casanova, H.: Resource management for rapid application turnaround on enterprise desktop grids. In: Proceedings of SC 2004 (2004)
Planetlab, http://www.planet-lab.org/
Lodygensky, O., Fedak, G., Neri, V., Cappello, F., Thain, D., Livny, M.: Xtremweb & condor: sharing resources between internet connected condor pool. In: Proceedings of GP2PC 2003 (Global and Peer-to-Peer computing on large scale distributed systems) (2003)
Entropia, inc., http://www.entropia.com
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2005 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Zhou, D., Lo, V. (2005). Wave Scheduler: Scheduling for Faster Turnaround Time in Peer-Based Desktop Grid Systems. In: Feitelson, D., Frachtenberg, E., Rudolph, L., Schwiegelshohn, U. (eds) Job Scheduling Strategies for Parallel Processing. JSSPP 2005. Lecture Notes in Computer Science, vol 3834. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11605300_10
Download citation
DOI: https://doi.org/10.1007/11605300_10
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-31024-2
Online ISBN: 978-3-540-31617-6
eBook Packages: Computer ScienceComputer Science (R0)