Skip to main content
SpringerLink
Log in

Meta-heuristics for Grid Scheduling Problems

  • Chapter
Metaheuristics for Scheduling in Distributed Computing Environments

Part of the book series: Studies in Computational Intelligence ((SCI,volume 146))

Summary

In this chapter, we review a few important concepts from Grid computing related to scheduling problems and their resolution using heuristic and meta-heuristic approaches. Scheduling problems are at the heart of any Grid-like computational system. Different types of scheduling based on different criteria, such as static vs. dynamic environment, multi-objectivity, adaptivity, etc., are identified. Then, heuristics and meta-heuristics methods for scheduling in Grids are presented. The chapter reveals the complexity of the scheduling problem in Computational Grids when compared to scheduling in classical parallel and distributed systems and shows the usefulness of heuristics and meta-heuristics approaches for the design of efficient Grid schedulers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 129.00
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 169.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 169.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Similar content being viewed by others

References

  1. Alba, E., Almeida, F., Blesa, M., Cotta, C., Díaz, M., Dorta, I., Gabarró, J., León, C., Luque, G., Petit, J., Rodríguez, C., Rojas, A., Xhafa, F.: Efficient parallel LAN/WAN algorithms for optimization. The MALLBA project. Parallel Computing 32(5-6), 415–440 (2006)

    Article  Google Scholar 

  2. Abraham, A., Buyya, R., Nath, B.: Nature’s heuristics for scheduling jobs on computational grids. In: The 8th IEEE International Conference on Advanced Computing and Communications (ADCOM 2000), India (2000)

    Google Scholar 

  3. Abraham, A., Liu, H., Zhang, W., Chang, T.: Scheduling jobs on computational grids using fuzzy particle swarm algorithm. In: 10th Int. Conf. on Knowledge-Based & Intelligent Information & Engineering Systems. LNCS. Springer, Heidelberg (2006)

    Google Scholar 

  4. Abramson, D., Buyya, R., Giddy, J.: A computational economy for grid computing and its implementation in the Nimrod-G resource broker. Future Generation Computer Systems Journal 18(8), 1061–1074 (2002)

    Article  MATH  Google Scholar 

  5. Ali, S., Siegel, H.J., Maheswaran, M., Hensgen, D.: Task execution time modeling for heterogeneous computing systems. In: Proceedings of Heterogeneous Computing Workshop (HCW 2000), pp. 185–199 (2000)

    Google Scholar 

  6. Beynon, M.D., Sussman, A., Catalyurek, U., Kure, T., Saltz, J.: Optimization for data intensive grid applications. In: Third Annual International Workshop on Active Middleware Services, California, pp. 97–106 (2001)

    Google Scholar 

  7. Braun, T.D., Siegel, H.J., Beck, N., Boloni, L.L., Maheswaran, M., Reuther, A.I., Robertson, J.P., Theys, M.D., Yao, B.: A comparison of eleven static heuristics for mapping a class of independent tasks onto heterogeneous distributed computing systems. J. of Parallel and Distributed Comp. 61(6), 810–837 (2001)

    Article  Google Scholar 

  8. Burke, E., Kendall, G., Landa Silva, D., O’Brien, R., Soubeiga, E.: An ant algorithm hyperheuristic for the project presentation scheduling problem. The 2005 IEEE Congress on Evolutionary Computation 3, 2263–2270 (2005)

    Article  Google Scholar 

  9. Burke, E.K., Kendall, G., Newall, J., Hart, E., Ross, P., Schulemburg, S.: Hyper-heuristics: an Emerging Direction in Modern Search Technology. In: Glover, F.W., Kochenberger, G.A. (eds.) Handbook of Meta-heuristics. Kluwer, Dordrecht (2003)

    Google Scholar 

  10. Burke, E.K., Kendall, G., Soubeiga, E.: A Tabu-Search Hyperheuristic for Timetabling and Rostering. J. Heuristics 9(6), 451–470 (2003)

    Article  Google Scholar 

  11. Burke, E., Soubeiga, E.: Scheduling Nurses Using a Tabu-Search Hyperheuristic. In: Proceedings of the 1st Multidisciplinary International Conference on Scheduling: Theory and Applications (MISTA 2003), Nottingham, UK, pp. 180–197 (2003)

    Google Scholar 

  12. Buyya, R.: Economic-based Distributed Resource Management and Scheduling for Grid Computing. PhD thesis, Monash University, Australia (2002)

    Google Scholar 

  13. Buyya, R., Abramson, D., Giddy, J.: Nimrod/G: An architecture for a resource management and scheduling system in a global computational grid. In: The 4th Int. Conf. on High Performance Comp., Asia-Pacific, China (2000)

    Google Scholar 

  14. Cahon, S., Melab, N., Talbi, E.: ParadisEO: A Framework for the Reusable Design of Parallel and Distributed Meta-heuristics. Journal of Heuristics 10(3), 357–380 (2004)

    Article  Google Scholar 

  15. Cao, J., Jarvis, S.A., Saini, S., Nudd, G.R.: GridFlow: Workflow Management for Grid Computing. In: Proc. of the 3rd International Symposium on Cluster Computing and the Grid (CCGrid 2003), Tokyo, Japan, May 2003, pp. 198–205 (2003)

    Google Scholar 

  16. Carretero, J., Xhafa, F.: Using Genetic Algorithms for Scheduling Jobs in Large Scale Grid Applications. Journal of Technological and Economic Development –A Research Journal of Vilnius Gediminas Technical University 12(1), 11–17 (2006)

    Google Scholar 

  17. Casanova, H., Dongarra, J.: Netsolve: Network enabled solvers. IEEE Computational Science and Engineering 5(3), 57–67 (1998)

    Article  Google Scholar 

  18. Casanova, H., Kim, M., Plank, J.S., Dongarra, J.J.: Adaptive Scheduling for Task Farming with Grid Middleware. Int. J. High Perform. Comput. Appl. 13(3), 231–240 (1999)

    Article  Google Scholar 

  19. Chin, S., Lee, J., Yoon, T., Yu, H.: List Scheduling Method for Service Oriented Grid Applications. In: Proceedings of the Second international Conference on Semantics, Knowledge, and Grid, p. 44. IEEE Computer Society, Los Alamitos (2006)

    Chapter  Google Scholar 

  20. Chunlin, L., Layuan, L.: Joint QoS optimization for layered computational grid. Inf. Sci. 177(15), 3038–3059 (2007)

    Article  Google Scholar 

  21. Domingues, P., Andrzejak, A., Silva, L.: Scheduling for fast touraround time on institutional desktop grid. CoreGRID TechRep No. 0027

    Google Scholar 

  22. Deb, K., Pratap, A., Agarwal, S., Meyarivan, T.: A Fast and Elitist Multi-objective Genetic Algorithm: NSGA-II. IEEE Transactions on Evolutionary Computation 6(2), 182–197 (2002)

    Article  Google Scholar 

  23. Ehrgott, M., Gandibleux, X.: Approximative solution methods for multiobjective combinatorial optimization. TOP –Trabajos de Investigación Operativa 12(1), 1–88 (2004)

    MATH  MathSciNet  Google Scholar 

  24. Ernemann, C., Hamscher, V., Yahyapour, R.: Benefits of Global Grid Computing for Job Scheduling. In: Proceedings of the Fifth IEEE/ACM International Workshop on Grid Computing. International Conference on Grid Computing, pp. 374–379. IEEE Computer Society, Washington (2004)

    Chapter  Google Scholar 

  25. Fibich, P., Matyska, L., Rudová, H.: Model of Grid Scheduling Problem. In: Exploring Planning and Scheduling for Web Services, Grid and Autonomic Computing, pp. 17–24. AAAI Press, Menlo Park (2005)

    Google Scholar 

  26. Foster, I., Kesselman, C.: The Grid - Blueprint for a New Computing Infrastructure. Morgan Kaufmann, San Francisco (1998)

    Google Scholar 

  27. Foster, I., Kesselman, C., Tuecke, S.: The anatomy of the grid. International Journal of Supercomputer Applications 15(3) (2001)

    Google Scholar 

  28. Fujimoto, N., Hagihara, K.: Near-Optimal Dynamic Task Scheduling of Precedence Constrained Coarse-Grained Tasks onto a Computational Grid. In: Second International Symposium on Parallel and Distributed Computing (ISPDC 2003), pp. 80–87 (2003)

    Google Scholar 

  29. Gao, Y., Rong, H., Huang, J.Z.: Adaptive Grid job scheduling with genetic algorithms. Future Gener. Comput. Syst. 21(1), 151–161 (2005)

    Article  Google Scholar 

  30. Garey, M.R., Johnson, D.S.: Computers and Intractability – A Guide to the Theory of NP-Completeness. W.H. Freeman and Co., New York (1979)

    MATH  Google Scholar 

  31. Gendreau, M., Potvin, J.-Y.: Meta-heuristics in Combinatorial Optimization. Annals of Operations Research 140(1), 189–213 (2005)

    Article  MATH  MathSciNet  Google Scholar 

  32. Glover, F.: Future Paths for Integer Programming and Links to Artificial Intelligence. Computers and Op. Res. 5, 533–549 (1986)

    Article  MathSciNet  Google Scholar 

  33. Gomoluch, J., Schroeder, M.: Market-based Resource Allocation for Grid Computing: A Model and Simulation. In: Middleware Workshops 2003, pp. 211–218 (2003)

    Google Scholar 

  34. Goux, J.P., Kulkarni, S., Linderoth, J., Yoder, M.: An enabling framework for master-worker applications on the computational grid. In: 9th IEEE Int. Symposium on High Performance Distributed Computing (HPDC 2000) (2000)

    Google Scholar 

  35. Hao, X., Dai, Y., Zhang, B., Chen, T., Yang, L.: QoS-Driven Grid Resource Selection Based on Novel Neural Networks. In: Chung, Y.-C., Moreira, J.E. (eds.) GPC 2006. LNCS, vol. 3947, pp. 456–465. Springer, Heidelberg (2006)

    Chapter  Google Scholar 

  36. Hotovy, S.: Workload evolution on the Cornell Theory Center IBM SP2. In: Job Scheduling Strategies for Parallel Proc. Workshop, IPPS 1996, pp. 27–40 (1996)

    Google Scholar 

  37. The Hebrew University Parallel Systems Lab. Parallel workload archive, http://www.cs.huji.ac.il/labs/parallel/workload/

  38. Huedo, E., Montero, R.S., Llorente, I.M.: Experiences on Adaptive Grid Scheduling of Parameter Sweep Applications. In: 12th Euromicro Conference on Parallel, Distributed and Network-Based Processing (PDP 2004), p. 28 (2004)

    Google Scholar 

  39. Hoos, H.H., Stützle, Th.: Stochastic Local Search: Foundations and Applications. Elsevier/Morgan Kaufmann (2005)

    Google Scholar 

  40. Kondo, D.: Scheduling Task Parallel Applications for Rapid Turnaround on Desktop Grids. Doctoral Thesis, University of California at San Diego (2005)

    Google Scholar 

  41. Kondo, D., Chien, A., Casanova, H.: Scheduling Task Parallel Applications for Rapid Turnaround on Enterprise Desktop Grids. Journal of Grid Computing 5(4), 379–405 (2007)

    Article  Google Scholar 

  42. Lee, L., Liang, C., Chang, H.: An Adaptive Task Scheduling System for Grid Computing. In: Proceedings of the Sixth IEEE international Conference on Computer and information Technology (CIT 2006), September 20-22, p. 57. IEEE Computer Society, Washington (2006)

    Chapter  Google Scholar 

  43. Linderoth, L., Wright, S.J.: Decomposition algorithms for stochastic programming on a computational grid. Computational Optimization and Applications (Special issue on Stochastic Programming) 24, 207–250 (2003)

    Article  MATH  MathSciNet  Google Scholar 

  44. Maheswaran, M., Ali, S., Siegel, H.J., Hensgen, D., Freund, R.F.: Dynamic mapping of a class of independent tasks onto heterogeneous computing systems. Journal of Parallel and Distributed Computing 59(2), 107–131 (1999)

    Article  Google Scholar 

  45. Di Gaspero, L., Schaerf, A.: EasyLocal++: an object-oriented framework for the flexible design of local search algorithms and metaheuristics. In: 4th Meta-heuristics International Conference (MIC 2001), pp. 287–292 (2001)

    Google Scholar 

  46. Di Martino, V., Mililotti, M.: Sub optimal scheduling in a grid using genetic algorithms. Parallel Computing 30, 553–565 (2004)

    Article  Google Scholar 

  47. Lee, Y.C., Zomaya, A.Y.: Practical Scheduling of Bag-of-Tasks Applications on Grids with Dynamic Resilience. IEEE Transactions on Computers 56(6), 815–825 (2007)

    Article  Google Scholar 

  48. Michalewicz, Z., Fogel, D.B.: How to solve it: modern heuristics. Springer, Heidelberg (2000)

    MATH  Google Scholar 

  49. Moscato, P.: On evolution, search, optimization, genetic algorithms and martial arts: Towards memetic algorithms. Technical report No. 826, California Institute of Technology, USA (1989)

    Google Scholar 

  50. MacLaren, J., Sakellariou, R., Krishnakumar, K.T., Garibaldi, J., Ouelhadj, D.: Towards Service Level Agreement Based Scheduling on the Grid. In: Workshop on Planning and Scheduling for Web and Grid Services (held in conjunction with the 14th International Conference on Automated Planning and Scheduling (ICAPS 2004)), Canada (2004)

    Google Scholar 

  51. Newman, H.B., Ellisman, M.H., Orcutt, J.A.: Data-intensive e-Science frontier research. Communications of ACM 46(11), 68–77 (2003)

    Article  Google Scholar 

  52. Othman, A., Dew, P., Djemame, K., Gourlay, K.: Adaptive Grid Resource Brokering. In: IEEE International Conference on Cluster Computing (CLUSTER 2003), p. 172 (2003)

    Google Scholar 

  53. Page, J., Naughton, J.: Framework for task scheduling in heterogeneous distributed computing using genetic algorithms. AI Review 24, 415–429 (2005)

    Google Scholar 

  54. Paniagua, C., Xhafa, F., Caballé, S., Daradoumis, T.: A parallel grid-based implementation for real time processing of event log data in collaborative applications. In: Parallel and Distributed Processing Techniques (PDPT 2005), Las Vegas, USA, pp. 1177–1183 (2005)

    Google Scholar 

  55. Perez, J., Kégl, B., Germain-Renaud, C.: Reinforcement learning for utility-based Grid scheduling. In: NIPS 2007 (Twenty-First Annual Conference on Neural Information Processing Systems) Workshops, Vancouver, Canada (2007)

    Google Scholar 

  56. Raman, R., Solomon, M., Livny, M., Roy, A.: The classads language. In: Nabrzyski, J., Schopf, J.M., Weglarz, J. (eds.) Grid Resource Management: State of the Art and Future Trends, pp. 255–270. Kluwer Academic Publishers, Norwell

    Google Scholar 

  57. Ritchie, G.: Static multi-processor scheduling with ant colony optimisation & local search. Master’s thesis, School of Informatics, Univ. of Edinburgh (2003)

    Google Scholar 

  58. Ritchie, G., Levine, J.: A fast, effective local search for scheduling independent jobs in heterogeneous computing environments. Technical report, Centre for Intelligent Systems and their Applications, University of Edinburgh (2003)

    Google Scholar 

  59. Ritchie, G., Levine, J.: A hybrid ant algorithm for scheduling independent jobs in heterogeneous computing environments. In: 23rd Workshop of the UK Planning and Scheduling Special Interest Group (PLANSIG 2004) (2004)

    Google Scholar 

  60. Schwiegelshohn, U., Yahyapour, R.: Analysis of First-Come-First- Serve Parallel Job Scheduling. In: Proceedings of the 9th SIAM Symposium on Discrete Algorithms, January 1998, pp. 629–638 (1998)

    Google Scholar 

  61. Schopf, J.M.: Ten Actions when Grid Scheduling. In: Nabrzyski, Schopf, Weglarz (eds.) Grid Resource Management, ch. 2. Kluwer, Dordrecht (2004)

    Google Scholar 

  62. Steuer, R.E.: Multiple Criteria Optimization: Theory, Computation and Application. Series in Probability and Mathematical Statistics. Wiley, Chichester (1987)

    Google Scholar 

  63. Talbi, E.G.: A Taxonomy of Hybrid Meta-heuristics. J. Heuristics 8(5), 541–564 (2002)

    Article  Google Scholar 

  64. Vengerov, D.: Adaptive Utility-Based Scheduling in Resource-Constrained Systems. In: Zhang, S., Jarvis, R. (eds.) AI 2005. LNCS (LNAI), vol. 3809, pp. 477–488. Springer, Heidelberg (2005)

    Chapter  Google Scholar 

  65. Venugopal, S., Buyya, R., Winton, L.: A Grid service broker for scheduling e-Science applications on global data Grids. Concurrency and Computation: Practice and Experience 18(6), 685–699 (2006)

    Article  Google Scholar 

  66. Wright, S.J.: Solving optimization problems on computational grids. Optima 65 (2001)

    Google Scholar 

  67. Wu, M.Y., Shu, W.: A high-performance mapping algorithm for heterogeneous computing systems. In: Proceedings of the 15th International Parallel & Distributed Processing Symposium, p. 74 (2001)

    Google Scholar 

  68. Xhafa, F.: A Hybrid Evolutionary Heuristic for Job Scheduling in Computational Grids, ch. 10. Studies in Computational Intelligence, vol. 75. Springer, Heidelberg (2007)

    Google Scholar 

  69. Xhafa, F.: A Hyper-heuristic for Adaptive Scheduling in Computational Grids. International Journal on Neural and Mass-Parallel Computing and Information Systems 17(6), 639–656 (2007)

    Google Scholar 

  70. Xhafa, F., Duran, B., Abraham, A., Dahal, K.P.: Tuning Struggle Strategy in Genetic Algorithms for Scheduling in Computational Grids. In: IEEE CelGrid Workshop, OOstrava, The Czech Republic, June 26-June 28 (to appear, 2008)

    Google Scholar 

  71. Xhafa, F., Alba, E., Dorronsoro, B., Duran, B.: Efficient Batch Job Scheduling in Grids using Cellular Memetic Algorithms. Journal of Mathematical Modelling and Algorithms (accepted, 2008) Published Online DOI: http://dx.doi.org/10.1007/s10852-008-9076-y

    Google Scholar 

  72. Xhafa, F., Barolli, L., Durresi, A.: An Experimental Study On Genetic Algorithms for Resource Allocation On Grid Systems. Journal of Interconnection Networks 8(4), 427–443 (2007)

    Article  Google Scholar 

  73. Xhafa, F., Carretero, J., Abraham, A.: Genetic Algorithm Based Schedulers for Grid Computing Systems. International Journal of Innovative Computing, Information and Control 3(5), 1–19 (2007)

    Google Scholar 

  74. Xhafa, F., Carretero, J., Alba, E., Dorronsoro, B.: Design and Evaluation of a Tabu Search Method for Job Scheduling in Distributed Environments. In: The 11th International Workshop on Nature Inspired Distributed Computing (NIDISC 2008) held in conjunction with the 22th IEEE/ACM International Parallel and Distributed Processing Symposium (IPDPS 2008), Miami, Florida, USA, April 14-18 (2008)

    Google Scholar 

  75. YarKhan, A., Dongarra, J.: Experiments with scheduling using simulated annealing in a grid environment. In: Parashar, M. (ed.) GRID 2002. LNCS, vol. 2536, pp. 232–242. Springer, Heidelberg (2002)

    Chapter  Google Scholar 

  76. Yu, J., Buyya, R.: A Taxonomy of Workflow Management Systems for Grid Computing. Journal of Grid Computing 3(3), 171–200 (2006)

    Article  Google Scholar 

  77. Yu, K.-M., Zhou, J., Chou, C.-H., Luo, Z.-J., Chen, C.-K.: A Fuzzy Neural Network Based Scheduling Algorithm for Job Assignment on Computational Grids. In: Enokido, T., Barolli, L., Takizawa, M. (eds.) NBiS 2007. LNCS, vol. 4658, pp. 533–542. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

  78. Yu, J., Li, M., Li, Y., Hong, F.: An Economy-Based Accounting System for Grid Computing Environments. In: Web Information Systems – WISE 2004 Workshops, pp. 233–238. Springer, Heidelberg (2004)

    Google Scholar 

  79. Zhang, S., Zong, Y., Ding, Z., Liu, J.: Workflow-Oriented Grid Service Composition and Scheduling. In: Proceedings of the International Conference on information Technology: Coding and Computing (Itcc 2005), vol. II, pp. 214–219. IEEE Computer Society, Los Alamitos (2005)

    Chapter  Google Scholar 

  80. Zhou, J., Yu, K.M., Chou, Ch.H., Yang, L.A., Luo, Zh.J.: A Dynamic Resource Broker and Fuzzy Logic Based Scheduling Algorithm in Grid Environment. ICANNGA 2007(1), 604–613 (2007)

    Google Scholar 

  81. Zomaya, A.Y., Teh, Y.H.: Observations on using genetic algorithms for dynamic load-balancing. IEEE Transactions on Parallel and Distributed Systems 12(9), 899–911 (2001)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Departament de Llenguatges i Sistemes Informàtics, Universitat Politècnica de Catalunya Barcelona, Spain

    Fatos Xhafa

  2. Center of Excellence for Quantifiable Quality of Service, Norwegian University of Science and Technology, Trondheim, Norway

    Ajith Abraham

Authors
  1. Fatos Xhafa
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Ajith Abraham
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Fatos Xhafa Ajith Abraham

Rights and permissions

Reprints and permissions

Copyright information

© 2008 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Xhafa, F., Abraham, A. (2008). Meta-heuristics for Grid Scheduling Problems. In: Xhafa, F., Abraham, A. (eds) Metaheuristics for Scheduling in Distributed Computing Environments. Studies in Computational Intelligence, vol 146. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-69277-5_1

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-69277-5_1

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-69260-7

  • Online ISBN: 978-3-540-69277-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation