Springer Nature is making SARS-CoV-2 and COVID-19 research free. View research | View latest news | Sign up for updates

Job Migration Policies for Grid Environment

Abstract

For efficient resource management in Grid, the resources overloading must be prevented, which can be obtained by efficient Load Balancing and Job Migration (JM) mechanisms. JM addresses the problem of resource overloading through various techniques in a Grid environment. In this paper, JM model has been designed. The proposed JM model offers three policies based on the scheduling, checkpointing and replication for Grid environment decisions. The JM problem has been formulated as an optimization problem and resource scheduling algorithm minimizes the average finish time and makespan. For all the three proposed techniques, JM policies have been designed and the policy rules have been specified in Extensible Markup Language schema for decision making. Each of the above techniques has been executed according to its specific condition at run time. Finally, the performances of the proposed model, algorithms and techniques have been rigorously examined over the GridSim simulator using various parameters, such as makespan, hit-ratio etc. Experimental results establish the superiority of the proposed techniques over the existing techniques.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

References

  1. 1.

    Zeng, Z., & Veeravalli, B. (2004). Rate-based and queue-based dynamic load balancing algorithms in distributed systems. In Proceedings of the 10th IEEE international conference on parallel & distributed systems (pp. 349–356).

  2. 2.

    Lin, H. C., & Raghavendra, C. S. (1992). A dynamic load-balancing policy with a central job dispatcher (LBC). IEEE Transaction on Software Engineering, 18(2), 148–158.

  3. 3.

    Amini, M., & Deldari, H. (2006). Grid load balancing using an echo system of ants. In Proceedings of 24th IASTED international conference, Innsbruck (pp. 47–52).

  4. 4.

    Rathore, N. K., & Chana, I. (2013). Report on hierarchal load balancing technique in grid environment. International Journal of Scientific and Innovative Technology. i-manager’s Journal on Information Technology, 2(4), 21–35. ISSN Print: 2277-5110.

  5. 5.

    Lan, Y., & Yu, T. (1995) A dynamic central scheduler load-balancing mechanism. In Proceedings of 14th IEEE conference on computers and communication, Tokyo, Japan (pp. 734–740).

  6. 6.

    Rathore, N. K., & Chana, I. (2010). Checkpointing algorithm in Alchemi.NET. Pragyaan: Journal of Information Technology, IMS Dehradun, 8(1), 32–38. ISSN No.: 0974-5513.

  7. 7.

    Kun-Ming, V., Chou,Y., Chih-Hsun, C., & Wang, Y-T. (2004). A fuzzy-based dynamic loadbalancing algorithm. Journal of Information, Technology and Society, 4(2), 55–63.

  8. 8.

    Lin, S.-J., Huang, M.-C., Lai, K.-C., & Huang, K.-C. (2008). Design and implementation of job migration policies in P2P grid system. In Asia-Pacific services computing conference IEEE.

  9. 9.

    Backschat, M., & Pfaffinger, A. (1996) Economic based dynamic load distribution in large workstation networks. In Euro-Par’96, 1124, 631–634.

  10. 10.

    Rathore, N. K., & Chana, I. (2013) A sender initiate based hierarchical load balancing technique for grid using variable threshold value. In International conference IEEE-ISPC (pp. 1–6). ISBN-978-1-4673-6188-0.

  11. 11.

    Travostino, F., Daspit, P., Gommans, L., Jog, C., de Laat, C., Mambretti, J., Monga, I., van Oudenaarde, B., Raghunath, S., & Wang, P. (2006). Seamless live migration of virtual machines over the MAN/WAN. Elsevier Future Generation Computer Systems.

  12. 12.

    Rathore, N. K., & Chana, I. (2011). A cogitative analysis of load balancing technique with job migration in grid environment. In World congress on information and communication technology (WICT), Mumbai, IEEE proceedings paper (pp. 77–82). ISBN -978-1-4673-0127-5.

  13. 13.

    Lu, K. (2009). Decentralized load balancing. In Heterogeneous computational grids (pp. 545–550). ISBN: 978-1-4244-5166-1.

  14. 14.

    Rathore, N. K., & Chana, I. (2010). Fault tolerance algorithm in Alchemi.NET middleware. In National conference on education & research (ConFR10), third CSI national conference of CSI division V, Bhopal Chapter, IEEE Bombay, and MPCST Bhopal, organized by JUIT, India.

  15. 15.

    Abraham, A., Buyya, R., & Nath, B. (2000). Nature’s heuristic for scheduling jobs on computational grids. In Proceedings of 8th IEEE International Conference on Advance in Computer and Communicate (ADCOM 2000), Cochin, India, (pp. 45–52).

  16. 16.

    Rathore, N. K., & Chana, I. (2008). Comparative analysis of checkpointing. In PIMR third national IT conference, IT enabled practices and emerging management paradigm book and category is communication technologies and security issues (pp. 32–35), Topic No/Name-46, Prestige Management and Research, Indore, (MP) India.

  17. 17.

    Rathore, N. (2015). Efficient agent based priority scheduling and load balancing using fuzzy logic in grid computing. i-Manager's Journal on Computer Science, 3(3), 11.

  18. 18.

    Rathore, N., & Chana, I. (2014). Load balancing and job migration techniques in grid: A survey of recent trends. In Wireless personal communication, Vol. 79(3), (pp. 2089–2125). Springer Publication: New York (USA).

  19. 19.

    Rathore, N. (2015). Map reduce architecture for grid. i-Manager's Journal on Software Engineering, 10(1), 21.

  20. 20.

    Rathore, N., & Chana, I. (2014). Job migration with fault tolerance based QoS scheduling using hash table functionality in Social Grid Computing. Journal of Intelligent & Fuzzy Systems, IOS Press publication, Netherland, 27(6), 2821–2833. ISSN print 1064-1246, IF-0.936.

  21. 21.

    Sharma, V., Kumar, R., Rathore, N. (2015). Topological broadcasting using parameter sensitivity-based logical proximity graphs in coordinated ground-flying ad hoc networks. Journal of Wireless Mobile Networks, Ubiquitous Computing, and Dependable Applications (JoWUA), 6(3), 54–72.

  22. 22.

    Rathore, N., & Chana, I. (2015). Variable threshold based hierarchical load balancing technique in grid. In Engineering with computers, Vol 31(3) (pp. 597–615). Springer publication: London (England (UK). ISSN: 0177-0667 (print version) ISSN: 1435-5663 (electronic version), IF-1.088.

  23. 23.

    Alaoui, S. M., Frieder, O., & El-hzawi, T. A parallel genetic algorithm for task mapping on parallel machine. In Job scheduling strategies for parallel processing, IPPS’95 Workshop, LNCS, 1999.

  24. 24.

    Altameem, T. (2013). Fault tolerance techniques in grid computing systems. International Journal of Computer Science and Information Technologies, 4(6), 858–862.

  25. 25.

    Patra, P. K., Singh, H., & Singh, G. (2013). Fault tolerance techniques and comparative implementation in cloud computing. International Journal of Computer Applications, 64(14), 0975–8887.

  26. 26.

    Yang, S. (2012). Online scheduling with migration cost. In IEEE 26th international parallel and distributed processing symposium workshops & PhD Forum.

  27. 27.

    Albers, S., & Hellwig, M. (2012). On the value of job migration in online makespan minimization. arXiv:1111.0773v2.

  28. 28.

    Sayar, Z. A., & Erdogan, N. (2012). Network load balancing with strong migration in an agent based grid using CSP Approach. International Journal of Grid Computing & Applications (IJGCA), 3(4), 43–53.

  29. 29.

    Alwada’n, Tariq, Aldabbas, Hamza, Janicke, Helge, Khdour, Thair, & Aldabba, Omer. (2012). Dynamic policy management in mobile grid environments. International Journal of Computer Networks & Communications (IJCNC), 4(2), 35–51.

  30. 30.

    El-Zoghdy, S. F. (2012). A capacity-based load balancing and job migration algorithm for heterogeneous computational grids. International Journal of Computer Networks & Communications (IJCNC), 4(1), 113–125.

  31. 31.

    Siripoonya, V., & Chanchio, K. (2011). Thread-based live checkpointing of virtual machines. In 2011 IEEE international symposium on network computing and applications.

  32. 32.

    Calzolari, F., & Volpe, S. (2011). A new job migration algorithm to improve data center efficiency, proceeding on science. In The International symposium on grids and clouds and the open grid forum academia sinica, Taipei, Taiwan.

  33. 33.

    Lee, D. W. (2010). IP-paging base resource management and task migration in mobile grid environments. International Journal of Grid and Distributed Computing, 3(3), 29–40.

  34. 34.

    Mishra, S., Kushwaha, D. S., & Misra, A. K. (2010). An optimized scheduling algorithm for migrated jobs in trusted distributed systems. In International conference on computer & communication technology.

  35. 35.

    Cuesta, D., Ayala, J., Hidalgo, J., Atienza, D., Acquaviva, A., & Macii, E. (2010) Adaptive task migration policies for thermal control in MPSoCs. In IEEE Annual Symposium on VLSI.

  36. 36.

    Mehnert-Spahn, J., & Schoettner, M. (2010). Checkpointing and migration of communication channels in heterogeneous grid environments. Algorithms and Architectures for Parallel Processing, Lecture Notes in Computer Science, 6081, 254–265.

  37. 37.

    Busseuil, R., Almeida, G. M., Varyani, S., Sassatelli, G., & Robert, M. (2010). Exploration of task migration techniques for distributed memory MultiProcessor Systems on Chips. In 18th IEEE/IFIP international conference on VLSI and systems-on-chip (VLSI-SoC2010), Madrid, Spain: IEEE Computer Society.

  38. 38.

    Satheesh, A., Kumar, K. V., & Krishnaveni, S. (2008). Generalized load sharing for homogeneous networks of distributed environment. Hindawi Publishing Corporation Journal of Computer Systems, Networks, and Communications, Article ID 294106.

  39. 39.

    Zhang, Z., & Cheng, W. (2007). Model and optimization of mobile agent’s migration in grid. In IEEE.

  40. 40.

    Shah, R., Veeravalli, B., & Misra, M. (2007). On the design of adaptive and decentralized load-balancing algorithms with load estimation for computational grid environments. IEEE Transactions on Parallel and Distributed Systems, 18(12), 1675–1686.

  41. 41.

    Chaudhary, V., Walters, J. P., & Jiang, H. (2006). An adaptive heterogeneous software DSM. In Proceedings of international conference on parallel processing workshops ICPPW.

  42. 42.

    Abdullah Azfar, M., Morshed, S., Islam, M. Z., Ullah, A. S. S. M. B., & Pathan, A. –M. K. (2005) A simplified process for grid job migration. In International conference of computer and information technology (ICCIT-2005) (pp. 706–709). Bangladesh: Islamic University of Technology (IUT).

  43. 43.

    Lee, H. M., Chung, K. S., Chin, S. H., Lee, J. H., Lee, D. W., Parka, S., & Yua, H. C. (2005). A resource management and fault tolerance services in grid computing. Journal of Parallel and Distributed Computing, 65, 1305–1317.

  44. 44.

    Vadhiyar, S. S., & Dongarra, J. J. A. (2003). performance oriented migration framework for the grid. In Cluster computing and the grid, proceedings, CCGrid 2003 (pp. 130–137). 3rd IEEE/ACM International Symposium on IEEE.

  45. 45.

    Tadepalli, S. S. (2003). GEMS: A fault tolerant grid job management system. Thesis, Master of Science, Blacksburg, Virginia.

  46. 46.

    Chen, P.-C., Lin, C.-I., Huang, S.-W., Chang, J.-B., Shieh, C.-K., & Liang, T.-Y. A performance study of virtual machine migration vs. thread migration for grid systems. In 22nd international conference on advanced information networking and applications-workshops.

  47. 47.

    Ellahi, T. N., Hudzia, B., McDermott, L. & Kechadi, T. Transparent migration of multi-threaded applications on a java based grid. University College Dublin Dublin-Ireland.

  48. 48.

    Chung, P. E., Huang, Y., Yajnik, S., Fowler, G., Vo, K.-P., & Wang, Y.-M. (1997). Checkpointing in CosMiC: A user-level process migration environment. In IEEE.

  49. 49.

    Rathore, N. (2006). Implementing checkpointing algorithm in Alchemi.NET. ME Thesis, Thapar University, Patiala. http://hdl.handle.net/10266/658. http://dspace.thapar.edu:8080/dspace/bitstream/10266/658/3/T658.pdf

  50. 50.

    Rathore, N. K., & Sharma, A. (2015). Efficient dynamic distributed load balancing technique. Germany: Lambert Academic Publication House (LBA). https://www.lap-publishing.com/catalog/details//store/gb/book/978-3-659-78288-6/efficient-dynamic-distributed-load-balancing-technique

  51. 51.

    Rathore, N. K., & Chana, I. (2010). Checkpointing algorithm in Alchemi.NET. Germany: Lambert Academic Publication House (LBA). https://www.lap-publishing.com/catalog/details/store/gb/book/978-3-8433-6137-8/checkpointing-algorithm-for-alchemi-net-in-grid.

  52. 52.

    Rathore, N. (2016). Ethical hacking & security against cyber crime. i-managers Journal on Information Technology (JIT), 5(1),13–17.

  53. 53.

    Backschat, M., & Pfaffinger, A. (1996). Economic based dynamic load distribution in large workstation networks. In Euro-Par’96, 1124, 631–634.

  54. 54.

    Prakash, R., Singhal, M. (1996). Maximum global snapshot with concurrent initiators. In Proceeding in sixth IEEE symposium of parallel and distributed systems 7(10), 1035–1048.

  55. 55.

    Spezialetti, M., & Kearns, P. (1986). Efficient distributed snapshots. In Proceedings of the sixth ICDCS (pp. 382–388).

  56. 56.

    Xhafa, F., Abraham, A. (2010). Computational models and heuristic methods for Grid scheduling problems. Future generation computer systems, 26(4), 608–621.

  57. 57.

    Sathya, S. S., Babu, K. S. (2010). Survey of fault tolerant techniques for Grid. Computer Science View, 4(2), 101–120.

  58. 58.

    Sulistio, A., Cibej, U., Venugopal, S., Robic, B., & Buyya, R. (2008) A toolkit for modelling and simulating data grids: An extension to GridSim. Concurrency and Computation: Practice and Experience (CCPE), 20(13), 1591–1609. Online ISSN: 1532-0634, Printed ISSN: 1532-0626, Wiley Press, New York, USA.

Download references

Author information

Correspondence to Neeraj Kumar Rathore.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Rathore, N.K., Chana, I. Job Migration Policies for Grid Environment. Wireless Pers Commun 89, 241–269 (2016). https://doi.org/10.1007/s11277-016-3264-2

Download citation

Keywords

  • Job migration
  • Checkpointing
  • Replication
  • Scheduling
  • Policy