Advertisement

Journal of Zhejiang University-SCIENCE A

, Volume 8, Issue 1, pp 95–105 | Cite as

A flexible architecture for job management in a grid environment

  • Luan Cui-ju 
  • Song Guang-hua 
  • Zheng Yao 
  • Zhang Ji-fa 
Article
  • 35 Downloads

Abstract

Job management is a key issue in computational grids, and normally involves job definition, scheduling, executing and monitoring. However, job management in the existing grid middleware needs to be improved in terms of efficiency and flexibility. This paper addresses a flexible architecture for job management with detailed design and implementation. Frameworks for job scheduling and monitoring, as two important aspects, are also presented. The proposed job management has the advantages of reusability of job definition, flexible and automatic file operation, visual steering of file transfer and job execution, and adaptive application job scheduler. A job management wizard is designed to implement each step. Therefore, what the grid user needs to do is only to define the job by constructing necessary information at runtime. In addition, the job space is adopted to ensure the security of the job management. Experimental results showed that this approach is user-friendly and system efficient.

Key words

Grid Job management Job definition reuse Steering of job transfer Job space 

CLC number

TP393 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Andreetto, P., Borgia, S.A., Dorigo, A., et al., 2006. CREAM: A Simple, GRID-Accessible, Job Management System for Local Computational Resources. Proceedings of Computing in High Energy and Nuclear Physics (CHEP 2006). Mumbai, India.Google Scholar
  2. Baranovski, A., Garzoglio, G., Terekhov, I., Roy, A., Tannenbaum, T., 2004. Management of Grid Jobs and Data within SAMGrid. Proceedings of the 2004 IEEE International Conference on Cluster Computing. IEEE Computer Society, Washington DC, USA, p.353–359.Google Scholar
  3. Casanova, H., 2001. Simgrid: A Toolkit for the Simulation of Application Scheduling. Proceedings of the IEEE Symposium on Cluster Computing and the Grid (CCGrid’01). IEEE Computer Society, p.430–437.Google Scholar
  4. Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., Tuecke, S., 1998. A Resource Management Architecture for Metacomputing Systems. Proceedings of the 4th Workshop on Job Scheduling Strategies for Parallel Processing. Springer-Verlag, p.62–82.Google Scholar
  5. Foster, I., Kesselman, C., 1997. Globus: a metacomputing infrastructure toolkit. International Journal of Supercomputer Applications, 11(2):115–128.CrossRefGoogle Scholar
  6. Foster, I., Kesselman, C., 1998. The Globus Project: A Status Report. Proceedings of IPPS/SPDP’98 Heterogeneous Computing Workshop. IEEE Press, p.4–18.Google Scholar
  7. Foster, I., Kesselman, C., Tuecke, S., 2001. The anatomy of the grid: enabling scalable virtual organizations. International Journal of Supercomputer Applications, 15(3):200–222.CrossRefGoogle Scholar
  8. Liu, C., Yang, L.Y., Foster, I., Angulo, D., 2002. Design and Evaluation of a Resource Selection Framework for Grid Applications. Proceedings of IEEE International Symposium on High Performance Distributed Computing (HPDC-11). IEEE CS Press, p.63–72.Google Scholar
  9. Luan, C.J., Song, G.H., Zheng, Y., 2005. An Infrastructure for Grid Job Monitoring. Proceedings of the International Workshop on Grid and Cooperative Computing (GCC’05). Lecture Notes in Computer Science. Springer-Verlag, Berlin, Heidelberg, 3795:443–448.Google Scholar
  10. Luan, C.J., Song, G.H., Zheng, Y., 2006. Application-adaptive resource scheduling in a computational grid. Journal of Zhejiang University SCIENCE A, 7(10):1634–1641. [doi:10.1631/jzus.2006.A1634]CrossRefzbMATHGoogle Scholar
  11. Tannenbaum, T., Wright, D., Miller, K., Livny, M., 2002. Condor—A Distributed Job Scheduler. Beowulf Cluster Computing with Linux. The MIT Press, Cambridge, MA, USA, p.307–350.Google Scholar
  12. Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R., 2002. A Grid Monitoring Architecture. http://www.ggf.org/documents/GFD/GFD-I.7.pdf
  13. Wang, W., Zheng, Y., Song, G.H., 2005. The Design and Implementation of Scalable Information Services in a Grid Environment. Proceedings of the 2005 IEEE International Conference on Services Computing. IEEE Computer Society, Los Alamitos, California, 2:265–267.Google Scholar
  14. Welch, V., Siebenlist, F., Foster, I., Bresnahan, J., Czajkowski, K., Gawor, J., Kesselman, C., Meder, S., Pearlman, L., Tuecke, S., 2003. Security for Grid Services. Proceedings of the 12th International Symposium on High Performance Distributed Computing (HPDC-12). IEEE Press, p.48–57.Google Scholar
  15. YarKhan, A., Seymour, K., Sagi, K., Shi, Z., Dongarra, J., 2006. Recent developments in gridsolve. International Journal of High Performance Computing Applications, 20(1):131–141. [doi:10.1177/1094342006061893]CrossRefGoogle Scholar
  16. Zheng, Y., Song, G.H., Zhang, J.F., Chen, J.J., 2004. An Enabling Environment for Distributed Simulation and Visualization. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004). IEEE Computer Society, Los Alamitos, California, p.26–33.CrossRefGoogle Scholar

Copyright information

© Springer-Verlag 2007

Authors and Affiliations

  • Luan Cui-ju 
    • 1
    • 2
  • Song Guang-hua 
    • 2
  • Zheng Yao 
    • 2
  • Zhang Ji-fa 
    • 2
  1. 1.College of Information EngineeringShanghai Maritime UniversityShanghaiChina
  2. 2.School of Computer Science and Center for Engineering and Scientific ComputationZhejiang UniversityHangzhouChina

Personalised recommendations