Abstract
Job management is a key issue in computational grids, and normally involves job definition, scheduling, executing and monitoring. However, job management in the existing grid middleware needs to be improved in terms of efficiency and flexibility. This paper addresses a flexible architecture for job management with detailed design and implementation. Frameworks for job scheduling and monitoring, as two important aspects, are also presented. The proposed job management has the advantages of reusability of job definition, flexible and automatic file operation, visual steering of file transfer and job execution, and adaptive application job scheduler. A job management wizard is designed to implement each step. Therefore, what the grid user needs to do is only to define the job by constructing necessary information at runtime. In addition, the job space is adopted to ensure the security of the job management. Experimental results showed that this approach is user-friendly and system efficient.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Andreetto, P., Borgia, S.A., Dorigo, A., et al., 2006. CREAM: A Simple, GRID-Accessible, Job Management System for Local Computational Resources. Proceedings of Computing in High Energy and Nuclear Physics (CHEP 2006). Mumbai, India.
Baranovski, A., Garzoglio, G., Terekhov, I., Roy, A., Tannenbaum, T., 2004. Management of Grid Jobs and Data within SAMGrid. Proceedings of the 2004 IEEE International Conference on Cluster Computing. IEEE Computer Society, Washington DC, USA, p.353–359.
Casanova, H., 2001. Simgrid: A Toolkit for the Simulation of Application Scheduling. Proceedings of the IEEE Symposium on Cluster Computing and the Grid (CCGrid’01). IEEE Computer Society, p.430–437.
Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., Tuecke, S., 1998. A Resource Management Architecture for Metacomputing Systems. Proceedings of the 4th Workshop on Job Scheduling Strategies for Parallel Processing. Springer-Verlag, p.62–82.
Foster, I., Kesselman, C., 1997. Globus: a metacomputing infrastructure toolkit. International Journal of Supercomputer Applications, 11(2):115–128.
Foster, I., Kesselman, C., 1998. The Globus Project: A Status Report. Proceedings of IPPS/SPDP’98 Heterogeneous Computing Workshop. IEEE Press, p.4–18.
Foster, I., Kesselman, C., Tuecke, S., 2001. The anatomy of the grid: enabling scalable virtual organizations. International Journal of Supercomputer Applications, 15(3):200–222.
Liu, C., Yang, L.Y., Foster, I., Angulo, D., 2002. Design and Evaluation of a Resource Selection Framework for Grid Applications. Proceedings of IEEE International Symposium on High Performance Distributed Computing (HPDC-11). IEEE CS Press, p.63–72.
Luan, C.J., Song, G.H., Zheng, Y., 2005. An Infrastructure for Grid Job Monitoring. Proceedings of the International Workshop on Grid and Cooperative Computing (GCC’05). Lecture Notes in Computer Science. Springer-Verlag, Berlin, Heidelberg, 3795:443–448.
Luan, C.J., Song, G.H., Zheng, Y., 2006. Application-adaptive resource scheduling in a computational grid. Journal of Zhejiang University SCIENCE A, 7(10):1634–1641. [doi:10.1631/jzus.2006.A1634]
Tannenbaum, T., Wright, D., Miller, K., Livny, M., 2002. Condor—A Distributed Job Scheduler. Beowulf Cluster Computing with Linux. The MIT Press, Cambridge, MA, USA, p.307–350.
Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R., 2002. A Grid Monitoring Architecture. http://www.ggf.org/documents/GFD/GFD-I.7.pdf
Wang, W., Zheng, Y., Song, G.H., 2005. The Design and Implementation of Scalable Information Services in a Grid Environment. Proceedings of the 2005 IEEE International Conference on Services Computing. IEEE Computer Society, Los Alamitos, California, 2:265–267.
Welch, V., Siebenlist, F., Foster, I., Bresnahan, J., Czajkowski, K., Gawor, J., Kesselman, C., Meder, S., Pearlman, L., Tuecke, S., 2003. Security for Grid Services. Proceedings of the 12th International Symposium on High Performance Distributed Computing (HPDC-12). IEEE Press, p.48–57.
YarKhan, A., Seymour, K., Sagi, K., Shi, Z., Dongarra, J., 2006. Recent developments in gridsolve. International Journal of High Performance Computing Applications, 20(1):131–141. [doi:10.1177/1094342006061893]
Zheng, Y., Song, G.H., Zhang, J.F., Chen, J.J., 2004. An Enabling Environment for Distributed Simulation and Visualization. Proceedings of the 5th IEEE/ACM International Workshop on Grid Computing (Grid 2004). IEEE Computer Society, Los Alamitos, California, p.26–33.
Author information
Authors and Affiliations
Additional information
Project supported by the National Natural Science Foundation of China (No. 90412014), the National Science Foundation of China for Distinguished Young Scholars (No. 60225009), and the China Next Generation Internet (CNGI) Project (No. CNGI-04-15-7A)
Rights and permissions
About this article
Cite this article
Luan, Cj., Song, Gh., Zheng, Y. et al. A flexible architecture for job management in a grid environment. J. Zhejiang Univ. - Sci. A 8, 95–105 (2007). https://doi.org/10.1631/jzus.2007.A0095
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1631/jzus.2007.A0095