A flexible architecture for job management in a grid environment
- 35 Downloads
Job management is a key issue in computational grids, and normally involves job definition, scheduling, executing and monitoring. However, job management in the existing grid middleware needs to be improved in terms of efficiency and flexibility. This paper addresses a flexible architecture for job management with detailed design and implementation. Frameworks for job scheduling and monitoring, as two important aspects, are also presented. The proposed job management has the advantages of reusability of job definition, flexible and automatic file operation, visual steering of file transfer and job execution, and adaptive application job scheduler. A job management wizard is designed to implement each step. Therefore, what the grid user needs to do is only to define the job by constructing necessary information at runtime. In addition, the job space is adopted to ensure the security of the job management. Experimental results showed that this approach is user-friendly and system efficient.
Key wordsGrid Job management Job definition reuse Steering of job transfer Job space
Unable to display preview. Download preview PDF.
- Andreetto, P., Borgia, S.A., Dorigo, A., et al., 2006. CREAM: A Simple, GRID-Accessible, Job Management System for Local Computational Resources. Proceedings of Computing in High Energy and Nuclear Physics (CHEP 2006). Mumbai, India.Google Scholar
- Baranovski, A., Garzoglio, G., Terekhov, I., Roy, A., Tannenbaum, T., 2004. Management of Grid Jobs and Data within SAMGrid. Proceedings of the 2004 IEEE International Conference on Cluster Computing. IEEE Computer Society, Washington DC, USA, p.353–359.Google Scholar
- Casanova, H., 2001. Simgrid: A Toolkit for the Simulation of Application Scheduling. Proceedings of the IEEE Symposium on Cluster Computing and the Grid (CCGrid’01). IEEE Computer Society, p.430–437.Google Scholar
- Czajkowski, K., Foster, I., Karonis, N., Kesselman, C., Martin, S., Smith, W., Tuecke, S., 1998. A Resource Management Architecture for Metacomputing Systems. Proceedings of the 4th Workshop on Job Scheduling Strategies for Parallel Processing. Springer-Verlag, p.62–82.Google Scholar
- Foster, I., Kesselman, C., 1998. The Globus Project: A Status Report. Proceedings of IPPS/SPDP’98 Heterogeneous Computing Workshop. IEEE Press, p.4–18.Google Scholar
- Liu, C., Yang, L.Y., Foster, I., Angulo, D., 2002. Design and Evaluation of a Resource Selection Framework for Grid Applications. Proceedings of IEEE International Symposium on High Performance Distributed Computing (HPDC-11). IEEE CS Press, p.63–72.Google Scholar
- Luan, C.J., Song, G.H., Zheng, Y., 2005. An Infrastructure for Grid Job Monitoring. Proceedings of the International Workshop on Grid and Cooperative Computing (GCC’05). Lecture Notes in Computer Science. Springer-Verlag, Berlin, Heidelberg, 3795:443–448.Google Scholar
- Tannenbaum, T., Wright, D., Miller, K., Livny, M., 2002. Condor—A Distributed Job Scheduler. Beowulf Cluster Computing with Linux. The MIT Press, Cambridge, MA, USA, p.307–350.Google Scholar
- Tierney, B., Aydt, R., Gunter, D., Smith, W., Swany, M., Taylor, V., Wolski, R., 2002. A Grid Monitoring Architecture. http://www.ggf.org/documents/GFD/GFD-I.7.pdf
- Wang, W., Zheng, Y., Song, G.H., 2005. The Design and Implementation of Scalable Information Services in a Grid Environment. Proceedings of the 2005 IEEE International Conference on Services Computing. IEEE Computer Society, Los Alamitos, California, 2:265–267.Google Scholar
- Welch, V., Siebenlist, F., Foster, I., Bresnahan, J., Czajkowski, K., Gawor, J., Kesselman, C., Meder, S., Pearlman, L., Tuecke, S., 2003. Security for Grid Services. Proceedings of the 12th International Symposium on High Performance Distributed Computing (HPDC-12). IEEE Press, p.48–57.Google Scholar