Abstract
This paper presents an autonomic system in which two managers with different responsibilities collaborate to achieve an overall objective within a cluster of server computers. The first, a node group manager, uses modeling and optimization algorithms to allocate server processes and individual requests among a set of server machines grouped into node groups, and also estimates its ability to fulfill its service-level objectives as a function of the number of server machines available in each node group. The second, a provisioning manager, consumes these estimates from one or more node group managers, and uses them to allocate machines to node groups over a longer timescale. We describe the operation of both managers and the information that flows between them, and present the results of some experiments demonstrating the effectiveness of our technique. Furthermore, we relate our architecture to a general autonomic computing architecture based on self-managing resources and patterns of inter-resource collaboration, and to emerging standards in the area of distributed manageability. We also discuss some of the issues involved in incorporating our implementation into existing products in the short term, and describe a number of further directions for this research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
J. O. Kephart and D. M. Chess, The vision of autonomic computing. Computer 36(1) (2003) 41–52.
S. R. White, J. E. Hanson, I. Whalley, D. M. Chess, and J. O. Kephart, An architectural approach to autonomic computing, in: First International Conference on Autonomic Computing (2004).
D. M. Chess, G. Pacifici, M. Spreitzer, M. Steinder, A. Tantawi, and I. Whalley, Experience with collaborating managers: Node group manager and provisioning manager; in: Second International Conference on Autonomic Computing (2005).
T. Kimbrel, M. Steinder, M. Sviridenko, and A. Tantawi, Dynamic application placement under service and memory constraints, In: 4th International Workshop on Efficient and Experimental Algorithms, Santorini Island, Greece (May 2005).
R. Levy, J. Nagarajarao, G. Pacifici, M. Spreitzer, A. Tantawi, and A. Youssef, Performance management for cluster based web services, in: 8th IFIP/IEEE International Symposium on Integrated Network Management (IM 2003) (2003).
IBM Corp, IBM Tivoli Intelligent Orchestrator—Product overview. http://www.ibm.com/software/tivoli/products/intell-orch/.
E. Manoel, S. C. Brumfield, K. Converse, M. DuMont, L. Hand, G. Lilly, M. Moeller, A. Nemati, and A. Waisanen, Provisioning on Demand: Introducing IBM Tivoli Intelligent Orchestrator (December 2003).
F. J. De Gilio, Orchestriating grid workloads—neither feast nor famine. http://www-128.ibm.com/developerworks/grid/library/gr-feast/ (2004).
M. S. Squillante, D. D. Yao, and L. Zhang, Internet traffic: Periodicity, tail behavior and performance implications, in: System Performance Evaluation: Methodologies and Applications (1999).
J. O. Kephart and W. E. Walsh, An artificial intelligence perspective on autonomic computing policies, in: IEEE 5th International Workshop on Policies for Distributed Systems and Networks (2004).
S. Aiber, D. Gilat, A. Landau, N. Razinkov, A. Sela, and S. Wasserkrug, Autonomic self-optimization according to business objectives, in: First International Conference on Autonomic Computing (2004).
W. E. Walsh, G. Tesauro, J. O. Kephart, and R. Das, Utility functions in autonomic computing, in: First International Conference on Autonomic Computing (2004).
D. Chess, A. Segal, I. Whalley, and S. White, Unity: experiences with a prototype autonomic computing system, in: First International Conference on Autonomic Computing (2004).
G. Tesauro, D. M. Chess, W. E. Walsh, R. Das, A. Segal, I. Whalley, J. O. Kephart, and S. R. White, A multi-agent systems approach to autonomic computing, in: AAMAS (2004) pp. 464–471.
K. Sycara, Multi-agent infrastructure, agent discovery, middle agents for web services and interoperation, in: G. J. Carbonell and J. Siekmann (Eds.), Mutli-Agents Systems and Applications. (Springer-Verlag, New York, Inc., 2001).
Introduction to UDDI: Important features and functional concepts. http://uddi.org/pubs/uddi-tech-wp.pdf (2004).
W3C Web Services Architecture Working Group. Web services architecture, http://www.w3.org/TR/ws-arch/ (2004).
Globus Alliance. The WS-Resource Framework. http://www. globus.org/wsrf/ (2004).
Web services distributed management: Management using web services (MUWS 1.0) Part 1. http://docs.oasis-open.org/ wsdm/2004/12/wsdm-muws-part1-1.0.pdf (2004).
Web services distributed management: Management using web services (MUWS 1.0) Part 2. http://docs.oasis-open.org/wsdm/ 2004/12/wsdm-muws-part2-1.0.pdf (2004).
Web services agreement specification. https://forge.gridforum.org/ projects/graap-wg/document/WS-AgreementSpecification (2005).
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Whalley, I., Tantawi, A., Steinder, M. et al. Experience with collaborating managers: node group manager and provisioning manager. Cluster Comput 9, 401–416 (2006). https://doi.org/10.1007/s10586-006-0009-0
Issue Date:
DOI: https://doi.org/10.1007/s10586-006-0009-0