Abstract
The increasing complexity of current and future very large computing systems with a rapidly growing number of cores and nodes requires high human effort on administration and maintenance of these systems. Existing monitoring tools are neither scalable nor capable to reduce the overwhelming flow of information and provide only essential information of high value. Current management tools lack on scalability and capability to process a huge amount of information intelligently by relating several data and information from various sources together for making right decisions on error/fault handling. In order to solve these problems, we present a solution designed within the TIMaCS project, a hierarchical, scalable, policy based monitoring and management framework.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
References
Strohmaier, E., Dongarra, J.J., Meuer, H.W., Simon, H.D.: Recent trends in the marketplace of high performance computing, Parallel Computing, Volume 31, Issues 3–4, pp. 261–273 March-April (2005)
Wong, Y.W., Mong Goh R.S., Kuo, S., Hean Low, M.Y.: A Tabu Search for the Heterogeneous DAG Scheduling Problem, 15th International Conference on Parallel and Distributed Systems (2009)
Asanovic, K., Bodik, R., Demmel, J., Keaveny, T., Keutzer, K., Kubiatowicz, J., Morgan, N., Patterson, D., Sen, K., Wawrzynek, J., Wessel, D., Yelick, K.: A view of the parallel computing landscape, Communications of the ACM, v. 52 n. 10, October (2009)
Ganglia web-site, http://ganglia.sourceforge.net/
Zenoss web-site, http://www.zenoss.com
TIMaCS project web-site, http://www.timacs.de
organic-computing web-site, http://www.organic-computing.de/spp
Wuertz, R.P.: Organic Computing (Understanding Complex Systems), Springer 2008
IBM: An architectural blueprint for autonomic computing, http://www-03.ibm.com/autonomic/pdfs/AC_Blueprint_White_Paper_V7.pdf, IBM Whitepaper, June 2006. Cited 16 December 2010
Linux Magazin, Technical Review, Monitoring, 2007
Nagios web-site, http://www.nagios.org
IBM Tivoli web-site, http://www-01.ibm.com/software/tivoli/
Buchholz, J., Volk, E.: The Need for New Monitoring and Management Technologies in Large Scale Computing Systems. In: Procedings of eChallenges 2010, to appear
Buchholz, J., Volk, E.: Towards an Architecture for Management of Very Large Computing Systems. In: Resch, M., Benkert, K., Wang, X., Galle, M., Bez, W., Kobayashi, H., Roller, S. (eds.) High Performance Computing on Vector Systems 2010, Springer, Berlin (2010)
eclipse Graphical Modeling Project (GMP) http://www.eclipse.org/modeling/gmp/
Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization, in SOSP ’03: Proceedings of the 19th ACM Symposium on Operating Systems Principles, ACM Press, Bolton Landing, NY, USA (2003)
Advanced Message Queuing Protocol (AMQP) web-site, http://www.amqp.org
RabbitMQ web-site, http://www.rabbitmq.com
Acknowledgements
The results presented in this paper are partially funded by Federal Ministry of Education and Research (BMBF) through the TIMaCS [6] project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2011 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Volk, E. et al. (2011). Towards Intelligent Management of Very Large Computing Systems. In: Bischof, C., Hegering, HG., Nagel, W., Wittum, G. (eds) Competence in High Performance Computing 2010. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-24025-6_16
Download citation
DOI: https://doi.org/10.1007/978-3-642-24025-6_16
Published:
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-24024-9
Online ISBN: 978-3-642-24025-6
eBook Packages: Computer ScienceComputer Science (R0)