Towards Intelligent Management of Very Large Computing Systems

  • Eugen Volk
  • Jochen Buchholz
  • Stefan Wesner
  • Daniela Koudela
  • Matthias Schmidt
  • Niels Fallenbeck
  • Roland Schwarzkopf
  • Bernd Freisleben
  • Götz Isenmann
  • Jürgen Schwitalla
  • Marc Lohrer
  • Erich Focht
  • Andreas Jeutter
Conference paper

Abstract

The increasing complexity of current and future very large computing systems with a rapidly growing number of cores and nodes requires high human effort on administration and maintenance of these systems. Existing monitoring tools are neither scalable nor capable to reduce the overwhelming flow of information and provide only essential information of high value. Current management tools lack on scalability and capability to process a huge amount of information intelligently by relating several data and information from various sources together for making right decisions on error/fault handling. In order to solve these problems, we present a solution designed within the TIMaCS project, a hierarchical, scalable, policy based monitoring and management framework.

References

  1. 1.
    Strohmaier, E., Dongarra, J.J., Meuer, H.W., Simon, H.D.: Recent trends in the marketplace of high performance computing, Parallel Computing, Volume 31, Issues 3–4, pp. 261–273 March-April (2005)Google Scholar
  2. 2.
    Wong, Y.W., Mong Goh R.S., Kuo, S., Hean Low, M.Y.: A Tabu Search for the Heterogeneous DAG Scheduling Problem, 15th International Conference on Parallel and Distributed Systems (2009)Google Scholar
  3. 3.
    Asanovic, K., Bodik, R., Demmel, J., Keaveny, T., Keutzer, K., Kubiatowicz, J., Morgan, N., Patterson, D., Sen, K., Wawrzynek, J., Wessel, D., Yelick, K.: A view of the parallel computing landscape, Communications of the ACM, v. 52 n. 10, October (2009)Google Scholar
  4. 4.
  5. 5.
    Zenoss web-site, http://www.zenoss.com
  6. 6.
    TIMaCS project web-site, http://www.timacs.de
  7. 7.
    organic-computing web-site, http://www.organic-computing.de/spp
  8. 8.
    Wuertz, R.P.: Organic Computing (Understanding Complex Systems), Springer 2008Google Scholar
  9. 9.
    IBM: An architectural blueprint for autonomic computing, http://www-03.ibm.com/autonomic/pdfs/AC_Blueprint_White_Paper_V7.pdf, IBM Whitepaper, June 2006. Cited 16 December 2010
  10. 10.
    Linux Magazin, Technical Review, Monitoring, 2007Google Scholar
  11. 11.
    Nagios web-site, http://www.nagios.org
  12. 12.
  13. 13.
    Buchholz, J., Volk, E.: The Need for New Monitoring and Management Technologies in Large Scale Computing Systems. In: Procedings of eChallenges 2010, to appearGoogle Scholar
  14. 14.
    Buchholz, J., Volk, E.: Towards an Architecture for Management of Very Large Computing Systems. In: Resch, M., Benkert, K., Wang, X., Galle, M., Bez, W., Kobayashi, H., Roller, S. (eds.) High Performance Computing on Vector Systems 2010, Springer, Berlin (2010)Google Scholar
  15. 15.
    eclipse Graphical Modeling Project (GMP) http://www.eclipse.org/modeling/gmp/
  16. 16.
    Barham, P., Dragovic, B., Fraser, K., Hand, S., Harris, T., Ho, A., Neugebauer, R., Pratt, I., Warfield, A.: Xen and the Art of Virtualization, in SOSP ’03: Proceedings of the 19th ACM Symposium on Operating Systems Principles, ACM Press, Bolton Landing, NY, USA (2003)Google Scholar
  17. 17.
    Advanced Message Queuing Protocol (AMQP) web-site, http://www.amqp.org
  18. 18.
    RabbitMQ web-site, http://www.rabbitmq.com

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Eugen Volk
    • 1
  • Jochen Buchholz
    • 1
  • Stefan Wesner
    • 1
  • Daniela Koudela
    • 2
  • Matthias Schmidt
    • 3
  • Niels Fallenbeck
    • 3
  • Roland Schwarzkopf
    • 3
  • Bernd Freisleben
    • 3
  • Götz Isenmann
    • 4
  • Jürgen Schwitalla
    • 4
  • Marc Lohrer
    • 4
  • Erich Focht
    • 5
  • Andreas Jeutter
    • 5
  1. 1.High Performance Computing Center StuttgartStuttgartGermany
  2. 2.Zentrum für Informationsdienste und Hochleistungsrechnen (ZIH)Technische Universität DresdenDresdenGermany
  3. 3.Department of Mathematics and Computer ScienceUniversity of MarburgMarburgGermany
  4. 4.science + computing agTübingenGermany
  5. 5.NEC High Performance Computing EuropeStuttgartGermany

Personalised recommendations