Skip to main content

Sensor Selection for IT Infrastructure Monitoring

  • Conference paper

Abstract

Supervisory control is the main means to assure a high level performance and availability of large IT infrastructures. Applied control theory is used in physical and virtualization based clustering, autonomic-, self-healing and cloud computing, but similar problems arise in any distributed environment.

The selection of a compact, but sufficiently characteristic set of control variables is one of the core problems both for design and run-time complexity. Most results in the literature are based on a single algorithm for variable selection, but our measurements indicate that no single algorithm can generate faithful estimates for all the different operational domains.

We propose to use a combination of different model extraction techniques on benchmark-like data logs. The main advantages of this multi-paradigm approach are twofold: it provides good parameter estimators for predictive control in a simple way; and supports the identification of the actual operational domain facilitating context-aware adaptive control, diagnostics and repair.

This is a preview of subscription content, log in via an institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD   39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD   54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Learn about institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Diao, Y., Hellerstein, J.L., Kaiser, G., Parekh, S., Phung, D.: Self-managing systems: A control theory foundation. Engineering of Computer-Based Systems, 441–448 (April 2005)

    Google Scholar 

  2. IBM Autonomic Computing Initiative, http://www.research.ibm.com/autonomic/

  3. Assessing, Measuring and Benchmarking Resilience, FP7 ICT CA 216295, http://amber.dei.uc.pt/

  4. Cohen, M., Goldszmidt, T., Kelly, J., Symons, J., Chase, J.S.: Correlating instrumentation data to system states: A building block for automated diagnosis and control. In: Proc. 6th USENIX OSDI, San Francisco, CA (December 2004)

    Google Scholar 

  5. Zhang, S., Cohen, I., Goldszmidt, M., Symons, J., Fox, A.: Ensembles of models for automated diagnosis of system performance problems. Technical Report HPL-2005-3, Hewlett-Packard (January 2005)

    Google Scholar 

  6. Powers, R., Goldszmidt, M., Cohen, I.: Short term performance forecasting in enterprise systems. In: ACM SIGKDD Intl. Conf. on Knowledge Discovery and Data Mining (August 2005)

    Google Scholar 

  7. Hoffmann, G.A., Trivedi, K.S., Malek, M.: A best practice guide to resource forecasting for computing systems. IEEE Transactions on Reliability 56, 615–628 (2007)

    Article  Google Scholar 

  8. Kohavi, R., John, G.: The wrapper approach. In: Liu, H., Motoda, H. (eds.) Feature Extraction, Construction and Selection: A Data Mining Perspective. Springer, Heidelberg (1998)

    Google Scholar 

  9. Jiang, M., Munawar, M.A., Reidemeister, T., Ward, P.A.S.: Information-theoretic modeling for tracking the health of complex software systems. In: Proceedings of the 2008 conference of the center for advanced studies on collaborative research: meeting of minds. ACM, New York (2008)

    Google Scholar 

  10. Ding, C., Peng, H.: Minimum redundancy feature selection from microarray gene expression data. In: Proceedings of the Computational Systems Bioinformatics Conference, pp. 523–529 (2003)

    Google Scholar 

  11. Zhou, J., Peng, H.: Automatic recognition and annotation of gene expression patterns of fly embryos. Bioinformatics 23(5), 589–596 (2007)

    Article  Google Scholar 

  12. Jiang, M., Munawar, M.A., Reidemeister, T., Ward, P.A.S.: Automatic Fault Detection and Diagnosis in Complex Software Systems by Information-Theoretic Monitoring. Will appear in IEEE International Conference on Dependable Systems and Networks (2009)

    Google Scholar 

  13. Grottke, M., Lie, L., Vaidyanathan, K., Trivedi, K.: Analysis of software aging in a web server. IEEE Trans. Reliability 55(3), 411–420 (2006)

    Article  Google Scholar 

  14. Keller, A., Diao, Y., Eskesen, F., Froehlich, S., Hellerstein, J.I., Surendra, M., Spainhower, L.F.: Generic On-Line Discovery of Quantitative Models. IEEE Transactions on Network and Service Management 1(1), 39–48 (2004)

    Article  Google Scholar 

  15. TPC-W official page, http://www.tpc.org/tpcw/default.asp

  16. Fodor, I.K.: A survey of dimension reduction techniques”. Technical Report UCRL-ID-148494, Lawrence Livermore National Laboratory, Center for Applied Scientific Computing (2002)

    Google Scholar 

  17. Molina, L., Belanche, L., Nebot, A.: Feature selection algorithms: a survey and experimental evaluation. In: International conference on data mining, Maebashi City, Japan (2002)

    Google Scholar 

  18. Peng, H., Long, F., Ding, C.: Feature selection based on mutual information criteria of max-dependency, max-relevance, and min-redundancy. IEEE Transactions on Pattern Analysis and Machine Intelligence 27, 1226–1238 (2005)

    Article  Google Scholar 

  19. Li, S., Zhu, Y., Feng, J., Ai, P., Chen, X.: Comparative Study of Three Feature Selection Methods for Regional Land Cover Classification Using MODIS Data. In: Proceedings of the 2008 Congress on Image and Signal Processing, vol. 4 (2008)

    Google Scholar 

  20. Chen, H., Jiang, G., Yoshihira, K.: Monitoring High-Dimensional Data for Failure Detection and Localization in Large-Scale Computing Systems. IEEE Trans. Knowl. Data Eng. (TKDE) 20 (2008)

    Google Scholar 

  21. He, X., Asada, H.: A new method for identifying orders of input–output models for nonlinear dynamic systems. In: Proc. Autom. Contr. Conf., pp. 2520–2523 (1993)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 ICST Institute for Computer Science, Social Informatics and Telecommunications Engineering

About this paper

Cite this paper

Paljak, G.J., Kocsis, I., Égel, Z., Tóth, D., Pataricza, A. (2010). Sensor Selection for IT Infrastructure Monitoring. In: Vasilakos, A.V., Beraldi, R., Friedman, R., Mamei, M. (eds) Autonomic Computing and Communications Systems. AUTONOMICS 2009. Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering, vol 23. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-11482-3_9

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-11482-3_9

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-11481-6

  • Online ISBN: 978-3-642-11482-3

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics