Square-Wave Like Performance Change Detection Using SPC Charts and ANFIS

Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 215)

Abstract

While developing software products, performance regressions are always big issues in enterprise software projects. To detect possible performance regressions earlier, many performance tests are executed during development phase for thousands or ten thousands of performance metrics. In the previous researches, we introduced an automated performance anomaly detection and management framework, and showed Statistical Process Control (SPC) charts can be successfully applied to anomaly detection. In this paper, we address the special performance trends in which the existing performance anomaly detection system hardly detects the performance change especially when a performance regression is introduced and recovered again. Generally the issue comes from that the fluctuation gets aggravated and the lower and upper control limits get relaxed with the fixed sampling window size while applying SPC charts. To resolve the issue, we propose to apply automatically tuned sampling size, and to build the optimized Fuzzy detection system. ANFIS is adopted as a Fuzzy inference system to determine the appropriate sampling window size. Using the randomly generated data sets, we tune fuzzy rules and fuzzy input/output membership functions of ANFIS by learning. Finally we show simulation results of the proposed anomaly detection system.

Keywords

Performance anomaly Statistical process control (SPC) chart Fuzzy theory Adaptive neuro-fuzzy inference system (ANFIS) 

References

  1. 1.
    Lee DH, Cha SK, Lee AH (2012) A performance anomaly detection and analysis framework for DBMS development. IEEE Trans Knowl Data Eng 24(8):1345–1360. doi:  10.1109/TKDE.2011.88 Google Scholar
  2. 2.
    Lee DH (2012) Performance anomaly detection and management using statistical process control during software development J KIISE Softw Appl 39(8):639–645Google Scholar
  3. 3.
    Montgomery DC (2005) Introduction to statistical quality control, 5th Edn. Wiley, New YorkGoogle Scholar
  4. 4.
    Komuro M (2006) Experiences of applying SPC techniques to software development processes. In: ICSE ‘06: Proceedings of the 28th international conference on Software engineering, pp 577–584Google Scholar
  5. 5.
    Cangussu JW, DeCarlo RA, Mathur AP (2003) Monitoring the software test process using statistical process control: a logarithmic approach. ACM SIGSOFT Softw Eng Notes 28(5):158–167CrossRefGoogle Scholar
  6. 6.
    Park J-J, Choi G-S (2001) Fuzzy control systems. KyowooSa, SeoulGoogle Scholar
  7. 7.
    Jang JSR (1993) ANFIS: adaptive network based fuzzy inference system. IEEE Trans Syst Man Cybern 23(3):665–685Google Scholar
  8. 8.
    Woodside M, Franks G, Petriu DC (2007) The future of software performance engineering. In: International conference on software engineering, 2007 Future of software engineering, pp 171–187. doi:  10.1109/FOSE.2007.32

Copyright information

© Springer Science+Business Media Dordrecht 2013

Authors and Affiliations

  1. 1.SAP Labs Korea TIPSeoulSouth Korea
  2. 2.Department of InternetChungwoon UniversityHongseong-gunSouth Korea

Personalised recommendations