Improved Usage Model for Web Application Reliability Testing

  • Gregor v. Bochmann
  • Guy-Vincent Jourdan
  • Bo Wan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7019)

Abstract

Testing the reliability of an application usually requires a good usage model that accurately captures the likely sequences of inputs that the application will receive from the environment. The models being used in the literature are mostly based on Markov chains. They are used to generate test cases that are statistically close to what the application is expected to receive when in production. In this paper, we study the specific case of web applications. We present a model that is created directly from the log file of the application. This model is also based on Markov chains and has two components: one component, based on a modified tree, captures the most frequent behavior, while the other component is another Markov chain that captures infrequent behaviors. The result is a statistically correct model that exhibits clearly what most users do on the site. We present an experimental study on the log of a real web site and discuss strength and weakness of the model for reliability testing.

Keywords

Web applications Usage models Reliability testing Markov chains 

References

  1. 1.
    Vilkomir, S.A., Parnas, D.L., Mendiratta, V.B., Murphy, E.: Segregated Failures Model for Availability Evaluation of Fault-Tolerant Systems. In: 29th Australasian Computer Science Conference, vol. 48 (2006)Google Scholar
  2. 2.
    Wang, W., Tang, M.: User-Oriented Reliability Modeling for a Web System. In: Proceedings of the 14th International Symposium on Software Reliability Engineering (ISSRE 2003), pp. 1–12 (2003)Google Scholar
  3. 3.
    Whittaker, J.A., Thomason, M.G.: A Markov Chain Model for Statistical Software Testing. IEEE Trans. Software Eng. 20(10), 812–824 (1994)CrossRefGoogle Scholar
  4. 4.
    Le Guen, H., Marie, R., Thelin, T.: Reliability Estimation for Statistical Usage Testing using Markov Chains. In: ISSRE 2004: Proceedings of the 15th International Symposium on Software Reliability Engineering, pp. 54–65. IEEE Computer Society, Washington, DC (2004)Google Scholar
  5. 5.
    Dulz, W., Zhen, F.: MaTeLo—statistical usage testing by annotated sequence diagrams, Markov chains, and TTCN-3. In: Proceedings of Third International Conference On Quality Software (QSIC 2003). IEEE, Los Alamitos (2003)Google Scholar
  6. 6.
    Sayre, K.: Improved Techniques for Software Testing Based on Markov Chain Usage Models. PhD thesis, University of Tennessee (1999)Google Scholar
  7. 7.
    Borges, J.: A Data Mining Model to Capture User Web Navigation. PhD thesis, University College London, London Uiversity (2000)Google Scholar
  8. 8.
    Borges, J., Levene, M.: A dynamic clustering-based Markov model for web usage mining. In: CoRR:the computing research repository. cs.IR/0406032 (2004)Google Scholar
  9. 9.
    Goseva-Popstojanova, K., Trivedi, K.S.: Failure Correlation in Software Reliability Models. IEEE Trans. on Reliability 49, 37–48 (2000)CrossRefGoogle Scholar
  10. 10.
    Goseva-Popstojanova, K., Hamill, M.: Estimating the Probability of Failure When Software Runs Are Dependent: An Empirical Study. In: 20th International Symposium on Software Reliability Engineering, ISSRE, pp. 21–30 (2009)Google Scholar
  11. 11.
    Feliachi, A., Le Guen, H.: Generating transition probabilities for automatic model-based test generation. In: Third International Conference on Software Testing, Verification and Validation, pp. 99–102 (2010)Google Scholar
  12. 12.
    Cooley, R., Mobasher, B., Srivastava, J.: Data Preparation for Mining World Wide Web Browsing Patterns. Knowledge and Information Systems 1(1), 5–32 (1999)Google Scholar
  13. 13.
    Pei, J., et al.: Mining Access Patterns Efficiently from Web Logs. In: Proc. Pacific-Asia Conf. on Knowledge Discovery and Data Mining, pp. 396–407. Springer, New York (2000)Google Scholar
  14. 14.
    Miller, K.W., et al.: Estimating the Probability of Failure When Testing Reveals No Failures. IEEE Transactions on Software Engineering 18, 33–42 (1992)CrossRefGoogle Scholar
  15. 15.
    Pirolli, P.L.T., Pitkow, J.E.: Distributions of surfers’ paths through the world wide web: Empirical characterizations. World Wide Web, 29–45 (1999)Google Scholar
  16. 16.
    Deshpande, M., Karypis, G.: Selective Markov Models for Predicting Web-Page Accesses. In: Proc. of the 1st SIAM International Conference on Data Mining (2001)Google Scholar
  17. 17.
    Charniak, E.: Statistical Language Learning. The MIT Press, Cambridge (1996)Google Scholar
  18. 18.
    Jespersen, S., Pedersen, T.B., Thorhauge, J.: Evaluating the markov assumption for web usage mining. In: Proceeding of the Fifth International Workshop on Web Information and Data Management (WIDM 2003), pp. 82–89 (2003)Google Scholar
  19. 19.
    Walpole, R.E., Myers, R.H.: Probability and Statistics for Engineers and Scientists, 5th edn. Macmillan Publishing Company, Basingstoke (1993)Google Scholar

Copyright information

© IFIP International Federation for Information Processing 2011

Authors and Affiliations

  • Gregor v. Bochmann
    • 1
  • Guy-Vincent Jourdan
    • 1
  • Bo Wan
    • 1
  1. 1.School of Information Technology & EngineeringUniversity of OttawaOttawaCanada

Personalised recommendations