Skip to main content

An Evaluation of the Effectiveness of the Atomic Section Model

  • Conference paper
Model-Driven Engineering Languages and Systems (MODELS 2014)

Part of the book series: Lecture Notes in Computer Science ((LNPSE,volume 8767))

Abstract

Society increasingly depends on web applications for business and pleasure. As the use of web applications continues to increase, the number of failures, some minor and some major, continues to grow. A significant problem is that we still have relatively weak abilities to test web applications. Traditional testing techniques do not adequately model or test these novel technologies. The atomic section model (ASM), models web applications to support design, analysis, and testing. This paper presents an empirical study to evaluate the effectiveness of the ASM. The model was implemented into a tool, WASP, which extracts the ASM from the implementation and supports various test criteria. We studied ten web applications, totaling 156 components and 11,829 lines of code. Using WASP, we generated 207 tests, which revealed 31 faults.Seventeen of those faults exposed internal information about the application and server.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Offutt, J.: Quality attributes of Web software applications. IEEE Software: Special Issue on Software Engineering of Internet Software 19(2), 25–32 (2002)

    Google Scholar 

  2. comScore: 2012 U.S. online holiday spending grows 14 percent vs. year ago to 42.3 billion dollars (January 2013), http://www.comscore.com/ (last access: June 2014)

  3. LogiGear: The seven most stunning website failures of 2011 (2012), http://www.logigear.com/magazine/issue/past-articles/the-seven-most-stunning-website-failures-of-2011/ (last access: June 2014)

  4. Clay, K.: Amazon.com goes down, loses $66,240 per minute (2013), http://www.forbes.com/sites/kellyclay/2013/08/19/amazon-com-goes-down-loses-66240-per-minute/ (last access: March 2014)

  5. Ford, P.: The obamacare website didn’t have to fail. How to do better next time. Bloomberg Businessweek Technology (October 2013), http://www.graphviz.org/ (last access: June 2014)

  6. Offutt, J., Wu, Y.: Modeling presentation layers of web applications for testing. Software and Systems Modeling 9(2), 257–280 (2010)

    Google Scholar 

  7. Ammann, P., Offutt, J.: Introduction to Software Testing. Cambridge University Press, Cambridge (2008) ISBN 978-0-521-88038-1

    Google Scholar 

  8. Parr, T.: Antlr parser generator (2003), http://www.antlr.org/ (ast access: June 2014)

  9. Software, O.S.: Graphviz, http://www.graphviz.org/ (last access: March 2014)

  10. Ammann, P., Offutt, J., Xu, W., Li, N.: Graph coverage web applications (2008), http://cs.gmu.edu:8080/offutt/coverage/GraphCoverage (last access: March 2014)

  11. Hower, R.: Web site test tools and site management tools (2002), http://www.softwareqatest.com/qatweb1.html

  12. Kung, D., Liu, C.H., Hsia, P.: An object-oriented Web test model for testing Web applications. In: 24th Annual International Computer Software and Applications Conference (COMPSAC 2000), Taipei, Taiwan, pp. 537–542. IEEE Computer Society Press (October 2000)

    Google Scholar 

  13. Liu, C.H., Kung, D., Hsia, P., Hsu, C.T.: Structural testing of Web applications. In: Proceedings of the 11th International Symposium on Software Reliability Engineering, San Jose CA, pp. 84–96. IEEE Computer Society Press (October 2000)

    Google Scholar 

  14. Halfond, W.G.J., Orso, A.: Improving test case generation for web applications using automated interface discovery. In: Proceedings of the Foundations of Software Engineering, Dubrovnik, Croatia, pp. 145–154 (2007)

    Google Scholar 

  15. Lucca, G.A.D., Penta, M.D.: Considering browser interaction in web application testing. In: 5th International Workshop on Web Site Evolution (WSE 2003), Amsterdam, The Netherlands, pp. 74–84. IEEE Computer Society Press (September 2003)

    Google Scholar 

  16. Andrews, A., Offutt, J., Alexander, R.: Testing Web applications by modeling with FSMs. Software and Systems Modeling 4(3), 326–345 (2005)

    Google Scholar 

  17. Andrews, A., Offutt, J., Dyreson, C., Mallery, C.J., Jerath, K., Alexander, R.: Scalability issues with using FSMWeb to test web applications. Information and Software Technology 52(1), 52–66 (2010)

    Google Scholar 

  18. Benedikt, M., Freire, J., Godefroid, P.: VeriWeb: Automatically testing dynamic Web sites. In: Proceedings of 11th International World Wide Web Conference (WWW 2002) – Alternate Paper Tracks (WE-3 Web Testing and Maintenance), Honolulu, HI, pp. 654–668 (May 2002)

    Google Scholar 

  19. Elbaum, S., Rothermel, G., Karre, S., Fisher, M.: Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering 31(3), 187–202 (2005)

    Article  Google Scholar 

  20. Alshahwan, N., Harman, M.: Automated repair of session data to improve web application regression testing. In: 1st IEEE International Conference on Software Testing, Verification and Validation (ICST 2008 Industry Track), Lillehammer, Norway, pp. 298–307 (April 2008)

    Google Scholar 

  21. Lee, S.C., Offutt, J.: Generating test cases for XML-based Web component interactions using mutation analysis. In: Proceedings of the 12th International Symposium on Software Reliability Engineering, Hong Kong China, pp. 200–209. IEEE Computer Society Press (November 2001)

    Google Scholar 

  22. Jia, X., Liu, H.: Rigorous and automatic testing of Web applications. In: 6th IASTED International Conference on Software Engineering and Applications (SEA 2002), Cambridge, MA, pp. 280–285 (November 2002)

    Google Scholar 

  23. Offutt, J., Wu, Y., Du, X., Huang, H.: Bypass testing of web applications. In: 15th International Symposium on Software Reliability Engineering, Saint-Malo, Bretagne, France, pp. 187–197. IEEE Computer Society Press (November 2004)

    Google Scholar 

  24. Offutt, J., Papadimitriou, V., Praphamontripong, U.: A case study on bypass testing of web applications. Springer’s Empirical Software Engineering 1–36 (July 2012) (Published online), doi:10.1007/s10664-012-9216-x

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2014 Springer International Publishing Switzerland

About this paper

Cite this paper

Thummala, S., Offutt, J. (2014). An Evaluation of the Effectiveness of the Atomic Section Model. In: Dingel, J., Schulte, W., Ramos, I., Abrahão, S., Insfran, E. (eds) Model-Driven Engineering Languages and Systems. MODELS 2014. Lecture Notes in Computer Science, vol 8767. Springer, Cham. https://doi.org/10.1007/978-3-319-11653-2_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-11653-2_3

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-11652-5

  • Online ISBN: 978-3-319-11653-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics