Abstract
Society increasingly depends on web applications for business and pleasure. As the use of web applications continues to increase, the number of failures, some minor and some major, continues to grow. A significant problem is that we still have relatively weak abilities to test web applications. Traditional testing techniques do not adequately model or test these novel technologies. The atomic section model (ASM), models web applications to support design, analysis, and testing. This paper presents an empirical study to evaluate the effectiveness of the ASM. The model was implemented into a tool, WASP, which extracts the ASM from the implementation and supports various test criteria. We studied ten web applications, totaling 156 components and 11,829 lines of code. Using WASP, we generated 207 tests, which revealed 31 faults.Seventeen of those faults exposed internal information about the application and server.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Offutt, J.: Quality attributes of Web software applications. IEEE Software: Special Issue on Software Engineering of Internet Software 19(2), 25–32 (2002)
comScore: 2012 U.S. online holiday spending grows 14 percent vs. year ago to 42.3 billion dollars (January 2013), http://www.comscore.com/ (last access: June 2014)
LogiGear: The seven most stunning website failures of 2011 (2012), http://www.logigear.com/magazine/issue/past-articles/the-seven-most-stunning-website-failures-of-2011/ (last access: June 2014)
Clay, K.: Amazon.com goes down, loses $66,240 per minute (2013), http://www.forbes.com/sites/kellyclay/2013/08/19/amazon-com-goes-down-loses-66240-per-minute/ (last access: March 2014)
Ford, P.: The obamacare website didn’t have to fail. How to do better next time. Bloomberg Businessweek Technology (October 2013), http://www.graphviz.org/ (last access: June 2014)
Offutt, J., Wu, Y.: Modeling presentation layers of web applications for testing. Software and Systems Modeling 9(2), 257–280 (2010)
Ammann, P., Offutt, J.: Introduction to Software Testing. Cambridge University Press, Cambridge (2008) ISBN 978-0-521-88038-1
Parr, T.: Antlr parser generator (2003), http://www.antlr.org/ (ast access: June 2014)
Software, O.S.: Graphviz, http://www.graphviz.org/ (last access: March 2014)
Ammann, P., Offutt, J., Xu, W., Li, N.: Graph coverage web applications (2008), http://cs.gmu.edu:8080/offutt/coverage/GraphCoverage (last access: March 2014)
Hower, R.: Web site test tools and site management tools (2002), http://www.softwareqatest.com/qatweb1.html
Kung, D., Liu, C.H., Hsia, P.: An object-oriented Web test model for testing Web applications. In: 24th Annual International Computer Software and Applications Conference (COMPSAC 2000), Taipei, Taiwan, pp. 537–542. IEEE Computer Society Press (October 2000)
Liu, C.H., Kung, D., Hsia, P., Hsu, C.T.: Structural testing of Web applications. In: Proceedings of the 11th International Symposium on Software Reliability Engineering, San Jose CA, pp. 84–96. IEEE Computer Society Press (October 2000)
Halfond, W.G.J., Orso, A.: Improving test case generation for web applications using automated interface discovery. In: Proceedings of the Foundations of Software Engineering, Dubrovnik, Croatia, pp. 145–154 (2007)
Lucca, G.A.D., Penta, M.D.: Considering browser interaction in web application testing. In: 5th International Workshop on Web Site Evolution (WSE 2003), Amsterdam, The Netherlands, pp. 74–84. IEEE Computer Society Press (September 2003)
Andrews, A., Offutt, J., Alexander, R.: Testing Web applications by modeling with FSMs. Software and Systems Modeling 4(3), 326–345 (2005)
Andrews, A., Offutt, J., Dyreson, C., Mallery, C.J., Jerath, K., Alexander, R.: Scalability issues with using FSMWeb to test web applications. Information and Software Technology 52(1), 52–66 (2010)
Benedikt, M., Freire, J., Godefroid, P.: VeriWeb: Automatically testing dynamic Web sites. In: Proceedings of 11th International World Wide Web Conference (WWW 2002) – Alternate Paper Tracks (WE-3 Web Testing and Maintenance), Honolulu, HI, pp. 654–668 (May 2002)
Elbaum, S., Rothermel, G., Karre, S., Fisher, M.: Leveraging user-session data to support web application testing. IEEE Transactions on Software Engineering 31(3), 187–202 (2005)
Alshahwan, N., Harman, M.: Automated repair of session data to improve web application regression testing. In: 1st IEEE International Conference on Software Testing, Verification and Validation (ICST 2008 Industry Track), Lillehammer, Norway, pp. 298–307 (April 2008)
Lee, S.C., Offutt, J.: Generating test cases for XML-based Web component interactions using mutation analysis. In: Proceedings of the 12th International Symposium on Software Reliability Engineering, Hong Kong China, pp. 200–209. IEEE Computer Society Press (November 2001)
Jia, X., Liu, H.: Rigorous and automatic testing of Web applications. In: 6th IASTED International Conference on Software Engineering and Applications (SEA 2002), Cambridge, MA, pp. 280–285 (November 2002)
Offutt, J., Wu, Y., Du, X., Huang, H.: Bypass testing of web applications. In: 15th International Symposium on Software Reliability Engineering, Saint-Malo, Bretagne, France, pp. 187–197. IEEE Computer Society Press (November 2004)
Offutt, J., Papadimitriou, V., Praphamontripong, U.: A case study on bypass testing of web applications. Springer’s Empirical Software Engineering 1–36 (July 2012) (Published online), doi:10.1007/s10664-012-9216-x
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Thummala, S., Offutt, J. (2014). An Evaluation of the Effectiveness of the Atomic Section Model. In: Dingel, J., Schulte, W., Ramos, I., Abrahão, S., Insfran, E. (eds) Model-Driven Engineering Languages and Systems. MODELS 2014. Lecture Notes in Computer Science, vol 8767. Springer, Cham. https://doi.org/10.1007/978-3-319-11653-2_3
Download citation
DOI: https://doi.org/10.1007/978-3-319-11653-2_3
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-11652-5
Online ISBN: 978-3-319-11653-2
eBook Packages: Computer ScienceComputer Science (R0)