HTAF: Hybrid Testing Automation Framework to Leverage Local and Global Computing Resources

  • Keun Soo Yim
  • David Hreczany
  • Ravishankar K. Iyer
Part of the Lecture Notes in Computer Science book series (LNCS, volume 6784)

Abstract

In web application development, testing forms an increasingly large portion of software engineering costs due to the growing complexity and short time-to-market of these applications. This paper presents a hybrid testing automation framework (HTAF) that can automate routine works in testing and releasing web software. Using this framework, an individual software engineer can easily describe his routine software engineering tasks and schedule these described tasks by using both his local machine and global cloud computers in an efficient way. This framework is applied to commercial web software development processes. Our industry practice shows four example cases where the hybrid and decentralized architecture of HTAF is helpful at effectively managing both hardware resources and manpower required for testing and releasing web applications.

Keywords

Web application testing automation tool 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Berner, S., Weber, R., Keller, R.K.: Observations and Lessons Learned from Automated Testing. In: Proceedings of the International Conference on Software Engineering, pp. 571–579 (2005)Google Scholar
  2. 2.
    Ciortea, L., Zamfir, C., Bucur, S., Chipounov, V., Candea, G.: Cloud9: a software testing service. ACM SIGOPS Operating Systems Review 43(4), 5–10 (2010)CrossRefGoogle Scholar
  3. 3.
  4. 4.
    Testing with Selenium in the cloud, http://saucelabs.com
  5. 5.
    Dave, C., Bae, H., Min, S.-J., Lee, S., Eigenmann, R., Midkiff, S.: Cetus: A Source-to-Source Compiler Infrastructure for Multicores. IEEE Computer 42(12), 36–42 (2009)CrossRefGoogle Scholar
  6. 6.
    Ferrari, F.C., Nakagawa, E.Y., Rashid, A., Maldonado, J.C.: Automating the Mutation Testing of Aspect-Oriented Java Programs. In: Proceedings of the International Workshop on Automation of Software Test, pp. 51–58 (2010)Google Scholar
  7. 7.
    Ghemawat, S., Gobioff, H., Leung, S.-T.: The Google file system. In: Proceedings of the ACM Symposium on Operating Systems Principles, pp. 29–43 (2003)Google Scholar
  8. 8.
    Grechanik, M., Xie, Q., Fu, C.: Maintaining and Evolving GUI-Directed Test Scripts. In: Proceedings of the International Conference on Software Engineering, pp. 408–418 (2009)Google Scholar
  9. 9.
    Horgan, J.R., London, S., Lyu, M.R.: Achieving Software Quality with Testing Coverage Measures. IEEE Computer 27(9), 60–69 (1994)CrossRefGoogle Scholar
  10. 10.
    Jovic, M., Adamoli, A., Zaparanuks, D., Hauswirth, M.: Automating Performance Testing of Interactive Java Applications. In: Proceedings of the International Workshop on Automation of Software Test, pp. 8–15 (2010)Google Scholar
  11. 11.
    JSCoverage: Code Coverage for JavaScript, http://siliconforks.com/jscoverage
  12. 12.
    Karhu, K., Repo, T., Taipale, O., Smolander, K.: Empirical Observations on Software Testing Automation. In: Proceedings of the IEEE International Conference on Software Testing Verification and Validation, pp. 201–209 (2009)Google Scholar
  13. 13.
    Kereki, F.: Essential GWT: Building for the Web with Google Web Toolkit 2. Addison-Wesley, Reading (2010)Google Scholar
  14. 14.
    Kim, E.H., Na, J.C., Ryoo, S.M.: Implementing an Effective Test Automation Framework. In: Proceedings of the IEEE Intl. Computer Software and Applications Conference, pp. 534–538 (2009)Google Scholar
  15. 15.
    Lee, J.-h., Kim, S., Ryu, C., Kim, D., Lee, C.-H.: A Test Automation of a Full Software Stack on Virtual Hardware-based Simulator. In: Proceedings of the International Conference on Computer Sciences and Convergence Information Technology, pp. 37–39 (2009)Google Scholar
  16. 16.
    Yu, W.D., Patil, G.: A Workflow-Based Test Automation Framework for Web Based Systems. In: Proceedings of the IEEE Symposium on Computers and Communications, pp. 333–339 (2007)Google Scholar
  17. 17.
    The Open Group, TETware – White Paper (Test Environment Toolkit), http://tetworks.opengroup.org/
  18. 18.
    Ousterhoust, J.: Scripting: Higher Level Programming for the 21st Century. IEEE Computer 31(3), 23–30 (1998)CrossRefGoogle Scholar
  19. 19.
    Petschenik, N.H.: Building Awareness of System Testing Issues. In: Proceedings of the International Conference on Software Engineering, pp. 183–188 (1985)Google Scholar
  20. 20.
  21. 21.
    Ramler, R., Wolfmaier, K.: Economic Perspectives in Test Automation: Balancing Automated and Manual Testing with Opportunity Cost. In: Proceedings of the International Workshop on Automation of Software Test, pp. 85–91 (2006)Google Scholar
  22. 22.
    Rankin, C.: The Software Testing Automation Framework. IBM Systems J. 41(1), 126–139 (2002)CrossRefGoogle Scholar
  23. 23.
    Richardson, D.J.: TAOS: Testing with Oracles and Analysis Support. In: Proceedings of the International Software Testing and Analysis, pp. 138–153 (1994)Google Scholar
  24. 24.
    Selenium web application testing system, http://seleniumhq.org
  25. 25.
    Sun, Y., Jones, E.L.: Specification-Driven Automated Testing of GUI-Based Java Programs. In: Proceedings of the ACM Southeast Conference, pp. 140–145 (2004)Google Scholar
  26. 26.
    Tikir, M.M., Hollingsworth, J.K.: Efficient instrumentation for code coverage testing. In: Proceedings of the International Software Testing and Analysis, pp. 86–96 (2002)Google Scholar
  27. 27.
    Underwriters Labs, http://www.ul.com
  28. 28.
    Zhifang, L., Bin, L., Xiaopeng, G.: Test Automation on Mobile Device. In: Proceedings of the International Workshop on Automation of Software Test, pp. 1–7 (2010)Google Scholar
  29. 29.
    Vogel, P.A.: An Integrated General Purpose Automated Test Environment. In: Proceedings of the International Software Testing and Analysis, pp. 61–69 (1993)Google Scholar
  30. 30.
    Vosloo, I., Kourie, D.G.: Server-centric Web frameworks: An overview. ACM Computing Surveys 40(2), article 4 (2008)Google Scholar
  31. 31.
    Wandan, Z., Ningkang, J., Xubo, Z.: Design and Implementation of a Web Application Automation Testing Framework. In: Proceedings of the IEEE International Conference on Hybrid Intelligent Systems, pp. 316–318 (2009)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Keun Soo Yim
    • 1
  • David Hreczany
    • 2
  • Ravishankar K. Iyer
    • 1
  1. 1.University of Illinois at Urbana-ChampaignUrbanaUSA
  2. 2.Google Inc.KirklandUSA

Personalised recommendations