Abstract
Aim: Regression testing practices in industry have to be better understood, both for the industry itself and for the research community. Method: We conducted a qualitative industry survey by i) running a focus group meeting with 15 industry participants and ii) validating the outcome in an on line questionnaire with 32 respondents. Results: Regression testing needs and practices vary greatly between and within organizations and at different stages of a project. The importance and challenges of automation is clear from the survey. Conclusions: Most of the findings are general testing issues and are not specific to regression testing. Challenges and good practices relate to test automation and testability issues.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
IEEE: IEEE standard for software test documentation. IEEE Std(829-1983, Revision) (1998)
Chittimalli, P.K., Harrold, M.J.: Recomputing coverage information to assist regression testing. IEEE Transactions on Software Engineering 35(4), 452–469 (2009)
Engström, E., Runeson, P., Skoglund, M.: A systematic review on regression test selection techniques. Information and Software Technology 52(1), 14–30 (2010)
Engström, E., Runeson, P., Wikstrand, G.: An empirical evaluation of regression testing based on fix-cache recommendations. In: Proceedings of the 3rd International Conference on Software Testing Verification and Validation, pp. 75–78 (2010)
Skoglund, M., Runeson, P.: A case study of the class firewall regression test selection technique on a large scale distributed software system. In: International Symposium on Empirical Software Engineering., pp. 72–81 (2005)
White, L., Robinson, B.: Industrial real-time regression testing and analysis using firewalls. In: Proceedings 20th IEEE International Conference on Software Maintenance, pp. 18–27 (2004)
Rooksby, J., Rouncefield, M., Sommerville, I.: Testing in the wild: The social and organisational dimensions of real world practice. Computer Supported Cooperative Work (CSCW) 18(5), 559–580 (2009)
Flink, A.: The survey handbook, 2nd edn. SAGE Publications, Thousand Oaks (2003)
Onoma, A.K., Tsai, W.T., Poonawala, M.H., Suganuma, H.: Regression testing in an industrial environment: Progress is attained by looking backward. Association for Computing Machinery. Communications of the ACM 41(5), 81–86 (1998)
Causevic, A., Sundmark, D., Punnekkat, S.: An industrial survey on contemporary aspects of software testing. In: Proceedings of the 3rd International Conference on Software Testing Verification and Validation, pp. 393–401 (2010)
Grindal, M., Offutt, J., Mellin, J.: On the testing maturity of software producing organizations. In: Testing: Academia & Industry Conference-Practice And Research Techniques, TAIC/PART (2006)
Runeson, P.: A survey of unit testing practices. IEEE Software 23(4), 22 (2006)
Runeson, P., Andersson, C., Höst, M.: Test processes in software product evolution - a qualitative survey on the state of practice. Journal of Software Maintenance and Evolution: Research and Practice 15, 41–59 (2003)
Robson, C.: Real World Research, 2nd edn. Blackwell Publishing, Malden (2002)
Runeson, P., Beremark, P., Larsson, B., Lundh, E.: SPIN-syd - a non-profit exchange network. In: 1st International Workshop on Software Engineering Networking Experiences, Joensuu, Finland (2006)
Surveygizmo (December 2009) a web tool for questionnaires and polls, http://www.surveygizmo.com
Runeson, P., Höst, M.: Guidelines for conducting and reporting case study research in software engineering. Empirical Software Engineering 14(2), 131–164 (2009)
Zachman, J.A.: A framework for information systems architecture. IBM Systems Journal 26(3), 276–293 (1987)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2010 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Engström, E., Runeson, P. (2010). A Qualitative Survey of Regression Testing Practices. In: Ali Babar, M., Vierimaa, M., Oivo, M. (eds) Product-Focused Software Process Improvement. PROFES 2010. Lecture Notes in Computer Science, vol 6156. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-13792-1_3
Download citation
DOI: https://doi.org/10.1007/978-3-642-13792-1_3
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-13791-4
Online ISBN: 978-3-642-13792-1
eBook Packages: Computer ScienceComputer Science (R0)