Abstract
For most XP techniques only a few experimental results on their effects are available. In October 2004 we started a medium-term experiment to investigate the impact of test-first compared to a classical-testing approach. We carefully designed a controlled experiment and conducted it with 18 graduated students randomly assigned to 9 pairs. Hypotheses dealt with development speed, number of test-cases and the test-coverage when applying the testing approaches. Results show differences however not significant ones. This paper also addresses other observations we made during the experimental run. Two major problems strongly affect the results of the experiment: the low number of data points and the non-trivial question, whether students really applied test-first all the time. Although we cannot provide any new results on testing to the research community, this paper contains valuable information about further experimental studies on this topic.
This is a preview of subscription content, access via your institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Beck, K.: Extreme Programming Explained. Addison-Wesley, Reading (2000)
Flohr, T., Schneider, T.: An XP Experiment with Students - Setup and Problems. In: Bomarius, F., Komi-Sirviö, S. (eds.) PROFES 2005. LNCS, vol. 3547, pp. 474–486. Springer, Heidelberg (2005)
Basili, V., Caldiera, G., Rombach, H.: Goal question metric paradigm. In: Marciniak, J.J. (ed.) Encyclopedia of Software Engineering, pp. 528–532. John Wiley & Sons, New York (1994)
Basili, V.R., Shull, F., Lanubile, F.: Building Knowledge through Families of Experiments. IEEE Transactions on Software Engineering 25 (1999)
Müller, M.M., Tichy, W.F.: Case Study: Extreme Programming in a University Environment. In: International Conference on Software Engineering, Toronto, Ontario, Canada. IEEE Computer Society, Los Alamitos (2001)
Noll, J., Atkinson, D.C.: Comparing Extreme Programming to Traditional Development for Student Projects: A Case Study. In: Marchesi, M., Succi, G. (eds.) XP 2003. LNCS, vol. 2675. Springer, Heidelberg (2003)
Lindvall, M., et al.: Empirical Findings in Agile Methods. In: Wells, D., Williams, L. (eds.) XP 2002. LNCS, vol. 2418, p. 197. Springer, Heidelberg (2002)
Müller, M.M., Hagner, O.: Experiment about Test-first programming. IEEE Proceedings Software 149(5) (2002)
Hulkko, H., Abrahamsson, P.: A multiple case study on the impact of pair programming on product quality. In: Inverardi, P., Jazayeri, M. (eds.) ICSE 2005. LNCS, vol. 4309. Springer, Heidelberg (2006)
Wohlin, C., et al.: Experimentation In Software Engineering: An Introduction. Kluwer Academic Publishers, Dordrecht (2000)
Schneider, K., Lübke, D.: Systematic Tailoring of Quality Techniques. In: 3rd World Congress for Software Quality, Munich, Germany (2005)
Gamma, E., Beck, K.: JUnit framework, http://www.junit.org/index.htm
Clover Code Coverage for Java, http://www.cenqua.com/clover/
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2006 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Flohr, T., Schneider, T. (2006). Lessons Learned from an XP Experiment with Students: Test-First Needs More Teachings. In: Münch, J., Vierimaa, M. (eds) Product-Focused Software Process Improvement. PROFES 2006. Lecture Notes in Computer Science, vol 4034. Springer, Berlin, Heidelberg. https://doi.org/10.1007/11767718_26
Download citation
DOI: https://doi.org/10.1007/11767718_26
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-540-34682-1
Online ISBN: 978-3-540-34683-8
eBook Packages: Computer ScienceComputer Science (R0)