Skip to main content
Log in

The role of replications in empirical software engineering—a word of warning

  • Viewpoint
  • Published:
Empirical Software Engineering Aims and scope Submit manuscript

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.


  • Kampenes V (2007) Quality of design, analysis and reporting of software engineering experiments a systematic review. Ph.D. Thesis, Department of Informatics, University of Oslo, Norway

  • Kitchenham BA, Mendes E, Travassos GH (2007) Cross versus within-company cost estimation studies: a systematic review. IEEE Trans Softw Eng 33(5):316–329

    Article  Google Scholar 

  • Shaddish WR, Cook TD, Campbell TD (2002) Experimental and quasi-experimental designs for generalized casual inference. Houghton Mifflin Company, Boston, MA

    Google Scholar 

  • Sjøberg DIK, Hannay JE, Hansen O, By Kampenes V, Karahasanovic A, Liborg N-K, Rekdal AC (2005) A survey of controlled experiments in software engineering. IEEE Trans Softw Eng 31(9):733–753

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations


Corresponding author

Correspondence to Barbara Kitchenham.

Additional information

Editor: Claes Wohlin

Rights and permissions

Reprints and permissions

About this article

Cite this article

Kitchenham, B. The role of replications in empirical software engineering—a word of warning. Empir Software Eng 13, 219–221 (2008).

Download citation

  • Published:

  • Issue Date:

  • DOI: