'Irreproducibility' is symptomatic of a broader challenge in measurement in biomedical research. From the US National Institute of Standards and Technology (NIST) perspective of rigorous metrology, reproducibility is only one aspect of establishing confidence in measurements. Appropriate controls, reference materials, statistics and informatics are required for a robust measurement process. Research is required to establish these tools for biological measurements, which will lead to greater confidence in research results.
This is a preview of subscription content, log in via an institution to check access.
References
Begley, C.G. & Ellis, L.M. Nature 483, 531–533 (2012).
Mobley, A., Linder, S.K., Braeuer, R., Ellis, L.M. & Zwelling, L. PLoS ONE 8, e63221 (2013).
Lehrer, J. The truth wears off. New Yorker (13 December 2010).
Naik, G. Scientists' elusive goal: reproducing study results. Wall Street Journal (2 December 2011).
Bhadriraju, K., Elliott, J.T., Nguyen, M. & Plant, A.L. BMC Cell Biol. 8, 43 (2007).
ANSI/ATCC. Authentication of human cell lines: standardization of STR profiling (ASN-0002-2011) (ANSI/ATCC, 2011).
Almeida, J.L., Hill, C.R. & Cole, K.D. BMC Biotechnol. 11, 102 (2011).
Almeida, J.L., Hill, C.R. & Cole, K.D. Cytotechnology 66, 133–147 (2014).
Hughes, P., Marshall, D., Reid, Y., Parkes, H. & Gelber, C. The costs of using unauthenticated, over-passaged cell lines: how much more data do we need? Biotechniques 43, 575–586 (2007).
Nardone, R.M. Biotechniques 45, 221–227 (2008).
Anonymous. Nat. Methods 10, 367 (2013).
Brazma, A. et al. Nat. Genet. 29, 365–371 (2001).
Taylor, C.F. et al. Nat. Biotechnol. 26, 889–896 (2008).
Plant, A.L., Elliott, J.T. & Bhat, T.N. BMC Bioinformatics 12, 487 (2011).
Liu, K., Hogan, W.R. & Crowley, R.S. J. Biomed. Inform. 44, 163–179 (2011).
The External RNA Controls Consortium. Nat. Methods 2, 731–734 (2005).
Zook, J.M., Samarov, D., McDaniel, J., Sen, S.K. & Salit, M. PLoS ONE 7, e41356 (2012).
Zook, J.M. et al. Nat. Biotechnol. 32, 246–251 (2014).
Wang, L. et al. Cytometry A 81, 567–575 (2012).
Wang, L. et al. Cytometry B Clin. Cytom. 72, 442–449 (2007).
Dima, A.A. et al. Cytometry A 79, 545–559 (2011).
Kharchenko, P.V., Silberstein, L. & Scadden, D.T. Nat. Methods 11, 740–742 (2014).
Brennecke, P. et al. Nat. Methods 10, 1093–1095 (2013).
Wu, A.R. et al. Nat. Methods 11, 41–46 (2014).
Grün, D., Kester, L. & van Oudenaarden, A. Nat. Methods 11, 637–640 (2014).
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Competing interests
The authors declare no competing financial interests.
Rights and permissions
About this article
Cite this article
Plant, A., Locascio, L., May, W. et al. Improved reproducibility by assuring confidence in measurements in biomedical research. Nat Methods 11, 895–898 (2014). https://doi.org/10.1038/nmeth.3076
Published:
Issue Date:
DOI: https://doi.org/10.1038/nmeth.3076
- Springer Nature America, Inc.
This article is cited by
-
Nanoparticle administration method in cell culture alters particle-cell interaction
Scientific Reports (2019)
-
The generation and use of recombinant extracellular vesicles as biological reference material
Nature Communications (2019)
-
Cell-based reference samples designed with specific differences in microRNA biomarkers
BMC Biotechnology (2018)
-
Counting Caenorhabditis elegans: Protocol Optimization and Applications for Population Growth and Toxicity Studies in Liquid Medium
Scientific Reports (2018)
-
The JBEI quantitative metabolic modeling library (jQMM): a python library for modeling microbial metabolism
BMC Bioinformatics (2017)