The Power and the Pitfalls of Large-scale, Unreplicated Natural Experiments
- 1.1k Downloads
Large-scale, unreplicated natural experiments (LUNEs) have a unique power to test hypotheses at ecologically realistic scales and have delivered insights of great power into cosmology, evolution and geology. Yet, LUNEs are relatively rare in the field of ecology and continue to meet resistance due to their lack of replication. However, in the vast majority of cases, large-scale experiments cannot be replicated for practical and ethical reasons. Here, we make the case that LUNEs have had a disproportionately positive effect on conservation policy and are a crucial next step in the extrapolation of our understanding of ecological processes from small-scale experiments to relevant scales, particularly in the context of the current “replication crisis” affecting many sciences. Greater inclusion of LUNEs in mainstream ecology will help humanity to solve global problems as human transformation of the planet accelerates in coming decades.
Keywordsecosystem scale ecological processes large-scale experiment natural experiment pseudo-experiment replication
We would like to thank the University of Western Australia, Perth, which partly funded this research via an International Postgraduate Research Scholarship to SB.
- Bence JR, Stewart-Oaten A, Schroeter SC. 1996. Estimating the size of an effect from a before-after-control impact paired series design. In: Russell J, Schmitt CWO, Eds. Detecting ecological impacts: concepts and applications in coastal habitats. San Diego: Academic Press.Google Scholar
- Edgar G, Stuart-Smith R, Willis T, Kininmonth S, Baker S, Banks S, Barrett N, Becerro M, Bernard A, Berkhout J, Buxton C, Campbell S, Cooper A, Davey M, Edgar S, Försterra G, Galván D, Irigoyen A, Kushner D, Moura R, Parnell P, Shears N, Soler G, Strain E, Thomson R. 2014. Global conservation outcomes depend on marine protected areas with five key features. Nature 506:216–20.CrossRefPubMedGoogle Scholar
- Ehrlich PR, Ehrlich AH. 2013. Can a collapse of global civilization be avoided? Proc Biol Sci 280:1–9.Google Scholar
- Estes JA, Terborgh J, Brashares JS, Power ME, Berger J, Bond WJ, Carpenter SR, Essington TE, Holt RD, Jackson JBC, Marquis RJ, Oksanen L, Oksanen T, Paine RT, Pikitch EK, Ripple WJ, Sandin SA, Scheffer M, Schoener TW, Shurin JB, Sinclair ARE, Soulé ME, Virtanen R, Wardle DA. 2011. Trophic downgrading of planet Earth. Science 333:301–6.CrossRefPubMedGoogle Scholar
- Fisher RA. 1926. The arrangement of field experiments. J Minist Agri 33:503–13.Google Scholar
- Gabric AJ, Cropp R, McTainsh G, Butler H, Johnston BM, O’Loingsigh T, Van Tran D. 2015. Tasman Sea biological response to dust storm events during the austral spring of 2009. Marine and Freshwater Research 9999.Google Scholar
- Grubbs RD, Carlson JK, Romine JG, Curtis TH, McElroy WD, McCandless CT, Musick CFC& JA. 2016. Critical assessment and ramifications of a purported marine trophic cascade. Sci Rep:20970.Google Scholar
- Ioannidis JPA. 2005. Why most published research findings are false. PLoS Med 2:0696–701.Google Scholar
- Johnson DH. 2006. The many faces of replication. In: Crop science. Vol. 46. pp 2486–91.Google Scholar
- Knowlton N. 1992. Thresholds and multiple stable states in coral reef community dynamics. Am Zool 32:674–82. http://www.jstor.org/stable/pdfplus/3883648.pdf.
- Kreyling J, Jentsch A, Beier C. 2014. Beyond realism in climate change experiments: gradient approaches identify thresholds and tipping points. Ecol Lett 17:125–8. http://doi.wiley.com/10.1111/ele.12193.
- McArdle BH. 1996. Levels of evidence in studies of competition, predation, and disease. N. Z. J Ecol 20:7–15.Google Scholar
- McNutt M. 2014. Reproducibility. Science (New York) 343:229. http://www.sciencemag.org/content/343/6168/229.short.
- Micheli F. 1999. Eutrophication, fisheries, and consumer-resource dynamics in marine pelagic ecosystems. Science (New York, NY) 285:1396–8Google Scholar
- Morrisette PM. 1989. The Evolution of Policy Responses to Stratospheric Ozone Depletion. Nat Res J 29:793–820.Google Scholar
- Nosek BA, Alter G, Banks GC, Borsboom D, Bowman SD, Breckler SJ, Buck S, Chambers CD, Chin G, Christensen G, Contestabile M, Dafoe A, Eich E, Freese J, Glennerster R, Goroff D, Green DP, Hesse B, Humphreys M, Ishiyama J, Karlan D, Kraut A, Lupia A, Mabry P, Madon TA, Malhotra N, Mayo-Wilson E, McNutt M, Miguel E, Paluck EL, Simonsohn U, Soderberg C, Spellman BA, Turitto J, VandenBos G, Vazire S, Wagenmakers EJ, Wilson R, Yarkoni T. 2015. Promoting an open research culture. Science 348:1422–5.CrossRefPubMedPubMedCentralGoogle Scholar
- Pauly D, Christensen V, Dalsgaard J, Froese R, Torres F. 1998. Fishing down marine food webs. Science (New York, NY) 279:860–3. http://www.ncbi.nlm.nih.gov/pubmed/9452385.
- Power ME, Dietrich WE, Sullivan KO. 1998. Experiment, observation, and inference in river and watershed investigations. In: Bernardo J, Resetarits WJ, Eds. Experimental ecology: issues and perspectives. Oxford: Oxford University Press. p 113–32.Google Scholar
- Ritsema J, Van Heijst HJ. 2000. Seismic imaging of structural heterogeneity in Earth’s mantle: evidence for large-scale mantle flow. Science progress 83.Google Scholar
- Rogers H, HilleRisLambers J, Miller R, Tewksbury J. 2012. ‘Natural experiment’ demonstrates top-down control of spiders by birds on a landscape level. PLoS One 7:1–8.Google Scholar
- Sarnelle O. 1997. Daphnia effects on microzooplankton: comparisons of enclosure and whole-lake responses. Ecology 78:913–28.Google Scholar
- Schindler DW, Hecky RE, Findlay DL, Stainton MP, Parker BR, Paterson MJ, Beaty KG, Lyng M, Kasian SEM. 2008. Eutrophication of lakes cannot be controlled by reducing nitrogen input: results of a 37-year whole-ecosystem experiment. Proc Natl Acad Sci U. S. A. 105:11254–8.CrossRefPubMedPubMedCentralGoogle Scholar
- Weimin X, Peet RK. 2011. The complexity of catastrophic wind impacts on temperate forest. In: Lupo A, Ed. Recent hurricane research - climate, dynamics, and societal impacts. InTech. pp 503–34.Google Scholar
- Worm B, Paine RT. 2016. Humans as a hyperkeystone species. Trends in Ecology and Evolution2.Google Scholar