Quantifying uncertainty in predictions of invasiveness, with emphasis on weed risk assessment Article Received: 25 February 2004 Accepted: 06 September 2004 DOI:
Cite this article as: Caley, P., Lonsdale, W.M. & Pheloung, P.C. Biol Invasions (2006) 8: 1595. doi:10.1007/s10530-004-0010-6 Abstract
Using the Australian Weed Risk Assessment (WRA) model as an example, we applied a combination of bootstrapping and Bayesian techniques as a means of explicitly estimating the posterior probability of weediness as a function of an import risk assessment model screening score. Our approach provides estimates of uncertainty around model predictions, after correcting for verification bias arising from the original training dataset having a higher proportion of weed species than would be the norm, and incorporates uncertainty in current knowledge of the prior (base-rate) probability of weediness. The results confirm the high sensitivity of the posterior probability of weediness to the base-rate probability of weediness of plants proposed for importation, and demonstrate how uncertainty in this base-rate probability manifests itself in uncertainty surrounding predicted probabilities of weediness. This quantitative estimate of the weediness probability posed by taxa classified using the WRA model, including estimates of uncertainty around this probability for a given WRA score, would enable bio-economic modelling to contribute to the decision process, should this avenue be pursued. Regardless of whether or not this avenue is explored, the explicit estimates of uncertainty around weed classifications will enable managers to make better informed decisions regarding risk. When viewed in terms of likelihood of weed introduction, the current WRA model outcomes of ‘accept’, ‘further evaluate’ or ‘reject’, whilst not always accurate in terms of weed classification, appear consistent with a high-expected cost of mistakenly introducing a weed. The methods presented have wider application to the quantitative prediction of invasive species for situations where the base-rate probability of invasiveness is subject to uncertainty, and the accuracy of the screening test imperfect.
Keywords Bayesian bootstrapping decision support invasion prediction modelling uncertainty risk assessment
An erratum to this article is available at
. http://dx.doi.org/10.1007/s10530-007-9107-z References Begg, CB, Greenes, RA 1983 Assessment of diagnostic tests when disease verification is subject to selection bias Biometrics 39 207 215 PubMed CrossRef Google Scholar Burnham, KP, Anderson, DR 2002Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach Springer-Verlag New York Google Scholar Daehler, CC, Carino, DA 2000 Predicting invasive plants: prospects for a general screening system based on current regional models Biological Invasions 2 93 102 CrossRef Google Scholar Daehler, CC, Denslow, JS, Ansari, S, Kuo, H-C 2004 A risk-assessment system for screening out invasive pest plants from Hawaii and other Pacific islands Conservation Biology 18 360 368 CrossRef Google Scholar Duncan, RP, Williams, PA 2002a Darwin’s naturalization hypothesis challenged Nature 417 608 609 CrossRef Google Scholar Duncan, RP, Williams, PA 2002b Taxonomic patterns in the naturalisation rate of plant species in New Zealand Spafford Jacob, H Dodd, J Moore, JH eds. Thirteenth Australian Weeds Conference Plant Protection Society of Western Australia Perth, Western Australia 183 185 Google Scholar Efron, B, Tibshirani, RJ 1993An Introduction to the Bootstrap Chapman and Hall New York Google Scholar Ewel, JJ, O’Dowd, DJ, Bergelson, J, Daehler, CC, D’Antonio, CM, Gomez, LD, Gordon, DR, Hobbs, RJ, Holt, A, Hopper, KR, Hughes, CE, LaHart, M, Leakey, RRB, Lee, WG, Loope, LL, Lorence, DH, Louda, SM, Lugo, AE, McEvoy, PB, Richardson, DM, Vitousek, PM 1999 Deliberate introductions of species: research needs BioScience 49 619 630 CrossRef Google Scholar Gigerenzer, G 2002Calculated Risks: How to Know When Numbers Deceive You Simon and Schuster New York Google Scholar Heger, T, Trepl, L 2003 Predicting biological invasions Biological Invasions 5 313 321 CrossRef Google Scholar Hughes, G, Madden, LV 2003 Evaluating predictive models with application in regulatory policy for invasive weeds Agricultural Systems 76 755 774 CrossRef Google Scholar Kohavi, R 1995 A study of cross-validation and bootstrap for accuracy estimation and model selection Mellish, CS eds. Proceedings of the Fourteenth International Joint Conference on Artificial Intelligence Morgan Kaufmann Publishers, Inc. Montreal, Quebec 1137 1143 Google Scholar Kolar, CS, Lodge, DM 2001 Progress in invasion biology: predicting invaders Trends in Ecology and Evolution 16 199 204 PubMed CrossRef Google Scholar Kolar, CS, Lodge, DM 2002 Ecological predictions and risk assessment for alien fishes in North America Science 298 1233 1236 PubMed CrossRef Google Scholar Kuhnert, PM, Mengersen, K 2003 Reliability measures for local nodes assessment in classification trees Journal of Computational and Graphical Studies 12 1 19 CrossRef Google Scholar Lonsdale, WM 1994 Inviting trouble: introduced pasture species in northern Australia Australian Journal of Ecology 19 345 354 CrossRef Google Scholar Mack, RN, Simberloff, D, Lonsdale, WM, Evans, H, Clout, M, Bazzaz, FA 2000 Biotic invasions: causes, epidemiology, global consequences, and control Ecological Applications 10 689 710 CrossRef Google Scholar Manel, S, Williams, HC, Ormerod, SJ 2001 Evaluating presence–absence models in ecology: the need to account for prevalence Journal of Applied Ecology 38 921 931 CrossRef Google Scholar Matthews, RAJ 1996 Base-rate errors and rain forecasts Nature 382 766 CrossRef Google Scholar Matthews, RAJ 1997 Decision-theoretic limits on earthquake prediction Geophysics Journal International 131 526 529 Google Scholar Metz, CE 1978 Basic principles of ROC analysis Seminars in Nuclear Medicine 8 283 298 PubMed Google Scholar Pearce, J, Ferrier, S 2000 Evaluating the predictive performance of habitat models developed using logistic regression Ecological Modelling 133 225 245 CrossRef Google Scholar Pheloung, PC, Williams, PA, Halloy, SR 1999 A weed risk assessment model for use as a biosecurity tool evaluating plant introductions Journal of Environmental Management 57 239 251 CrossRef Google Scholar Pimentel, DL, Lach, L, Zuniga, R, Morrison, D 2000 Environmental and economic costs associated with non-indigenous species in the United States BioScience 50 53 65 CrossRef Google Scholar Reichard, SH, Hamilton, CW 1997 Predicting invasions of woody plants introduced into North America Conservation Biology 11 193 203 CrossRef Google Scholar Richardson, DM, Pysek, P, Rejmanek, M, Barbour, MG, Panetta, FD, West, CJ 2000 Naturalization and invasion of alien plants: concepts and definitions Diversity and Distributions 6 93 107 CrossRef Google Scholar Ruesink, JL, Parker, IM, Groom, MJ, Kareiva, PM 1995 Reducing the risks of nonindigenous species introductions: guilty until proven innocent BioScience 45 465 477 CrossRef Google Scholar Scott, JK, Panetta, FD 1993 Predicting the Australian weed status of southern African plants Journal of Biogeography 20 87 93 CrossRef Google Scholar
Smith C (1999) Studies on Weed Risk Assessment. Master of Applied Science, University of Adelaide
Smith, CS, Lonsdale, WM, Fortune, J 1999 When to ignore advice: invasion predictions and decision theory Biological Invasions 1 89 96 CrossRef Google Scholar United States National Research Council 2002Predicting Invasions of Nonindigenous Plants and Plant Pests National Academy Press Washington, D.C Google Scholar Vose, D 2000Risk Analysis: A Quantitative Guide John Wiley and Sons Chichester, West Sussex Google Scholar Williamson, M, Fitter, A 1996 The varying success of invaders Ecology 77 1661 1665 CrossRef Google Scholar