Behavioral Ecology and Sociobiology

, Volume 65, Issue 1, pp 77–89

Model selection and model averaging in behavioural ecology: the utility of the IT-AIC framework

  • Shane A. Richards
  • Mark J. Whittingham
  • Philip A. Stephens
Original Paper

Abstract

Behavioural ecologists often study complex systems in which multiple hypotheses could be proposed to explain observed phenomena. For some systems, simple controlled experiments can be employed to reveal part of the complexity; often, however, observational studies that incorporate a multitude of causal factors may be the only (or preferred) avenue of study. We assess the value of recently advocated approaches to inference in both contexts. Specifically, we examine the use of information theoretic (IT) model selection using Akaike’s information criterion (AIC). We find that, for simple analyses, the advantages of switching to an IT-AIC approach are likely to be slight, especially given recent emphasis on biological rather than statistical significance. By contrast, the model selection approach embodied by IT approaches offers significant advantages when applied to problems of more complex causality. Model averaging is an intuitively appealing extension to model selection. However, we were unable to demonstrate consistent improvements in prediction accuracy when using model averaging with IT-AIC; our equivocal results suggest that more research is needed on its utility. We illustrate our arguments with worked examples from behavioural experiments.

Keywords

Effect size Inference Model weighting Null hypotheses Process-based models Statistics 

References

  1. Anderson DR, Burnham KP, Thompson WL (2000) Null hypothesis testing: problems, prevalence, and an alternative. J Wildl Manage 64:912–923CrossRefGoogle Scholar
  2. Bolker BM (2008) Ecological models and data in R. Princeton University Press, PrincetonGoogle Scholar
  3. Buckland ST, Burnham KP, Augustin NH (1997) Model selection: an integral part of inference. Biometrics 53:603–618CrossRefGoogle Scholar
  4. Burnham KP, Anderson DR (2001) Kullback–Leibler information as a basis for strong inference in ecological studies. Wildlife Res 28:111–119CrossRefGoogle Scholar
  5. Burnham KP, Anderson DR (2002) Model selection and multimodel inference: a practical information-theoretic approach, 2nd edn. Springer, New YorkGoogle Scholar
  6. Burnham KP, Anderson DR, Huyvaert K (2010) AICc model selection in ecological and behavioral science: some background, observations, and comparisons. Behavioral Ecology & Sociobiology. doi:10.1007/s00265-010-1029-6
  7. Cohen J (1994) The earth is round (P < .05). Am Psychol 49:997–1003CrossRefGoogle Scholar
  8. Freckleton RP (2010) Dealing with collinearity in behavioural and ecological data: model averaging and the problems of measurement error. Behavioral Ecology & Sociobiology. doi:10.1007/s00265-010-1045-6
  9. Garamszegi LZ (2010) Information-theoretic approaches to statistical analysis in behavioural ecology: an introduction. Behavioral Ecology & Sociobiology. doi:10.1007/s00265-010-1028-7
  10. Gurney WSC, Nisbet RM (1998) Ecological dynamics. Oxford University Press, OxfordGoogle Scholar
  11. Hegyi G, Garamszegi LZ (2010) Using information theory as a substitute for stepwise regression in ecology and behavior. Behavioral Ecology & Sociobiology (in press)Google Scholar
  12. Heyes CM, Dawson GR (1990) A demonstration of observational-learning in rats using a bidirectional control. Q J Exp Psychol B 42:59–71PubMedGoogle Scholar
  13. Hilborn R, Mangel M (1997) The ecological detective: confronting models with data, vol 28. Princeton University Press, PrincetonGoogle Scholar
  14. Hobbs NT, Hilborn R (2006) Alternatives to statistical hypothesis testing in ecology: a guide to self teaching. Ecol Appl 16:5–19PubMedCrossRefGoogle Scholar
  15. Hu B, Shao J (2008) Generalized linear model selection using R 2. J Stat Plan Inference 138:3705–3712CrossRefGoogle Scholar
  16. Johnson DH (1999) The insignificance of statistical significance testing. J Wildl Manage 63:763–772CrossRefGoogle Scholar
  17. Johnson JB, Omland KS (2004) Model selection in ecology and evolution. Trends Ecol Evol 19:101–108PubMedCrossRefGoogle Scholar
  18. Krebs JR, Davies NB (1978) Behavioural ecology: an evolutionary approach. Blackwell, OxfordGoogle Scholar
  19. Lind J, Cresswell W (2005) Determining the fitness consequences of antipredation behavior. Behav Ecol 16:945–956CrossRefGoogle Scholar
  20. Lukacs PM, Thompson WL, Kendall WL, Gould WR, Doherty PF, Burnham KP, Anderson DR (2007) Concerns regarding a call for pluralism of information theory and hypothesis testing. J Appl Ecol 44:456–460CrossRefGoogle Scholar
  21. Martin TG, Wintle BA, Rhodes JR, Kuhnert PM, Field SA, Low-Choy SJ, Tyre AJ, Possingham HP (2005) Zero tolerance ecology: improving ecological inference by modelling the source of zero observations. Ecol Lett 8:1235–1246CrossRefGoogle Scholar
  22. Martinez-Abrain A (2007) Are there any diffferences? A non-sensical question in ecology. Acta Oecol 32:203–206CrossRefGoogle Scholar
  23. McCarthy MA (2007) Bayesian methods for ecology. Cambridge University Press, CambridgeGoogle Scholar
  24. Mitchell CJ, Heyes CM, Gardner MR, Dawson GR (1999) Limitations of a bidirectional control procedure for the investigation of imitation in rats: odour cues on the manipulandum. Q J Exp Psychol B 52:193–202Google Scholar
  25. Mundry R (2010) Issues in information theory based statistical inference—a commentary from a frequentist's perspective. Behavioral Ecology & Sociobiology. doi:10.1007/s00265-010-1040-y
  26. Nakagawa S, Cuthill IC (2007) Effect size, confidence interval and statistical significance: a practical guide for biologists. Biol Rev 82:591–605PubMedCrossRefGoogle Scholar
  27. Nakagawa S, Freckleton RP (2008) Missing inaction: the dangers of ignoring missing data. Trends Ecol Evol 23:592–596PubMedCrossRefGoogle Scholar
  28. Nakagawa S, Freckleton RP (2010) Model averaging, missing data and multiple imputation: a case study for behavioural ecology. Behavioral Ecology & Sociobiology. doi:10.1007/s00265-010-1044-7
  29. R Development Core Team (2005) R: a language and environment for statistical computing. R Foundation for Statistical Computing, ViennaGoogle Scholar
  30. Richards SA (2005) Testing ecological theory using the information-theoretic approach: examples and cautionary results. Ecology 86:2805–2814CrossRefGoogle Scholar
  31. Richards SA (2008) Dealing with overdispersed count data in applied ecology. J Appl Ecol 45:218–227CrossRefGoogle Scholar
  32. Rogers D (1972) Random search and insect population models. J Anim Ecol 41:369–383CrossRefGoogle Scholar
  33. Ruxton GD, Colegrave N (2006) Experimental design for the life sciences, 2nd edn. Oxford University Press, OxfordGoogle Scholar
  34. Schielzeth H, Forstmeier W (2009) Conclusions beyond support: overconfident estimates in mixed models. Behavioral Ecology 20:416–420PubMedCrossRefGoogle Scholar
  35. Stephens PA, Buskirk SW, Hayward GD, Martinez del Rio C (2005) Information theory and hypothesis testing: a call for pluralism. J Appl Ecol 42:4–12CrossRefGoogle Scholar
  36. Stephens PA, Buskirk SW, Hayward GD, Del Rio CM (2007a) A call for statistical pluralism answered. J Appl Ecol 44:461–463CrossRefGoogle Scholar
  37. Stephens PA, Buskirk SW, Martinez del Rio C (2007b) Inference in ecology and evolution. Trends Ecol Evol 22:192–197PubMedCrossRefGoogle Scholar
  38. van de Pol MV, Wright J (2009) A simple method for distinguishing within- versus between-subject effects using mixed models. Anim Behav 77:753–758CrossRefGoogle Scholar
  39. Vander Wall SB (2000) The influence of environmental conditions on cache recovery and cache pilferage by yellow pine chipmunks (Tamias amoenus) and deer mice (Peromyscus maniculatus). Behavioral Ecology 11:544–549CrossRefGoogle Scholar
  40. Whittingham MJ, Stephens PA, Bradbury RB, Freckleton RP (2006) Why do we still use stepwise modelling in ecology and behaviour? J Anim Ecol 75:1182–1189PubMedCrossRefGoogle Scholar
  41. Ydenberg RC, Brown JS, Stephens DW (2007) Foraging: an overview. In: Stephens DW, Brown JS, Ydenberg RC (eds) Foraging: Behavior and Ecology. University of Chicago Press, Chicago, pp 1–28Google Scholar

Copyright information

© Springer-Verlag 2010

Authors and Affiliations

  • Shane A. Richards
    • 1
  • Mark J. Whittingham
    • 2
  • Philip A. Stephens
    • 1
  1. 1.School of Biological and Biomedical SciencesDurham UniversityDurhamUK
  2. 2.School of BiologyNewcastle UniversityNewcastle upon TyneUK

Personalised recommendations