Skip to main content

Eliciting Judgments, Priorities, and Values Using Structured Survey Methods

  • Chapter
  • First Online:
Environmental Modeling with Stakeholders

Abstract

The judgments of scientists, priorities of managers, and values of stakeholders are unique aspects of knowledge embedded in environmental management. Structured survey methods enable statistically rigorous analyses to account for the unique perspectives of these audiences. Several considerations are critical for ensuring the successful application of these methods. The number and type of respondents affect the way in which surveys are designed. If unaddressed, frailties in human judgment and other practical considerations can impact the number and quality of responses. Various question types are available which include asking participants to respond using a single measurement scale or by making choices that require trade-offs among multiple and often competing attributes. At the heart of these considerations is the recognition of trade-offs, not only among different aspects of the decision, but also the strengths and weaknesses of various approaches for eliciting and aggregating stakeholder preferences. Experimental design considerations can help achieve a balance between the quantity and quality of data collected. Three case studies demonstrate application of these methods. The first illustrates heuristics that scientists used to characterize the significance of adverse events associated with a large-scale hydropower system in British Columbia, Canada. The next example demonstrates managers’ preferred options for regulating incidental take of migratory birds across Canada. Lastly, a survey of recreational boaters in northern Wisconsin, USA revealed differences in management priorities within a stakeholder group. Collectively, these examples demonstrate the broad usefulness of applying structured survey methods to real-world applications in environmental management.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 99.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 129.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 199.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    Extracted from: http://www.ec.gc.ca/paom-itmb/.

References

  • Adamowicz W, Louviere JJ, Williams M (1994) Combining revealed and stated preference methods for valuing environmental amenities. J Environ Econ Manag 26:271–292

    Article  Google Scholar 

  • Beardmore B (2015) Boater perceptions of environmental issues affecting lakes in northern Wisconsin. J Am Water Resour Assoc 51(2):537–549

    Google Scholar 

  • Beardmore B, Haider W, Hunt LM, Arlinghaus R (2013) Evaluating the ability of specialization indicators to explain fishing preferences. Leis Sci 35(3):273–292. doi:10.1080/01490400.2013.780539

    Article  Google Scholar 

  • Boxall PC, Adamowicz WL (2002) Understanding heterogeneous preferences in random utility models: a latent class approach. Environ Resour Econ 23(4):421–446

    Article  Google Scholar 

  • Brieman L, Friedman JH, Olshen RA, Stone CJ (1984) Classification and regression trees. Wadsworth, Belmont

    Google Scholar 

  • Buffram I, Turner MG, Desai AR, Hanson PC, Rusak JA, Lottig NR, Stanley EH, Carpenter SR (2011) Integrating aquatic and terrestrial components to construct a complete carbon budget for a north temperate lake district. Glob Chang Biol 17:1193–1211

    Article  Google Scholar 

  • Bulkeley H, Mol APJ (2003) Participation and environmental governance: consensus, ambivalence and debate. Environ Values 12:143–154

    Article  Google Scholar 

  • Carpenter SR, Caraco NF, Correll DL, Howarth RW, Sharpley AN, Smith VH (1998) Nonpoint pollution of surface waters with phosphorus and nitrogen. Ecol Appl 8:559–568

    Article  Google Scholar 

  • Carpenter SR, Benson BJ, Biggs R, Chipman JW, Foley JA, Golding SA, Hammer RB, Hanson PC, Johnson PTJ, Kamarainen AM, Kratz TK, Lathrop RC, McMahon KD, Provencher B, Rusak JA, Soloman CT, Stanley EH, Turner MG, Vander Zanden MJ, Wu C-H, Yuan H (2007) Understanding regional change: a comparison of two lake districts. Bioscience 57:323–335

    Article  Google Scholar 

  • Carson RT, Louviere JJ (2011) A common nomenclature for stated preference elicitation approaches. Environ Resour Econ 49(4):539–559

    Article  Google Scholar 

  • Cohen S (2003) Maximum difference scaling: improved measures of importance and preference for segmentation. Research Paper Series. Sawtooth Software Inc, Sequim

    Google Scholar 

  • de Vaus D (2002) Surveys in social research, 5th edn. Allen & Unwin, Crows Nest

    Google Scholar 

  • Dillman DA, Smyth JD, Christian LM (2008) Internet, mail, and mixed-mode surveys: the tailored design method. Wiley, Hoboken

    Google Scholar 

  • Dorow M, Beardmore B, Haider W, Arlinghaus R (2010) Winners and losers of conservation policies for European eel, Anguilla anguilla: an economic welfare analysis for differently specialised eel anglers. Fish Manag Ecol 17(2):106–125

    Article  Google Scholar 

  • Ehrlinger J, Johnson K, Banner M, Dunning D, Kruger J (2008) Why the unskilled are unaware: further explorations of (absent) self-insight among the incompetent. Organ Behav Hum Decis Process 105(1):98–121. doi:10.1016/j.obhdp.2007.05.002

    Article  Google Scholar 

  • Estes WK (1976) The cognitive side of probability learning. Psychol Rev 83(5):37–64

    Article  Google Scholar 

  • Finn A, Louviere JJ (1992) Determining the appropriate response to evidence of public concern: the case of food safety. J Public Pol Market 11:12–25

    Google Scholar 

  • Flynn TN, Louviere JJ, Peters TJ, Coast J (2007) Best-worst scaling: what it can do for health care research and how to do it. J Health Econ 26:171–189

    Article  Google Scholar 

  • Galton F (1907) Vox populi. Nature 75:450–451

    Article  Google Scholar 

  • Gray SA, Jordan R (2010) Ecosystem-based angling: incorporating recreational anglers into ecosystem-based management. Hum Dimens Wildl 15:233–246

    Article  Google Scholar 

  • Hagerman SM, Satterfield T (2013) Entangled judgments: expert preferences for adapting biodiversity conservation to climate change. J Environ Manag 129:555–563

    Article  Google Scholar 

  • Haider W, Hunt LM (1997) Remote tourism in northern Ontario: patterns of supply and a motivational segmentation of clients. J Appl Recreat Res 22:49–78

    Google Scholar 

  • Hammond JS, Keeney RL, Raiffa H (1999) Smart choices: a practical guide to making better life decisions. Harvard Business School Press, Boston

    Google Scholar 

  • Hensher DA, Greene WH (2003) The mixed logit model: the state of practice. Transportation 30(2):133–176

    Article  Google Scholar 

  • Hensher D, Rose J, Green W (2005) Applied choice: a primer. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Huang IB, Keisler J, Linkov I (2011) Multi-criteria decision analysis in environmental sciences: ten years of applications and trends. Sci Total Environ 409:3578–3594

    Article  CAS  Google Scholar 

  • Hunt LM (2008) Examining state dependence and place attachment within a recreational fishing site choice model. J Leis Res 40(1):110–127

    Google Scholar 

  • Hunt LM, Gonder D, Haider W (2010) Hearing voices from the silent majority: a comparison of preferred fish stocking outcomes for Lake Huron by anglers from representative and convenience samples. Hum Dimens Wildl 15:27–44

    Article  Google Scholar 

  • Kahneman D, Knetsch J, Thaler R (1990) Experimental test of the endowment effect and the Coase Theorem. J Polit Econ 98(6):1325–1348

    Article  Google Scholar 

  • Kamakura WA, Wedel M, Agrawal J (1994) Concomitant variable latent class models for conjoint analysis. Int J Res Mark 11:451–464

    Article  Google Scholar 

  • Kaner S, Lind L, Toldi C, Fisk S, Berger D (2007) Facilitator’s guide to participatory decision making, 2nd edn. John Wiley & Sons, San Francisco

    Google Scholar 

  • Kuhfeld WF, Tobias RD, Garratt M (1994) Efficient experimental design with marketing research applications. J Mark Res 31(4):545–557

    Article  Google Scholar 

  • Kynn M (2008) The ‘heuristics and biases’ bias in expert elicitation. J R Stat Soc Ser A 171:239–264

    Google Scholar 

  • Lackey RT (2009) Is science biased toward natural? Northwest Sci 83(3):291–293

    Article  Google Scholar 

  • Linstone HA, Turoff M (eds) (2002) The Delphi method: techniques and applications. Addison-Wesley Publishing Company, Reading

    Google Scholar 

  • Louviere JJ, Woodworth G (1983) Design and analysis of simulated consumer choice or allocation experiments: an approach based on aggregate data. J Mark Res 20:350–367

    Article  Google Scholar 

  • Louviere JJ, Hensher DA, Swait JD (2000) Stated choice methods: analysis and applications. Cambridge University Press, Cambridge

    Book  Google Scholar 

  • Marley AAJ, Louviere JJ (2005) Some probabilistic models of best, worst, and best–worst choices. J Math Psychol 49:464–480

    Article  Google Scholar 

  • Martin TG, Burgman MA, Fidler F, Kuhnert PM, Low-Choy S, McBride M, Mengersen K (2011) Eliciting expert knowledge in conservation science. Conserv Biol 26(1):29–38

    Article  Google Scholar 

  • McFadden D (1974) Conditional logit analysis of qualitative choice behaviour. In: Zarembka P (ed) Frontiers in econometrics. Academic, New York, pp 105–142

    Google Scholar 

  • Oh C, Ditton RB (2006) Using recreation specialization to understand multiattribute management preferences. Leis Sci 28:369–384

    Article  Google Scholar 

  • Patt A, Schrag DP (2003) Using specific language to describe risk and probability. Clim Chang 61:17–30

    Article  Google Scholar 

  • Peterson MN, Hartis B, Rodriguez S, Green M, Lepczyk CA (2012) Opinions from the front lines of cat colony management conflict. PLoS ONE 7(9), e44616. doi:10.1371/journal.pone.0044616

    Article  CAS  Google Scholar 

  • Raktoe BL, Hedayat A, Federer WT (1981) Factorial designs. Wiley, New York

    Google Scholar 

  • Reed MS (2008) Stakeholder participation for environmental management: a literature review. Biol Conserv 141:2417–2431

    Article  Google Scholar 

  • Rogelberg SG, Stanton JM (2007) Introduction: understanding and dealing with organizational survey nonresponse. Organ Res Methods 10(2):195–209

    Article  Google Scholar 

  • Schkade DA, Kahneman D (1998) Does living in California make people happy? A focusing illusion in judgments of life satisfaction. Psychol Sci 9:340–346

    Article  Google Scholar 

  • Surowiecki J (2004) The wisdom of crowds. Doubleday Publishing, New York

    Google Scholar 

  • Swait J (1994) A structural equation model of latent segmentation and product choice for cross-sectional revealed preference choice data. J Retail Consum Serv 1(2):77–89

    Article  Google Scholar 

  • Tutsch M, Haider W, Beardmore B, Lertzman K, Cooper AB, Walker RC (2010) Estimating the consequences of wildfire for wildfire risk assessment: a case study in the southern Gulf Islands, British Columbia, Canada. Can J For Res 40(11):2104–2114

    Article  Google Scholar 

  • Tversky A, Kahneman D (1974) Judgment under uncertainty: heuristics and biases. Science 185(4157):1124–1131

    Article  CAS  Google Scholar 

  • Vaske JJ (2008) Survey research and analysis: applications in parks, recreation and human dimensions. Venture Publications, State College

    Google Scholar 

  • Vermunt JK, Magidson J (2005) Technical guide for Latent GOLD 4.0: basic and advanced. Statistical Innovations Inc, Belmont

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Marc A. Nelitz .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Nelitz, M.A., Beardmore, B. (2017). Eliciting Judgments, Priorities, and Values Using Structured Survey Methods. In: Gray, S., Paolisso, M., Jordan, R., Gray, S. (eds) Environmental Modeling with Stakeholders. Springer, Cham. https://doi.org/10.1007/978-3-319-25053-3_4

Download citation

Publish with us

Policies and ethics