Abstract
Insights from behavioral and experimental economics research can inform the design of evidence-based, cost-effective agri-environmental programs that mitigate environmental damages and promote the supply of environmental benefits from agricultural landscapes. To enhance future research on agri-environmental program design and to increase the speed at which credible scientific knowledge is accumulated, we highlight methodological challenges, identify important gaps in the existing literature, and make key recommendations for both researchers and those evaluating research. We first report on four key methodological challenges—underpowered designs, multiple hypothesis testing, interpretation issues, and choosing appropriate econometric methods—and suggest strategies to overcome these challenges. Specifically, we emphasize the need for more detailed planning during the experimental design stage, including power analyses and publishing a pre-analysis plan. Greater use of replication studies and meta-analyses will also help address these challenges and strengthen the quality of the evidence base. In the second part of this paper, we discuss how insights from behavioral and experimental economics can be applied to improve the design of agri-environmental programs. We summarize key insights using the MINDSPACE framework, which categorizes nine behavioral effects that influence decision-making (messenger, incentives, norms, defaults, salience, priming, affect, commitment, and ego), and we highlight recent research that tests these effects in agri-environmental contexts. We also propose a framework for prioritizing policy-relevant research in this domain.
Similar content being viewed by others
Notes
Ellis (2010) provides a helpful review of concepts including statistical power, effect sizes, and meta-analysis.
Lakens et al. (2018) emphasize that researchers should also justify their alpha level (i.e. the statistical significance level) along with other decisions when designing a study.
See Brown et al. (2019) for a discussion about statistical methods that can be used to interpret null findings, which can be meaningful and policy-relevant when derived from a well-designed study.
This module accommodates within and between-subject experimental designs that may involve complications such as continuous treatment variables, order effects, and repetition. Further, power calculations can be based on tests derived from a range of econometric estimators, including tobit, probit, and common panel data estimators.
See Feiveson (2002) for additional guidance on estimating the power of statistical tests using Stata.
There is not a universally employed method of standardization. Common alternatives include Glass’s Δ and Hedge’s g.
To be clear, if the standard deviation of the outcome variable is 2.5, a 0.10 standard deviation effect size refers to an unstandardized treatment effect of 0.25.
We have compiled a table of standardized effect sizes reported in experimental economics papers that present behavioral insights which can inform agri-environmental research and program design. The table will be periodically updated to reflect new research and can be found at https://osf.io/cf259/.
Power analyses are already an important component of proposals to fund clinical research, and an inadequate description of power calculations is considered to be a major issue during the review process (Inouye and Fiellin 2005).
Another approach is to control the familywise error rate (FWER)—the probability of falsely rejecting even one hypothesis (i.e., the probability of at least one Type I error). List et al. (2019) present an approach to control the FWER that the authors assert leads to gains in power over Bonferroni-type procedures.
If one can identify the various channels through which an intervention works, it may be possible to design an experiment that turns various channels on and off. See, for example, Ferraro and Hanauer (2014).
Currently, the AEA registry is set up primarily for the registration of RCTs, but we recommend that registries be updated to accommodate pre-analysis plans for both laboratory and field experiments.
Behavioral nudges were popularized by Thaler and Sunstein (2008) in their book, Nudge, which presents a behavioral economics toolkit for designing more-effective private and government programs and policies. They define a nudge as “any aspect of the choice architecture that alters people's behavior in a predictable way without forbidding any options or significantly changing their economic incentives. To count as a mere nudge, the intervention must be easy and cheap to avoid. Nudges are not mandates.” (Thaler and Sunstein 2008, p. 6).
See Mason and Phillips (1997), Messer et al. (2007), Shogren and Taylor (2008), Kotani et al. (2010), Messer and Murphy (2010), Shogren et al. (2010), Gsottbauer and van den Bergh (2011), Osbaldiston and Schott (2012), Friesen and Gangadharan (2013), Schultz (2014), List and Price (2016), Delaney and Jacobson (2016), Hobbs and Mooney (2016), Ferraro et al. (2017), Reddy et al. (2017), Zarghamee et al. (2017), Brent et al. (2017) and Kesternich et al. (2017).
Although consumer preferences and behavior can drive change in agriculture, we include only studies analyzing producer behavior. This is consistent with the aim of agri-environmental programs, which is to achieve permanent changes in how producers manage impure public goods.
We only review papers that are published in peer-reviewed journals, but we acknowledge that there is a growing body of experimental literature in the agri-environmental domain, and many of these papers are in the review process or in working paper form. We do not believe, however, that including this body of in-progress work would change our overall conclusions.
Duflo et al. (2011) analyze farmer investments in fertilizer and is, therefore, not categorized as an Ag-E paper.
A large portion of this literature tests the outcomes of various tax and subsidy mechanisms to reduce nonpoint source (NPS) pollution (Alpízar et al. 2004; Poe et al. 2004; Spraggon 2004, 2013; Cochard et al. 2005; Vossler et al. 2006; Suter et al. 2008; Spraggon and Oxoby 2010; Cason 2010; Cason and Gangadharan 2013; Suter and Vossler 2014; Miao et al. 2016; Palm-Forster et al. 2017), improve extraction of ground water for irrigation (Gardner, Moore, and Walker 1997; Suter et al. 2012, 2018; Li et al. 2014; Liu et al. 2014), and incentivize land conservation and ecosystem service provision (Parkhurst et al. 2002; Cason and Gangadharan 2004; Parkhurst and Shogren 2007, 2008; Arnold, Duke, and Messer 2013; Banerjee et al. 2014, 2015, 2017; Fooks et al. 2015, 2016; Messer et al. 2017; Duke et al. 2017; Banerjee 2018; Reeling et al. 2018).
See Ostrom (2000) for more discussion on the evolution of rules and social norms. There is also broad literature on the role that communication and voting have on improving the performance of groups in public good and common pool resource settings (Messer et al. 2017, 2008); however, these studies have not focused on agri-environmental decision-making.
As a frequently cited example of the power of defaults, organ donor rates are much higher in countries where the default option is that everyone is an organ donor (Johnson and Goldstein 2003).
We recommend publishing pre-analysis plans on a public experiment registry, like those maintained by the American Economic Association and the Open Science Framework.
References
Allcott H (2011) Social norms and energy conservation. J Public Econ 95:1082–1095. https://doi.org/10.1016/j.jpubeco.2011.03.003
Alpízar F, Requate T, Schram A (2004) Collective versus random fining: an experimental study on controlling ambient pollution. Environ Resour Econ 29:231–252. https://doi.org/10.1023/B:EARE.0000044608.66145.0c
Armitage P, McPherson CK, Rowe BC (1969) Repeated significance tests on accumulating data. J R Stat Soc Ser Gen 132:235–244. https://doi.org/10.2307/2343787
Arnold MA, Duke JM, Messer KD (2013) Adverse selection in reverse auctions for ecosystem services. Land Econ 89:387–412
Banerjee S (2018) Improving spatial coordination rates under the agglomeration bonus scheme: a laboratory experiment with a pecuniary and a non-pecuniary mechanism (NUDGE). Am J Agric Econ 100:172–197. https://doi.org/10.1093/ajae/aax066
Banerjee S, de Vries FP, Hanley N, van Soest DP (2014) The impact of information provision on agglomeration bonus performance: an experimental study on local networks. Am J Agric Econ 96:1009–1029. https://doi.org/10.1093/ajae/aau048
Banerjee S, Kwasnica AM, Shortle JS (2015) Information and auction performance: a laboratory study of conservation auctions for spatially contiguous land management. Environ Resour Econ 61:409–431. https://doi.org/10.1007/s10640-014-9798-4
Banerjee S, Cason TN, de Vries FP, Hanley N (2017) Transaction costs, communication and spatial coordination in payment for ecosystem services schemes. J Environ Econ Manag 83:68–89. https://doi.org/10.1016/j.jeem.2016.12.005
Bellemare C, Bissonnette L, Kröger S (2016) Simulating power of economic experiments: the powerBBK package. J Econ Sci Assoc 2:157–168. https://doi.org/10.1007/s40881-016-0028-4
Benjamini Y, Hochberg Y (1995) Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol 57:289–300
Benjamini Y, Yekutieli D (2001) The control of the false discovery rate in multiple testing under dependency. Ann Stat 29:1165–1188. https://doi.org/10.1214/aos/1013699998
Bernedo M, Ferraro PJ (2017) Behavioral economics and climate change adaptation: insights from experimental economics on the role of risk and time preferences. In: Botelho A (ed) World scientific reference on natural resources and environmental policy in the era of global change: volume 4: experimental economics. World Scientific, pp 151–177
Brent DA, Friesen L, Gangadharan L, Leibbrandt A (2017) Behavioral insights from field experiments in environmental economics. Int Rev Environ Resour Econ 10:95–143. https://doi.org/10.1561/101.00000084
Brown JP, Lambert DM, Wojan TR (2019) The effect of the conservation reserve program on rural economies: deriving a statistical verdict from a null finding. Am J Agric Econ 101:528–540. https://doi.org/10.1093/ajae/aay046
Burke MA, Young HP (2011) Social norms. In: Benhabib J, Bisin A, Jackson MO (eds) Handbook of social economics. North-Holland, Amsterdam, pp 311–338
Butler JM, Fooks JR, Messer KD, Palm-Forster LH (2019) Addressing social dilemmas with mascots, information, and graphics. Econ Inq. https://doi.org/10.1111/ecin.12783
Button KS, Ioannidis JPA, Mokrysz C et al (2013) Power failure: why small sample size undermines the reliability of neuroscience. Nat Rev Neurosci 14:365–376. https://doi.org/10.1038/nrn3475
Cameron AC, Miller DL (2015) A practitioner’s guide to cluster-robust inference. J Hum Resour 50:317–372
Cason TN (2010) What can laboratory experiments teach us about emissions permit market design? Agric Resour Econ Rev 39:151–161. https://doi.org/10.1017/S1068280500007218
Cason TN, Gangadharan L (2004) Auction design for voluntary conservation programs. Am J Agric Econ 86:1211–1217. https://doi.org/10.1111/j.0002-9092.2004.00666.x
Cason TN, Gangadharan L (2013) Empowering neighbors versus imposing regulations: an experimental analysis of pollution reduction schemes. J Environ Econ Manag 65:469–484. https://doi.org/10.1016/j.jeem.2012.09.001
Cason TN, Wu SY (2018) Subject pools and deception in agricultural and resource economics experiments. Environ Resour Econ. https://doi.org/10.1007/s10640-018-0289-x
Cason TN, Gangadharan L, Duke C (2003) A laboratory study of auctions for reducing non-point source pollution. J Environ Econ Manag 46:446–471. https://doi.org/10.1016/S0095-0696(03)00026-3
Cherry TL, Kroll S, Shogren JF (eds) (2008) Environmental economics, experimental methods. Routledge, New York
Cochard F, Willinger M, Xepapadeas A (2005) Efficiency of nonpoint source pollution instruments: an experimental study. Environ Resour Econ 30:393–422. https://doi.org/10.1007/s10640-004-5986-y
Cohen J (1988) Statistical power analysis for the behavioral sciences, 2nd edn. Lawrence Erlbaum Associates, Hillsdale
Czap NV, Czap HJ, Khachaturyan M et al (2013) Smiley or Frowney: the effect of emotions and empathy framing in a downstream water pollution game. Int J Econ Finance 5:9. https://doi.org/10.5539/ijef.v5n3p9
Deaton A, Cartwright N (2018) Understanding and misunderstanding randomized controlled trials. Soc Sci Med 210:2–21. https://doi.org/10.1016/j.socscimed.2017.12.005
Delaney J, Jacobson S (2016) Payments or persuasion: common pool resource management with price and non-price measures. Environ Resour Econ 65:747–772. https://doi.org/10.1007/s10640-015-9923-z
Dolan P, Hallsworth M, Halpern D et al (2012) Influencing behaviour: the mindspace way. J Econ Psychol 33:264–277. https://doi.org/10.1016/j.joep.2011.10.009
Doucouliagos C, Stanley TD (2013) Are all economic facts greatly exaggerated? Theory competition and selectivity. J Econ Surv 27:316–339
Duflo E, Kremer M, Robinson J (2011) Nudging farmers to use fertilizer: theory and experimental evidence from Kenya. Am Econ Rev 101:2350–2390. https://doi.org/10.1257/aer.101.6.2350
Duke JM, Messer KD, Lynch L, Li T (2017) The effect of information on discriminatory-price and uniform-price reverse auction efficiency: an experimental economics study of the purchase of ecosystem services. Strateg Behav Environ 7:41–71. https://doi.org/10.1561/102.00000073
Duquette E, Higgins N, Horowitz J (2012) Farmer discount rates: experimental evidence. Am J Agric Econ 94:451–456. https://doi.org/10.1093/ajae/aar067
Ehmke MD, Shogren JF (2009) Experimental methods for environment and development economics. Environ Dev Econ 14:419–456. https://doi.org/10.1017/S1355770X08004592
Ellis PD (2010) The essential guide to effect sizes: statistical power, meta-analysis, and the interpretation of research results. Cambridge University Press, New York
FAO (2016) FAOSTAT land domain. http://www.fao.org/faostat/en/#data/RL. Accessed 13 Mar 2019
Feiveson AH (2002) Power by simulation. Stata J 2:107–124. https://doi.org/10.1177/1536867X0200200201
Ferraro PJ, Hanauer MM (2014) Quantifying causal mechanisms to determine how protected areas affect poverty through changes in ecosystem services and infrastructure. Proc Natl Acad Sci. https://doi.org/10.1073/pnas.1307712111
Ferraro PJ, Miranda JJ (2013) Heterogeneous treatment effects and mechanisms in information-based environmental policies: evidence from a large-scale field experiment. Resour Energy Econ 35:356–379. https://doi.org/10.1016/j.reseneeco.2013.04.001
Ferraro PJ, Price MK (2013) Using nonpecuniary strategies to influence behavior: evidence from a large-scale field experiment. Rev Econ Stat 95:64–73. https://doi.org/10.1162/REST_a_00344
Ferraro PJ, Miranda JJ, Price MK (2011) The persistence of treatment effects with norm-based policy instruments: evidence from a randomized environmental policy experiment. Am Econ Rev 101:318–322
Ferraro PJ, Messer KD, Wu S (2017) Applying behavioral insights to improve water security. Choices 32:1–6
Fink G, McConnell M, Vollmer S (2014) Testing for heterogeneous treatment effects in experimental data: false discovery risks and correction procedures. J Dev Eff 6:44–57. https://doi.org/10.1080/19439342.2013.875054
Fooks JR, Messer KD, Duke JM (2015) Dynamic entry, reverse auctions, and the purchase of environmental services. Land Econ 91:57–75
Fooks JR, Higgins N, Messer KD et al (2016) Conserving spatially explicit benefits in ecosystem service markets: experimental tests of network bonuses and spatial targeting. Am J Agric Econ 98:468–488. https://doi.org/10.1093/ajae/aav061
Fowlie M, Wolfram C, Spurlock CA et al (2017) Default effects and follow-on behavior: evidence from an electricity pricing program. National Bureau of Economic Research, Cambridge
Friesen L, Gangadharan L (2013) Environmental markets: what do we learn from the lab? J Econ Surv 27:515–535. https://doi.org/10.1111/joes.12021
Gardner R, Moore MR, Walker JM (1997) Governing a groundwater commons: a strategic and laboratory analysis of western water law. Econ Inq 35:218–234. https://doi.org/10.1111/j.1465-7295.1997.tb01905.x
Gelman A, Carlin J (2014) Beyond power calculations: assessing type S (sign) and type M (magnitude) errors. Perspect Psychol Sci 9:641–651. https://doi.org/10.1177/1745691614551642
Griesinger MR, Palm-Forster LH, Messer KD et al (2017) Stewardship signaling and the power of using social pressures to reduce nonpoint source pollution. Agricultural and Applied Economics Association, Chicago
Gsottbauer E, van den Bergh JCJM (2011) Environmental policy theory given bounded rationality and other-regarding preferences. Environ Resour Econ 49:263–304. https://doi.org/10.1007/s10640-010-9433-y
Harrison GW, List JA (2004) Field experiments. J Econ Lit 42:1009–1055
Higgins N, Hellerstein D, Wallander S, Lynch L (2017) Economic experiments for policy analysis and program design: a guide for agricultural decisionmakers. US Department of Agriculture, Economic Research Service, Washington
Hobbs JE, Mooney S (2016) Applications of behavioral and experimental economics to decision making in the agricultural, food, and resource sectors: an introduction. Can J Agric Econ Can Agroecon 64:593–597. https://doi.org/10.1111/cjag.12117
Inouye SK, Fiellin DA (2005) An evidence-based guide to writing grant proposals for clinical research. Ann Intern Med 142:274–282. https://doi.org/10.7326/0003-4819-142-4-200502150-00009
Ioannidis JPA, Stanley TD, Doucouliagos H (2017) The power of bias in economics research. Econ J 127:F236–F265. https://doi.org/10.1111/ecoj.12461
Jacquemet N, Luchini S, Shogren JF, Zylbersztejn A (2018) Coordination with communication under oath. Exp Econ 21:627–649. https://doi.org/10.1007/s10683-016-9508-x
Johnson EJ, Goldstein D (2003) Do defaults save lives? Science 302:1338–1339. https://doi.org/10.1126/science.1091721
Kahneman D (2003) Maps of bounded rationality: psychology for behavioral economics. Am Econ Rev 93:1449–1475
Kesternich M, Reif C, Rübbelke D (2017) Recent trends in behavioral environmental economics. Environ Resour Econ 67:403–411. https://doi.org/10.1007/s10640-017-0162-3
Kotani K, Messer KD, Schulze WD (2010) Matching grants and charitable giving: why people sometimes provide a helping hand to fund environmental goods. Agric Resour Econ Rev 39:324–343
Lakens D, Adolfi FG, Albers CJ et al (2018) Justify your alpha. Nat Hum Behav 2:168–171. https://doi.org/10.1038/s41562-018-0311-x
Leiser D, Azar OH (2008) Behavioral economics and decision making: applying insights from psychology to understand how people make economic decisions. J Econ Psychol 29:613–618. https://doi.org/10.1016/j.joep.2008.08.001
Li J, Michael HA, Duke JM et al (2014) Behavioral response to contamination risk information in a spatially explicit groundwater environment: experimental evidence. Water Resour Res 50:6390–6405. https://doi.org/10.1002/2013WR015230
List JA, Price MK (2016) The use of field experiments in environmental and resource economics. Rev Environ Econ Policy. https://doi.org/10.1093/reep/rew008
List JA, Sadoff S, Wagner M (2011) So you want to run an experiment, now what? Some simple rules of thumb for optimal experimental design. Exp Econ 14:439–457. https://doi.org/10.1007/s10683-011-9275-7
List JA, Shaikh AM, Xu Y (2016) Multiple hypothesis testing in experimental economics. National Bureau of Economic Research, Cambridge
List JA, Shaikh A, Xu Y (2019) Multiple hypothesis testing in experimental economics. Exp Econ. https://doi.org/10.1007/s10683-018-09597-5
Liu Z, Suter JF, Messer KD et al (2014) Strategic entry and externalities in groundwater resources: evidence from the lab. Resour Energy Econ 38:181–197. https://doi.org/10.1016/j.reseneeco.2014.07.002
Lokhorst AM, Werner C, Staats H et al (2013) Commitment and behavior change: a meta-analysis and critical review of commitment-making strategies in environmental research. Environ Behav 45:3–34. https://doi.org/10.1177/0013916511411477
Mason CF, Phillips OR (1997) Mitigating the tragedy of the commons through cooperation: an experimental evaluation. J Environ Econ Manag 34:148–172. https://doi.org/10.1006/jeem.1997.1006
Messer KD, Borchers AM (2015) Choice for goods under threat of destruction. Econ Lett 135:137–140. https://doi.org/10.1016/j.econlet.2015.07.026
Messer KD, Murphy JJ (2010) Special issue on experimental methods in environmental, natural resource, and agricultural economics. Econ Rev 39:iii–vi. https://doi.org/10.1017/s106828050000719x
Messer KD, Kaiser HM, Poe GL (2007) Voluntary funding for generic advertising using a provision point mechanism: an experimental analysis of option assurance. Appl Econ Perspect Policy 29:612–631. https://doi.org/10.1111/j.1467-9353.2007.00375.x
Messer KD, Duke JM, Lynch L (2014) Applying experiments to land economics: public information and auction efficiency in ecosystem service markets. In: Duke JM, Wu J (eds) The Oxford handbook of land economics. Oxford University Press, Oxford, pp 481–546
Messer KD, Duke JM, Lynch L, Li T (2017) When does public information undermine the efficiency of reverse auctions for the purchase of ecosystem services? Ecol Econ 134:212–226. https://doi.org/10.1016/j.ecolecon.2016.12.004
Miao H, Fooks JR, Guilfoos T et al (2016) The impact of information on behavior under an ambient-based policy for regulating nonpoint source pollution. Water Resour Res 52:3294–3308. https://doi.org/10.1002/2015WR018142
Miguel E, Casey K, Glennerster R (2012) Reshaping institutions: evidence on aid impacts using a preanalysis plan. Q J Econ 127:1755–1812. https://doi.org/10.1093/qje/qje027
Muthukrishna M, Henrich J (2019) A problem in theory. Nat Hum Behav 10:10. https://doi.org/10.1038/s41562-018-0522-1
OECD (2017) Tackling environmental problems with the help of behavioural insights. Organisation for Economic Cooperation and Development, Paris. https://doi.org/10.1787/9789264273887-en
Olken BA (2015) Promises and perils of pre-analysis plans. J Econ Perspect 29:61–80. https://doi.org/10.1257/jep.29.3.61
Osbaldiston R, Schott JP (2012) Environmental sustainability and behavioral science: meta-analysis of proenvironmental behavior experiments. Environ Behav 44:257–299. https://doi.org/10.1177/0013916511402673
Ostrom E (2000) Collective action and the evolution of social norms. J Econ Perspect 14:137–158. https://doi.org/10.1257/jep.14.3.137
Palm-Forster LH, Swinton SM, Shupp RS (2017) Farmer preferences for conservation incentives that promote voluntary phosphorus abatement in agricultural watersheds. J Soil Water Conserv 72:493–505. https://doi.org/10.2489/jswc.72.5.493
Palm-Forster LH, Suter JF, Messer KD (2019) Experimental evidence on policy approaches that link agricultural subsidies to water quality outcomes. Am J Agric Econ 101:109–133. https://doi.org/10.1093/ajae/aay057
Parkhurst GM, Shogren JF (2007) Spatial incentives to coordinate contiguous habitat. Ecol Econ 64:344–355. https://doi.org/10.1016/j.ecolecon.2007.07.009
Parkhurst GM, Shogren JF (2008) Smart subsidies for conservation. Am J Agric Econ 90:1192–1200. https://doi.org/10.1111/j.1467-8276.2008.01203.x
Parkhurst GM, Shogren JF, Bastian C et al (2002) Agglomeration bonus: an incentive mechanism to reunite fragmented habitat for biodiversity conservation. Ecol Econ 41:305–328. https://doi.org/10.1016/S0921-8009(02)00036-8
Poe GL, Schulze WD, Segerson K et al (2004) Exploring the performance of ambient-based policy instruments when nonpoint source polluters can cooperate. Am J Agric Econ 86:1203–1210
Reeling C, Palm-Forster LH, Melstrom RT (2018) Policy instruments and incentives for coordinated habitat conservation. Environ Resource Econ. https://doi.org/10.1007/s10640-018-0304-2
Reddy SMW, Montambault J, Masuda YJ et al (2017) Advancing conservation by understanding and influencing human behavior. Conserv Lett 10:248–256. https://doi.org/10.1111/conl.12252
Schultz PW (2014) Strategies for promoting proenvironmental behavior: lots of tools but few instructions. Eur Psychol 19:107–117. https://doi.org/10.1027/1016-9040/a000163
Shogren JF, Taylor LO (2008) On behavioral-environmental economics. Rev Environ Econ Policy 2:26–44. https://doi.org/10.1093/reep/rem027
Shogren JF, Parkhurst GM, Banerjee P (2010) Two cheers and a qualm for behavioral environmental economics. Environ Resour Econ 46:235–247. https://doi.org/10.1007/s10640-010-9376-3
Simmons JP, Nelson LD, Simonsohn U (2011) False-positive psychology: undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychol Sci 22:1359–1366. https://doi.org/10.1177/0956797611417632
Smaldino PE, McElreath R (2016) The natural selection of bad science. R Soc Open Sci 3:160384. https://doi.org/10.1098/rsos.160384
Spraggon J (2004) Testing ambient pollution instruments with heterogeneous agents. J Environ Econ Manag 48:837–856. https://doi.org/10.1016/j.jeem.2003.11.006
Spraggon JM (2013) The impact of information and cost heterogeneity on firm behaviour under an ambient tax/subsidy instrument. J Environ Manag 122:137–143. https://doi.org/10.1016/j.jenvman.2013.02.032
Spraggon J, Oxoby RJ (2010) Ambient-based policy instruments: the role of recommendations and presentation. Agric Resour Econ Rev 39:262–274
Stuart D, Benveniste E, Harris LM (2014) Evaluating the use of an environmental assurance program to address pollution from United States cropland. Land Use Policy 39:34–43. https://doi.org/10.1016/j.landusepol.2014.03.009
Sturm B, Weimann J (2006) Experiments in environmental economics and some close relatives. J Econ Surv 20:419–457. https://doi.org/10.1111/j.0950-0804.2006.00285.x
Suter JF, Vossler CA (2014) Towards an understanding of the performance of ambient tax mechanisms in the field: evidence from upstate new york dairy farmers. Am J Agric Econ 96:92–107. https://doi.org/10.1093/ajae/aat066
Suter JF, Vossler CA, Poe GL, Segerson K (2008) Experiments on damage-based ambient taxes for nonpoint source polluters. Am J Agric Econ 90:86–102
Suter JF, Duke JM, Messer KD, Michael HA (2012) Behavior in a spatially explicit groundwater resource: evidence from the lab. Am J Agric Econ 94:1094–1112. https://doi.org/10.1093/ajae/aas058
Suter JF, Collie S, Messer KD et al (2018) Common pool resource management at the extensive and intensive margins: experimental evidence. Environ Resour Econ. https://doi.org/10.1007/s10640-018-0283-3
Thaler RH, Sunstein CR (2008) Nudge: improving decisions about health, wealth, and happiness. Yale University Press, New Haven
Thalheimer W, Cook S (2002) How to calculate effect sizes from published research: a simplified methodology. Work-Learning Research, Somerville
U.S. Environmental Protection Agency (2018) National summary of state information water quality assessment and TMDL information. https://ofmpub.epa.gov/waters10/attains_nation_cy.control#total_assessed_waters. Accessed 27 Aug 2018
Vossler CA, Poe GL, Schulze WD, Segerson K (2006) Communication and incentive mechanisms based on group performance: an experimental study of nonpoint pollution control. Econ Inq 44:599–613. https://doi.org/10.1093/ei/cbj043
Wallander S, Ferraro P, Higgins N (2017) Addressing participant inattention in federal programs: a field experiment with the conservation reserve program. Am J Agric Econ. https://doi.org/10.1093/ajae/aax023
Xie J, Cai TT, Maris J, Li H (2011) Optimal false discovery rate control for dependent data. Stat Interface 4:417–430
Yekutieli D (2008) Hierarchical false discovery rate-controlling methodology. J Am Stat Assoc 103:309–316. https://doi.org/10.1198/016214507000001373
Zarghamee HS, Messer KD, Fooks JR et al (2017) Nudging charitable giving: three field experiments. J Behav Exp Econ 66:137–149. https://doi.org/10.1016/j.socec.2016.04.008
Zhang L, Ortmann A (2013) Exploring the meaning of significance in experimental economics. Social Science Research Network, Rochester
Acknowledgements
The authors acknowledge financial support from the USDA Economic Research Service (ERS), the Center for Behavioral and Experimental Agri-environmental Research (CBEAR), and conference funding from the USDA National Institute of Food and Agriculture through the Agriculture and Food Research Initiative Foundational Program (NIFA-AFRI Grant No. 12234087). The authors appreciate feedback and helpful comments from Simanti Banerjee, Tim Cason, Lata Gangadharan, Jordan Suter, Tim Wojan, attendees at the 2018 Brown Bag Lunch Series on Behavioral Science in Agri-environmental Program Design hosted by USDA ERS, and participants of the 2018 Appalachian Experimental and Environmental Economics Workshop and the 2017 Conference for Behavioral and Experimental Agri-environmental Research: Methodological Advancements and Applications to Policy (CBEAR-MAAP). Dr. Janusch contributed to this article in his personal capacity. The views expressed are his own and do not necessarily represent the views of the California Energy Commission.
Author information
Authors and Affiliations
Corresponding author
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Palm-Forster, L.H., Ferraro, P.J., Janusch, N. et al. Behavioral and Experimental Agri-Environmental Research: Methodological Challenges, Literature Gaps, and Recommendations. Environ Resource Econ 73, 719–742 (2019). https://doi.org/10.1007/s10640-019-00342-x
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10640-019-00342-x
Keywords
- Behavioral insights
- Conservation
- Effect size
- Environmental economics
- Experimental design
- Power analysis
- Subject pools