Skip to main content

Non-Compliance and Instrumental Variables in Behavioural Medicine: a Commentary on van Dongen et al.

The paper by van Dongen et al. [1] in this issue is to be commended on many levels. It contributes substantially to the blood donor recruitment and mere-measurement literatures and highlights the importance of replication. Importantly, it opens up the debate on the causes and consequences of non-compliance in randomised controlled trials (RCTs) in behavioural medicine. Non-compliance introduces non-random selection bias to RCTs and has implications for causality, generalizability and policy [25]. Therefore, reducing bias caused by non-compliance either methodologically or statistically is important.

Methodological solutions to this bias are less likely to be used than statistical ones, due, in part, to the lack of coherent frameworks to understand non-compliance. Indeed, as van Dongen et al. [1] highlight, non-compliance is complex, arising from person characteristics (e.g. attitudes to trials and conscientiousness), intervention idiosyncrasies or person/intervention interactions [6]. A first step in a methodological solution would be to identify psychological (traits, attitudes, beliefs) and demographic characteristics that differentiate compliant from non-compliant behaviour in treatment and control arms of trials. A framework developed by Angrist and colleagues offers a useful starting point [24]. This model identifies four groups [24]. The first group comply with the intervention protocol regardless of their assignment to the treatment or control arms: these are called compliers. The second group comply only if allocated to the treatment but not the control arm: called always-takers or may also be termed treatment only compliers. The third group comply if allocated to the control but not the treatment arm: the never-takers or control only compliers. The final group—defiers—do not comply with whichever arm they are allocated. Using these groups, non-compliance could be studied at a general or trial-specific level. At a general level, these four groups could be identified with respect to stable preferences to comply or not with treatment or control arm protocols across a variety of RCTs. Any stable psychological and demographic differences across these groups could be fed into compliance enhancing designs. For a specific RCT, it would be possible to explore how different intervention protocols influence who are likely to be treatment-only and control-only compliers and this information used to enhance compliance in both treatment and control arms. For example, in general, financially incentivized questionnaires (treatment arm) increase compliance relative to non-incentivized questionnaires (control arm) [7]. However, for blood donors, financially incentivized questionnaires may be either counter-productive [8] or helpful [913] for compliance. Identifying if incentivizing questionnaires increase the number of control only compliers (those preferring the non-incentivized questionnaire) and why will help to inform the intervention design and its interpretation.

If bias due to non-compliance cannot be designed out, it needs to be addressed statistically [25]. van Dongen et al. [1] call for the use of instrumental variables (IVs) analysis. IVs are designed to deal with problems of endogeneity (the explanatory predictor is correlated with the error term, leading to threats to causality due to missing variables, reverse causality etc.) by isolating the variability in the predictor that is causally related to the outcome [25, 1418]. IVs have to be highly correlated with the predictor (instrumental relevance) [14, 18], influence the outcome only via the predictor, be orthogonal to the error in the predictive model (instrumental exogeneity) and require large Ns [35, 1418]. Randomization can be used as an instrument to adjust for threats arising from non-compliance [25]. While policy questions of effectiveness (What are the benefits from treatment assignment?) and treatment questions of efficacy (What are the benefits of treatment to patients?) can be analysed using intention to treat (ITT) and ‘per protocol’ or ‘as treated’ analysis [5], the IV estimator for a RCT adjusts the ITT by the proportion actually receiving the treatment. This may account for why some studies with high compliance (e.g. 82 %) [19] have observed a mere-measurement effect with ITT analysis and others have not.

Finally, the use of IV analysis should be extended beyond RCTs as it has in the education, economic and medicine literature to infer causality when randomization is not possible, for example from survey data [15, 17, 18, 20]. Surprisingly, IV analyses have not been used in behavioural medicine where such data are often collected. Therefore, van Dongen et al.’s [1] call is timely and IV analysis, and other related techniques (e.g. directed acyclic graphs, propensity score matching and selection models), should be considered more widely in behavioural medicine [14, 2123].

References

  1. 1.

    van Dongen A, Abraham C, Ruiter RAC, Veldhuizen IJC. Does questionnaire distribution promote blood donation? An investigation of question-behavior effects. Annals Behav Med. 2013. doi:10.1007/s12160-012-9449-3.

  2. 2.

    Angrist JD, Imbens GW, Rubin DB. Identification of causal effects using instrumental variables. J Am Statistical Ass. 1996;91:444-455. doi:10.2307/2291629.

    Article  Google Scholar 

  3. 3.

    Little RJ, Long Q, Lin X. A comparison of methods for estimating the causal effect of a treatment in randomized clinical trials subject to non-compliance. Biometrics. 2009;65:640-649. doi:10.1111/j.1541-0420.2008.01066.x.

    PubMed  Article  Google Scholar 

  4. 4.

    Greenland S. An introduction to instrumental variables for epidemiologists. Int J Epid. 2000;29:722-729.

    Article  CAS  Google Scholar 

  5. 5.

    Sussman JB, Hayward RA. Using instrumental variables to adjust for treatment contamination in randomized controlled trials. British Medical Journal. 2009;340:1181-1184. doi:10.1136/bmj/c2073.

    Google Scholar 

  6. 6.

    Ferguson E. Personality is of central concern to understand health: Towards a theoretical model for health psychology. Health Psychol Rev. 2013. doi:10.1080/17437199.2010.547985. http://www.tandfonline.com/doi/abs.

  7. 7.

    Edwards P, Roberts I, Clarke M, DiCuiseppi C, Pratap S, Wentz R, Kwan I. Increasing response rates to postal questionnaires: Systematic review. British Medical Journal. 2002;324:1183-1185. doi:10.1136/bmj.324.7347.1183.

    PubMed  Article  Google Scholar 

  8. 8.

    Titmuss RM. The gift relationship. London: Allen and Unwin; 1970.

    Google Scholar 

  9. 9.

    Goette L, Stutzer A, Frey BM. Prosocial motivation and blood donations: A survey of the empirical literature. Transfusion Medicine Hemotherapy. 2010;37:149-155. doi:10.1159/000314737.

    Article  Google Scholar 

  10. 10.

    Lacetera N, Macis M, Slonim R. Rewardimg altruism? A natural field experiment. 2011, MFI working paper series No. 2011–101

  11. 11.

    Ferguson E, Farrell K, Lawrence C. Blood Donation is an act of Benevolence Rather Than Altruism. Health Psychol. 2008;27:327-336. doi:10.1037/0278-6133.27.3.327.

    PubMed  Article  Google Scholar 

  12. 12.

    Ferguson E, Atsma F, de Kort W, Veldhuizen I. Exploring the pattern of blood donor beliefs in first time, novice and experienced donors: Differentiating reluctant altruism, pure altruism, impure altruism and warm-glow. Transfusion. 2012;52:343-355. doi:10.1111/j.1537-2995.2011.03279.x.

    PubMed  Article  Google Scholar 

  13. 13.

    Ferguson E, Taylor M, Keatley D, Flynn N, Lawrence C. Blood donors’ helping behavior is driven by warm glow more evidence for the blood donor benevolence hypothesis. Transfusion. 2012;52:2189-2200. doi:10.1111/j.1537-2995.2011.03557.x.

    PubMed  Article  Google Scholar 

  14. 14.

    Bascle G. Controlling for endogeneity with instrumental variables in strategic management research. Strategic Organization. 2008;6:285-327. doi:10.1177/1476127008094339.

    Article  Google Scholar 

  15. 15.

    Martens EP, Pestman WR, de Boer A, Belitser SV, Klungel OH. Instrumental variables: Applications and limitations. Epidemiology. 2006;17:260-267. doi:10.1097/01.ede.0000215160.88317.cb.

    PubMed  Article  Google Scholar 

  16. 16.

    Angrist JD, Krueger AB. Instrumental variables and the search for identification. From supply and demand to natural experiments. J Econ Perspect. 2001;15:69-85. doi:10.1257/jep.15.4.69.

    Article  Google Scholar 

  17. 17.

    Newhouse JP, McClellan M. Econometrics in outcomes research. The use of instrumental variables. Annu Rev Public Health. 1998;19:17-34. doi:10.1146/annurev.publhealth.19.1.17.

    PubMed  Article  CAS  Google Scholar 

  18. 18.

    Bound J, Jaeger DA, Baker R. Problems with instrumental variable estimation when correlation between the instruments and the endogenous explanatory variable is weak. J Am Stat Assic. 1995;90:443-450. doi:10.2307/2291055.

    Google Scholar 

  19. 19.

    Godin G, Sheeran P, Conner M, Germain M. Asking questions changes behavior: Mere measurement effects on frequency of blood donation. Health Psychol. 2008;27:179-184. doi:1037/0278-6133.27.2.179.

    PubMed  Article  Google Scholar 

  20. 20.

    Grootendorst P. A review of instrumental variables estimation of treatment effects in the applied health sciences. SEDAP Research Program, McMaster University, Hamilton, Ontario, vol. 215, 2007

  21. 21.

    Heckman JJ. Sample selection bias as a specification error. Economerica. 1979;47:153-161. doi:10.2307/1912352.

    Article  Google Scholar 

  22. 22.

    Greenland S, Pearl J, Robins JM. Causal diagrams for epidemiologic research. Epidemiology. 1999;10:37-48. doi:10.1097/00001648-199901000-00008.

    PubMed  Article  CAS  Google Scholar 

  23. 23.

    Thoemmes FJ, Kim ES. A systematic review of propensity score methods in the social sciences. Multivar Behav Res. 2011;46:90-118. doi:10.1080/00273171.2011.540475.

    Article  Google Scholar 

Download references

Conflict of Interests

The author has previously written papers with C Abraham and IJC Veldhuizen and conducts ongoing collaborative research with IJC Veldhuizen.

Author information

Affiliations

Authors

Corresponding author

Correspondence to Eamonn Ferguson BSc, PhD.

Rights and permissions

This article is published under an open access license. Please check the 'Copyright Information' section either on this page or in the PDF for details of this license and what re-use is permitted. If your intended use exceeds what is permitted by the license or if you are unable to locate the licence and re-use information, please contact the Rights and Permissions team.

About this article

Cite this article

Ferguson, E. Non-Compliance and Instrumental Variables in Behavioural Medicine: a Commentary on van Dongen et al.. ann. behav. med. 45, 137–138 (2013). https://doi.org/10.1007/s12160-012-9460-8

Download citation

Keywords

  • Propensity Score
  • Instrumental Variable
  • Behavioural Medicine
  • Propensity Score Match
  • Methodological Solution