Skip to main content
Log in

Deliberative Engagement Methods for Patient-Centered Outcomes Research

  • Practical Application
  • Published:
The Patient - Patient-Centered Outcomes Research Aims and scope Submit manuscript

Abstract

There is growing emphasis on eliciting and incorporating stakeholder perspectives into health research and public policy development. The deliberative engagement session (DES) method provides one approach to elicit informed preferences from patients and other stakeholders on policy issues. DES involves day-long interaction with participants, including short plenary presentations followed by small group discussion. While interest in DES methods is expanding, practical guidance for researchers on this method remains limited. In this paper, we describe the DES method and its contemporary relevance for health policy research, illustrate how to conduct a DES using an example of a recent patient-centered outcomes research (PCOR) study with which we were involved, and discuss strengths and challenges of using this approach. DES methods generate rich data, reduce the risk of eliciting uniformed preferences or non-attitudes, and increase the likelihood of eliciting informed, reflective preferences. However, they are resource-intensive, and thus generally require trading away a larger, more representative sample. Despite these limitations, the DES method, when carefully designed, is well-suited for engaging stakeholders in research on complex health policy issues.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Fleurence R, Selby JV, Odom-Walker K, et al. How the Patient-Centered Outcomes Research Institute is engaging patients and others in shaping its research agenda. Health Aff. 2013;32(2):393–400.

    Article  Google Scholar 

  2. Garces JPD, Lopez GJP, Wang Z, et al. Eliciting patient perspective in patient-centered outcomes research: a meta narrative systematic review [PCORI website]. 2012. http://www.pcori.org/sites/default/files/Eliciting-Patient-Perspective-in-Patient-Centered-Outcomes-Research-A-Meta-Narrative-Systematic-Review1.pdf. Accessed 7 Oct 2015.

  3. Mullins CD, Barnet B, dosReis S, et al. Integrating patients’ voices in study design elements with a focus on hard-to-reach populations [PCORI website]. 2012. http://www.pcori.org/assets/pdfs/Integrating%20Patients%20Voices.pdf. Accessed 7 Oct 2015.

  4. Holm KE, Casaburi R, Cerreta S, et al. Patient involvement in the design of a patient-centered clinical trial to promote adherence to supplemental oxygen therapy in COPD. Patient. 2016;9(3):271–9.

    Article  PubMed  Google Scholar 

  5. Fleurence R, Whicher D, Dunham K, et al. The patient-centered outcomes research institute’s role in advancing methods for patient-centered outcomes research. Med Care. 2015;53(1):2–8.

    Article  PubMed  Google Scholar 

  6. Concannon TW, Fuster M, Saunders T, et al. A systematic review of stakeholder engagement in comparative effectiveness and patient centered outcomes research. J Gen Intern Med. 2014;29(12):1692–701.

    Article  PubMed  PubMed Central  Google Scholar 

  7. Deverka PA, Lavallee DC, Desai PJ, et al. Stakeholder participation in comparative effectiveness research: defining a framework for comparative effectiveness research. J Comp Eff Res. 2012;1(2):181–94.

    Article  PubMed  PubMed Central  Google Scholar 

  8. Cottrell E, Whitlock E, Kato E, et al. Defining the benefits of stakeholder engagement in systematic reviews. Research White Paper. (Prepared by the Scientific Resource Center under contract no. 290-2012-00004-C.) AHRQ publication no. 14-EHC006-EF. Rockville: Agency for Healthcare Research and Quality; 2014 Mar. https://www.ncbi.nlm.nih.gov/pubmedhealth/PMH0077182/. Accessed 2 Apr 2017.

  9. Esmail L, Moore E, Rein A. Evaluating patient and stakeholder engagement in research: moving from theory to practice. J Comp Eff Res. 2015;4(2):133–45.

    Article  PubMed  Google Scholar 

  10. Fetters MD, Curry LA, Creswell JW. Achieving integration in mixed methods designs—principles and practices. Health Serv Res. 2013;48(6):2134–56.

    Article  PubMed  PubMed Central  Google Scholar 

  11. Lemke AA, Halverson C, Ross LF. Biobank participation and returning research results: perspectives from a deliberative engagement session in South Side Chicago. Am J Med Genet A. 2012;158A(5):1029–37.

    Article  PubMed  PubMed Central  Google Scholar 

  12. Willison DJ, Swinton M, Schwartz L, et al. Alternatives to project-specific consent for access to personal information for health research: insights from a public dialogue. BMC Med Ethics. 2008;9:18.

    Article  PubMed  PubMed Central  Google Scholar 

  13. Rychetnik L, Carter SM, Abelson J, et al. Enhancing citizen engagement in cancer screening through deliberative democracy. J Natl Cancer Inst. 2013;105(6):380–6.

    Article  PubMed  Google Scholar 

  14. Kass N, Faden R, Fabi R, et al. Alternative consent models for comparative effectiveness studies: views of patients from two institutions. AJOB Empir Bioeth. 2016;7(2):92–105.

    Article  Google Scholar 

  15. De Vries R, Stanczyk A, Wall IF, et al. Assessing the quality of democratic deliberation: a case study of public deliberation on the ethics of surrogate consent for research. Soc Sci Med. 2010;70:1896–903.

    Article  PubMed  PubMed Central  Google Scholar 

  16. McWhirter RE, Critchley CR, Nicol D, et al. Community engagement for big epidemiology: deliberative democracy as a tool. J Personal Med. 2014;4:459–74.

    Article  Google Scholar 

  17. Damschroder LJ, Pritts JL, Neblo MA, et al. Patients, privacy and trust: patients’ willingness to allow researchers to access their medical records. Soc Sci Med. 2007;64(1):223–35.

    Article  PubMed  Google Scholar 

  18. Gregory J, Hartz-Karp J, Watson R. Using deliberative techniques to engage the community in policy development. Aust NZ Health Policy. 2008;5(16). doi:10.1186/1743-8462-5-16.

  19. Kim SYH, Uhlmann RA, Appelbaum PS, et al. Deliberative assessment of surrogate consent in dementia research. Alzheimers Dement. 2010;6(4):342–50.

    Article  PubMed  PubMed Central  Google Scholar 

  20. Sorensen K, Van den Broucke S, Fullam J, et al. Health literacy and public health: a systematic review and integration of definitions and models. BMC Public Health. 2012;12:80.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Schuman H, Presser S. Public opinion and public ignorance: the fine line between attitudes and nonattitudes. Am J Soc. 1980;85(5):1214–25.

    Article  Google Scholar 

  22. Abelson J, Forest PG, Eyles J, et al. Deliberations about deliberative methods: issues in the design and evaluation of public participation processes. Soc Sci Med. 2003;57(2):239–51.

    Article  PubMed  Google Scholar 

  23. Miller WL, Crabtree BF, Harrison MI, et al. Integrating mixed methods in health services and delivery system research. Health Serv Res. 2013;48(6):2125–33.

    Article  PubMed  PubMed Central  Google Scholar 

  24. Bombard Y, Miller FA, Hayeems RZ, et al. Citizens values regarding research with stored samples from newborn screening in Canada. Pediatrics. 2012;129(2):239–47.

    Article  PubMed  Google Scholar 

  25. Fishkin J. When the people speak: deliberative democracy and public consultation. Oxford: Oxford University Press; 2009.

    Google Scholar 

  26. Kim SYH, Wall IF, Stanczyk A, et al. Assessing the public’s views in research ethics controversies: deliberative democracy and bioethics as natural allies. J Empir Res Hum Res Ethics. 2009;4(4):3–16.

    Article  PubMed  PubMed Central  Google Scholar 

Download references

Acknowledgements

Dr. Morain gratefully acknowledges generous financial and intellectual support from the Hecht-Levi fellowship program at the Berman Institute of Bioethics. The authors thank Kristina Hallez, Rachel Fabi, and the staff at Geisinger Health System and the Center for Medical Technology Policy for support in the conduct and analysis of the DES study described in this manuscript.

Author information

Authors and Affiliations

Authors

Contributions

All authors contributed to the concept and design of this manuscript. Stephanie Morain drafted the manuscript, and acts as the overall guarantor for this work. Danielle Whicher, Nancy Kass, and Ruth Faden designed the example DES described in this manuscript, and reviewed and provided substantial feedback on earlier drafts. All authors reviewed and approved the final draft of this manuscript.

Corresponding author

Correspondence to Stephanie R. Morain.

Ethics declarations

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards.

Funding

This research was supported by Contract Number IP2PI000487-01 from the Patient-Centered Outcomes Research Institute (PCORI). All statements in this article, including its findings and conclusions, are solely those of the authors and do not necessarily represent the views of PCORI, its Board of Governors, or Methodology Committee.

Conflict of interest

Stephanie Morain, Nancy Kass, and Ruth Faden have no conflicts relevant to the contents of this article. Danielle Whicher is an employee of PCORI. Dr. Whicher’s work on the DES study described in this manuscript was completed before her employment with PCORI.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Morain, S.R., Whicher, D.M., Kass, N.E. et al. Deliberative Engagement Methods for Patient-Centered Outcomes Research. Patient 10, 545–552 (2017). https://doi.org/10.1007/s40271-017-0238-8

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s40271-017-0238-8

Keywords

Navigation