Skip to main content
Log in

Comparison of Two Multi-Criteria Decision Techniques for Eliciting Treatment Preferences in People with Neurological Disorders

  • Conference Paper
  • Published:
The Patient: Patient-Centered Outcomes Research Aims and scope Submit manuscript

Abstract

Objective: To present and compare two multi-criteria decision techniques (analytic hierarchy process [AHP] and conjoint analysis [CA]) for eliciting preferences in patients with cervical spinal cord injury (SCI) who are eligible for surgical augmentation of hand function, either with or without implantation of a neuroprosthesis. The methods were compared in respect to attribute weights, overall preference, and practical experiences.

Methods: Two previously designed and administered multi-criteria decision surveys in patients with SCI were compared and further analysed. Attributes and their weights in the AHP experiment were determined by an expert panel, followed by determination of the weights in the patient group. Attributes for the CA were selected and validated using an expert panel, piloted in six patients with SCI and subsequently administered to the same group of patients as participated in the AHP experiment.

Results: Both experiments showed the importance of non-outcome-related factors such as inpatient stay and number of surgical procedures. In particular, patients were less concerned with clinical outcomes in actual decision making. Overall preference in both the AHP and CA was in favor of tendon reconstruction (0.6 vs 0.4 for neuroprosthetic implantation). Both methods were easy to apply, but AHP was less easily explained and understood.

Conclusions: Both the AHP and CA methods produced similar outcomes, which may have been caused by the obvious preferences of patients. CA may be preferred because of the holistic approach of considering all treatment attributes simultaneously and, hence, its power in simulating real market decisions. On the other hand, the AHP method is preferred as a hands-on, easy-to-implement task with immediate feedback to the respondent. This flexibility allows AHP to be used in shared decision making. However, the way the technique is composed results in many inconsistencies. Patients preferred CA but complained about the number of choice tasks.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Table I
Table II
Fig. 1
Fig. 1

Notes

  1. (N × T × A)/C ≥ 500, where N = number of respondents, T = number of choice sets per respondent, A = number of scenarios per choice set, and C = maximum number of levels.

References

  1. Haynes R, Deveraux P, Guyatt GH. Physicians’ and patients’ choices in evidence based practice: evidence does not make decisions, people do [editorial]. BMJ 2002; 324: 1350

    Article  PubMed  Google Scholar 

  2. Cabana MD, Rand CS, Powe NR, et al. Why don’t physicians follow clinical practice guidelines: a framework for improvement. JAMA 1999; 282(15): 1458–64

    Article  PubMed  CAS  Google Scholar 

  3. Suarez-Almazor ME, Conner-Spady B, Kendall CJ, et al. Lack of congruence in the ratings of patients’ health states by patients and their physicians. Med Decis Making 2001; 21: 113–21

    PubMed  CAS  Google Scholar 

  4. Waters RL, Mucitelli LM. Tendon transfer to improve function of patients with tetraplegia. In: Kirschblum S, Campagnolo DI, DeLisa JA, editors. Spinal cord medicine. Philadelphia (PA): Lippincott, Williams & Wilkins, 2002: 409-23

    Google Scholar 

  5. Peckham PH, Keith MW, Kilgore KL, et al. Efficacy of an implanted neuroprosthesis for restoring hand grasp in tetraplegia: a multicenter study. Arch Phys Med Rehabil 2001; 82: 1380–8

    Article  PubMed  CAS  Google Scholar 

  6. Ryan M, Scott DA, Reeves C, et al. Eliciting preferences for health care: a systematic review of techniques. Health Technol Assess 2001; 5: 1–186

    PubMed  CAS  Google Scholar 

  7. Belton V, Stewart TJ. Multiple criteria decision analysis; an integrated approach. Dordrecht: Kluwer Academic Publishers, 2003

    Google Scholar 

  8. Saaty TL. How to make a decision: the analytic hierarchy process. Eur J Oper Res 1990; 48(1): 9–26

    Article  Google Scholar 

  9. Dolan JG, Isselhardt BJ, Cappuccio JD. The analytic hierarchy process in medical decision making: a tutorial. Med Decis Making 1989 Jan–Mar; 9 (1): 40-50

  10. Phillips KA, Maddala T, Johnson FR. Measuring preferences for health care interventions using conjoint analysis: an application to HIV testing. Health Serv Res 2002 Dec; 37(6): 1681–705

    Article  PubMed  Google Scholar 

  11. Bridges J, Onukwugha E, Johnson FR, et al. Patient preference methods: a patient centered evaluation pradigm. ISPOR Connections 2007; 13(6): 4–7

    Google Scholar 

  12. Snoek GJ, van Til JA, Krabbe PFM, et al. Decision for reconstructive interventions of the upper limb in individuals with tetraplegia: the effect of treatment characteristics. Spinal Cord 2008 Mar; 46(3): 228–33

    Article  PubMed  CAS  Google Scholar 

  13. Hummel JM, Snoek GJ, van Til JA, et al. A multi-criteria decision analysis of augmentative treatment of the hand in tetraplegia. J Rehab R&D 2005; 42 (5): 635-44

    Google Scholar 

  14. Expertchoice® [online]. Available from URL: http://www.expertchoice.com [Accessed 2007 Oct 22]

  15. Sawtooth Software [online]. Available from URL: http://www.sawtoothsoftware.com [Accessed 2007 Jul 3]

  16. Maynard FM, Bracken MB, Ditunno JF, et al. International standards for neurological and functional classification of spinal cord injury. Spinal Cord 1997; 35: 266–74

    Article  PubMed  Google Scholar 

  17. Orme B. Getting started with conjoint analysis: strategies for product design and pricing research. Madison (WI): Research Publishers LLC, 2006 [online]. Available from URL: http://www.sawtooth.com [2007 Jul 30]

  18. McDowell CL, Moberg M, House JH. The Second International Conference on Surgical Rehabilitation of the Upper Limb in Tetraplegia. J Hand Surg 1986; 11A: 604–8

    Google Scholar 

  19. Snoek GJ, IJzerman MJ, Post MW, et al. Valuation of SCI-related impairments. Archives PM&R 2005; 86: 1623–30

    Google Scholar 

  20. Mulye R. An empirical comparison of three variants of AHP and two variants of conjoint analysis. J Behav Dec Making 1998; 11: 263–80

    Article  Google Scholar 

  21. Zanakis SH, Solomon A, Wishart N, et al. Multi-attribute decision making: a simulation comparison of select methods. Eur J Oper Res 1998; 107: 507–29

    Article  Google Scholar 

  22. Srivastava J, Connolly T, Beach LR. Do ranks suffice? A comparison of alternative weighting approaches in value elicitation. Organ Behav Hum Decis Process 1995; 63(1): 112–6

    Article  Google Scholar 

Download references

Acknowledgements

No sources of funding were used to assist in the preparation of this study. The authors have no conflicts of interest that are directly relevant to the content of this study.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Maarten J. IJzerman.

Rights and permissions

Reprints and permissions

About this article

Cite this article

IJzerman, M.J., van Til, J.A. & Snoek, G.J. Comparison of Two Multi-Criteria Decision Techniques for Eliciting Treatment Preferences in People with Neurological Disorders. Patient-Patient-Centered-Outcome-Res 1, 265–272 (2008). https://doi.org/10.2165/1312067-200801040-00008

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.2165/1312067-200801040-00008

Keywords

Navigation