Abstract
Designing and manufacturing medical devices for specific patients is becoming increasingly feasible with developments in 3D printing and 3D imaging software. This raises the question of how patient-specific devices can be evaluated, since our ‘gold standard’ method for evaluation, the randomised controlled trial (RCT), requires that an intervention is standardised across a number of individuals in an experimental group. I distinguish several senses of patient-specific device, and focus the discussion on understanding the problem of variations between instances of an intervention for RCT evaluation. I argue that, despite initial appearances, it is theoretically possible to use RCTs to evaluate some patient-specific medical devices. However, the argument reveals significant difficulties for ensuring the validity of such trials, with implications for how we should think about methods of evidence gathering and regulatory approaches for these technologies.
Similar content being viewed by others
Notes
Patient-specific medical devices can be considered part of recent trends toward ‘personalised medicine’, which seeks to provide treatments targeted for specific patients. ‘Personalised medicine’ most often refers to methods for identifying which pharmacological treatments are likely to work for specific patients by developing drug efficacy data for sub-populations, and methods for identifying which sub-populations specific patients belong to (e.g., genetic tests), such that it relies upon stratified population-level evidence. The personalisation discussed here is somewhat different, referring rather to adapting treatments (surgical or pharmaceutical) to suit the needs of particular patients, or designing treatments for particular patients from scratch (which is not generally feasible for pharmaceutical treatments, but would include bespoke surgeries and prosthetics).
Regulatory systems currently allow patient-specific devices to bypass regulatory controls under some conditions (see, e.g., FDA 2014; TGA n.d.). These exemptions typically limit their use to small numbers of people (e.g., less than 5 units per year for the FDA), and more regulatory controls will be appropriate if use is to be scaled up.
Greater use of custom manufacture may also require changes to other kinds of regulatory control, such as different approaches to quality assurance in manufacturing, although I shall not discuss this issue.
Variation in interventions is of course not limited to patient-specific devices, so this argument has relevance for discussions of the use of RCTs in other areas where standardisation is difficult or problematic, such as surgery and complex interventions.
I do not consider diagnostic devices.
This term and the distinction with custom-made devices are borrowed from Australia’s Therapeutic Goods Administration (TGA n.d.).
The custom-made/bespoke distinction and terms are from Chadwick (2014).
There are also likely to be various practical barriers, e.g., less available funding [as in surgical trials (Garas et al. 2012)]. In order to focus on the theoretical tension between RCT evidence and custom-made devices, I leave these practical barriers aside.
For further discussion of the barriers discussed in the following three paragraphs, as well as other barriers, see, e.g., Cook (2009), Garas et al. (2012), Lassen et al. (2012), Meshikhes (2015), Stirrat (2004). Some intersections between my argument and literature on complex interventions is noted below.
Another way of seeing this is to consider that explanatory trials seek to ensure that the contextual factors surrounding an intervention are the same in the experimental and control groups, and this is possible for RCTs of custom-made devices as long as the variations between these devices are considered part of the intervention, rather than part of the context of the intervention (Schwartz and Lellouch 1967, p. 638). How interventions are defined is discussed further in the section “Variation within the definition of ‘the same’ intervention”.
An example is pill-case colour, which has been shown to sometimes influence outcomes in pharmaceutical trials (de Craen et al. 1996). Variations of pill-case colour within a trial might seem innocuous, but could influence results.
This is a controversial claim amongst philosophers concerned with the nature of causation, but I shall not seek to deal with this here. Cartwright’s analysis can be regarded as useful in understanding the significance of inherent variation even if we resist its metaphysical commitments.
Though further research is needed, current research suggests that for patients with over-expressed PDGFRB or mutated NRAS, vemurafenib’s causal capacity (which is thought to involve blocking how the cancer grows and maintains itself) is triggered, but this effect is negated by other mechanisms (as over-expressed PDGRFB or mutated NRAS mean the cancer has other routes by which to grow and maintains itself). In the case of patients whose stromal cells secrete hepatocyte growth factor, it would appear that vemurafenib’s capacity to block cancer growth and maintenance is itself prevented from occurring (see Nazarian et al. 2010; Straussman et al. 2012; Wilson et al. 2012).
This view would imply that in explanatory trials, no variations should be acceptable without strong reasons to think they are causally innocuous. In pragmatic trials, some variations would still be acceptable since this view is consistent with thinking that the causal contribution of a varied intervention could remain similar across its various instances, albeit not the same. The causal capacity of, for instance, taking the same drug every day at the same time might be similar to that of taking the same drug most days at slightly different times. The point at which variations made internal validity so low that the trial results tell us nothing at all would, again, often be very difficult to assess.
A similar view is found in the work of Schwartz and Lellouch (1967), as discussed below. Something like this view is also implicated in discussions of intervention ‘fidelity’ or ‘integrity’, that is, the extent to which an intervention is carried our according to a defined protocol, primarily discussed in relation to complex interventions. Though discussions of fidelity are partly concerned with how to ensure a treatment known to be effective is implemented as planned, some of this literature recognises that resolving issues related to variation will involve identifying a clear definition of an intervention, and identifying what aspects of an intervention are causally implicated in the desired outcomes (see, e.g., Gearing et al. 2011, p. 82; Medical Research Council 2008; Moncher and Prinz 1991, p. 250). However, exactly why variations are tied to these matters is not made explicit in this literature.
Hawe et al. (2004) offer a view of complex interventions which is consistent with this account. As they put it, “[r]ather than defining the components of the intervention as standard—for example, the information kit, the counselling intervention, the workshops—what should be defined as standard are the steps in the change process that the elements are purporting to facilitate or the key functions that they are meant to have” (2004, p. 1562). What Hawe and colleagues refer to as the ‘change process’ or ‘function’ of the intervention, I take it, maps onto what I have called the causal contribution of the intervention, though these authors do not elaborate on the conceptual basis for their view.
Thank you to an anonymous reviewer for pointing this out.
References
Atala, A. 2009. Engineering organs. Current Opinion in Biotechnology 20: 575–592.
Bargar, W. L. 1989. Shape the implant to the patient: A rationale for the use of custom-fit cementless total implants. Clinical Orthopedics and Related Research 249: 73–78.
Cartwright, N. 1994. Nature’s capacities and their measurement. Oxford: Oxford University Press.
Cartwright, N. 2009. What is this thing called efficacy? In Philosophy of the Social Sciences, ed. C. Mantzavinos, 185–206. Cambridge: Cambridge University Press.
Cartwright, N. 2010. What are randomised controlled trials good for? Philosophical Studies 147: 59–70.
Cartwright, N., and J. Hardie. 2012. Evidence-based Policy: A practical guide to doing it better. Oxford: Oxford University Press.
Cartwright, N., and E. Munro. 2010. The limitations of randomized controlled trials in predicting effectiveness. Journal of Evaluation in Clinical Practice 16: 260–266.
Chadwick, R. 2014. The ethics of personalized medicine: A philosopher’s perspective. Personalized Medicine 11 (1): 5.
Chapman, P. B., et al. 2011. Improved survival with vemurafenib in melanoma with BRAF V600E mutation. New England Journal of Medicine 364 (26): 2507–2516.
Clarke, B., D. Gillies, P. Illari, F. Russo, and J. Williamson. 2014. Mechanisms and the evidence hierarchy. Topoi 33: 339–360.
Colen, S., A. Dalemans, A. Schouwenaars, and M. Mulier. 2014. Outcome of custom-made IMP femoral components of total hip arthroplasty. A follow-up of 15–22 years. Journal of Arthroplasty 29: 397–400.
Cook, J. A. 2009. The challenges faced in the design, conduct and analysis of surgical randomised controlled trials. Trials 10: 9.
de Craen, A. J., P. J. Roos, A. L. de Vries, and J. Kleijnen. 1996. Effect of colour of drugs: Systematic review of perceived effect of drugs and of their effectiveness. BMJ (Clinical Research Ed.) 313 (7072): 1624–1626.
Food and Drug Administration (FDA). 2014. Custom device exemption: Guidance for industry and Food and Drug Administration staff. Rockville, MD: US Department of Health and Human Services.
Garas, G., A. Ibrahim, H. Ashrafian, K. Ahmed, V. Patel, K. Okabayashi, P. Skapinakis, A. Darzi, and T. Athanasiou. 2012. Evidence-based surgery: Barriers, solutions and the role of evidence synthesis. World Journal of Surgery 36: 1723–1731.
Gearing, R. E., N. El-Bassel, A. Ghesquiere, S. Baldwin, J. Gillies, and E. Ngeow. 2011. Major ingredients of fidelity: A review and scientific guide to improving quality of intervention research implementation. Clinical Psychology Review 31: 79–88.
Gilbert, F., C. D. O’Connell, T. Mladenovska, and S. Dodds. 2017. Print me and organ? Ethical and regulatory issues emerging from 3D bioprinting in medicine. Science and Engineering Ethics 1–19.
Grant, P., A. Aamodt, J. A. Falch, and L. Nordsletten. 2005. Differences in stability and bone remodeling between a customized uncemented hydroxyapatite coated and a standard cemented femoral stem. A randomized study with use of radiostereometry and bone densitometry. Journal of Orthopedic Research 23 (6): 1280–1285.
Hawe, P., A. Shiell, and T. Riley. 2004. Complex interventions: How “out of control” can a randomised controlled trial be? BMJ (Clinical Research Ed.) 328 (7455): 1561–1563.
Hey, S. P. 2015. What theories are tested in clinical trials? Philosophy of Science 82: 1318–1329.
Howick, J. 2011. Exposing the vanities – and a qualified defense – of mechanistic reasoning in health care decision making. Philosophy of Science 78 (5): 926–940.
Howick, J., P. Glasziou, and J. K. Aronson. 2013. Can understanding mechanisms solve the problem of extrapolating from study to target populations (the problem of ‘external validity’)? Journal of the Royal Society of Medicine 106: 81–86.
Imanishi, J., and P. F. M. Choong. 2015. Three-dimensional printed calcaneal prosthesis following total calcanectomy. International Journal of Surgery Case Reports 10: 83–87.
Lassen, K., A. Høye, and T. Myrmel. 2012. Randomised trials in surgery: The burden of evidence. Reviews on Recent Clinical Trials 7: 244–248.
Marro, A., T. Bandukwala, and W. Mak. 2016. Three-dimensional printing and medical imaging: A review of the methods and applications. Current Problems in Diagnostic Radiology 45: 2–9.
Medical Research Council (2008) Developing and evaluating complex interventions: New guidance, http://www.mrc.ac.uk/complexinterventionsguidance.
Meshikhes, A. N. 2015. Evidence-based surgery: The obstacles and solutions. International Journal of Surgery 18: 159–162.
Moncher, F. J., and R. J. Prinz. 1991. Treatment fidelity in outcome studies. Clinical Psychology Review 11: 247–266.
Muirhead-Allwood, S. K., N. Sandiford, J. A. Skinner, J. Hua, C. Kabir, and P. S. Walker. 2010. Uncemented custom computer-assisted design and manufacture of hydroxyapatite-coated femoral components. The Journal of Bone and Joint Surgery 92-B: 1079–1084.
Mustafa, F. A. 2017. Notes on the use of randomised controlled trials to evaluate complex interventions: Community treatment orders as an illustrative case. Journal of Evaluation in Clinical Practice 23(1): 185–192.
Nazarian, R., H. Shi, Q. Wang, X. Kong, R. C. Koya, H. Lee, Z. Chen, M. K. Lee, N. Attar, H. Sazegar, T. Chodon, S. F. Nelson, G. McArthur, J. A. Sosman, A. Ribas, and R. S. Lo. 2010. Melanomas acquire resistance to B-RAF(V600E) inhibition by RTK or N-RAS upregulation. Nature 468: 973–977.
Ng, V. Y., J. H. DeClaire, K. R. Berend, B. C. Gulick, and A. V. Lombardi. 2012. Improved accuracy of alignment with patient-specific positioning guides compared with manual instrumentation in TKA. Clinical Orthopaedics and Related Research 470: 99–107.
Nieuwenhuis, J. B., E. Irving, K. O. Rengerink, E. Lloyd, I. Goetz, D. E. Grobbee, P. Stolk, R. H. H. Groenwold, and M. Zuidgeest. 2016. Pragmatic trial design elements showed a different impact on trial interpretation and feasibility than explanatory elements. Journal of Clinical Epidemiology 77: 95–100.
Pope, C. 2002. Contingency in everyday surgical work. Sociology of Health and Illness 24 (4): 369–384.
Schwartz, D., and J. Lellouch. 1967. Explanatory and pragmatic attitudes in therapeutic trials. Journal of Chronic Diseases 20: 637–648.
Small, T., V. Krebs, R. Molloy, J. Bryan, A. K. Klika, and W. K. Barsoum. 2014. Comparison of acetabular shell position using patient specific instruments vs. standard surgical instruments: A randomized clinical trial. Journal of Arthroplasty 29: 1030–1037.
Stirrat, G. M. 2004. Ethics and evidence based surgery. Journal of Medical Ethics 30: 160–165.
Straussman, R., R. Morikawa, K. Shee, M. Barzily-Rokni, Z. R. Qian, J. Du, A. Davis, M. M. Mongare, J. Gould, D. T. Frederick, Z. A. Cooper, P. B. Chapman, D. B. Solit, A. Ribas, R. S. Lo, K. T. Flaherty, S. Ogino, J. A. Wargo, and T. Golub. 2012. Tumour micro-environment elicits innate resistance to RAF inhibitors through HGF secretion. Nature 487: 500–504.
Therapeutic Goods Administration (TGA). No date. Custom-made medical devices (fact sheet). Available at: https://www.tga.gov.au/custom-made-medical-devices.
Thorpe, K. E., M. Zwarenstein, A. D. Oxman, S. Treweek, C. D. Furberg, D. Altman, S. Tunis, E. Bergel, I. Harvey, D. Magid, and K. Chalkidou. 2009. A pragmatic-explanatory continuum indicator summary (PRECIS): A tool to help trial designers. Journal of Clinical Epidemiology 62: 464–475.
Viceconti, M., D. Testi, R. Gori, C. Zannoni, A. Cappello, and A. De Lollis. 2001. HIDE: A new hybrid environment for the design of custom-made hip prosthesis. Computer Methods and Programs in Biomedicine 64: 137–144.
Wallace, G. G., R. Cornock, C. O’Connell, S. Beirne, S. Dodds, and F. Gilbert. 2014. 3D bioprinting: Printing parts for bodies. Wollongong: ARC Centre of Excellence for Electromaterials Science. https://3dbioprint.creatavist.com/3dbioprinting.
Wilson, T. R., J. Fridlyand, Y. Yan, E. Penuel, L. Burton, E. Chan, J. Peng, E. Lin, Y. Wang, J. Sosman, A. Ribas, J. Li, J. Moffat, D. P. Sutherlin, H. Koeppen, M. Merchant, R. Neve, and J. Settleman. 2012. Widespread potential for growth-factor-driven resistance to anticancer kinase inhibitors. Nature 487: 505–509.
Worral, J. 2011. Causality in medicine: Getting back to the Hill top. Preventive Medicine 53: 235–238.
Zopf, D. A., S. J. Hollister, M. E. Nelson, R. G. Ohye, and G. E. Green. 2013. bioresorbable airway splint created with a three-dimensional printer. New England Journal of Medicine 368: 2043–2045.
Acknowledgements
My thanks to Robert Sparrow, Wendy Rogers, David Wotton, Tajanka Mladenovska, and the anonymous referees for this journal, for their comments on previous drafts. The funding was provided by Australian Research Council (Grant No. CE140100012)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Walker, M.J. Patient-specific devices and population-level evidence: evaluating therapeutic interventions with inherent variation. Med Health Care and Philos 21, 335–345 (2018). https://doi.org/10.1007/s11019-017-9807-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11019-017-9807-9