Practical guidance for engaging patients in health research, treatment guidelines and regulatory processes: results of an expert group meeting organized by the World Health Organization (WHO) and the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO)
- 2.4k Downloads
There is increasing emphasis on patient-centred research to support the development, approval and reimbursement of health interventions that best meet patients’ needs. However, there is currently little guidance on how meaningful patient engagement may be achieved. An expert working group, representing a wide range of stakeholders and disciplines, was convened by the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) and the World Health Organization (WHO). Through a structured, collaborative process the group generated practical guidance to facilitate optimal patient engagement in clinical development and regulatory decisions. Patient engagement is a relational process. The principles outlined in this report were based on lessons learned through applied experience and on an extensive dialogue among the expert participants. This practice guidance forms a starting point from which tailoring of the approach to suit different chronic diseases may be undertaken.
KeywordsOutcomes research Patient engagement Patient preference Regulatory process Treatment guidelines
Committee for orphan medicinal products
Committee for human medicinal products
Committee for advanced therapies
European public assessment report
Scientific advice working party
Scientific advisory group
Pharmacovigilance risk assessment committee
Patient research partner
Health literacy Enabling patient to read, understand and act on quality health information;
Shared decision making and personal care planning Enhancing self-determination and working with clinicians to select appropriate treatments or management options ;
Quality improvement Providing patient relevant feedback on healthcare processes and outcomes.
Patient engagement in healthcare decisions respects patient autonomy increases the likelihood that treatments would be aligned with patient (group) needs and preferences and ultimately leads to better outcomes for all concerned . The complementary impact on society includes reducing healthcare and research waste through the efficient use of resources, as is the focus of health economics [7, 8]. This applies at all levels in society and thus includes individual clinical decisions. The promotion of patient-centeredness is not limited to improving healthcare, but is relevant for the entire life cycle of medicines.
To support the development, approval and reimbursement of medical interventions that best meet patients’ needs, there is increasing emphasis on patient-centred research through the engagement of patients in identifying unmet needs , the design and conduct of clinical studies , subsequent regulatory assessments , post-marketing vigilance and data collection. Patient engagement in clinical practice guideline development is also recommended by many organizations [12, 13, 14, 15, 16, 17]. Despite the many ongoing pilots, there is currently little practical guidance on how effective patient engagement may be facilitated. In this paper, we examine how patients’ perspectives can inform the development of clinical research and regulatory decisions. Our aim was to generate practical guidance to facilitate optimal patient engagement in these decisions and to raise awareness of its value.
An expert working group meeting was organized by the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) and the WHO, and held in Geneva, Switzerland, on June 9, 2017. The working group comprised a global representation of clinicians, outcome researchers, social scientists, epidemiologists, health technology assessment (HTA) and regulatory experts, pharmacists and patient representatives. They were invited for their expertise and knowledge regarding patient engagement and preference research. Agreement on the principles outlined in this article was based on an exchange of peer-reviewed publications prior to the meeting and a 1 day interactive meeting with short presentations and intense discussion among the meeting participants.
At the meeting, results from a literature review of methods for incorporating patients’ preferences into decision-making were presented followed by an introduction to the nomenclature of patient engagement and a case study on improving the quality of delivering integrated care by involving older people (I. Araujo de Carvalho, I. Aujoulat, M. Hiligsmann). Next, organizations including the European Medicines Agency (EMA) and the Outcomes Measures in Rheumatology (OMERACT) initiative introduced their principles for engagement and presented lessons learned through applied experiences (N. Bere, M. de Wit). After the presentations, a prolonged discussion among the expert group members took place, focused on the application of these principles in different contexts, and shared conclusions were reached.
Following the meeting, members of the writing group (M. de Wit, C. Cooper, N. Bere, P. Tugwell, P. G. Conaghan, C. Roberts, I. Aujoulat) drafted a first report on the meeting, which was reviewed and commented on by all authors. In this resulting article, we define the concepts of patient involvement at different levels and discuss patient engagement within the three areas: patient preference elicitation, outcomes research and regulatory processes. Case studies from the EMA and the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis (GRAPPA) (following OMERACT principles) exemplify our approach.
There are complementary approaches to capturing patients’ perspectives in health research and health services innovation, to ensure that research and development of medical interventions adequately meet patients’ needs. Patients in different numbers may contribute to subsequent phases of a process, carrying out a variety of tasks and on different levels. Different terminology is used, and it is first important to clarify these concepts [18, 19]. We distinguish the following patient roles in patient involvement.
Consultation involves participation of patients and/or their representatives as study participants; their role may be to trial an investigational agent and/or to provide information on their own individual experience. This level of involvement requires predominantly a flow of information in one direction from patient to researcher. Protocols for participation in a clinical trial or other means of data collection such as surveys, interviews or focus groups are well developed and highly regulated through the Helsinki declaration.
Advice is provided by an informed patient, e.g., by discussing new developments and sharing personal knowledge and experience, or by reviewing research grant applications or a scientific publication. The involvement is often limited to one occasion.
Collaboration may be undertaken through multiple roles, e.g., patient research partner (PRP), or patient expert . A patient expert may be defined as an ‘expert’ in their own disease and its management, and someone who is equipped to look further than their own personal experience of the disease. Patient collaboration takes place on a collective level and influences the aims, design and conduct of a study through dialogue, two-way communication in partnership with other stakeholders.
Control is achieved when a patient organization takes the lead, determines the research gap or research questions, controls the study and owns the data.
We will use the terms engaging patients and patient involvement as synonyms for the process of enabling people with a long-term condition to provide a meaningful contribution to research or the improvement in healthcare services. Patient empowerment is a process whereby the person develops more control over decisions and actions that affect their own life and health [20, 21]. This involves helping a person to learn to think critically and make informed decisions about self-care to reduce symptoms from the chronic disease . There is increasing recognition that patient empowerment is a core element of quality oriented, sustainable health systems of the future . However, because the focus of this article is on engaging patients in the context of health research and medicine development and authorisation, we will not elaborate on patient empowerment.
Patient engagement in patient preference elicitation
The assessment of patient preferences could help to improve disease management, facilitate shared decision-making and improve adherence, whilst increasing the use of patient preferences in health policy making may improve the quality of decisions and increase efficiency . For example, the collection of individual preferences may inform regulatory review processes . Preference studies offer a systematic approach to gathering information on the distribution of preferences in a population and the implications on patients’ acceptance of specific treatments. Although the usefulness of stated preference studies is still not well established, such studies, along with other methods such as focus groups and expert opinions, have the potential to become an important tool for gathering patient views in a systematic way to estimate treatment acceptability and concordance, and thus inform regulatory and treatment decisions .
Qualitative and quantitative methods could be used to identify what is important to patients with respect to healthcare decision-making. Stated preference methods have been increasingly used in HTA to elicit preference . The most often used stated-preference methods include discrete choice experiment (DCE) [27, 28], best–worst scaling (BWS) , and analytical hierarchy process (AHP) [30, 31]. As an example, Rothery et al. used a DCE to assess patient preference for treatment-related benefits and risk of disease relapse in the management of low disease states of psoriatic arthritis (PsA) . The study found that among patients in low disease states of PsA, respondents were willing to accept greater risk of relapse (up to 30% increased risk) for an improvement in the side effects of sickness and nausea and health status.
Patients’ preferences are nowadays increasingly sought in healthcare decision-making. By example, the US Food and Drug Administration (FDA) has developed an initiative for the consideration of patient preferences for multiple endpoints in development assessment of new health technologies in medical devices (FDA Medical Device Patient Preference initiative) . The FDA has also provided definitive guidance on the use of patient reported outcome measures for use in trials to support labelling claims , and the EMA has developed guidance on the use of patient reported outcomes in anticancer studies .
The German Institute for Quality and Efficiency in Healthcare (IQWiG) may include patient preference in cost–benefit assessment as part of the economic evaluation.
The National Institute for Health and Care Excellence (NICE) assessment of utility impact involves the elicitation of general population preferences.
The EMA piloted swing weighting to elicit patient preferences for benefit/risk analysis for market authorization . This was followed up with a larger study eliciting preferences of over 550 multiple myeloma patients on benefits and risks of cancer treatments to illustrate how such data may be used to estimate patients’ acceptance of new treatments .
The PROTECT (Pharmacoepidemiological Research on Outcomes of Therapeutics by a European Consortium) project, conducted by the Innovative Medicines Initiative (IMI) and coordinated by the EMA, focuses on the question of public/patient involvement in regulatory processes .
IMI PREFER (Patient Preferences in Benefit-Risk Assessments during the Drug Life Cycle) project initiated late 2016 focuses on eliciting patient perspectives for use in benefit-risk assessment (BRA) and health technology assessment (HTA) . PREFER will result in recommendations regarding the best ways to perform and include patient-preference in the decision-making process of industry, regulatory authorities and HTA bodies.
These initiatives have focused on the role of patient preferences through the life cycle of medicines and for regulatory decision making. Incorporating the preferences of patients in clinical decision-making (shared decision making) is another dimension that could be the focus of future initiatives .
Patient engagement in clinical outcomes research
Initiatives to increase patient engagement in aspects of clinical research have been undertaken by a wide range of research communities. Engagement may involve the patient, relatives, informal carers or patient representatives, all of whom can give a relevant stakeholder perspective on research and healthcare innovation. The patient engagement process is evolving, and roles for patients may vary with increasing degrees of involvement, from steering group members, committee or working party members with voting rights, to PRPs or Delphi participants .
Here we explore the experience of the OMERACT Initiative. OMERACT sets out to achieve consensus about core outcome sets (endpoints) for clinical trials and longitudinal observational studies in rheumatology, with patient involvement an integral part of the process . OMERACT defines the PRP as a person with a relevant disease who operates as an equal member in the research team to provide the patient perspective in every phase of the study . PRPs share decision-making power with professionals, can take on any role similar to all other members and have full voting rights at the biannual meeting . Practical recommendations for patient engagement in research teams were published in 2016 .
European League Against Rheumatism (EULAR) published practical recommendations for the inclusion of patient representatives in scientific projects . They are widely followed by all working groups developing disease management recommendations for rheumatic conditions.
COMET (Core Outcome Measures in Effectiveness Trials) brings together people interested in the development and application of agreed standardised outcome sets used in clinical research . COMET has established a People and Patient Participation, Involvement and Engagement (PoPPIE) Working Group that develops practical resources for PRPs.
The Standardised Outcomes in Nephrology (SONG) initiative aims to establish a set of core outcomes and outcome measures across the spectrum of kidney disease for trials and other forms of research. The outcomes will be developed based on the shared priorities of patients, caregivers, clinicians, researchers, policy makers and relevant stakeholders. This will help to ensure that research is reporting outcomes that are meaningful and relevant to patients with kidney disease, their family and their clinicians. Currently in development are core outcomes for haemodialysis (SONG-HD), transplantation (SONG-Tx), peritoneal dialysis (SONG-PD) children and adolescents (SONG-Kids), and polycystic kidney disease (SONG-PKD) .
Based on the concept of value-based healthcare, the International Consortium for Health Outcomes Measurement (ICHOM) brings together global teams of physician leaders, outcomes researchers and patient advocates to define Standard Sets of outcomes for clinical practice that matter most to patients. ICHOM captures the patient perspective both by conducting qualitative research to collect data on patient preferences as by active involvement of patient experts in the consensus building process. The final standard sets then drive adoption to enable healthcare providers globally to compare, learn and improve .
The Patient-Centered Outcomes Research Institute (PCORI) has developed the PCORI Engagement Rubric, which provides a framework for operationalizing engagement to incorporate patients and other stakeholders in all phases of research. The aim is to encourage active and sustained engagement of patients as partners in planning, conducting and disseminating research, to improve clinical decision-making and outcomes .
Case study 1: GRAPPA core outcomes set in PsA
GRAPPA is a non-profit organisation focused on identifying and initiating research projects, advancing standardized criteria for PsA registries and developing treatment guidelines. GRAPPA was formed in 2003 of > 600 rheumatologists, dermatologists, radiologists, geneticists, methodologists, epidemiologists and biopharmaceutical industry representatives with an interest in PsA and psoriasis research. Since 2013, patient research partners participate in the annual meetings and a variety of working groups. A best practice case study of patient participation in the update of the PsA core domain set is outlined here [46, 47].
The OMERACT-GRAPPA PsA working group met to review the existing PsA core set  based on the patient perspective as well as new research findings and further develop PsA responder indices. The group discussed the need to revise the PsA core set, and opportunities to add, move, or merge existing domains to better integrate the patient perspective and to remove redundancy; and how to incorporate the core set in a composite index .
Active partnership of five PRPs in the working group and one PRP in the Steering Group.
International focus group study representing five continents and including seven countries.
New domains were identified through systematic literature review, international focus groups exploring the opinions and experiences of people with PsA and two international surveys with patients and physicians to prioritise domains. Consensus was achieved through an international face-to-face expert meeting with equal representation of patients and physicians to agree on the most important domains, and voting at the OMERACT 2016 conference. PRPs were involved at all phases of the process. As a result, the updated PsA core domain set incorporates patients’ and physicians’ priorities and includes the domains of: musculoskeletal disease activity, skin disease activity, pain, patient global, physical function, health-related quality of life, fatigue and systemic inflammation .
Challenges identified were to ensure broad representativeness of patients’ perspectives in demography, geography, disease severity and in numbers, which entails a significant level of communication and efforts to enable equal collaboration. Preserving the patient perspective throughout the research process is of great importance and following from an unanticipated workload for PRPs and researchers it may be difficult to keep PRPs and researchers motivated to collaborate.
Participation requires multiple forms of engagement and should always be tailor-made, there is no common methodology or application that fits every research context. In addition, participation requires a willingness for mutual learning, and the role of the principal investigator is key in providing adequate support to patients. Fruitful participation always requires additional resources to be allocated to the process, with extra effort in time, money and energy. A structural approach guarantees sustainability of participation.
Patient engagement in regulatory processes
Since establishment of the EMA in 1995, interaction with patients has developed progressively with the creation of a Framework for interaction with patient and consumer groups in 2005, a Patients and Consumers Working Party (PCWP) in 2006, including representatives from 20 organisations and a dedicated ‘public engagement’ department in 2014.
The EMA has increasingly incorporated the patients’ voice within its regulatory activities by way of pilot projects testing the various engagement methodologies, in collaboration with its network of patient organisations [50, 51]. There are now processes to include patients at all stages along the regulatory lifecycle (See Case Study 2).
Case study 2: EMA methodology on patient engagement, a progressive journey
Selection of end-points.
Defining target population, inclusion/exclusion criteria.
Study duration, treatment administration, formulation and dosage.
Clinical relevance versus statistical significance.
Identification of risk potential.
Significant benefit (added-value) over existing therapies.
Ethical aspects, informed consent.
Define the role of the patient for each specific activity and ensure that all involved parties are informed. This facilitates participation and also manages expectations from all angles.
Identify the most suitable patients/groups to involve in each situation, taking into account representation and confidentiality aspects.
Establish a range of engagement methodologies and assess for each case which method is most suitable for the situation (e.g., face-to-face, in writing, surveys, committee meetings, preference elicitation).
Provide individualised support and training, tailored to the individual and the activity, e.g., training sessions, videos, info-sheets, webpages, one-to-one support. To aid training, the European Patients’ Academy on Therapeutic Innovation (EUPATI) has developed patient education resources in key areas of non-clinical and clinical development, clinical trials, regulatory affairs and health technology assessment [52, 53].
Provide feedback to all involved, especially so that the patient sees that their input is valuable.
Continuous monitoring and reporting on interactions, and refining procedures according to feedback received.
Challenges identified were in finding suitable patients (e.g., language barrier, availability) while ensuring representativeness and in knowing how to also gather validated information from larger groups. Potential conflicts of interest need to be handled sensitively. Compensation is also an area requiring attention. Demonstrating the value and/or impact of patient involvement in a quantitative manner while avoiding subjectivity is a challenge; however, qualitative methods can be of value provided that there is sufficient reflexivity and transparency. The trend in public health is now to use mixed methods designs.
Conclusions: principles for engaging with patients
Engaging with patients helps to bridge the gap between health research, policy and patient-centred practice, increases transparency and patients’ adherence to treatments, reduces waste and leads to more meaningful regulatory outcomes. Patient engagement should be initiated in a stepwise approach through which all parties can learn together and identify the format that works best for all involved. At all stages of engagement, provide support, define roles, manage expectations and give feedback, to ensure that engagement is mutually beneficial. In this way, ultimately everyone can benefit from knowledge sharing.
WHO-ESCEO Principles for engaging patients in health research, treatment guidelines and regulatory processes.
Table reprinted from de Wit et al.  with permission from Elsevier
9 principles for best practice
1. Patient perspective
The perspective of patients is pivotal in health research, treatment guidelines, and the authorization of medicines
Capturing patients’ perspectives requires multiple forms of engagement that are complementary; the strategy should be tailored to suit different chronic diseases and contexts
Transparency for all stakeholders about the role of patients in the process facilitates participation and manages expectations from all perspectives
Broad representativeness of patients’ perspectives in terms of demography, geography, disease severity and sample size must be ensured
5. Multiple inputs
Involvement of at least two patient experts throughout the research, assessment and deliberation processes ensures that the patient perspective is preserved and increases the validity of the outcomes
Providing adequate information, support and feedback to patient representatives is key to effective engagement
Teaching researchers the knowledge and skills required to support public engagement should always be considered
Productive participation always requires resources to be allocated to the process, with extra effort in time, money and energy
Continuous monitoring and measuring of interactions will be vital for refining procedures according to feedback
In this article, we acknowledge that there are different levels of patient engagement, all equally valuable and complementary, and that the degree of patient participation and level of power or authority should not be mandatory but may be tailor-made to suit the individual research purpose. Patient engagement is an evolving concept, and the research agenda for future refinement of the process will include the development of new methodologies to assess the impact of patient engagement and novel ways to enhance the significance of existing methods for engagement, in order to emphasize the role of the patient voice in health research, treatment guidelines and regulatory processes. The impact of patient engagement, in terms of added value, but also cost and potential downsides is currently poorly understood. Reasons for this include a lack of consensus on a validated methodology or tool to measure impact, and a lack of consensus on the important outcomes of patient engagement; people and stakeholder groups have different expectations and objectives regarding patient engagement, and thus require different methodologies and outcomes for evaluation.
Another challenge is that we, as an expert group, all agree that principal investigators and stakeholders should invest in support, information, education and feedback to patient experts (see Panel); however, there is a growing awareness that it does not make sense to train patients in the medicine development cycle, without simultaneously preparing researchers for their role and task of engaging patients in that process. Thus, there is a need to explore both the benefits and downsides of educating patient experts as well as exploring the needs of researchers for guidance, coaching and training .
Role of the funding source The meeting was funded by the ESCEO asbl, a Belgian not-for-profit organisation. The authors thank the Chair for Biomarkers of Chronic Diseases and the International Scientific Partnership Program (ISPP#0111) at King Saud University, Riyadh, Saudi Arabia for their support. Role of medical writer/editor Editorial assistance in the preparation of this manuscript was provided by Lisa Buttle, PhD, of Medscript Ltd., which was funded by the ESCEO asbl, Belgium.
At the meeting, results from a literature review of methods for incorporating patients’ preferences into decision-making were presented followed by an introduction to the nomenclature of patient engagement and a case study on improving the quality of delivering integrated care by involving older people (I. Araujo de Carvalho, I. Aujoulat, M. Hiligsmann). Next, organizations including EMA and the OMERACT initiative introduced their principles for engagement and presented lessons learned through applied experiences (NB, MDW). After the presentations, a prolonged discussion among the expert group members took place and shared conclusions were reached. Following the meeting, members of the writing group (MDW, CC, NB, PT, PGC, CR, IA) drafted a first report on the meeting, which was reviewed and commented on by all authors (including: NA, MB, NB, WL). All authors meet the ICMJE criteria for authorship for this manuscript, take responsibility for the integrity of the work as a whole and have given final approval to the version to be published.
Compliance with ethical standards
Conflict of interest
O Bruyère reports grants from Biophytis, IBSA, MEDA, Servier, SMB, and Theramex, outside of the submitted work. N. Bedlington’s organisation has received grants from GSK, Abbvie, Pfizer, Janssen, CSL Behring, Almirall, Baxter, Sanofi-Pasteur, EUPATI project (IMI-JU) industry consortium (UCB, Amgen, Genzyme, VFA, AZ, Novo Nordisk, Bayer, Merck, Janssen, GSK, Chiesi, Hoffmann, Lilly, Novartis, Esteve), Gilead, Eli-Lilly, Johnson & Johnson, MSD, Alexion, Mylan, Servier, Teva, Celgene, Novartis, Vertex, AIPP, Bosch Foundation, Sanofi Aventis, Hoffman La Roche, Grunenthal, European Commission. She has an advisory role with Janssen, Teva and GSK, outside of the submitted work. M.L. Brandi reports personal fees from Amgen, Bruno Farmaceutici, Kyowa Kirin, grants and personal fees from Abiogen, Alexion, Amgen, Bruno Farmaceutici, Eli Lilly, Kyowa Kirin, MSD, NPS, Servier, Shire, SPA, personal fees from Alexion, Bruno Farmaceutici, Kyowa Kirin, Servier, Shire, outside the submitted work. N. Burlet is a full-time employee at Sanofi Pasteur headquarters, Lyon, France. P.G. Conaghan is supported in part by the National Institute for Health Research (NIHR) Leeds Biomedical Research Centre, outside of the submitted work. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. C. Cooper reports personal fees from Alliance for Better Bone Health, Amgen, Eli Lilly, GSK, Medtronic, Merck, Novartis, Pfizer, Roche, Servier, Takeda and UCB, outside of the submitted work. M. de Wit has received fees for lectures or consultancy through Stichting Tools from Abbvie, BMS, Celgene, Eli Lilly, Janssen-Cilag, Novartis, Pfizer and Roche, outside of the submitted work. J.A. Kanis reports grants from Amgen, grants from Lilly, grants from Radius Health, grants from UCB, other from Meda, outside the submitted work; and is a member of the National Osteoporosis Guideline Group (NOGG) and the principal architect of FRAX but derives no financial benefit. W. Lawrence reports personal fees from Danone Nutricia, outside the submitted work. J.Y. Reginster reports personal fees and other from Servier, IBSA, Genevrier, UCB, Asahi, Radius Health, Meda, Pierre Fabre, grants from Merck Sharp & Dohme (MSD), Amgen, Lilly, Servier, Pfizer, Danone, Meda, Cniel, IBSA, Genevrier, personal fees from MSD, IBSA, Genevrier, Servier, Danone, Pharmevo, Cniel, Meda, and the Dairy Research Council (DRC), outside of the submitted work. R. Rizzoli reports personal fees from Radius Health, Effryx and Danone, outside of the submitted work. M. Scholte-Voshaar has received a grant for her PhD research from Roche and fees for lectures from Pfizer, outside of the submitted work. All other authors report nothing to disclose relating to the submitted work: N. Al-Daghri, I. Araujo de Carvalho, I. Aujoulat, N. Bere, M. Barker, P. Halbout, M. Hiligsmann, F. Jiwa, J. Kirwan, A. Laslop, D. Pinto, C. Prieto Yerro, V. Rabenda, C. Roberts, P. Tugwell, M. Vlaskovska.
Statement of human and animal rights
This article does not contain any studies with human participants or animals performed by any of the authors.
For this type of study formal consent is not required.
- 1.WHO (2015) World report on ageing and health. http://www.who.int/ageing/events/world-report-2015-launch/en/. Accessed 24 Jan 2018
- 3.Haywood K, Brett J, Salek S et al (2015) Patient and public engagement in health-related quality of life and patient-reported outcomes research: what is important and why should we care? Findings from the first isoqol patient engagement symposium. Qual Life Res 24:1069–1076. https://doi.org/10.1007/s11136-014-0796-3 CrossRefPubMedGoogle Scholar
- 13.Montori VMDPJ, Straus S, Haynes B et al (2008) Decision making and the patient. In: Guyatt GRD, Meade MO, Cook DJ (eds) Users’ guides to the medical literature: a manual for evidence-based clinical practice, 2nd edn. Mcgraw-Hill Education, ColumbusGoogle Scholar
- 14.INVOLVE (2018) The lead for advancement of public involvement in health and care research across nihr and beyond. www.invo.org.uk/about-involve. Accessed 24 Jan 2018
- 19.PatientPartner (2011) Patient involvement in clinical research. A guide for patient organisations and patient representatives. https://www.geneticalliance.org.uk/media/1602/patientspartnerforpatientorgs.pdf. Accessed 24 Jan 2018
- 23.EPF (2016) European patients forum: patient empowerment campaign http://www.eu-patient.eu/campaign/patientsprescribe. Accessed 24 Jan 2018
- 25.Postmus D, Mavris M, Hillege HL et al (2016) Incorporating patient preferences into drug development and regulatory decision making: results from a quantitative pilot study with cancer patients, carers, and regulators. Clin Pharmacol Ther 99:548–554. https://doi.org/10.1002/cpt.332 CrossRefPubMedGoogle Scholar
- 34.FDA (2009) Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Clinical/medical 2009 http://www.fda.gov/downloads/drugs/guidancecomplianceregulatoryinformation/guidances/ucm193282.pdf. Accessed 24 Jan 2018
- 35.EMA (2016) Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man: the use of patient-reported outcome (pro) measures in oncology studies. http://www.ema.europa.eu/docs/en_gb/document_library/other/2016/04/wc500205159.pdf. Accessed 12 Feb 2018
- 36.PROTECT (2018) The pharmacoepidemiological research on outcomes of therapeutics by a european consortium. http://www.imi-protect.eu/index.shtml. Accessed 24 Jan 2018
- 37.PREFER (2016) Patient preferences in benefit-risk assessments during the drug life cycle. www.imi-prefer.eu Accessed 24 Jan 2018
- 38.Coulter A, Collins A (2011) Making shared decision-making a reality: no decision about me, without me. The King’s Fund, London. https://www.kingsfund.org.uk/sites/default/files/making-shared-decision-making-a-reality-paper-angela-coulter-alf-collins-july-2011_0.pdf. Accessed 24 Jan 2018
- 39.de Wit MP, Kvien TK, Gossec L (2015) Patient participation as an integral part of patient-reported outcomes development ensures the representation of the patient voice: a case study from the field of rheumatology. RMD Open 1:e000129. https://doi.org/10.1136/rmdopen-2015-000129 CrossRefPubMedPubMedCentralGoogle Scholar
- 43.SONG (2018) The standardised outcomes in nephrology (song) initiative: an international initiative that aims to establish core outcomes in chronic kidney disease. http://songinitiative.org/ Accessed 24 Jan 2018
- 44.ICHOM (2018) International consortium for health outcomes measurement. www.ichom.org. Accessed 24 Jan 2018
- 50.EMA (2011) Outcome report on pilot phase for participation of patient representatives in scientific advisory group (sag) meetings. http://www.ema.europa.eu/docs/en_gb/document_library/report/2011/12/wc500119201.pdf. Accessed 24 Jan 2018
- 51.EMA (2017) Outcome report on pilot to involve patients in benefit/risk discussions at chmp meetings. http://www.ema.europa.eu/docs/en_gb/document_library/report/2017/05/wc500227335.pdf. Accessed 24 Jan 2018
- 52.EUPATI (2018) European patients’ academy on therapeutic innovation (eupati) https://www.eupati.eu/. Accessed 24 Jan 2018
- 54.de Wit MC, Reginster J-Y (2019) Practical guidance for patient-centred health research. Lancet 393:1095–1096. https://doi.org/10.1016/S0140-6736(19)30034-0
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.