Practical guidance for engaging patients in health research, treatment guidelines and regulatory processes: results of an expert group meeting organized by the World Health Organization (WHO) and the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO)


There is increasing emphasis on patient-centred research to support the development, approval and reimbursement of health interventions that best meet patients’ needs. However, there is currently little guidance on how meaningful patient engagement may be achieved. An expert working group, representing a wide range of stakeholders and disciplines, was convened by the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) and the World Health Organization (WHO). Through a structured, collaborative process the group generated practical guidance to facilitate optimal patient engagement in clinical development and regulatory decisions. Patient engagement is a relational process. The principles outlined in this report were based on lessons learned through applied experience and on an extensive dialogue among the expert participants. This practice guidance forms a starting point from which tailoring of the approach to suit different chronic diseases may be undertaken.


The patient perspective is now increasingly recognized as key in the development, conduct and evaluation of health interventions. The 2015 World Health Organization (WHO) report on healthy ageing identified that self-care plays a critical role in health, with increasing patient participation leading to better health outcomes in older adults including improvements in physical activity, chronic pain and self-efficacy [1]. By involving patients at all stages of healthcare delivery and evaluation, the aim of enhancing self-care in patients with chronic, non-communicable disease may be achieved [2, 3]. Patient-centred care requires an understanding of a variety of patient-relevant components that go beyond medical diagnostic and treatment-related issues. They comprise psychosocial life-related challenges and a focus on patient engagement that acknowledges that patients have an important role to play in their own healthcare. This includes three pillars [4]:

  1. 1.

    Health literacy Enabling patient to read, understand and act on quality health information;

  2. 2.

    Shared decision making and personal care planning Enhancing self-determination and working with clinicians to select appropriate treatments or management options [5];

  3. 3.

    Quality improvement Providing patient relevant feedback on healthcare processes and outcomes.

Patient engagement in healthcare decisions respects patient autonomy increases the likelihood that treatments would be aligned with patient (group) needs and preferences and ultimately leads to better outcomes for all concerned [6]. The complementary impact on society includes reducing healthcare and research waste through the efficient use of resources, as is the focus of health economics [7, 8]. This applies at all levels in society and thus includes individual clinical decisions. The promotion of patient-centeredness is not limited to improving healthcare, but is relevant for the entire life cycle of medicines.

To support the development, approval and reimbursement of medical interventions that best meet patients’ needs, there is increasing emphasis on patient-centred research through the engagement of patients in identifying unmet needs [9], the design and conduct of clinical studies [10], subsequent regulatory assessments [11], post-marketing vigilance and data collection. Patient engagement in clinical practice guideline development is also recommended by many organizations [12,13,14,15,16,17]. Despite the many ongoing pilots, there is currently little practical guidance on how effective patient engagement may be facilitated. In this paper, we examine how patients’ perspectives can inform the development of clinical research and regulatory decisions. Our aim was to generate practical guidance to facilitate optimal patient engagement in these decisions and to raise awareness of its value.


An expert working group meeting was organized by the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO) and the WHO, and held in Geneva, Switzerland, on June 9, 2017. The working group comprised a global representation of clinicians, outcome researchers, social scientists, epidemiologists, health technology assessment (HTA) and regulatory experts, pharmacists and patient representatives. They were invited for their expertise and knowledge regarding patient engagement and preference research. Agreement on the principles outlined in this article was based on an exchange of peer-reviewed publications prior to the meeting and a 1 day interactive meeting with short presentations and intense discussion among the meeting participants.

At the meeting, results from a literature review of methods for incorporating patients’ preferences into decision-making were presented followed by an introduction to the nomenclature of patient engagement and a case study on improving the quality of delivering integrated care by involving older people (I. Araujo de Carvalho, I. Aujoulat, M. Hiligsmann). Next, organizations including the European Medicines Agency (EMA) and the Outcomes Measures in Rheumatology (OMERACT) initiative introduced their principles for engagement and presented lessons learned through applied experiences (N. Bere, M. de Wit). After the presentations, a prolonged discussion among the expert group members took place, focused on the application of these principles in different contexts, and shared conclusions were reached.

Following the meeting, members of the writing group (M. de Wit, C. Cooper, N. Bere, P. Tugwell, P. G. Conaghan, C. Roberts, I. Aujoulat) drafted a first report on the meeting, which was reviewed and commented on by all authors. In this resulting article, we define the concepts of patient involvement at different levels and discuss patient engagement within the three areas: patient preference elicitation, outcomes research and regulatory processes. Case studies from the EMA and the Group for Research and Assessment of Psoriasis and Psoriatic Arthritis (GRAPPA) (following OMERACT principles) exemplify our approach.


There are complementary approaches to capturing patients’ perspectives in health research and health services innovation, to ensure that research and development of medical interventions adequately meet patients’ needs. Patients in different numbers may contribute to subsequent phases of a process, carrying out a variety of tasks and on different levels. Different terminology is used, and it is first important to clarify these concepts [18, 19]. We distinguish the following patient roles in patient involvement.

Consultation involves participation of patients and/or their representatives as study participants; their role may be to trial an investigational agent and/or to provide information on their own individual experience. This level of involvement requires predominantly a flow of information in one direction from patient to researcher. Protocols for participation in a clinical trial or other means of data collection such as surveys, interviews or focus groups are well developed and highly regulated through the Helsinki declaration.

Advice is provided by an informed patient, e.g., by discussing new developments and sharing personal knowledge and experience, or by reviewing research grant applications or a scientific publication. The involvement is often limited to one occasion.

Collaboration may be undertaken through multiple roles, e.g., patient research partner (PRP), or patient expert [18]. A patient expert may be defined as an ‘expert’ in their own disease and its management, and someone who is equipped to look further than their own personal experience of the disease. Patient collaboration takes place on a collective level and influences the aims, design and conduct of a study through dialogue, two-way communication in partnership with other stakeholders.

Control is achieved when a patient organization takes the lead, determines the research gap or research questions, controls the study and owns the data.

We will use the terms engaging patients and patient involvement as synonyms for the process of enabling people with a long-term condition to provide a meaningful contribution to research or the improvement in healthcare services. Patient empowerment is a process whereby the person develops more control over decisions and actions that affect their own life and health [20, 21]. This involves helping a person to learn to think critically and make informed decisions about self-care to reduce symptoms from the chronic disease [22]. There is increasing recognition that patient empowerment is a core element of quality oriented, sustainable health systems of the future [23]. However, because the focus of this article is on engaging patients in the context of health research and medicine development and authorisation, we will not elaborate on patient empowerment.

Patient engagement in patient preference elicitation

The assessment of patient preferences could help to improve disease management, facilitate shared decision-making and improve adherence, whilst increasing the use of patient preferences in health policy making may improve the quality of decisions and increase efficiency [24]. For example, the collection of individual preferences may inform regulatory review processes [25]. Preference studies offer a systematic approach to gathering information on the distribution of preferences in a population and the implications on patients’ acceptance of specific treatments. Although the usefulness of stated preference studies is still not well established, such studies, along with other methods such as focus groups and expert opinions, have the potential to become an important tool for gathering patient views in a systematic way to estimate treatment acceptability and concordance, and thus inform regulatory and treatment decisions [26].

Qualitative and quantitative methods could be used to identify what is important to patients with respect to healthcare decision-making. Stated preference methods have been increasingly used in HTA to elicit preference [24]. The most often used stated-preference methods include discrete choice experiment (DCE) [27, 28], best–worst scaling (BWS) [29], and analytical hierarchy process (AHP) [30, 31]. As an example, Rothery et al. used a DCE to assess patient preference for treatment-related benefits and risk of disease relapse in the management of low disease states of psoriatic arthritis (PsA) [32]. The study found that among patients in low disease states of PsA, respondents were willing to accept greater risk of relapse (up to 30% increased risk) for an improvement in the side effects of sickness and nausea and health status.

Patients’ preferences are nowadays increasingly sought in healthcare decision-making. By example, the US Food and Drug Administration (FDA) has developed an initiative for the consideration of patient preferences for multiple endpoints in development assessment of new health technologies in medical devices (FDA Medical Device Patient Preference initiative) [33]. The FDA has also provided definitive guidance on the use of patient reported outcome measures for use in trials to support labelling claims [34], and the EMA has developed guidance on the use of patient reported outcomes in anticancer studies [35].

In Europe, there are several initiatives which aim to increase the use of patient preferences in policy decision-making, which include:

  • The German Institute for Quality and Efficiency in Healthcare (IQWiG) may include patient preference in cost–benefit assessment as part of the economic evaluation.

  • The National Institute for Health and Care Excellence (NICE) assessment of utility impact involves the elicitation of general population preferences.

  • The EMA piloted swing weighting to elicit patient preferences for benefit/risk analysis for market authorization [25]. This was followed up with a larger study eliciting preferences of over 550 multiple myeloma patients on benefits and risks of cancer treatments to illustrate how such data may be used to estimate patients’ acceptance of new treatments [26].

  • The PROTECT (Pharmacoepidemiological Research on Outcomes of Therapeutics by a European Consortium) project, conducted by the Innovative Medicines Initiative (IMI) and coordinated by the EMA, focuses on the question of public/patient involvement in regulatory processes [36].

  • IMI PREFER (Patient Preferences in Benefit-Risk Assessments during the Drug Life Cycle) project initiated late 2016 focuses on eliciting patient perspectives for use in benefit-risk assessment (BRA) and health technology assessment (HTA) [37]. PREFER will result in recommendations regarding the best ways to perform and include patient-preference in the decision-making process of industry, regulatory authorities and HTA bodies.

These initiatives have focused on the role of patient preferences through the life cycle of medicines and for regulatory decision making. Incorporating the preferences of patients in clinical decision-making (shared decision making) is another dimension that could be the focus of future initiatives [38].

Patient engagement in clinical outcomes research

Initiatives to increase patient engagement in aspects of clinical research have been undertaken by a wide range of research communities. Engagement may involve the patient, relatives, informal carers or patient representatives, all of whom can give a relevant stakeholder perspective on research and healthcare innovation. The patient engagement process is evolving, and roles for patients may vary with increasing degrees of involvement, from steering group members, committee or working party members with voting rights, to PRPs or Delphi participants [39].

Here we explore the experience of the OMERACT Initiative. OMERACT sets out to achieve consensus about core outcome sets (endpoints) for clinical trials and longitudinal observational studies in rheumatology, with patient involvement an integral part of the process [10]. OMERACT defines the PRP as a person with a relevant disease who operates as an equal member in the research team to provide the patient perspective in every phase of the study [40]. PRPs share decision-making power with professionals, can take on any role similar to all other members and have full voting rights at the biannual meeting [18]. Practical recommendations for patient engagement in research teams were published in 2016 [40].

Other initiatives that have developed rules and pilots to include PRPs in their research activities:

  • European League Against Rheumatism (EULAR) published practical recommendations for the inclusion of patient representatives in scientific projects [41]. They are widely followed by all working groups developing disease management recommendations for rheumatic conditions.

  • COMET (Core Outcome Measures in Effectiveness Trials) brings together people interested in the development and application of agreed standardised outcome sets used in clinical research [42]. COMET has established a People and Patient Participation, Involvement and Engagement (PoPPIE) Working Group that develops practical resources for PRPs.

  • The Standardised Outcomes in Nephrology (SONG) initiative aims to establish a set of core outcomes and outcome measures across the spectrum of kidney disease for trials and other forms of research. The outcomes will be developed based on the shared priorities of patients, caregivers, clinicians, researchers, policy makers and relevant stakeholders. This will help to ensure that research is reporting outcomes that are meaningful and relevant to patients with kidney disease, their family and their clinicians. Currently in development are core outcomes for haemodialysis (SONG-HD), transplantation (SONG-Tx), peritoneal dialysis (SONG-PD) children and adolescents (SONG-Kids), and polycystic kidney disease (SONG-PKD) [43].

  • Based on the concept of value-based healthcare, the International Consortium for Health Outcomes Measurement (ICHOM) brings together global teams of physician leaders, outcomes researchers and patient advocates to define Standard Sets of outcomes for clinical practice that matter most to patients. ICHOM captures the patient perspective both by conducting qualitative research to collect data on patient preferences as by active involvement of patient experts in the consensus building process. The final standard sets then drive adoption to enable healthcare providers globally to compare, learn and improve [44].

  • The Patient-Centered Outcomes Research Institute (PCORI) has developed the PCORI Engagement Rubric, which provides a framework for operationalizing engagement to incorporate patients and other stakeholders in all phases of research. The aim is to encourage active and sustained engagement of patients as partners in planning, conducting and disseminating research, to improve clinical decision-making and outcomes [45].

Case study 1: GRAPPA core outcomes set in PsA

GRAPPA is a non-profit organisation focused on identifying and initiating research projects, advancing standardized criteria for PsA registries and developing treatment guidelines. GRAPPA was formed in 2003 of > 600 rheumatologists, dermatologists, radiologists, geneticists, methodologists, epidemiologists and biopharmaceutical industry representatives with an interest in PsA and psoriasis research. Since 2013, patient research partners participate in the annual meetings and a variety of working groups. A best practice case study of patient participation in the update of the PsA core domain set is outlined here [46, 47].

The OMERACT-GRAPPA PsA working group met to review the existing PsA core set [48] based on the patient perspective as well as new research findings and further develop PsA responder indices. The group discussed the need to revise the PsA core set, and opportunities to add, move, or merge existing domains to better integrate the patient perspective and to remove redundancy; and how to incorporate the core set in a composite index [49].

OMERACT recommendations for patient involvement were followed and included (Fig. 1):

Fig. 1

Patient involvement in all steps of the update to the core outcome set for psoriatic arthritis

  1. 1.

    Active partnership of five PRPs in the working group and one PRP in the Steering Group.

  2. 2.

    International focus group study representing five continents and including seven countries.

  3. 3.

    Delphi study.

  4. 4.

    Consensus meeting.

New domains were identified through systematic literature review, international focus groups exploring the opinions and experiences of people with PsA and two international surveys with patients and physicians to prioritise domains. Consensus was achieved through an international face-to-face expert meeting with equal representation of patients and physicians to agree on the most important domains, and voting at the OMERACT 2016 conference. PRPs were involved at all phases of the process. As a result, the updated PsA core domain set incorporates patients’ and physicians’ priorities and includes the domains of: musculoskeletal disease activity, skin disease activity, pain, patient global, physical function, health-related quality of life, fatigue and systemic inflammation [47].

Lessons learned

Challenges identified were to ensure broad representativeness of patients’ perspectives in demography, geography, disease severity and in numbers, which entails a significant level of communication and efforts to enable equal collaboration. Preserving the patient perspective throughout the research process is of great importance and following from an unanticipated workload for PRPs and researchers it may be difficult to keep PRPs and researchers motivated to collaborate.

Participation requires multiple forms of engagement and should always be tailor-made, there is no common methodology or application that fits every research context. In addition, participation requires a willingness for mutual learning, and the role of the principal investigator is key in providing adequate support to patients. Fruitful participation always requires additional resources to be allocated to the process, with extra effort in time, money and energy. A structural approach guarantees sustainability of participation.

Patient engagement in regulatory processes

Since establishment of the EMA in 1995, interaction with patients has developed progressively with the creation of a Framework for interaction with patient and consumer groups in 2005, a Patients and Consumers Working Party (PCWP) in 2006, including representatives from 20 organisations and a dedicated ‘public engagement’ department in 2014.

The EMA has increasingly incorporated the patients’ voice within its regulatory activities by way of pilot projects testing the various engagement methodologies, in collaboration with its network of patient organisations [50, 51]. There are now processes to include patients at all stages along the regulatory lifecycle (See Case Study 2).

Case study 2: EMA methodology on patient engagement, a progressive journey

Patient engagement occurs at all steps along the medicine regulatory lifecycle (Fig. 2). As the EMA progressed with involving patients in its activities, it became apparent that there were different levels of patient’s representation, depending on the nature of the activity. The different categories are: representing the patient community; representing their own organisation, and patient as individual experts.

Fig. 2

Patient involvement can occur at all steps along the medicine development and regulatory lifecycle

In the pre-submission phase of development, examples of where patients can contribute to EMA discussions on the design of clinical trials include:

  • Selection of end-points.

  • Defining target population, inclusion/exclusion criteria.

  • Study duration, treatment administration, formulation and dosage.

  • Clinical relevance versus statistical significance.

  • Identification of risk potential.

  • Significant benefit (added-value) over existing therapies.

  • Ethical aspects, informed consent.

Lessons learned

It also became apparent that for optimal and mutually beneficial engagement to occur, the following elements are vital:

  • Define the role of the patient for each specific activity and ensure that all involved parties are informed. This facilitates participation and also manages expectations from all angles.

  • Identify the most suitable patients/groups to involve in each situation, taking into account representation and confidentiality aspects.

  • Establish a range of engagement methodologies and assess for each case which method is most suitable for the situation (e.g., face-to-face, in writing, surveys, committee meetings, preference elicitation).

  • Provide individualised support and training, tailored to the individual and the activity, e.g., training sessions, videos, info-sheets, webpages, one-to-one support. To aid training, the European Patients’ Academy on Therapeutic Innovation (EUPATI) has developed patient education resources in key areas of non-clinical and clinical development, clinical trials, regulatory affairs and health technology assessment [52, 53].

  • Provide feedback to all involved, especially so that the patient sees that their input is valuable.

  • Continuous monitoring and reporting on interactions, and refining procedures according to feedback received.

Challenges identified were in finding suitable patients (e.g., language barrier, availability) while ensuring representativeness and in knowing how to also gather validated information from larger groups. Potential conflicts of interest need to be handled sensitively. Compensation is also an area requiring attention. Demonstrating the value and/or impact of patient involvement in a quantitative manner while avoiding subjectivity is a challenge; however, qualitative methods can be of value provided that there is sufficient reflexivity and transparency. The trend in public health is now to use mixed methods designs.

Conclusions: principles for engaging with patients

Engaging with patients helps to bridge the gap between health research, policy and patient-centred practice, increases transparency and patients’ adherence to treatments, reduces waste and leads to more meaningful regulatory outcomes. Patient engagement should be initiated in a stepwise approach through which all parties can learn together and identify the format that works best for all involved. At all stages of engagement, provide support, define roles, manage expectations and give feedback, to ensure that engagement is mutually beneficial. In this way, ultimately everyone can benefit from knowledge sharing.

Patient engagement is a relational process, and the nine principles outlined here (see Table 1) [54], form a starting point from which tailoring of the approach to suit different chronic diseases and other healthcare context needs may be undertaken. Overarching principles include the recognition that the perspective of patients is pivotal in outcomes research and the decision-making process of medicine authorisation that earlier involvement of patients is always better and that involvement at all stages is necessary. Patients should be offered the possibility to consult each other on experience-based views; furthermore, patients sometimes need to cancel their presence due to health issues. To ensure proper representation, inviting at least two PRPs is recommended [55]. Finally, acknowledgement of input and feedback to patients is essential, and integrated knowledge translation is desirable [56].

Table 1 WHO-ESCEO Principles for engaging patients in health research, treatment guidelines and regulatory processes.

In this article, we acknowledge that there are different levels of patient engagement, all equally valuable and complementary, and that the degree of patient participation and level of power or authority should not be mandatory but may be tailor-made to suit the individual research purpose. Patient engagement is an evolving concept, and the research agenda for future refinement of the process will include the development of new methodologies to assess the impact of patient engagement and novel ways to enhance the significance of existing methods for engagement, in order to emphasize the role of the patient voice in health research, treatment guidelines and regulatory processes. The impact of patient engagement, in terms of added value, but also cost and potential downsides is currently poorly understood. Reasons for this include a lack of consensus on a validated methodology or tool to measure impact, and a lack of consensus on the important outcomes of patient engagement; people and stakeholder groups have different expectations and objectives regarding patient engagement, and thus require different methodologies and outcomes for evaluation.

Another challenge is that we, as an expert group, all agree that principal investigators and stakeholders should invest in support, information, education and feedback to patient experts (see Panel); however, there is a growing awareness that it does not make sense to train patients in the medicine development cycle, without simultaneously preparing researchers for their role and task of engaging patients in that process. Thus, there is a need to explore both the benefits and downsides of educating patient experts as well as exploring the needs of researchers for guidance, coaching and training [57].



Committee for orphan medicinal products


Committee for human medicinal products


Committee for advanced therapies


European public assessment report


Paediatric committee


Scientific advice working party


Scientific advisory group


Pharmacovigilance risk assessment committee


Psoriatic arthritis


Patient research partner


  1. 1.

    WHO (2015) World report on ageing and health. Accessed 24 Jan 2018

  2. 2.

    Brett J, Staniszewska S, Mockford C et al (2014) Mapping the impact of patient and public involvement on health and social care research: a systematic review. Health Expect 17:637–650.

    Article  PubMed  Google Scholar 

  3. 3.

    Haywood K, Brett J, Salek S et al (2015) Patient and public engagement in health-related quality of life and patient-reported outcomes research: what is important and why should we care? Findings from the first isoqol patient engagement symposium. Qual Life Res 24:1069–1076.

    Article  PubMed  Google Scholar 

  4. 4.

    Coulter A (2012) Patient engagement–what works? J Ambul Care Manage 35:80–89.

    Article  PubMed  Google Scholar 

  5. 5.

    Coulter A, Entwistle VA, Eccles A et al (2015) Personalised care planning for adults with chronic or long-term health conditions. Cochrane Database Syst Rev 3:523.

    Article  Google Scholar 

  6. 6.

    Vahdat S, Hamzehgardeshi L, Hessam S et al (2014) Patient involvement in health care decision making: a review. Iran Red Crescent Med J 16:e12454.

    Article  PubMed  PubMed Central  Google Scholar 

  7. 7.

    Macleod MR, Michie S, Roberts I et al (2014) Biomedical research: increasing value, reducing waste. Lancet 383:101–104.

    Article  PubMed  Google Scholar 

  8. 8.

    Minogue V, Cooke M, Donskoy A-L et al (2018) Patient and public involvement in reducing health and care research waste. Res Involv Engagem 4:5.

    Article  PubMed  PubMed Central  Google Scholar 

  9. 9.

    Pittens CACM, Elberse JE, Visse M et al (2014) Research agendas involving patients: factors that facilitate or impede translation of patients’ perspectives in programming and implementation. Sci Public Policy 41:809–820.

    Article  Google Scholar 

  10. 10.

    de Wit M, Kirwan JR, Tugwell P et al (2017) Successful stepwise development of patient research partnership: 14 years’ experience of actions and consequences in outcome measures in rheumatology (omeract). Patient 10:141–152.

    Article  PubMed  Google Scholar 

  11. 11.

    Pushparajah D, Geissler J, Westergaard N (2015) Eupati: collaborating between patients, academia and industry to champion the informed patient in medicines research and development. J Med Dev Sci 1:74–80.

    Article  Google Scholar 

  12. 12.

    Rashid A, Thomas V, Shaw T et al (2017) Patient and public involvement in the development of healthcare guidance: an overview of current methods and future challenges. Patient 10:277–282.

    Article  PubMed  Google Scholar 

  13. 13.

    Montori VMDPJ, Straus S, Haynes B et al (2008) Decision making and the patient. In: Guyatt GRD, Meade MO, Cook DJ (eds) Users’ guides to the medical literature: a manual for evidence-based clinical practice, 2nd edn. Mcgraw-Hill Education, Columbus

    Google Scholar 

  14. 14.

    INVOLVE (2018) The lead for advancement of public involvement in health and care research across nihr and beyond. Accessed 24 Jan 2018

  15. 15.

    Selva A, Sanabria AJ, Pequeno S et al (2017) Incorporating patients’ views in guideline development: a systematic review of guidance documents. J Clin Epidemiol 88:102–112.

    Article  PubMed  Google Scholar 

  16. 16.

    Diaz Del Campo P, Gracia J, Blasco JA et al (2011) A strategy for patient involvement in clinical practice guidelines: methodological approaches. BMJ Qual Saf 20:779–784.

    Article  CAS  PubMed  Google Scholar 

  17. 17.

    Lanza ML, Ericsson A (2000) Consumer contributions in developing clinical practice guidelines. J Nurs Care Qual 14:33–40

    Article  CAS  PubMed  Google Scholar 

  18. 18.

    Abma TA, Nierse CJ, Widdershoven GA (2009) Patients as partners in responsive research: methodological notions for collaborations in mixed research teams. Qual Health Res 19:401–415.

    Article  PubMed  Google Scholar 

  19. 19.

    PatientPartner (2011) Patient involvement in clinical research. A guide for patient organisations and patient representatives. Accessed 24 Jan 2018

  20. 20.

    Bravo P, Edwards A, Barr PJ et al (2015) Conceptualising patient empowerment: a mixed methods study. BMC Health Serv Res 15:252.

    Article  PubMed  PubMed Central  Google Scholar 

  21. 21.

    Barr PJ, Scholl I, Bravo P et al (2015) Assessment of patient empowerment: a systematic review of measures. PLoS ONE 10:e0126553.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  22. 22.

    Arvidsson S, Bergman S, Arvidsson B et al (2012) Psychometric properties of the swedish rheumatic disease empowerment scale, swe-res-23. Musculoskeletal Care 10:101–109.

    Article  PubMed  Google Scholar 

  23. 23.

    EPF (2016) European patients forum: patient empowerment campaign Accessed 24 Jan 2018

  24. 24.

    Bridges JF, Hauber AB, Marshall D et al (2011) Conjoint analysis applications in health—a checklist: a report of the ispor good research practices for conjoint analysis task force. Value Health 14:403–413.

    Article  PubMed  Google Scholar 

  25. 25.

    Postmus D, Mavris M, Hillege HL et al (2016) Incorporating patient preferences into drug development and regulatory decision making: results from a quantitative pilot study with cancer patients, carers, and regulators. Clin Pharmacol Ther 99:548–554.

    Article  CAS  PubMed  Google Scholar 

  26. 26.

    Postmus D, Richard S, Bere N et al (2017) Individual trade-offs between possible benefits and risks of cancer treatments: results from a stated preference study with patients with multiple myeloma. Oncologist 22:1–8.

    Article  Google Scholar 

  27. 27.

    Clark MD, Determann D, Petrou S et al (2014) Discrete choice experiments in health economics: a review of the literature. Pharmacoeconomics 32:883–902.

    Article  PubMed  Google Scholar 

  28. 28.

    Pinto D, Danilovich MK, Hansen P et al (2017) Qualitative development of a discrete choice experiment for physical activity interventions to improve knee osteoarthritis. Arch Phys Med Rehabil 98:1210–1216.

    Article  PubMed  Google Scholar 

  29. 29.

    Cheung KL, Wijnen BF, Hollin IL et al (2016) Using best-worst scaling to investigate preferences in health care. Pharmacoeconomics 34:1195–1209.

    Article  PubMed  PubMed Central  Google Scholar 

  30. 30.

    Marsh K, Caro JJ, Hamed A et al (2017) Amplifying each patient’s voice: a systematic review of multi-criteria decision analyses involving patients. Appl Health Econ Health Policy 15:155–162.

    Article  PubMed  Google Scholar 

  31. 31.

    Hiligsmann M, Dellaert BG, Dirksen CD et al (2017) Patients’ preferences for anti-osteoporosis drug treatment: a cross-european discrete choice experiment. Rheumatology 56:1167–1176.

    Article  PubMed  Google Scholar 

  32. 32.

    Rothery C, Bojke L, Richardson G et al (2016) A discrete choice experiment to explore patients’ willingness to risk disease relapse from treatment withdrawal in psoriatic arthritis. Clin Rheumatol 35:2967–2974.

    Article  PubMed  PubMed Central  Google Scholar 

  33. 33.

    Basch E (2013) Toward patient-centered drug development in oncology. N Engl J Med 369:397–400.

    Article  CAS  PubMed  Google Scholar 

  34. 34.

    FDA (2009) Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims. Clinical/medical 2009 Accessed 24 Jan 2018

  35. 35.

    EMA (2016) Appendix 2 to the guideline on the evaluation of anticancer medicinal products in man: the use of patient-reported outcome (pro) measures in oncology studies. Accessed 12 Feb 2018

  36. 36.

    PROTECT (2018) The pharmacoepidemiological research on outcomes of therapeutics by a european consortium. Accessed 24 Jan 2018

  37. 37.

    PREFER (2016) Patient preferences in benefit-risk assessments during the drug life cycle. Accessed 24 Jan 2018

  38. 38.

    Coulter A, Collins A (2011) Making shared decision-making a reality: no decision about me, without me. The King’s Fund, London. Accessed 24 Jan 2018

  39. 39.

    de Wit MP, Kvien TK, Gossec L (2015) Patient participation as an integral part of patient-reported outcomes development ensures the representation of the patient voice: a case study from the field of rheumatology. RMD Open 1:e000129.

    Article  PubMed  PubMed Central  Google Scholar 

  40. 40.

    Cheung PP, de Wit M, Bingham CO 3rd et al (2014) Recommendations for the involvement of patient research partners (prp) in omeract working groups. A report from the omeract 2014 working group on prp. J Rheumatol 43:187–193.

    Article  Google Scholar 

  41. 41.

    de Wit MP, Berlo SE, Aanerud GJ et al (2011) European league against rheumatism recommendations for the inclusion of patient representatives in scientific projects. Ann Rheum Dis 70:722–726.

    Article  PubMed  Google Scholar 

  42. 42.

    Williamson PR, Altman DG, Bagley H et al (2017) The comet handbook: version 1.0. Trials 18:280.

    Article  PubMed  PubMed Central  Google Scholar 

  43. 43.

    SONG (2018) The standardised outcomes in nephrology (song) initiative: an international initiative that aims to establish core outcomes in chronic kidney disease. Accessed 24 Jan 2018

  44. 44.

    ICHOM (2018) International consortium for health outcomes measurement. Accessed 24 Jan 2018

  45. 45.

    Sheridan S, Schrandt S, Forsythe L et al (2017) The pcori engagement rubric: Promising practices for partnering in research. Ann Fam Med 15:165–170.

    Article  PubMed  PubMed Central  Google Scholar 

  46. 46.

    Tillett W, Adebajo A, Brooke M et al (2014) Patient involvement in outcome measures for psoriatic arthritis. Curr Rheumatol Rep 16:418.

    Article  PubMed  Google Scholar 

  47. 47.

    Orbai AM, de Wit M, Mease P et al (2017) International patient and physician consensus on a psoriatic arthritis core outcome set for clinical trials. Ann Rheum Dis 76:673–680.

    Article  PubMed  Google Scholar 

  48. 48.

    Gladman DD, Mease PJ, Strand V et al (2007) Consensus on a core set of domains for psoriatic arthritis. J Rheumatol 34:1167–1170

    PubMed  Google Scholar 

  49. 49.

    Tillett W, Eder L, Goel N et al (2015) Enhanced patient involvement and the need to revise the core set—report from the psoriatic arthritis working group at omeract 2014. J Rheumatol 42:2198–2203.

    Article  CAS  PubMed  Google Scholar 

  50. 50.

    EMA (2011) Outcome report on pilot phase for participation of patient representatives in scientific advisory group (sag) meetings. Accessed 24 Jan 2018

  51. 51.

    EMA (2017) Outcome report on pilot to involve patients in benefit/risk discussions at chmp meetings. Accessed 24 Jan 2018

  52. 52.

    EUPATI (2018) European patients’ academy on therapeutic innovation (eupati) Accessed 24 Jan 2018

  53. 53.

    Chakradhar S (2015) Insurance companies are slow to cover next-generation sequencing. Nat Med 21:204–205.

    Article  CAS  PubMed  Google Scholar 

  54. 54.

    de Wit MC, Reginster J-Y (2019) Practical guidance for patient-centred health research. Lancet 393:1095–1096.

  55. 55.

    Hewlett S, Wit M, Richards P et al (2006) Patients and professionals as research partners: challenges, practicalities, and benefits. Arthritis Rheum 55:676–680.

    Article  PubMed  Google Scholar 

  56. 56.

    Tunis SR, Maxwell LJ, Graham ID et al (2017) Engaging stakeholders and promoting uptake of omeract core outcome instrument sets. J Rheumatol 44:1551–1559.

    Article  PubMed  Google Scholar 

  57. 57.

    de Wit M, Beurskens A, Piskur B et al (2018) Preparing researchers for patient and public involvement in scientific research: development of a hands-on learning approach through action research. Health Expect 21:752–763.

    Article  PubMed  PubMed Central  Google Scholar 

Download references


Role of the funding source The meeting was funded by the ESCEO asbl, a Belgian not-for-profit organisation. The authors thank the Chair for Biomarkers of Chronic Diseases and the International Scientific Partnership Program (ISPP#0111) at King Saud University, Riyadh, Saudi Arabia for their support. Role of medical writer/editor Editorial assistance in the preparation of this manuscript was provided by Lisa Buttle, PhD, of Medscript Ltd., which was funded by the ESCEO asbl, Belgium.

Author information




At the meeting, results from a literature review of methods for incorporating patients’ preferences into decision-making were presented followed by an introduction to the nomenclature of patient engagement and a case study on improving the quality of delivering integrated care by involving older people (I. Araujo de Carvalho, I. Aujoulat, M. Hiligsmann). Next, organizations including EMA and the OMERACT initiative introduced their principles for engagement and presented lessons learned through applied experiences (NB, MDW). After the presentations, a prolonged discussion among the expert group members took place and shared conclusions were reached. Following the meeting, members of the writing group (MDW, CC, NB, PT, PGC, CR, IA) drafted a first report on the meeting, which was reviewed and commented on by all authors (including: NA, MB, NB, WL). All authors meet the ICMJE criteria for authorship for this manuscript, take responsibility for the integrity of the work as a whole and have given final approval to the version to be published.

Corresponding author

Correspondence to Jean-Yves Reginster.

Ethics declarations

Conflict of interest

O Bruyère reports grants from Biophytis, IBSA, MEDA, Servier, SMB, and Theramex, outside of the submitted work. N. Bedlington’s organisation has received grants from GSK, Abbvie, Pfizer, Janssen, CSL Behring, Almirall, Baxter, Sanofi-Pasteur, EUPATI project (IMI-JU) industry consortium (UCB, Amgen, Genzyme, VFA, AZ, Novo Nordisk, Bayer, Merck, Janssen, GSK, Chiesi, Hoffmann, Lilly, Novartis, Esteve), Gilead, Eli-Lilly, Johnson & Johnson, MSD, Alexion, Mylan, Servier, Teva, Celgene, Novartis, Vertex, AIPP, Bosch Foundation, Sanofi Aventis, Hoffman La Roche, Grunenthal, European Commission. She has an advisory role with Janssen, Teva and GSK, outside of the submitted work. M.L. Brandi reports personal fees from Amgen, Bruno Farmaceutici, Kyowa Kirin, grants and personal fees from Abiogen, Alexion, Amgen, Bruno Farmaceutici, Eli Lilly, Kyowa Kirin, MSD, NPS, Servier, Shire, SPA, personal fees from Alexion, Bruno Farmaceutici, Kyowa Kirin, Servier, Shire, outside the submitted work. N. Burlet is a full-time employee at Sanofi Pasteur headquarters, Lyon, France. P.G. Conaghan is supported in part by the National Institute for Health Research (NIHR) Leeds Biomedical Research Centre, outside of the submitted work. The views expressed are those of the authors and not necessarily those of the NHS, the NIHR or the Department of Health. C. Cooper reports personal fees from Alliance for Better Bone Health, Amgen, Eli Lilly, GSK, Medtronic, Merck, Novartis, Pfizer, Roche, Servier, Takeda and UCB, outside of the submitted work. M. de Wit has received fees for lectures or consultancy through Stichting Tools from Abbvie, BMS, Celgene, Eli Lilly, Janssen-Cilag, Novartis, Pfizer and Roche, outside of the submitted work. J.A. Kanis reports grants from Amgen, grants from Lilly, grants from Radius Health, grants from UCB, other from Meda, outside the submitted work; and is a member of the National Osteoporosis Guideline Group (NOGG) and the principal architect of FRAX but derives no financial benefit. W. Lawrence reports personal fees from Danone Nutricia, outside the submitted work. J.Y. Reginster reports personal fees and other from Servier, IBSA, Genevrier, UCB, Asahi, Radius Health, Meda, Pierre Fabre, grants from Merck Sharp & Dohme (MSD), Amgen, Lilly, Servier, Pfizer, Danone, Meda, Cniel, IBSA, Genevrier, personal fees from MSD, IBSA, Genevrier, Servier, Danone, Pharmevo, Cniel, Meda, and the Dairy Research Council (DRC), outside of the submitted work. R. Rizzoli reports personal fees from Radius Health, Effryx and Danone, outside of the submitted work. M. Scholte-Voshaar has received a grant for her PhD research from Roche and fees for lectures from Pfizer, outside of the submitted work. All other authors report nothing to disclose relating to the submitted work: N. Al-Daghri, I. Araujo de Carvalho, I. Aujoulat, N. Bere, M. Barker, P. Halbout, M. Hiligsmann, F. Jiwa, J. Kirwan, A. Laslop, D. Pinto, C. Prieto Yerro, V. Rabenda, C. Roberts, P. Tugwell, M. Vlaskovska.

Statement of human and animal rights

This article does not contain any studies with human participants or animals performed by any of the authors.

Informed consent

For this type of study formal consent is not required.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

de Wit, M., Cooper, C., Tugwell, P. et al. Practical guidance for engaging patients in health research, treatment guidelines and regulatory processes: results of an expert group meeting organized by the World Health Organization (WHO) and the European Society for Clinical and Economic Aspects of Osteoporosis, Osteoarthritis and Musculoskeletal Diseases (ESCEO). Aging Clin Exp Res 31, 905–915 (2019).

Download citation


  • Outcomes research
  • Patient engagement
  • Patient preference
  • Regulatory process
  • Treatment guidelines