Abstract
Digital health technologies (DHTs) have the potential to modernize drug development and clinical trial operations by remotely, passively, and continuously collecting ecologically valid evidence that is meaningful to patients’ lived experiences. Such evidence holds potential for all drug development stakeholders, including regulatory agencies, as it will help create a stronger evidentiary link between approval of new therapeutics and the ultimate aim of improving patient lives. However, only a very small number of novel digital measures have matured from exploratory usage into regulatory qualification or efficacy endpoints. This shows that despite the clear potential, actually gaining regulatory agreement that a new measure is both fit-for-purpose and delivers value remains a serious challenge. One of the key stumbling blocks for developers has been the requirement to demonstrate that a digital measure is meaningful to patients. This viewpoint aims to examine the co-evolution of regulatory guidance in the United States (U.S.) and best practice for integration of DHTs into the development of clinical outcome assessments. Contextualizing guidance on meaningfulness within the larger shift towards a patient-centric drug development approach, this paper reviews the U.S. Food and Drug Administration (FDA) guidance and existing literature surrounding the development of meaningful digital measures and patient engagement, including the recent examples of rejections by the FDA that further emphasize patient-centricity in digital measures. Finally, this paper highlights remaining hurdles and provides insights into the established frameworks for development and adoption of digital measures in clinical research.
Similar content being viewed by others
Introduction
Digital health technologies (DHTs) offer the ability to capture data remotely, continuously, and with low patient burden1,2,3. As such, DHTs are paving the way for the development of a new class of clinical outcome assessments (COAs) that reflect how patients feel, function, and survive in real-world environments4. Many believe the evidence generated from DHTs provides an opportunity for a more holistic and direct understanding of the patient experience2,5, and consequently, there has been a significant investment into developing new DHT-derived outcome measures6. Initial efforts were technology-driven and centered around expanding the limits of what can be measured1,7. However, following the overall trend in the industry for a more patient-centric approach to drug development, there is an increased focus on understanding what should be measured with DHTs1,2,8,9,10,11,12.
The US Food and Drug Administration (FDA) has progressively evolved their guidance and exerted pressure on drug developers to move towards a more patient-focused approach, encouraging the systematic incorporation of the patient voice into all aspects of drug development and evaluation13. Over the past decade, there has been an increasing emphasis on engaging patients in protocol development, endpoint selection, and the development of fit-for-purpose evidence generation tools12. Both the 2009 Patient-reported Outcome (PRO) guidance for industry14 and the 2012 Patient-Focused Drug Development (PFDD) initiative12 provide roadmaps on how to incorporate the patient experience into medical product development. The most recently released four-part guidance series further emphasizes this by providing stepwise recommendations on how to collect and submit patient experience data for regulatory decision making. Collectively, the goal of these initiatives is to develop interventions that induce a treatment benefit that is considered meaningful to patients.
This viewpoint aims to illustrate how the recent FDA PFDD guidance has shaped digital measure development with a particular emphasis on generating evidence that DHT-derived COAs are meaningful to patients. This paper discusses various methodologies available to establish the meaningfulness of digital measures required to facilitate regulatory endorsement, and highlights the progress made, hurdles that remain, and future directions needed for the successful adoption and implementation of digital measures.
Shaping digital measure development: the role of regulatory guidance
The scientific, financial, and operational advantages of digital measures in drug development have been extensively discussed6,15,16, however, despite this, adoption has been limited to date. Some of the resistance from sponsors is due to the uncertainty that endpoints derived from DHTs will be of value in discussions with regulators. Given the importance of PFDD at the FDA, establishing clear rationales of meaningfulness of digital measures provides the best opportunity for regulatory qualification, which in turn paves the way for broad utilization in future drug development trials. Digital measures capture aspects of life in real-world environments, and compelling cases can be made that outcomes derived from DHTs will be inherently meaningful to patients, yet robust evidence is required to support those arguments. Recent guidance describes what is required to justify the seemingly simple statement that a new digital measure is “patient-centric”.
Understanding the FDA guidance on driving patient-centric digital measure development
The FDA’s recent four-part guidance on PFDD significantly expands their position on patient engagement in drug development17. This guidance series is applicable to all COA categories (i.e., PROs, clinician-reported outcomes, observer-reported outcomes, and performance outcomes), and outcomes derived from DHTs. Part 118 and part 419 of the series primarily address comprehensive and representative input from patients and caregivers for regulatory decision making. Part 220 focuses on the methods and best practices for gathering patient input on what is important to them in disease and treatment, including a focus on psychometric testing. Part 321 provides a general roadmap for developing patient-focused outcome measurement and supporting a COA as fit-for-purpose. It also provides recommendations for evaluating COAs based on their construct and content validity, as well as reliability and responsiveness to change. While the FDA has consistently required evidence to support the claim that COAs are selected based on patient-centric concepts22, this recent guidance series emphasizes the importance of adopting robust methodologies to generate such evidence.
Digital measure developers have started adopting this guidance to initiate regulatory submissions amidst discussion of a dedicated pathway for deploying digital measures as drug development tools (DDTs)23.
Evolving FDA expectations on incorporating meaningfulness in digital measure development
In the history of the FDA DDT-COA qualification program4, which evaluates whether COAs are a well-defined and meaningful assessment of how patients feel, function, and survive in specified contexts of use, 9 letter of intents (LOIs) for DHT-derived COAs have been submitted for qualification24. The earliest submission of an LOI accepted into the qualification program was reported in 2018 for the assessment of physical activity via accelerometry25. In total, 6 LOIs for DHT-derived COAs have been accepted into the program; however, it has been 4 years since the last LOI was accepted by the FDA. The most common reason for LOI rejection is a lack of meaningfulness of the measure to patients, which is pushing developers to align with FDA’s evolving expectations, particularly for the projects that were planned or submitted years before the recent guidance was released.
For example, the FDA rejected an LOI for a DHT-derived COA assessing motor symptom severity using a finger tapping test on a smartphone, for use in Parkinson’s disease26. While a case could be made that maintaining fine motor skills is important for patients with Parkinson’s disease, in the rejection letter FDA was concerned about the meaningfulness of the act of tapping repeatedly on a screen to patients26.
Similarly, the FDA rejected an LOI for a COA reflecting aspects of gait abnormality in Huntington’s Disease because the advanced gait assessment proposed was not inherently easy to understand. Further, as indicated in the decision letter, there was a general lack of clarity on whether changes in the proposed gait parameters were meaningful to patients and if changes in gait parameters would reflect changes in everyday functioning27. The FDA’s response was consistent in its most recent rejection of an LOI for an actigraphy-derived COA that reflected aspects of functional mobility such as gait, balance and coordination for use in neurodegenerative diseases28. The reviewers expressed concerns as to whether the measures are relevant and important to functional mobility and whether the gait kinematic parameters suggested in the conceptual model would be meaningful to patients. To note, there has been an uptake of DHTs in the neurological field, signaling early integration in clinical research, particularly in Parkinson’s disease29. Evidence of patient-centric development will inform success in regulatory approval and wider adoption, but the approach needs to be tailored to the patient population. For example, in Alzheimer’s disease, patients find difficulties articulating their lived experiences due to cognitive decline, and so the development effort may require more nuance.
The rejections in the FDA COA qualification program indicate a shift in the rigor of evidence required to demonstrate that digital measures are meaningful to patients30. A separate guidance, issued for remote data acquisition using DHTs in clinical trials31, outlines that evidence is needed to demonstrate that a DHT is usable and acceptable by patients, accurately measures the outcomes it claims to measure, and that the derived outcomes are clinically relevant to the specific population (i.e. conforms to evidentiary standards detailed in the V3 framework32). Although evidence collection along this continuum is critical for DHT-derived COAs and biomarkers to be accepted or qualified by regulators, FDA’s recent guidance series related to meaningfulness of the measures captured by the DHTs is at the forefront. Alignment across stakeholders around the V3 framework has catalyzed innovation, leading to adaptations of established methodologies and concepts from the “traditional” biomarker field33. Current regulatory guidance is now prompting a similar cross-pollination, with digital measure developers increasingly turning to established practices from fields like psychometrics research, product development and user experience, in order to robustly demonstrate that the chosen measurement concepts are meaningful to patients. The FDA also offers various channels of early engagement for submissions, for example, through the Critical Path Innovation Meeting (CPIM) for COAs34 and pre-LOI program for biomarkers35. This encourages a dialog between researchers, developers and regulators in the pre-competitive or pre-submission stage.
Establishing meaningful aspects of health in practice
Engaging with patients to determine meaningful aspects of health
The Digital Measures that Matter framework1 provides a hierarchical model for establishing meaningfulness. First, patients’ experiences are mapped to high-level Meaningful Aspects of Health (MAH). MAH are then linked to broader and specific measurable concepts of interest, and finally to specific outcomes and endpoints. The framework helps to understand meaningful evidence as something rooted in MAH and avoid “technological determinism”, i.e. defining a patient’s lived experience by what can be measured with a technology instead of first considering what should be measured. Similarly, the PFDD guidance emphasizes using robust methods and psychometric analysis to gather patients’ experience and input on important aspects of life that should be assessed in the disease and its treatment20,21. The following sections present a brief recap of the key methodologies available to determine meaningful measurement concepts. The best method to gather patient input must be determined on a case-by-case basis and is dependent on the specific needs and context of the research in question.
The FDA encourages facilitated discussions with patients and caregivers to incorporate patient voice through the established model of FDA-, or externally-led PFDD meetings that organizations can adopt for collaborative meetings with patients and key stakeholders in any specific disease area36. Consensus on high-level MAH is often gathered in these meetings, catalyzing further research that can then focus on determining specific measurable concepts or outcomes linked to identified MAH. Qualitative research methods, such as one-on-one interviews and focus group discussions, are recommended to gain a deeper understanding of individual or group experiences. Quantitative methods such as surveys can also be useful for gathering patient input, but considerations should be taken to develop clear, concise and relevant questions and pilot with small groups of participants before launching larger studies. Mixed-methods approaches that integrate quantitative and qualitative approaches can provide a comprehensive understanding of patient perspectives and can help understand the generalizability of any observations.
These methods can provide foundational evidence to support the meaningfulness of novel DHT-derived COAs. The examples discussed below and in Table 1 showcase how sponsors and researchers are using the Measures that Matter framework and the roadmap developed by the FDA to gather patient input for COA development.
Obtaining diverse patient input to establish meaningfulness: key examples
In an example of patient-centric development, a mixed-methods study was conducted to understand MAH in atopic dermatitis37. The results found that scratch was the most burdensome and the most bothersome symptom that kept patients awake at night. The patients’ treatment considerations included relief from nocturnal scratch and adopting technologies that would measure scratch. This evidence is key for development and discovery of novel products and interventions that improve the lives of many individuals living with atopic dermatitis.
In another example, findings from an FDA-led PFDD meeting were used to identify MAH16 in idiopathic pulmonary fibrosis (IPF). The Voice of the Patient report provided the justification that higher-intensity physical activity is meaningful to patients with IPF. As a result, moderate-to-vigorous physical activity derived from a wrist actigraphy sensor was incorporated as a primary endpoint in a Phase 3 IPF trial38. This serves as a key example of how existing sources of evidence should be leveraged to gather patient input whenever possible.
Additionally, the development of stride velocity 95th centile (SV95C) in Duchenne Muscular Dystrophy (DMD)39, with an accepted LOI and endpoint qualified by EMA, established MAH through qualitative investigation in clinical experts, and patients and caregivers40. Evidence from these efforts indicated that patients and their caregivers view ambulatory function as key to their independence, want to maintain or improve it through treatment, and consider its real-world measurement important. (See Table 1).
Co-creating a conceptual framework with patients
Patient involvement in digital measure development is crucial beyond the initial step of establishing MAH. In the subsequent step of developing a conceptual framework, concepts identified as MAH are linked to measurable outcomes and then mapped to specific endpoints21. At this stage, patient input is important for ensuring that identified concepts and outcomes resonate with their lived experiences.
Such co-creation is the hallmark of Mobilise-D’s development effort. The consortium is developing digital measures of mobility in various conditions such as Parkinson’s disease, multiple sclerosis, chronic obstructive pulmonary disease, hip fracture, heart failure, frailty and sarcopenia41. Their work includes an exhaustive literature review of qualitative evidence of meaningfulness of walking. Patients were directly involved in the interpretation of the findings, where they helped identify several concepts of walking experience that are universally meaningful42,43. This level of patient engagement confirms that development efforts are rooted in patient experience.
Engaging with patients to evaluate user experiences and deliver value with DHTs
Meaningfulness in defining the measured concept is, of course, a foundational step, but this work is inconsequential if the implementation of the digital measure is not thoughtful6. Engaging patients provides a path to inform what evidence needs to be considered, how a measure will be implemented, and whether direct value for patients will be delivered. Therefore, once the conceptual framework supporting a digital measure is established, evidence of usability and acceptability of the relevant technology should be generated, beyond the required verification and validation32. As such, meaningfulness can be enhanced by ensuring that a measure that is rooted in patient experience is also acceptably captured by DHTs based on the user experience31. Equally, thinking of the value that can be directly delivered to patients, for example through the return of a summary of health data or trial results, opens further opportunities for engagement.
Establishing DHT acceptability and feasibility through real-world testing
There are various factors to consider while user testing DHTs, such as technical features, ease and comfort of use, interference with daily life, and the perceived benefit of use in the real-world43,44. Engaging with patients who have used and tested a given DHT in their lived environment is critical to generating such evidence. In a notable example, IDEA-FAST, another IMI-funded research consortium aiming to develop digital measures of sleep, fatigue, and activities of daily living in neurodegenerative and immune-mediated inflammatory diseases, has ongoing work to directly evaluate feasibility of using multiple sensing devices45. Researchers are using mixed-methods approaches to evaluate user experience, acceptability, and compliance. Patients’ daily reports are collected through questionnaires and daily diary, and objective measures of sensor wear time and compliance are collected directly from the DHTs46. Such data are also critical to evaluate whether DHTs are feasible for continuous and reliable data collection in the real world44.
To ensure representativeness of a DHT’s acceptability and feasibility, it is crucial that real-world device testing is performed in individuals from diverse socio-demographic backgrounds and disease severities. As DHTs pave the path for decentralized trials, gathering a broad spectrum of experiences becomes a priority in order to achieve inclusivity and representation in clinical trials47. Moreover, understanding the patient’s journey requires recognizing that distinct “personas” and preferences are dynamic and differ significantly among patient groups. For example, while a given wearable technology might be well received by patients with mild Alzheimer’s disease, its acceptability may be different for those with moderate and severe forms of the disease. Similarly, for cancer patients undergoing intensive treatment, the tolerance for wearable sensors may be diminished during treatment compared to other times.
Returning DHT-derived data back to the patients
Return of summarized health data to participants, especially those collected using DHTs, has recently been recognized as preferred by patients48 and known to help motivate patients and encourage communications with clinicians49. This serves as an opportunity for continuous patient engagement during the digital measure development process. It is also one way to ensure that meaningfulness is retained when progressing from the establishment of MAH and conceptual framework to digital measure deployment. In IDEA-FAST’s feasibility study utilizing multiple sensing devices (measuring physical activity, cognition and other health metrics), a summary of health data was provided back to patients at different time points during the study. To understand the importance of returning data and the best mechanisms to do so, the study explored patients’ perceived benefits of access to data, as well as use and interpretability of the data50. The preliminary findings suggested that patients reported using the information to monitor their health and performance, and felt confident about their adherence to the devices, which also fostered communications with clinicians. Some patients had difficulties interpreting the data, and some were confused about missing data. While the research on this front is still new, providing patients with access to their post-study data can be valuable to continue engagement at the final stage of digital measure deployment. As such, innovations on this front, for returning accessible and interpretable data, such as through mobile app features or summary reports, may be a worthwhile investment.
Traditionally, in clinical trials such return of data or results is uncommon. The return of DHT-derived data as discussed here is in line with the patient engagement efforts crucial for generating the evidence required for identifying and developing digital measures that are ultimately integrated in the clinical trials. Nevertheless, this must be approached with caution, and depending on the type of study there may be ethical and legal implications as well as errors or biases impacting patient behavior and the data thereafter51. Key considerations here include clear communication with patients (in informed consent), and proper documentation of plans for handling incidental findings and ways of mitigating risks (in IRB application)52.
Remaining hurdles for digital measure development and adoption
The past 10 years of FDA PFDD guidance have culminated in a deepening focus on patient engagement throughout the process of DDT-COA development. The patterns observed in the FDA COA qualification submissions reveal an increased emphasis on meaningfulness to patients, underscoring the importance, for acceptance and qualification by regulators, of developing digital measures that resonate with patients’ lived experiences in disease or treatment. As such, the regulatory guidance requires a continuous co-evolution with the digital measure field.
The FDA showcases commitment to building internal infrastructure and expertise to continue to advance the field. The future looks promising as both developers and regulators realize the significant benefits of PFDD in improving patient outcomes with increased efficiency, expedited regulatory decisions, and enhanced stakeholder engagement6,15,41. Figure 1 summarizes a roadmap for frequent patient engagement throughout the process of digital measure development. The roadmap also suggests an iterative process of communicating the results back to the patients and refining the development approach so that the meaningfulness is retained throughout.
Despite progress, challenges persist. First, patient experiences can be highly heterogeneous making it difficult to identify a single aspect of health that is meaningful and generalizable across all patients. Further, the ways in which a single aspect of health manifests across patients may also differ. For example, the fear of losing independence, while common across different phases of a patient journey, may translate to different measurement concepts depending on multiple factors including disease severity, culture, or other socioeconomic variables.
Secondly, even with detailed regulatory guidance on developing meaningful measures, there is no straightforward or standard path to successful development of a conceptual model. Without a clear roadmap for generating a specific concept of interest from the established MAH, qualification of DHT-derived COAs is challenging. Further, challenges in defining clinical significance remain due to the nature of digital measures and variability across patients and to lack or absence of associated anchors. There are a few examples of successful development in this case, such as the SV95C in DMD40, and the FDA’s guidance on PRO (and other COA) development can be utilized to understand methodologies in this context19. Still, there is a need for further guidance on these issues.
Furthermore, challenges lie in the classification of digital measures as COAs vs biomarkers in drug development23. As many behavioral digital measures are DHT-derived, they occupy a gray area between directly measuring “feel and function” (which would be characteristic of a COA), and a precisely defined, yet relatively abstract, measurement concept (which would be characteristic of a biomarker)23. Clarity from regulators will be required to understand whether individual measures are more suitable as COAs or biomarkers going forward.
Finally, there is a need to facilitate adoption internationally. In Europe, EMA has also released its own guidance on DHT-based methodologies to support medical products53,54. The EMA database points to various developments in this space. At the forefront is the recent qualification of SV95C as a primary endpoint in DMD clinical trials15,40. Additionally, Mobilise-D and IDEA-FAST have engaged the EMA for qualification advice on their digital measure development studies55,56,57. The forthcoming regulatory decisions may also provide valuable insights into alignment or divergence in approval mechanisms and approaches of EMA and FDA. Outside of EMA and FDA, countries such as the UK, Canada, and Japan, as well as international organizations such as WHO, have released guidance for DHTs and real-world data, but specific developments around qualification of measures have yet to be reported.
Outlook
The co-evolution of best practice, regulatory expectations, and guidance will progress as more examples of DHT-derived COAs emerge. Furthermore, key frameworks will be implemented and refined, and methodologies from other fields will be adapted in order to fulfill evidentiary requirements. More active engagement and dialog between developers and regulators will be essential to fuel the co-evolution. Thus, there is a need for more developers to take the step of engaging with regulators for qualification and acceptance, and regulators to further clarify and enable digital measure LOIs to be submitted. Engaging interdisciplinary stakeholders is also critical. Scientific and clinical experts play an important role as subject matter experts or principal investigators and support all aspects of the design and implementation. Along with other key stakeholders like the payers, they are vital for advocating for the utility of DHTs. Further, payers are also crucially positioned to improve patient care by establishing reimbursement policies around DHTs and providing wealth of data to facilitate real-world evidence and health economics and outcomes research.
In conclusion, while there are remaining hurdles to the successful development, qualification, and widespread adoption of digital measures, the path forward, driven by co-creation and stakeholder collaboration, holds the promise of a transformed and more patient-centric future in drug development. Ultimately, digital measures that matter to patients and that deliver value to them will prove to be beneficial to all stakeholders.
References
Manta, C., Patrick-Lake, B. & Goldsack, J. C. Digital measures that matter to patients: a framework to guide the selection and development of digital measures of health. Digit. Biomark. 4, 69–77 (2020).
Clay, I. et al. Reverse engineering of digital measures: inviting patients to the conversation. Digit. Biomark. 7, 28–44 (2023).
Goldsack, J. C., Dowling, A. V., Samuelson, D., Patrick-Lake, B. & Clay, I. Evaluation, acceptance, and qualification of digital measures: from proof of concept to endpoint. Digit. Biomark. 5, 53–64 (2021).
Center for Drug Evaluation and Research. Clinical Outcome Assessment (COA) Qualification Program. FDA https://www.fda.gov/drugs/drug-development-tool-ddt-qualification-programs/clinical-outcome-assessment-coa-qualification-program (2023).
Clay, I. Impact of digital technologies on novel endpoint capture in clinical trials. Clin. Pharmacol. Ther. 102, 912–913 (2017).
Marra, C., Chen, J. L., Coravos, A. & Stern, A. D. Quantifying the use of connected digital products in clinical research. NPJ Digit. Med. 3, 50 (2020).
Burq, M. et al. Virtual exam for Parkinson’s disease enables frequent and reliable remote measurements of motor function. Npj Digit. Med. 5, 1–9 (2022).
Lacombe, D. et al. Moving forward from drug-centred to patient-centred research: A white paper initiated by EORTC and developed together with the BioMed Alliance members. Eur. Respir. J. 53, 1801870 (2019).
Timpe, C., Stegemann, S., Barrett, A. & Mujumdar, S. Challenges and opportunities to include patient-centric product design in industrial medicines development to improve therapeutic goals. Br. J. Clin. Pharmacol. 86, 2020–2027 (2020).
Stegemann, S., Ternik, R. L., Onder, G., Khan, M. A. & van Riet-Nales, D. A. Defining patient centric pharmaceutical drug product design. AAPS J. 18, 1047–1055 (2016).
Taber, D. J. et al. A viewpoint describing the American Society of Transplantation rationale to conduct a comprehensive patient survey assessing unmet immunosuppressive therapy needs. Clin. Transplant. 37, e14876 (2023).
Perfetto, E. M., Burke, L., Oehrlein, E. M. & Epstein, R. S. Patient-focused drug development: a new direction for collaboration. Med. Care 53, 9 (2015).
Center for Drug Evaluation and Research. FDA Patient-Focused Drug Development Guidance Series for Enhancing the Incorporation of the Patient’s Voice in Medical Product Development and Regulatory Decision Making. FDA (2020).
Guidance for industry: patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health Qual. Life Outcomes 4, 79 (2006).
Servais, L. et al. First regulatory qualification of a novel digital endpoint in duchenne muscular dystrophy: a multi-stakeholder perspective on the impact for patients and for drug development in neuromuscular diseases. Digit. Biomark. 5, 183–190 (2021).
King, C. S. et al. A phase-2 exploratory randomized controlled trial of inopulse in patients with fibrotic interstitial lung disease requiring oxygen. Ann. Am. Thorac. Soc. 19, 594–602 (2022).
Center for Drug Evaluation and Research. FDA Patient-Focused Drug Development Guidance Series for Enhancing the Incorporation of the Patient’s Voice in Medical Product Development and Regulatory Decision Making. https://www.fda.gov/drugs/development-approval-process-drugs/fda-patient-focused-drug-development-guidance-series-enhancing-incorporation-patients-voice-medical (2023).
Patient-Focused Drug Development: Collecting Comprehensive and Representative Input; Guidance for Industry, Food and Drug Administration Staff, and Other Stakeholders; Availability. Federal Register https://www.federalregister.gov/documents/2020/06/17/2020-13046/patient-focused-drug-development-collecting-comprehensive-and-representative-input-guidance-for (2020).
Center for Drug Evaluation and Research. Patient-Focused Drug Development: Incorporating Clinical Outcome Assessments Into Endpoints for Regulatory Decision-Making. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-focused-drug-development-incorporating-clinical-outcome-assessments-endpoints-regulatory (2023).
Center for Drug Evaluation and Research. Patient-Focused Drug Development: Methods to Identify What Is Important to Patients. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-focused-drug-development-methods-identify-what-important-patients (2022).
Center for Drug Evaluation and Research. Patient-Focused Drug Development: Selecting, Developing, or Modifying Fit-for-Purpose Clinical Outcome Assessments. https://www.fda.gov/regulatory-information/search-fda-guidance-documents/patient-focused-drug-development-selecting-developing-or-modifying-fit-purpose-clinical-outcome (2022).
Gnanasakthy, A., Qin, S. & Norcross, L. FDA guidance on selecting, developing, or modifying fit-for-purpose clinical outcome assessments: old wine in a new bottle? Patient - Patient-Centered Outcomes Res 16, 3–5 (2023).
Izmailova, E. S., Demanuele, C. & McCarthy, M. Digital health technology derived measures: Biomarkers or clinical outcome assessments? Clin. Transl. Sci. 16, 1113–1120 (2023).
CDER & CBER Drug Development Tool Qualification Project Search. FDA https://force-dsc.my.site.com/ddt/s/.
Center for Drug Evaluation and Research. DDT COA #000102: Physical Activity Accelerometry Assessment for Analgesic Clinical Trials (PAACT). FDA https://www.fda.gov/drugs/clinical-outcome-assessment-coa-qualification-program/ddt-coa-000102-physical-activity-accelerometry-assessment-analgesic-clinical-trials-paact (2021).
Center for Drug Evaluation and Research. DDT COA #000142: Virtual Motor Exam for Parkinson’s Disease, Part III Estimator (VME Part III). FDA https://www.fda.gov/drugs/drug-development-tool-ddt-qualification-programs/ddt-coa-000142-virtual-motor-exam-parkinsons-disease-part-iii-estimator-vme-part-iii (2021).
Center for Drug Evaluation and Research. DDT COA #000129: Advanced Gait Analysis. FDA https://www.fda.gov/drugs/drug-development-tool-ddt-qualification-programs/ddt-coa-000129-advanced-gait-analysis (2020).
Center for Drug Evaluation and Research. DDT COA #000146: Instrumented Score of Ataxia Mobility (I-SAM). FDA https://force-dsc.my.site.com/ddt/s/ddt-project?ddtprojectid=143 (2021).
Masanneck, L., Gieseler, P., Gordon, W. J., Meuth, S. G. & Stern, A. D. Evidence from ClinicalTrials.gov on the growth of Digital Health Technologies in neurology trials. Npj Digit. Med. 6, 1–5 (2023).
Diao, J. A., Raza, M. M., Venkatesh, K. P. & Kvedar, J. C. Watching Parkinson’s disease with wrist-based sensors. Npj Digit. Med. 5, 1–2 (2022).
Conway, A. Digital Health Technologies for Remote Data Acquisition in Clinical Investigations: Guidance for Industry, Investigators, and Other Stakeholders. FDA Draft Guidance. https://www.fda.gov/media/155022/download (2021).
Goldsack, J. C. et al. Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs). Npj Digit. Med. 3, 55 (2020).
Babrak, L. M. et al. Traditional and Digital Biomarkers: Two Worlds Apart? Digit. Biomark. 3, 92–102 (2019).
Center for Drug Evaluation andResearch. Critical Path Innovation Meetings (CPIM). FDA https://www.fda.gov/drugs/new-drugs-fda-cders-new-molecular-entities-and-new-therapeutic-biological-products/critical-path-innovation-meetings-cpim (2023).
Center for Drug Evaluation and Research. Resources for Biomarker Requestors. FDA https://www.fda.gov/drugs/biomarker-qualification-program/resources-biomarker-requestors (2021).
Center for Drug Evaluation and Research. FDA-led Patient-Focused Drug Development (PFDD) Public Meetings. FDA https://www.fda.gov/industry/prescription-drug-user-fee-amendments/fda-led-patient-focused-drug-development-pfdd-public-meetings (2023).
Cesnakova, L. et al. A patient-centred conceptual model of nocturnal scratch and its impact in atopic dermatitis: A mixed-methods study supporting the development of novel digital measurements. Ski. Health Dis. 3, e262 (2023).
Bellerophon Announces FDA Acceptance of Change to Ongoing Phase 3 REBUILD Study of INOpulse® for Treatment of Fibrotic Interstitial Lung Disease | Bellerophon Therapeutics, Inc. https://bellerophon.gcs-web.com/news-releases/news-release-details/bellerophon-announces-fda-acceptance-change-ongoing-phase-3.
Center for Drug Evaluation and Research. DDT-COA-000103, ActiMyo®. FDA https://force-dsc.my.site.com/ddt/s/ddt-project?ddtprojectid=19.
European Medicines Agency. Final Qualification Opinion for Stride Velocity 95th Centile as Primary Endpoint in Studies in Ambulatory Duchenne Muscular Dystrophy Studies https://www.ema.europa.eu/en/documents/scientific-guideline/qualification-opinion-stride-velocity-95th-centile-primary-endpoint-studies-ambulatory-duchenne_en.pdf (2023).
Mikolaizak, A. S. et al. Connecting real-world digital mobility assessment to clinical outcomes for regulatory and clinical endorsement-the Mobilise-D study protocol. PLOS ONE 17, e0269615 (2022).
Delgado-Ortiz, L. et al. Listening to the patients’ voice: a conceptual framework of the walking experience. Age Ageing 52, afac233 (2023).
Keogh, A. et al. Acceptability of wearable devices for measuring mobility remotely: Observations from the Mobilise-D technical validation study. Digit. Health 9, 20552076221150745 (2023).
Moore, K. et al. Older Adults’ Experiences With Using Wearable Devices: Qualitative Systematic Review and Meta-synthesis. JMIR MHealth UHealth 9, e23832 (2021).
IDEA-FAST. https://idea-fast.eu/.
IDEA-FAST_D2.1_FS-Approvals_v1.0_IMI.pdf.
Peters, U. et al. Considerations for Embedding Inclusive Research Principles in the Design and Execution of Clinical Trials. Ther. Innov. Regul. Sci. 57, 186–195 (2023).
Branco, D., Bouça, R., Ferreira, J. & Guerreiro, T. Designing Free-Living Reports for Parkinson’s Disease. in Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems 1–6 (Association for Computing Machinery, New York, NY, USA, 2019). https://doi.org/10.1145/3290607.3313032.
Riggare, S., Stamford, J. & Hägglund, M. A long way to go: patient perspectives on digital health for Parkinson’s disease. J. Park. Dis. 11, S5–S10 (2021).
Rainey, J. et al. Data Contribution Summaries for Patient Engagement in Multi-Device Health Monitoring Research. in Adjunct Proceedings of the 2021 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2021 ACM International Symposium on Wearable Computers 536–541 (ACM, Virtual USA, 2021). https://doi.org/10.1145/3460418.3479371.
Shen, F. X. et al. Returning Individual Research Results from Digital Phenotyping in Psychiatry. Am. J. Bioeth. 24, 69–90 (2024).
Gelinas, L., Morrell, W., White, S. A. & Bierer, B. E. Navigating the ethics of remote research data collection. Clin. Trials 18, 606–614 (2021).
European Medicines Agency. Questions and answers: Qualification of digital technology-based methodologies to support approval of medicinal products. https://www.ema.europa.eu/en/documents/other/questions-and-answers-qualification-digital-technology-based-methodologies-support-approval-medicinal-products_en.pdf.
Qualification of novel methodologies for medicine development | European Medicines Agency. https://www.ema.europa.eu/en/qualification-novel-methodologies-medicine-development.
European Medicines Agency. Letter of support for Mobilise-D digital mobility outcomes as monitoring biomarkers. EMA https://www.ema.europa.eu/en/documents/other/letter-support-mobilise-d-digital-mobility-outcomes-monitoring-biomarkers-follow_en.pdf.
IDEA-FAST qualification advice request submitted to EMA! – IDEA-FAST. https://idea-fast.eu/idea-fast-qualification-advice-request-submitted-to-ema/.
Office of the Commissioner. Focus Area: Biomarkers. FDA https://www.fda.gov/science-research/focus-areas-regulatory-science-report/focus-area-biomarkers (2022).
Center for Drug Evaluation and Research. DDT-COA-000120, Scratch Sensor. FDA https://force-dsc.my.site.com/ddt/s/ddt-project?ddtprojectid=56.
Johri, S. et al. MVPA Reflects Life Participation In Patients Using INOpulse Therapy.
Rochester, L. et al. A roadmap to inform development, validation and approval of digital mobility outcomes: the mobilise-D approach. Digit. Biomark. 4, 13–27 (2020).
Nobbs, D. et al. Regulatory qualification of a cross-disease digital measure: benefits and challenges from the perspective of IMI Consortium IDEA-FAST. Digit. Biomark. 7, 132–138 (2023).
Acknowledgements
The authors thank Robert Wright for helpful input in developing the initial outline of this work. The study received no external funding.
Author information
Authors and Affiliations
Contributions
S.A., J.M.B. and I.C. were involved in conception, design and first draft of this manuscript. S.A., J.M.B., S.L.B., S.H., Y.Z., J.C.R., I.C., and K.L. contributed to subsequent drafts and revisions of the final manuscript.
Corresponding author
Ethics declarations
Competing interests
SA, JMB, SLB, SH, YZ, JCR, IC, and KL are employees of VivoSense, Inc. IC is on the Editorial Board of Karger Digital Biomarkers and the Scientific Advisory Board for IMI IDEA-FAST and has received fees for lectures and consulting on digital health at ETH Zürich and FHNW Muttenz.
Ethics
Not relevant due to the nature of this manuscript.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Aryal, S., Blankenship, J.M., Bachman, S.L. et al. Patient-centricity in digital measure development: co-evolution of best practice and regulatory guidance. npj Digit. Med. 7, 128 (2024). https://doi.org/10.1038/s41746-024-01110-y
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41746-024-01110-y
- Springer Nature Limited