Abstract
Digital Health Technologies (DHTs) such as connected sensors offer particular promise for improving data collection and patient empowerment in neurology research and care. This study analyzed the recent evolution of the use of DHTs in trials registered on ClinicalTrials.gov for four chronic neurological disorders: epilepsy, multiple sclerosis, Alzheimer’s, and Parkinson’s disease. We document growth in the collection of both more established digital measures (e.g., motor function) and more novel digital measures (e.g., speech) over recent years, highlighting contexts of use and key trends.
Similar content being viewed by others
The burden of neurological disorders is growing in the US and abroad, with neurological conditions representing the most frequent cause of disability worldwide1. The resulting consequences are considerable individual suffering and substantial societal healthcare costs2,3. R&D investments are needed to identify new therapies, but clinical research faces challenges including high costs, administrative hurdles, and challenging patient recruitment4,5,6. Furthermore, clinical trials and their associated follow-up visits burden patients and their relatives7, especially for those with highly disabling neurological diseases.
Against this backdrop, the use of digital tools, such as connected sensors, promises to make research more patient-centered and move clinical trials beyond single “snapshots” of disease status toward more continuous measurement of chronic disorders8. Connected digital products9 or Digital Health Technologies (DHTs)10,11 are software-containing, patient-focused, portable, and connected sensors of health-related measurements, which describe different products, including many wearables. DHT examples from current FDA guidance include spirometers with smart connectivity, consumer activity trackers, and mobile applications for patients to report outcomes11. Such connected sensors may improve both the quantity and quality of data collection during clinical trials and enable patient recruitment in a less burdensome and more patient-empowering remote setting9.
In neurological diseases such as Parkinson’s disease (PD), use of validated, reliable, and sensitive tools has already been shown to provide better data on the “real-life distribution of disease severity, as it fluctuates longitudinally” in early-stage patients12,13. DHTs can therefore facilitate new study designs12, improve the efficiency of clinical trials14,15,16, and contribute to tackling many of the challenges neurological research faces. As more researchers adopt such technologies, understanding the use and development of DHTs in neurological clinical trials will be valuable for investigators, practicing clinicians, and those designing patient care pathways. As such, this study documents trends in the use of DHTs in neurology research and highlights opportunities for both R&D activities and care delivery going forward.
We assessed studies registered on ClinicalTrials.gov for four exemplary chronic neurological disorders. Building on methods from Marra et al. (2020)9, we identified trial-indication pairs for clinical studies in epilepsy, the neuroinflammatory disease multiple sclerosis (MS), and the two neurodegenerative diseases, PD and Alzheimer’s disease (AD). We present quantitative and qualitative (categorical) analyses of the trials that used connected sensors to describe technology adoption in neurology research and outline underlying trends over the years 2010-2021, inclusive.
Of the 6763 trial-indication pairs for epilepsy, MS, AD, and PD considered, 503 trial-indication pairs were identified as using DHTs by our search algorithm. After manual verification, 441 trial-indication pairs, associated with 430 unique clinical trials, were determined to be relevant and included in the analysis sample (Supplementary Fig. 1). Analysis sample trial counts varied significantly across indications: most frequent were studies in PD (198, 44.9%), followed by MS (119, 27.0%), AD (87, 19.7%), and epilepsy (37, 8.4%).
We document growth in the use of DHTs in neurological clinical trials, with a compound annual growth rate of ~39% from 2010 – 2020, consistent with trends in DHT growth that have been documented in registered clinical studies more broadly9. Most analyzed trials were interventional, with DHT trials based on registries having started only in recent years and typically incorporating some kind of digital activity or speech tracking (Fig. 1).
The relative frequency of DHT use in trials for the focal conditions increased from 0.7% of trials in 2010 to 11.4% in 2020. PD trials showed early uptake of DHTs and the highest use rate over the full period of the study (8.3% on average). AD, MS, and epilepsy trials showed a delayed upward trend, with respective use rates of 7.3%, 5.8%, and 3.3% overall (Supplementary Table 1).
Among all DHT trials, 16.6% included an industry sponsor or collaborator – slightly less frequently than the 19% previously documented across all medical disciplines9 – with industry partnerships more commonly observed in trials for epilepsy (37.8%) and AD (23.0%) (see Supplementary Fig. 2).
With respect to studies’ categorical (qualitative) features, most trials tracked patient symptoms (91.4%), with exceptions focusing on vital signs of caregivers or other disease-related outcomes such as medication adherence. The majority of trials measured motor functions (68.9%), with many including exercise elements (34.7%), sometimes through the use of gaming consoles (7.9%). Sleep (15.4%), cognition (10.4%), and speech (4.3%) tracking were less common as were gamification (19.3%), caregiver support (6.6%), and medication adherence (4.3%) elements (Table 1). A large share of studies used some form of mobile application (35.1%) and the most commonly referenced DHTs were wearables (129, 29.3%), smartphones (76, 17.2%), actigraphs (48, 10.9%) and mobile applications (42, 9.5%) (see Supplementary Table 2).
PD and MS trials often focused on motor symptoms and physical exercise, with a high share of gamification elements in MS trials. Other observed characteristics included numerous caregiver support and speech recognition tools in AD trials, frequent sleep tracking in AD and epilepsy trials, cognition tracking in AD and MS trials, and a recurrent tracking of medication adherence in epilepsy trials (Table 1).
Generally, a trend toward more complex and more extensive studies was observed, as represented by a gradual change in categorical trial features over time (Fig. 2). Whereas the use of motor function and exercise tracking were already observed in 2010, speech and cognition tracking were not observed until the mid-2010s (Fig. 2). Speech and cognition tracking both grew over time and were present in 8.1% and 14.0% of analyzed DHTs using trials in 2021, respectively (Supplementary Table 1). Conversely, the relative use of gamification elements decreased slightly in more recent years (Supplementary Table 1).
Most registered trial-indication pairs were identified in North America or Europe, with a large share of trials having principal investigators in the US (209, 47.4%), followed by Italy and France (both 28 or 6.3% each), the UK (19, 4.3%), Belgium (17, 3.9%), Switzerland (16, 3.6%), Israel (14, 3.2%), Canada, Turkey, and Germany (all 13 or 2.9% each). In total, trials from 33 countries and all inhabited continents were included in the analysis sample. Some regions showed a local/regional concentration of DHT studies, often related to a specific indication. An interactive map displaying the locations of sample trials are publicly accessible at https://www.reine-nervensache.de/eigene-forschungsergebnisse/digital-health-technologies-in-neurology-trials.
Qualitatively, included studies displayed heterogeneity in their aims. Whereas some clinical trials aimed to validate products or novel biomarkers, others already applied them as endpoints in studies of other interventions.
While some have highlighted insufficient prospective clinical research applying DHTs and mobile health17, the use of DHTs in neurology trials has not previously been characterized in detail. We analyzed disease-specific DHT adoption in trials registered on ClinicalTrials.gov to provide insights specific to four chronic neurologic diseases.
The analysis confirmed a clear trend in DHT adoption, with some disease-specific heterogeneity. The earlier application of such tools in disorders with primarily motoric symptoms, such as PD or MS, is likely due to the early availability of wearable sensors to track motor functions and might contribute to the higher number of trials observed for these two indications. However, as novel sensors and sophisticated technical setups became available in more recent years, multimodal clinical trials tackling diverse research questions with DHTs began to emerge. This development is evident in the subset of AD trials, where recent growth in the share of trials using DHTs is consistent with increasing readiness of novel digital measures that integrate speech and cognition tracking18,19. In parallel, the repertoire of DHTs used in early-adopting subfields has also expanded, for example through potential PD monitoring technologies that now include passive tremor monitoring via wearables12,13, smartphone-based motor and vocal symptom assessments20,21, gait analysis via smart insoles22, and sensors for swallowing23.
Interestingly, pharmaceutical companies tested self-developed DHTs in some trials24,25,26, indicating a possibility for broader prospective adoption by other stakeholders. Differences in the share of industry-sponsored trials across neurologic diseases could indicate differences in experience with digital measures across indications or difference in research funding for different diseases (either within firms themselves and/or from investments by research foundations or public funders). Any of these factors could shape biopharmaceutical and medical device firms’ investments in their use in clinical trials. Regions with a higher density of clinical trials using DHTs differ in their indication-specificity, suggesting different backgrounds and foci of research teams: high-density areas with multiple indications were more frequent in the US and could indicate technology-driven research, whereas regional clusters focusing on research in a single indication appeared more common in other countries.
Some digital measures assessed in the analysis sample integrate information previously unavailable to clinicians and researchers, such as details of smartphone usage27 or characteristics of patient-caregiver-interactions28,29, in one case deploying real-time monitoring of mood and stress via a smart-home approach29. Monitoring cognitive and motor skills with ‘byproduct data’ such as metadata on smartphone keystroke dynamics, for example, in epilepsy27 or MS30, could allow remote monitoring to be passively and therefore more seamlessly integrated into patients’ daily lives and eventually, into clinical routines. Further examples of the use of previously inaccessible data for novel phenotyping include approaches such as longitudinal repetitive cognitive testing18,31, speech characterization32, or swallowing monitoring23. Especially in more complex recent studies, digital biomarkers or measures were observed in conjunction with biological and radiological biomarkers22,33, promising a more detailed overview of patients’ health status than ever before. Furthermore, the small but growing trend of monitoring and supporting caregivers or relatives via DHTs28,29 could preview new forms of promising assistance for these essential but often neglected alleviators of the burdens of chronic diseases. A personalized prevention of secondary burn-out or depression among caregivers could be supported by DHTs that objectively track interactions with patients and monitor caregivers’ vital signs and stress28,29.
The observed heterogenous use pattern of DHTs in the analysis sample highlights different use cases for validating DHTs, gathering data with DHTs, or using DHTs as interventions; understanding this heterogeneity should be a focus of future research. Examples of trials categorized by the use cases according to Marra et al.9 can be found in Supplementary Table 3. Generally, there appears to be a large variety of new therapeutic and monitoring solutions under study, although solutions often remain fragmented, stand-alone approaches, making it difficult to bring user-friendly, holistic approaches into practice at scale.
The growing share of disease-specific trials applying DHTs show that neurological research is already adapting and increasingly integrating remote digital measurements into its research agenda. In addition to growing adoption of established digital measures, such as motor function, novel approaches, such as speech and cognition tracking are being deployed more often.
Recent regulatory trends further support this development, as seen in the first qualification of a digital endpoint by the EMA in Duchenne muscular dystrophy34, a neuromuscular disorder, and published guidance for applying DHTs by the FDA11. Nevertheless, there remains ample opportunity to extend the use of DHTs in clinical trials and support their transition into routine clinical care. Different technologies promise improved patient healthcare access and new setups for decentralized clinical trials, thereby enabling previously unimaginable measures for gathering real-world evidence. Further research is needed to clarify what is required for broader adoption in practice, thus enabling the translation of verified, analytically validated, and clinically validated tools35 into improved patient care.
Methods
We identified DHTs in trials registered on ClinicalTrials.gov following Marra et al. (2020)9 and using an updated and curated version of the searched product list (see Supplementary Note 1 and GitHub repository in the Data Availability Statement). Additionally, trials were filtered for the conditions epilepsy, MS, AD, or PD, resulting in a dataset built around unique trial-indication pairs (only 10 trials had multiple indications). The analysis sample was restricted to trials launched from 2010–2021 (inclusive) that had at least begun recruitment. Data were retrieved on February 28th, 2022. The resulting set of records was analyzed for the use of DHTs and trials that referenced such products were included in the analysis and mapped to a list of relevant categories defined for this purpose. This list included non-mutually-exclusive features such as different tracking characteristics as listed in Table 1 and Supplementary Table 1 (mapping was carried out by L.M. and P.G.). For comparison, other contemporaneous trials for the same indications were pulled from ClinicalTrials.gov. All analyses were run using Python 3.8 (Python Software Foundation, Delaware, USA). An interactive map of the principal trial locations was generated using plotly version 5.4.036 after geocoding addresses with geopy version 2.2.037. The co-author team included a patient with one of the focal disorders.
Reporting summary
Further information on research design is available in the Nature Research Reporting Summary linked to this article.
Data availability
The data that support the findings of this study are publicly available at https://github.com/Entspannter/DHTs-in-neurology-trials. A visualization of the of the interactive map in the GitHub repository can be accessed at https://www.reine-nervensache.de/eigene-forschungsergebnisse/digital-health-technologies-in-neurology-trials/.
Code availability
Code and instructions to reproduce the study are available in a public GitHub repository at https://github.com/Entspannter/DHTs-in-neurology-trials.
References
Feigin, V. L. et al. The global burden of neurological disorders: translating evidence into policy. Lancet Neurol. 19, 255–265 (2020).
Gooch, C. L., Pracht, E. & Borenstein, A. R. The burden of neurological disease in the United States: A summary report and call to action. Ann. Neurol. 81, 479–484 (2017).
Olesen, J. et al. The economic cost of brain disorders in Europe. Eur. J. Neurol. 19, 155–162 (2012).
Hall, D. A. et al. The state of clinical research in neurology. Neurology 90, e1347–e1354 (2018).
Wouters, O. J., McKee, M. & Luyten, J. Estimated Research and Development Investment Needed to Bring a New Medicine to Market, 2009-2018. JAMA 323, 844–853 (2020).
Lohmann, L. et al. Status of clinical research in neurology in Germany-A national survey. Eur. J. Neurol. 28, 1446–1452 (2021).
Naidoo, N. et al. The research burden of randomized controlled trial participation: a systematic thematic synthesis of qualitative evidence. BMC Med. 18, 6 (2020).
Stroud, C., Onnela, J.-P. & Manji, H. Harnessing digital technology to predict, diagnose, monitor, and develop treatments for brain disorders. npj Digit. Med. 2, 1–4 (2019).
Marra, C., Chen, J. L., Coravos, A. & Stern, A. D. Quantifying the use of connected digital products in clinical research. npj Digit. Med. 3, 1–5 (2020).
Vasudevan, S., Saha, A., Tarver, M. E. & Patel, B. Digital biomarkers: Convergence of digital health technologies and biomarkers. npj Digit. Med. 5, 1–3 (2022).
Center for Drug Evaluation and Research. Digital Health Technologies for Remote Data Acquisition in Clinical Investigations. U.S. Food and Drug Administration https://www.fda.gov/regulatory-information/search-fda-guidance-documents/digital-health-technologies-remote-data-acquisition-clinical-investigations (2022). (accessed June 10, 2022)
Burq, M. et al. Virtual exam for Parkinson’s disease enables frequent and reliable remote measurements of motor function. npj Digit. Med. 5, 65 (2022).
Mahadevan, N. et al. Development of digital biomarkers for resting tremor and bradykinesia using a wrist-worn wearable device. npj Digit. Med. 3, 1–12 (2020).
Dodge, H. H. et al. Use of High-Frequency In-Home Monitoring Data May Reduce Sample Sizes Needed in Clinical Trials. PLOS ONE 10, e0138095 (2015).
Czech, M. D. et al. Age and environment-related differences in gait in healthy adults using wearables. npj Digit. Med. 3, 127 (2020).
De Brouwer, W., Patel, C. J., Manrai, A. K., Rodriguez-Chavez, I. R. & Shah, N. R. Empowering clinical research in a decentralized world. npj Digit. Med. 4, 1–5 (2021).
Rowland, S. P., Fitzgerald, J. E., Holme, T., Powell, J. & McGregor, A. What is the clinical value of mHealth for patients? npj Digit. Med. 3, 1–6 (2020).
Meier, I. B. et al. Using a Digital Neuro Signature to measure longitudinal individual-level change in Alzheimer’s disease: the Altoida large cohort study. npj Digit. Med. 4, 1–9 (2021).
Kourtis, L. C., Regele, O. B., Wright, J. M. & Jones, G. B. Digital biomarkers for Alzheimer’s disease: the mobile/wearable devices opportunity. npj Digit. Med. 2, 1–9 (2019).
Beats Medical. A Randomized, Cross-Over, Placebo-Controlled Pilot Study to Evaluate the Self-Management of Gait, Speech and Dexterity in Patients With Parkinson’s Disease Using a Novel Digital Therapeutic Approach. https://clinicaltrials.gov/ct2/show/NCT05120609 (2021).
Goalspal LLC. A Study to Analyze Features of Dysphonia and Tremor in PD Patients to Aid in the Development of an Accurate Diagnostic Tool for Early-Detection of PD. https://clinicaltrials.gov/ct2/show/NCT04288804 (2022).
University Hospital, Lille. A Prospective Study on Markers of Disease Progression and Gait Within the Parkinsonian Population. https://clinicaltrials.gov/ct2/show/NCT04653688 (2022).
Xu, S. (Steve). Novel Sensor for Swallowing in Patients With Parkinson’s Disease. https://clinicaltrials.gov/ct2/show/NCT04664634 (2022).
Montalban, X. et al. A smartphone sensor-based digital outcome assessment of multiple sclerosis. Mult. Scler. J. 28, 654–664 (2022).
Midaglia, L. et al. Adherence and Satisfaction of Smartphone- and Smartwatch-Based Remote Active Testing and Passive Monitoring in People With Multiple Sclerosis: Nonrandomized Interventional Feasibility Study. J. Med. Internet Res. 21, e14863 (2019).
Limmroth, V., Bayer-Gersmann, K., Mueller, C. & Schürks, M. Ascertaining Medication Use and Patient-Reported Outcomes via an App and Exploring Gamification in Patients With Multiple Sclerosis Treated With Interferon β-1b: Observational Study. JMIR Form. Res. 6, e31972 (2022).
Stichting Epilepsie Instellingen Nederland. Using Day-to-day Behavior on Smartphones to Improve Epilepsy Management. https://clinicaltrials.gov/ct2/show/NCT04617418 (2021).
Dawson, W. Assessing Acceptability, Cost, and Efficacy of STELLA-Support Via Technology: Living and Learning With Advancing AD. https://clinicaltrials.gov/ct2/show/NCT04335110 (2022).
Rose, K. Collaborative Research: Learning and Improving Alzheimer’s Patient-Caregiver Relationships Via Smart Healthcare Technology. https://clinicaltrials.gov/ct2/show/NCT04536701 (2021).
Lam, K.-H. et al. The Use of Smartphone Keystroke Dynamics to Passively Monitor Upper Limb and Cognitive Function in Multiple Sclerosis: Longitudinal Analysis. J. Med. Internet Res. 24, e37614 (2022).
Altoida. Precision Medicine Initiative Against Alzheimer’s Disease (PMIAAD): Digitally-enhanced, Decentralized, Multi-omics, Observational Cohort. https://clinicaltrials.gov/ct2/show/NCT04701177 (2022).
Novoic Limited. A Study to Evaluate the Ability of Speech- and Language-based Digital Biomarkers to Detect and Characterise Prodromal and Preclinical Alzheimer’s Disease in a Clinical Setting - FUTURE Extension Study. https://clinicaltrials.gov/ct2/show/NCT04846426 (2021).
Washington University School of Medicine. Cerebrospinal Fluid-biomarkers-based Diagnostic and Prognostic Models for Multiple Sclerosis. https://clinicaltrials.gov/ct2/show/NCT04496830 (2022).
Servais, L. et al. First Regulatory Qualification of a Novel Digital Endpoint in Duchenne Muscular Dystrophy: A Multi-Stakeholder Perspective on the Impact for Patients and for Drug Development in Neuromuscular Diseases. Digit. Biomark. 5, 183–190 (2021).
Goldsack, J. C. et al. Verification, analytical validation, and clinical validation (V3): the foundation of determining fit-for-purpose for Biometric Monitoring Technologies (BioMeTs). npj Digit. Med. 3, 55 (2020).
Plotly Technologies Inc. Collaborative data science. (2015).
Esmukov, K. & others. geopy. (2022).
Acknowledgements
The authors would like to thank Melissa Ouellet for excellent research assistance. The authors would also like to thank Marc Pawlitzki and Linea Schmidt for critical reading of the manuscript. There is no funding to be declared.
Author information
Authors and Affiliations
Contributions
All authors contributed to data collection, data analysis and interpretation, and the writing of this manuscript.
Corresponding author
Ethics declarations
Competing interests
LM reports personal fees from Biogen and Merck, both outside the scope of this study, PG reports personal fees for activities as a patient consultant from Novartis, WJG reports consulting income from Novocardia Inc., and Great Point Ventures, outside the scope of this work, SGM reports no conflict of interest related to this study, ADS declares that she serves as a member of the Scientific Advisory Board of the German Society for Digital Medicine and the Strategic Advisory Board of HumanFirst.
Additional information
Publisher’s note Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons license, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons license and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this license, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Masanneck, L., Gieseler, P., Gordon, W.J. et al. Evidence from ClinicalTrials.gov on the growth of Digital Health Technologies in neurology trials. npj Digit. Med. 6, 23 (2023). https://doi.org/10.1038/s41746-023-00767-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41746-023-00767-1
- Springer Nature Limited
This article is cited by
-
Unleashing the full potential of digital outcome measures in clinical trials: eight questions that need attention
BMC Medicine (2024)
-
Numerosity estimation of virtual humans as a digital-robotic marker for hallucinations in Parkinson’s disease
Nature Communications (2024)
-
Navigating the U.S. regulatory landscape for neurologic digital health technologies
npj Digital Medicine (2024)
-
Patient-centricity in digital measure development: co-evolution of best practice and regulatory guidance
npj Digital Medicine (2024)
-
Online cognitive monitoring technology for people with Parkinson’s disease and REM sleep behavioural disorder
npj Digital Medicine (2024)