Abstract
Background
Functional decline in Alzheimer’s disease (AD) is typically measured using single-time point subjective rating scales, which rely on direct observation or (caregiver) recall. Remote monitoring technologies (RMTs), such as smartphone applications, wearables, and home-based sensors, can change these periodic subjective assessments to more frequent, or even continuous, objective monitoring. The aim of the RADAR-AD study is to assess the accuracy and validity of RMTs in measuring functional decline in a real-world environment across preclinical-to-moderate stages of AD compared to standard clinical rating scales.
Methods
This study includes three tiers. For the main study, we will include participants (n = 220) with preclinical AD, prodromal AD, mild-to-moderate AD, and healthy controls, classified by MMSE and CDR score, from clinical sites equally distributed over 13 European countries. Participants will undergo extensive neuropsychological testing and physical examination. The RMT assessments, performed over an 8-week period, include walk tests, financial management tasks, an augmented reality game, two activity trackers, and two smartphone applications installed on the participants’ phone. In the first sub-study, fixed sensors will be installed in the homes of a representative sub-sample of 40 participants. In the second sub-study, 10 participants will stay in a smart home for 1 week.
The primary outcome of this study is the difference in functional domain profiles assessed using RMTs between the four study groups. The four participant groups will be compared for each RMT outcome measure separately. Each RMT outcome will be compared to a standard clinical test which measures the same functional or cognitive domain. Finally, multivariate prediction models will be developed. Data collection and privacy are important aspects of the project, which will be managed using the RADAR-base data platform running on specifically designed biomedical research computing infrastructure.
Results
First results are expected to be disseminated in 2022.
Conclusion
Our study is well placed to evaluate the clinical utility of RMT assessments. Leveraging modern-day technology may deliver new and improved methods for accurately monitoring functional decline in all stages of AD. It is greatly anticipated that these methods could lead to objective and real-life functional endpoints with increased sensitivity to pharmacological agent signal detection.
Similar content being viewed by others
Explore related subjects
Find the latest articles, discoveries, and news in related topics.Background
Alzheimer’s disease (AD) is a neurodegenerative disease characterized by amyloid β (Aβ) and tau pathology [1]. Symptoms associated with the disease include extensive cognitive and functional decline, resulting in patients gradually losing their ability to carry out activities of daily life (ADL) and function independently. In the early stage of the disease, people with demonstrably high levels of Aβ and tau pathology present little or no cognitive and functional symptoms (prodromal/preclinical AD) that are detectable with the available tools to date. As the disease progresses, cognition and function decline towards the syndromic stages of mild cognitive impairment (MCI) and dementia [2], with the extent of functional impairment being the key feature differentiating between these stages. The conventional method for measuring such decline is through questionnaires, patient and caregiver interview (and less frequently through direct observation or testing) in the clinic. These assessments are only performed periodically and typically rely on (caregiver) recall, hence representing a frequently biassed snapshot of the patient’s function captured in a clinical environment. Moreover, these conventional methodologies lack sensitivity to subtle symptoms in the early stages of the disease [3] and have limited utility as outcome measurements in clinical trials of interventions in preclinical AD. The development of current digital technologies provides an until now unavailable opportunity to repeat and improve measurements of functional decline in AD [4], which is exactly the aim of the “Remote Assessment of Disease and Relapse – Alzheimer’s Disease” (RADAR-AD) project [5].
Remote Monitoring Technologies (RMTs), such as fixed sensors at home, smartphone applications, and wearables (e.g. activity trackers), are minimally invasive and can measure parameters continuously and objectively. RMTs are suitable to monitor ADLs, since they are able to assess processes in a “real-world” environment, and therefore carry the promise of providing greater ecological validity and sensitivity than conventional in-clinic measures of function. The RADAR-AD study will use RMTs as the main method for assessing function via ADLs.
The field of digital technologies is rapidly developing. A recent review [4] emphasizes the increasing number of studies utilizing RMTs in both cognitively healthy older adult populations and patients with MCI or dementia. The authors conclude that only a few studies deal with real-world measurements. The number of studies using wearables is limited, and these studies generally cover only short-term measurement periods (< 4 weeks). Hence, it remains unclear which device outcomes have the most consistent association with cognitive and functional decline. Additionally, an important knowledge gap in the current literature is whether RMTs can detect the earliest symptoms of functional decline in preclinical AD patients.
The RADAR-AD study is a step forward to address some of these knowledge gaps. Its overall aim is to assess whether RMTs are able to accurately measure function with improved sensitivity in a real-world environment across preclinical-to-moderate stages of AD. In order to meet this aim, three sub-topics will be addressed:
-
1.
Differentiation: is it possible to differentiate between healthy controls and participants with preclinical AD, prodromal AD, and mild-to-moderate AD using outcome measures of multiple RMTs?
-
2.
Head-to-head comparison with current clinical standard: are the outcomes of the RMTs better than the standard clinical measures of functional decline?
-
3.
Feasibility: what is the technical performance of RMTs in the real-world and how acceptable are RMTs to AD spectrum patients and their study partners?
Methods
Study design
RADAR-AD is a multicentre observational, cross-sectional, cohort study in subjects within the preclinical-to-moderate AD spectrum as well as healthy controls. The design entails three tiers: (1) main study, which includes smartphone applications and wearable devices only; (2) first sub-study, which in addition includes fixed sensors at the participant’s home; and (3) second sub-study, which in addition includes fixed sensors in an existing smart home environment.
Data will be collected in 13 countries across Europe (see Table 1). Participating clinical sites were selected based on their geographic location, expertise in digital technologies and disease population of interest, and the availability of clinical cohorts with known AD biomarkers.
Participants
The aim is to include 220 participants in the main study, of which a representative sub-sample of 40 participants continues into the first sub-study and 10 participants continue into the second sub-study. Each clinical site aims to recruit 5 participants of each study group (controls, preclinical AD, prodromal AD/MCI and mild-to-moderate AD; see below) in the main study, to equally distribute participants over the centres across Europe. Participants will be recruited from memory clinics and ongoing observational studies. Participants in the first sub-study are drawn from the four study groups, and are participants from the clinical sites in Amsterdam, Stavanger, Oxford, and London that already participated in the main study and meet the inclusion criteria for the sub-study. Participants in the second sub-study are participants from the clinical site in Thessaloniki only that already participated in the main study. To ensure all AD participants have underlying AD pathology, all participants will have AD biomarker evidence of supra-threshold Aβ burden (defined through each site’s local procedures), with either positron emission topography (PET) or cerebral spinal fluid (CSF), before inclusion. All healthy control participants will be cognitively unimpaired, be age- and sex-matched to the AD groups, and have confirmation of negative AD biomarkers if available. The diagnosis of subjects within the AD spectrum will be based on the NIA-AA criteria [2] and the study groups on the Mini-Mental State Examination (MMSE) [6] and the Clinical Dementia Rating (CDR) [7]:
-
1.
AD spectrum (positive Aβ biomarkers)
-
(a)
Preclinical AD: MMSE > 26, CDR = 0 (N = 55)
-
(b)
Prodromal AD/MCI: MMSE > 23, CDR = 0.5 (N = 55)
-
(c)
Mild-to-moderate AD: MMSE > 17, CDR > 0.5 (N = 55)
-
(a)
-
2.
Control (negative Aβ biomarkers if available)
-
(a)
Healthy controls: MMSE > 27, CDR = 0 (N = 55)
-
(a)
Inclusion criteria for all participants are male or female over 50 years of age, in generally good health, or diagnosed with mild chronic disorder (of metabolic, respiratory, immunological, cardiologic, and metabolic origin) or any other medical conditions that are controlled by therapy and/or do not impair function on a secondary basis to that of AD-related symptomatology, and availability of a study partner (spouse/family member/caregiver/friend) that consents to collaborating with the study. Furthermore, the participant and study partner should be able to read and communicate in the language of the recruitment centre and able to actively engage in tests and questionnaires, and the participant and study partner should both own a smartphone. For those volunteering in the first sub-study, availability of appropriate Wi-Fi and/or phone line connectivity in the participants’ house is required. For those volunteering in the second sub-study, participants and their study partners are required to move in to the smart home and should therefore only involve cognitively unimpaired age-matched participants. Exclusion criteria for all subjects are presence of a comorbid-neurological or psychiatric disease that may affect ADLs or social interactions, and any other kind of disorders that may significantly affect mobility, ADLs, or social interactions (e.g., immune-mediated inflammatory disorders, recovery from recent trauma, stroke, etc.). Since the local investigator has medical history available of potential participants for pre-screening, the local investigator is in the best position to judge the influence of these diseases or disorders on functional or social behaviour.
Sample size
The web-based version of the Amsterdam Instrumental Activities of Daily Living (Amsterdam IADL) questionnaire [8] was selected as the primary endpoint for sample size calculation. This endpoint will serve as the gold standard for quantifying ADLs and staging the severity of functional impairment.
The hypothesis of the RADAR-AD study is that RMTs should have at least the same differentiating power as the Amsterdam IADL questionnaire in indexing functional decline in AD. Sample size was chosen to have 80% power to detect a difference in ADLs of > 10% between subjects in the following comparisons, as observed using available data from the Amsterdam IADL rating scale: (I) healthy controls vs. preclinical AD, (II) preclinical AD vs. MCI, and (III) MCI vs. mild-to-moderate AD. The lowest number of participants per group giving RADAR-AD’s cohorts at least 80% power is 55 in each of the four study groups, producing a total sample size of 220. This is based on the interquartile ranges from Jutten et al. [8] that reported on one thousand clinical trials to simulate sample size. They considered a trial positive if all three of the abovementioned comparisons had Holm adjusted p-values of less than 0.05. Each comparison was performed using a two-sided t-test with unequal variances.
The sub-studies are explorative studies, which primary focus is on feasibility of the devices. To meet this goal, a small subset of participants from the main study is sufficient for the sub-studies.
Patient advisory board
A patient advisory board (PAB) was set up in month 3 of the project. This work has been led by Alzheimer Europe in collaboration with project partners. The PAB has provided feedback to the study protocol, patient-facing materials, prioritization of functional domains, selection of devices, and ethical issues. Further information about the PAB composition and work can be found at [9].
Selection of relevant functional domains
We carried out an extensive literature review to select functional domains relevant to AD biomarkers, quality of life (QoL), rate of disease progression, and loss of independence. PubMed literature until March 2019 was searched using relevant keywords and the results were tabulated to guide the prioritization of these preliminary functional domains. A more detailed description of the prioritization of the functional domains process can be found in [10].
Functional domains were ranked and grouped by the empirical evidence for each in relation to ability to predict MCI-to-AD dementia conversion, relevance to early AD, and prediction of decline in people with dementia. The list of functional domains from the literature review then underwent a systemic Delphi-type process before being handed over for discussion with the RADAR-AD Patient Advisory Board for feedback on the relevance of the functional domains to the experience of living with AD or caring for someone with AD from patients and/or their carers. The results from these search criteria were prioritized into tiers: tier 1, highly relevant; tier 2, relevant; tier 3, neutral; and tier 4, less relevant. Functional domains that met all three established criteria (predicts MCI-to-AD conversion, relevance to early AD, and being predictive of decline in people with dementia) and were reported as relevant by the RADAR-AD Patient Advisory Board were grouped into tier 1. Functional domains that met two of the criteria and were reported as relevant by the RADAR-AD Patient Advisory Board were grouped into tier 2. Functional domains that met one of these criteria and were reported as relevant by the RADAR-AD Patient Advisory Board were grouped into tier 3, and functional domains that met 1 of the criteria were grouped into tier 4. The result can be found in the first column of Table 2.
Device selection
Based on the list of relevant functional domains, a device selection process of potential RMTs was initiated to quantify behavioural, motor and cognitive measures in each functional domain. A selection process was developed that would bring together technical, clinical, and participant perspectives, based on three interlinked activities to identify relevant technologies, synthesize into a compatible selection, and verify that the rationale for that selection is well-founded [10]. Devices were selected with the following considerations in mind:
-
1.
Features. Size, battery life, comfort, convenience, or other relevant features such as whether it is water-resistant.
-
2.
What the RMT can do for the participant. How the RMT is perceived by the participant and his/her caregiver, if it provides feedback regarding exercise or steps per day or shows time or date, and if it does not compound potential societal stigmas. These issues were discussed extensively with the PAB.
-
3.
What the RMT can do for the researchers. Provide information about relevant processes, type of data provided, presence of CE marking as medical device, and assess remotely.
Selected devices were discussed with the RADAR-AD PAB in order to ensure that patients and their study partners are willing and able to use the RMTs. The following RMTs were chosen for use in the RADAR-AD main study in the participant’s own environments (Fig. 1):
-
1.
Fitbit Charge 3. A wrist-worn accelerometry device that will be worn on the non-dominant arm, which will provide information about night-time sleep duration and number of awakenings, heart rate, and daytime activity profile. This CE-marked device was chosen because it measures both heart rate and activity. Moreover, the RADAR-AD PAB indicated that they appreciate an aesthetic device, which gives feedback on their activities.
-
2.
Axivity AX3. An accelerometry device which will be worn on the dominant hand. It passively measures raw 3D acceleration, which will be further processed to obtain measures of sleep, physical activity, and circadian rhythms. This CE-marked device was added to the Fitbit Charge 3 since it provides a more granular measure of raw accelerations, unlike the Fitbit, but the AX3 has no display to provide feedback to the user and does not measure heart rate. The large UK Biobank study (N = 100,000) has already demonstrated AX3’s suitability to measure activity profiles, while also providing data from a cognitively normal cohort [11].
-
3.
RADAR-base passive RMT app (pRMT). A smartphone application for Android users only that will passively collect information from app usage, relative GPS (Global Positioning System) coordinates, Bluetooth, and other on-phone sensors [12] for further analysis of mobility and social communications [13]. This app does not need any active involvement of the participant, while collecting large amounts of data on social behaviour and phone usage.
-
4.
Autographer wearable camera. This device will be worn around the neck and will be taking a photo every 20 s in order to contextualize the activities measured using the Fitbit and Axivity wristbands. This camera is CE marked, is lightweight, has a wide-angle lens, and captures images unobtrusively of the participant’s perspective. Wearable cameras are already used in studies of social interactions, sedentary, behaviour and health-related research [14]. The use of the camera is optional for participants, since participants might have privacy concerns [15].
-
5.
Mezurio app. A smartphone application for iOS and Android based on the very earliest neural and cognitive correlates of preclinical AD, utilizing both active and passive data collection. Participants will be asked to interact with the app for no more than 10 min at a regular time of their own choosing, during each day of the study. A bespoke protocol for the app containing a mix of different gamified tasks and short self-report questionnaire measures has been designed for the RADAR-AD study. Mezurio also includes active tasks for voice and speech analysis and passive measurement of typing dynamics, and GPS will be collected for iOS users only. The caregiver will also be asked to complete a complementary parallel Mezurio schedule of self-reported measures relating to the participant’s capabilities across functional domains. A previous study shows the feasibility of this app [16] and a large ongoing study (N > 16,000) will provide normative data [17].
-
6.
Altoida Medical Device (Altoida MD). A smartphone and tablet-based CE-marked digital biomarker platform that simulates a complex ADL exercise using augmented reality. It calculates the Neuro Motor Index (NMI), a score derived from the performance combining data streams from voice data, hand micro movements and errors, gait micro errors, posture changes, eye tracking, and visuospatial navigation micro errors. It has been shown to have an accuracy of 94% in predicting cognitive worsening in amyloid positive individuals who converted from MCI to AD after 5 years [18]. The Altoida MD app will be used in the clinic baseline and weekly at home.
-
7.
Amsterdam IADL. A questionnaire, filled out by a caregiver, assessing instrumented ADLs (IADLs) on a PC or tablet. The questionnaire is validated in a memory clinic cohort [19] and is able to detect functional decline [8]. The Amsterdam IADL will both be filled out in the clinic baseline visit and weekly at home.
The following RMTs were chosen to use in the RADAR-AD main study in the clinic:
-
1.
Gait Up Physilog sensors. These body-worn sensors contain accelerometers and gyroscopes to calculate 26 gait parameters, such as walking speed, gait asymmetry, and step variability during a 1-min walking task, a 1-min dual task (in which people have to count back from 100 to 0 while walking), and a timed up-and-go (TUG) test. This CE-marked RMT was chosen because it is user-friendly and validated in a large number of patient groups and normative data for cognitively healthy older adults are available [20].
-
2.
Banking app. A smartphone application simulating a bank withdrawal. The application was developed as part of a multi-sensor assessment and monitoring system, during the Dem@Care project [21], to assess parameters related to the functional abilities of managing finances. The app is now extended and enhanced for use in this study (e.g., multi-lingual use).
The following fixed RMTs were chosen to use in the first RADAR-AD sub-study:
-
1.
Residential activity sensors. Presence sensors (based on infrared motion), door-window sensors (based on magnetic sensors), and appliance energy-usage sensors (measuring energy consumption) will be strategically placed in the participants’ homes. These sensors will monitor occupancy of certain spaces (e.g., the kitchen) and utility usage (e.g., opening the fridge door or kitchen appliances usage). Fusing those values together via complex event processing methods will then provide profiling, context-awareness, and activity recognition related to IADLs, such as preparing a meal. Outlier detection can detect certain problems and symptoms, for example long duration of chores or visiting the bathroom multiple times at night.
-
2.
DREEM headband. A handband-based remote polysomnography device, worn during sleep that logs parameters on sleep quality and patterns through dry electroencephalogram (EEG) electrodes and accelerometers [22]. This data can, among others, be used to assess the distribution of the various sleep stages.
-
3.
CANedge driving performance logger. A data logger that is plugged into the Open DataBase Connectivity (ODBC) port of the participant’s car (if available). This logger, which is generally used to perform car diagnostics, gathers data on acceleration and breaking patterns, driving frequency, and fuel consumption. The advantage of this device over, e.g., a real-world driving evaluation is that it measures driving behaviour each time a participant uses the car for 4 weeks, it does not affect someone’s driving behaviour, and it does not need an additional contact moment.
For the second sub-study, 10 healthy control participants from the main study will be observed for 1 week in the Digital Home developed by the Centre for Research and Technology Hellas (CERTH). The CERTH-ITI nZEB Smart House [23] is a rapid prototyping and novel technologies demonstration infrastructure resembling a real domestic building where occupants can experience actual living scenarios while exploring various innovative smart Internet of Things (IoT)-based technologies with provided energy, health, big data, robotics, and artificial intelligence (AI) services. Technology related to dementia assessment and monitoring for elders has been embedded as part of H2020 ACTIVAGE [24] and FP7 Dem@Care [25] and will be enriched with first sub-study RADAR-AD devices but in greater variety and quantity so as to explore the potential of deeper and wider monitoring capabilities to extract biomarkers in a controlled environment.
Data platform
Selected devices were then integrated by a development team into the RADAR-base platform, an open-source mHealth platform developed by the RADAR-CNS consortium [13]. Based on the Apache Kafka stream processing engine, it harmonizes the data it receives using a set of standard schema and typically stores its data in Apache Avro file format. Clinical research forms (CRFs) were built using the REDCap system [26, 27]. The complete platform was then deployed in a secure, private, OpenStack cloud environment physically within the Oxford University Big Data Institute’s High Performance Biomedical Compute facility.
Study timeline and procedures
Eligible participants and their study partners will receive written and oral information regarding the study. There will be a minimum time window before the RADAR-AD research team will contact the potential participant and study partner again to answer any questions and to determine if they would like to participate in the study. If both are willing to participate, the baseline and close-out visit will be scheduled, with at least 8 weeks between the two appointments. Informed consent will be signed before participation in the study.
During the baseline visit, several paper and pencil tests will be administered (see Table 2). In order to compare the outcomes of the RMTs with the outcomes of standard clinical tests and to confirm clinical diagnosis, participants will complete a battery of neuropsychological tests, conventional paper and pencil assessments, and a physical examination in a clinical setting. Furthermore, all smartphone applications will be installed on the participant’s and their partner’s phones, and instructions will be provided on how to operate the RMTs at home. Both the participant and the study partner have to be present at the baseline visit, which will take around 4 h.
Participation in the main study lasts for 8 weeks, with an optional extension of 4 weeks for the first sub-study (for participants in Amsterdam, Stavanger, Oxford, and London only) or 1 week for the second sub-study (for participants in Thessaloniki only). The first sub-study can also be done in parallel to the main study. The study visit scheme can be found in Fig. 2 (main study) and Fig. 3 (first sub-study). The banking app, Altoida MD and walk tests will be performed during the baseline visit in clinic. The Fitbit, Axivity (sampled at 25 Hz), and pRMT app will measure passively and continuously during the 8-week period of data collection. The optional wearable camera will be worn during 2 consecutive days on up to three occasions. The Mezurio schedule has been set-up for active involvement on a daily basis, while the Altoida MD and Amsterdam IADL Questionnaire need active involvement on a weekly basis. Every 2 weeks, a phone call is made by a RADAR-AD researcher to participants to check for technical issues and adverse events. Additionally, compliance is checked and discussed with the participant. The only RMTs used by the study partner are the Amsterdam IADL and Mezurio app in order to answer questions about the participant on a weekly and daily basis, respectively.
Timeline of the visit scheme of the main study. Participants visit the clinic for a baseline visit. Both standard clinical tests and digital tests will take place during this baseline visit. Additionally, participants will receive a description and training for the device usage at home. The participants will use the RMTs for 8 weeks at home. Devices in green measure continuously while devices in orange measure periodically. The participants will be called by phone every 2 weeks to evaluate the device usage and to check for adverse events. After these 8 weeks, the participants will visit the clinic again for a close-out visit, in which the devices have to be handed in and several final tests will be done
Timeline of the first sub-study. Participants will be opted in as a representative sub-sample from the main study equally distributed over the study groups. Several residential activity sensors will be installed in the home of the participant and the participant will receive training regarding the devices. During the 4-week data collection, participants will use the DREEM device each night. After 2 weeks, a phone call will be made to evaluate the device usage and to check for adverse events. After 4 weeks, the devices will be de-installed at home
Feature extraction
High-frequency sensor data are typically processed to extract meaningful features using algorithms which are highly specific to that stream and then aggregated over a variety of time periods. For example, an accelerometer providing 30 measurements per second can be processed [28] to derive sleep characteristics for each night, and relative location data can be used to estimate distance travelled per day, duration of home stay per day, number of places visit per day, etc. Work is now ongoing to curate relevant feature algorithms into a computationally consistent environment so that a database suitable for further analysis can be produced.
Outcomes
The primary outcome of this study is the difference in functional domain profiles using each RMT separately between the four study groups: healthy controls, participants with preclinical AD, participants with prodromal AD, and participants with mild-to-moderate AD. A secondary outcome is the association between the RMTs and the standard clinical tests assessing the same functional domain. The additional objective of the second sub-study is to set up and validate the capabilities of a fully equipped, digital home of the future, with an extended set of monitoring equipment and analysis from the first sub-study.
Statistical analysis plan
Data obtained from RMTs will be collected continuously (for example, accelerometer recordings or GPS data), periodically (for example, the weekly Altoida or Amsterdam IADL), or obtained during the baseline visit only (for example, gait assessment). Continuous data will be subjected to feature extraction as per the “Feature extraction” section. We will then analyse each RMT dataset separately to assess whether they differ significantly between the four study groups, and whether they correlate with standard clinical questionnaires.
For a continuous day-by-day time series, we will model such a RMT measure using a mixed-effect model for repeated measures (MMRM) based on observed case data. The effect size of any between study groups differences (or relation to related ADL scale) is of primary interest. In the case of RMT data obtained at a single study time point (such as gait assessment), analysis of covariance (ANCOVA) will be conducted. Correction for multiple comparison will be considered for univariate RMT modelling.
As a second step, we will attempt to answer the question, whether a combination of different RMT assessments contributes to either study group discrimination and/or is related to ADL scale in a multivariate predictive modelling approach. Results of univariate modelling will be considered a filter-based feature selection, which will inform what information to include into the model. Continuous RMT data will be aggregated (e.g. mean, standard deviation, lagged autocorrelation, as estimated using data from a whole 8-week experiment duration) for each participant. These preselected aggregated features in combination with preselected RMT measures obtained at a single study point will be used for modelling. Since many classification or regression algorithms cannot handle situations where a value of at least one covariate is missing for a particular data sample, imputation will be applied, instead of completely removing this data sample. This imputation will be done under assumption that data are missing at random, and where the number of missing cases is not drastically high, e.g. less than 25%. Multivariate prediction (of either study group or related ADL scale) models will be constructed and further variable selection, based on, for example, LASSO L1-regularization for (generalized) linear models, or different feature selection algorithms will be applied. Models’ performance will be characterized through n-fold cross-validation.
For the assessments which will be primary done in the clinic and repeated at home (as, for example, experiments with the Altoida app), results will be compared using Bland Altman analysis to assess the agreement between two quantitative variables. Based on the result, recommendation regarding possibility to use home-based tests will be provided. To check whether “real-world” (at home) assessment outperforms the one done in the “clinical environment”, we will check whether the predictive models (described above) using “real-world” assessments have better predictive performance than the ones using “clinical” assessments.
Modelling of the data
To allow modelling-driven interpretation of the cross-sectional data that will be collected during the main study and two sub-studies, we will also model functional and cognitive decline using data from available longitudinal cohorts such as Alzheimer’s Disease Neuroimaging Initiative (ADNI) [29] and AddNeuroMed [30], which will provide variables of interest. After generation of these overview variables, initial steps for statistical and machine learning based modelling will be performed. These initial steps for modelling will include extraction of individual item scores of variables, pre-processing, and normalizing the data. We will then apply and compare statistical (linear mixed models) and machine learning based approaches (e.g., recurrent neural networks) to model the functional and cognitive measures obtained from the heterogeneous longitudinal cohorts over time, having identified biosignatures indicative of changes in functional and cognitive status.
In addition, we have established semantic mappings between digital biomarkers and functional domains. A further aim is to understand, whether the digital biomarker data collected in RADAR-AD can be mapped to the longitudinal model.
Our work also aims to build and evaluate different machine learning classifiers, for example random forest and gradient boosted decision trees trained on functional domains. These classifiers will be built on multiple longitudinal datasets, such as ADNI and National Alzheimer’s Coordinating Center (NACC). It will help us to analyse the difference of functional domains between the different AD stages. The prioritization of functional domains will be mapped with those established from literature [10]. This classifier will be further applied on the digital data in order to see if RTMs are a more sensitive measure of disease progression compared to the traditionally clinically measured functional and cognitive data.
Ethics
Medical ethics committees associated with each clinical site will approve the study independently. Minor adjustments of the research protocol, such as a substitution of a clinical questionnaire, are allowed in each country in order to facilitate ethical approval. Before submission to the local ethical committees, the study was reviewed by our internal ethics group (Lucivero et al., in preparation). The study will be carried out in accordance with the ethical conduct and juridical laws of the Declaration of Helsinki of 2013. Participants will be recruited from memory clinics and ongoing cohort studies. Appropriately trained research staff at the clinical sites will screen participants for eligibility. All study participants and their study partners will sign written informed consent separately before inclusion in the study. In all cases, participants’ data will be collected and processed according to the European General Data Protection Regulation (GDPR) and any applicable national privacy regulation. The RMTs data storage and utilization will comply with EU regulation No. 1291/2013 of the European Parliament and of the Council of 11 December 2013 and the new Medical Device Regulation (EU 2017/745).
Privacy and data processing
Participant’s privacy and confidentiality will be respected throughout the course of the study. All clinical and personal data (age, gender, level of education, clinical data, and diagnosis) will be provided with a code that cannot be traced to an individual. Identifiable information collected at clinical sites will be stored within a password protected key file, separate from the RADAR-base platform and accessible only to members of the local research team. All RMT data will be centrally stored in the RADAR-base platform.
Data collected via the Fitbit Charge 3 and Altoida MD is first transmitted to respective company data warehouses from which data will be accessed, encrypted, and uploaded to a secure server maintained by the sponsor organization and will be not identifiable by participant name. Data collected via smartphone will be encrypted and uploaded to the secure RADAR-base server by Wi-Fi or mobile data connection. Data will be temporarily cached on the smartphone until an appropriate connection is available and will then be automatically deleted from the phone’s memory.
The non-identifiable data acquired may be transmitted through a computer network, through the internet, or transferred via removable media to be shared with other members of the RADAR-AD consortium. This information will be anonymized and will not include anything that could identify participants by name, date of birth or address. Participants will be informed and asked to consent to sharing of information.
The RADAR-AD research team will keep legible and accurate documents to ensure thorough documentation of study conduct. The highest degree of confidentiality will be maintained for managing data collected throughout the course of this study, however, to meet legal responsibilities and quality assurance policies, the investigational site will permit authorized representatives of the sponsor, funder, and health authorities to examine anonymized records to satisfy quality assurance reviews, audits, and evaluations of study safety and progress.
Results
The first participant was enrolled in July 2020, and recruitment will continue until December 2021. The first results are expected to be disseminated in 2022.
Discussion
The RADAR-AD project aims to study the use of RMTs to measure function in participants across the AD spectrum. RMTs are potentially beneficial in comparison to standard clinical assessments because they can measure continuously during sleep, gait, and ADLs at home; do not rely on caregiver recall; are objective; and are minimally invasive and burdensome for the participant. Previous literature shows that measuring ADLs in the real-world is feasible using wearables and home-based sensors in dementia patients [4]. Healthy control studies with a large sample size have been carried out [11], but real-world data from large studies with AD spectrum patients are still lacking. Therefore, this study will contribute to the field significantly, since this is a relatively large cohort study using smartphone applications, wearables, and home-based sensors. Moreover, our cohort will complete an extensive battery of neuropsychological tests and conventional paper and pencil assessments of cognition and function. Assessments of cognition and function will be carried out both in the clinic and in the real-world and therefore allow direct comparison. Of great importance is that, in contrast to many previous studies, all clinical participants will have AD biomarker confirmation. This is in line with the recent NIA-AA research framework [2] and current clinical trials, which emphasize the importance of the outcomes of this study in defining endpoints for future clinical trials.
One of the main tasks of RADAR-AD is securing data privacy. To ensure data privacy, thorough precautions, as mentioned in the “Privacy and data processing” section, will be undertaken, including the use of the specifically designed data platform RADAR-base. A possible challenge is that older adults may distrust or not accept the technologies to observe them. However, despite this perception, the review of Piau et al. [4] and our RADAR-AD PAB workshop (Stavropoulos et al., in preparation) suggest that the acceptability issues are relatively minor, both with fixed sensors and wearables. Moreover, one of the aims of this study is to test the acceptability of RMTs to measure functioning in daily life, and therefore, any major acceptability issues will constitute an important outcome of the study. Another challenge is the large number of participating sites, i.e., fourteen, across thirteen countries. To ensure high data quality across all centres, several precautions are taken: a detailed study manual describing all study procedures, extensive training for all researchers involved before inclusion of the first participant in each centre, and data quality will be monitored centrally during the data collection period. It is expected that AD patients have a less structured day and are less active during the day compared to unimpaired older adults [31,32,33,34]. Also, cultural differences between countries are expected, since, e.g., older adults in the Mediterranean countries make less use of computers and smartphones than older adults in Northern European countries [35].
Limitations
One limitation is the difficulty to obtain independent behavioural data to validate the RMT metrics. We emphasize that the RADAR-AD study is an exploratory study aiming to find differences between the four study groups on the RMT outcomes and the association with standard clinical tests, but this does not necessarily validate the real-world performance of the RMTs. Longitudinal assessment of functional decline and the associations with RMTs aiming to measure this decline will help with validation. However, the design of the RADAR-AD study is cross-sectional. Therefore, if the results of this study are promising, longitudinal studies are recommended for further research. Another limitation is the start of the study in the middle of the COVID-19 pandemic. Behaviour of individuals may have changed, especially for elderly people at high risk. Therefore, COVID-19 restrictions across countries will be observed closely. Moreover, medical events such as COVID-19 positive tests will be monitored during the study by asking the participants about medical events during the bi-weekly phone calls and end-of-study visit. Most importantly, this pandemic demonstrates the importance of monitoring disease symptoms remotely, and therefore we are confident that the RADAR-AD study is of added value.
Conclusions
The RADAR-AD study aims to assess the accuracy and validity of RMTs in measuring functional decline in a real-world environment across preclinical-to-moderate stages of AD compared to standard clinical rating scales. If successful, the RADAR-AD study may provide important guidance on novel digital endpoint deployment for future clinical trials. Improved measures and monitoring of function may ultimately lead to higher successful drug development rate, earlier interventions, and overall better care of those affected by AD.
Availability of data and materials
Not applicable.
Abbreviations
- AD:
-
Alzheimer’s disease
- ADCS-ADL:
-
Alzheimer’s Disease Cooperative Study—Activities of Daily Living scale
- ADL:
-
Activities of daily living
- ADNI:
-
Alzheimer’s Disease Neuroimaging Initiative
- AI:
-
Artificial intelligence
- Altoida MD:
-
Altoida Medical Device
- Amsterdam IADL/AIADL:
-
Amsterdam Instrumental Activities of Daily Living Questionnaire
- ANCOVA:
-
Analysis of covariance
- Aβ:
-
Amyloid β
- CDR:
-
Clinical Dementia Rating
- CE:
-
Conformité Européenne
- CERTH:
-
Centre for Research and Technology Hellas
- CRF:
-
Clinical research form
- CSF:
-
Cerebral spinal fluid
- DSST:
-
Digit Symbol Substitution Test
- Ecog:
-
Everyday cognition
- EEG:
-
Electroencephalogram
- ESS:
-
Epworth Sleepiness Scale
- GDPR:
-
General Data Protection Regulation
- GPS:
-
Global Positioning System
- IADL:
-
Instrumented Activities of Daily Living
- IoT:
-
Internet of Things
- MCI:
-
Mild cognitive impairment
- MMRM:
-
Mixed-effect model for repeated measures
- MMSE:
-
Mini-Mental State Examination
- NACC:
-
National Alzheimer’s Coordinating Center
- NIA-AA:
-
National Institute on Aging—Alzheimer’s Association
- NMI:
-
Neuro Motor Index
- NPI:
-
Neuropsychiatric Inventory
- ODBC:
-
Open DataBase Connectivity
- PAB:
-
Patient advisory board
- PET:
-
Positron emission topography
- pRMT:
-
RADAR-base passive RMT app
- PSQI:
-
Pittsburgh Sleep Quality Inventory
- QoL:
-
Quality of life
- RADAR-AD:
-
Remote Assessment of Disease and Relapse—Alzheimer’s Disease
- RAS:
-
Residential activity sensors
- RMT:
-
Remote monitoring technology
- SFS:
-
Social Functioning Scale
- TUG:
-
Timed up-and-go
References
Selkoe DJ. Alzheimer’s disease: genes, proteins, and therapy. Physiol Rev. 2001;81(2):741–66. https://doi.org/10.1152/physrev.2001.81.2.741.
Jack CR Jr, Bennett DA, Blennow K, Carrillo MC, Dunn B, Haeberlein SB, Holtzman DM, Jagust W, Jessen F, Karlawish J, Liu E, Molinuevo JL, Montine T, Phelps C, Rankin KP, Rowe CC, Scheltens P, Siemers E, Snyder HM, Sperling R, Elliott C, Masliah E, Ryan L, Silverberg N. NIA-AA research framework: toward a biological definition of Alzheimer’s disease. Alzheimers Dement. 2018;14(4):535–62. https://doi.org/10.1016/j.jalz.2018.02.018.
Amariglio RE, Donohue MC, Marshall GA, Rentz DM, Salmon DP, Ferris SH, Karantzoulis S, Aisen PS, Sperling RA, Alzheimer’s Disease Cooperative Study. Tracking early decline in cognitive function in older individuals at risk for Alzheimer disease dementia: the Alzheimer’s Disease Cooperative Study Cognitive Function Instrument. JAMA Neurol. 2015;72(4):446–54. https://doi.org/10.1001/jamaneurol.2014.3375.
Piau A, Wild K, Mattek N, Kaye J. Current state of digital biomarker technologies for real-life, home-based monitoring of cognitive function for mild cognitive impairment to mild Alzheimer disease and implications for clinical care: systematic review. J Med Internet Res. 2019;21(8):e12785. https://doi.org/10.2196/12785.
RADAR-AD. https://www.radar-ad.org/. Accessed 9 June 2020.
Folstein MF, Folstein SE, McHugh PR. ‘Mini-mental state’ a practical method for grading the cognitive state of patients for the clinician. J Psychiatr Res. 1974;12:189–98.
Morris JC. The Clinical Dementia Rating (CDR): current version and scoring rules. Neurology. 1993;43(11):2412–4. https://doi.org/10.1212/WNL.43.11.2412-a.
Jutten RJ, Peeters CF, Leijdesdorff SM, Visser PJ, Maier AB, Terwee CB, et al. Detecting functional decline from normal aging to dementia: development and validation of a short version of the Amsterdam IADL Questionnaire. Alzheimer’s Dement. 2017;8(1):26–35. https://doi.org/10.1016/j.dadm.2017.03.002.
RADAR-AD Patient Advisory Board. https://www.radar-ad.org/patient-engagement/patient-advisory-board. Accessed 9 June 2020.
Owens AP, Hinds C, Manyakov NV, Stavropoulos TG, Lavelle G, Gove D, Diaz-Ponce A, Aarsland D. Selecting remote measurement technologies to optimize assessment of function in early Alzheimer’s disease: a case study. Front Psychiatry. 2020;11 https://doi.org/10.3389/fpsyt.2020.582207.
Doherty AR, Jackson D, Hammerla N, Plotz T, Olivier P, Granat MH, et al. Large scale population assessment of physical activity using wrist worn accelerometers: the UK Biobank Study. Plos One. 2017;12(2):e0169649. https://doi.org/10.1371/journal.pone.0169649.
RADAR-base. https://radar-base.org/. Accessed 9 June 2020.
Ranjan Y, Rashid Z, Stewart C, Conde P, Begale M, Verbeeck D, Boettcher S, The Hyve, Dobson R, Folarin A, The RADAR-CNS Consortium. RADAR-base: open source mobile health platform for collecting, monitoring, and analyzing data using sensors, wearables, and mobile devices. JMIR mHealth and uHealth. 2019;7(8):e11734. https://doi.org/10.2196/11734.
Doherty AR, Hodges SE, King AC, Smeaton AF, Berry E, Moulin CJ, et al. Wearable cameras in health: the state of the art and future possibilities. Am J Prev Med. 2013;44(3):320–3. https://doi.org/10.1016/j.amepre.2012.11.008.
Kelly P, Marshall SJ, Badland H, Kerr J, Oliver M, Doherty AR, Foster C. An ethical framework for automated, wearable cameras in health behavior research. Am J Prev Med. 2013;44(3):314–9. https://doi.org/10.1016/j.amepre.2012.11.006.
Lancaster C, Koychev I, Blane J, Chinner A, Wolters L, Hinds C. The Mezurio smartphone application: evaluating the feasibility of frequent digital cognitive assessment in the PREVENT dementia study. medRxiv. 2019:19005124. https://doi.org/10.1101/19005124.
Gamechanger. https://www.alzheimers.org.uk/research/play-your-part/gamechanger. Accessed 9 June 2020.
Tarnanas I, Tsolaki A, Wiederhold M, Wiederhold B, Tsolaki M. Five-year biomarker progression variability for Alzheimer’s disease dementia prediction: can a complex instrumental activities of daily living marker fill in the gaps? Alzheimers Dement (Amst). 2015;1(4):521–32. https://doi.org/10.1016/j.dadm.2015.10.005.
Sikkes SA, Knol DL, Pijnenburg YA, de Lange-de Klerk ES, Uitdehaag BM, Scheltens P. Validation of the Amsterdam IADL Questionnaire(c), a new tool to measure instrumental activities of daily living in dementia. Neuroepidemiol. 2013;41(1):35–41.
Dadashi F, Mariani B, Rochat S, Büla CJ, Santos-Eggimann B, Aminian K. Gait and foot clearance parameters obtained using shoe-worn inertial sensors in a large-population sample of older adults. Sensors. 2014;14(1):443–57.
Stavropoulos TG, Meditskos G, Kompatsiaris I. DemaWare2: integrating sensors, multimedia and semantic analysis for the ambient care of dementia. Pervasive Mob Comput. 2017;34:126–45. https://doi.org/10.1016/j.pmcj.2016.06.006.
Arnal PJ, Thorey V, Ballard ME, Hernandez AB, Guillot A, Jourde H, et al. The Dreem headband as an alternative to polysomnography for EEG signal acquisition and sleep staging. BioRxiv. 2019;662734. https://doi.org/10.1101/662734.
ITI Smarthome. https://smarthome.iti.gr/. Accessed 9 June 2020.
ACTIVAGE. http://www.activageproject.eu/. Accessed 9 June 2020.
Dem@Care. http://www.demcare.eu/. Accessed 9 June 2020.
Harris PA, Taylor R, Thielke R, Payne J, Gonzalez N, Conde JG. A metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. https://doi.org/10.1016/j.jbi.2008.08.010.
Harris PA, Taylor R, Minor BL, Elliott V, Fernandez M, O'Neal L, et al. The REDCap consortium: Building an international community of software platform partners. J Biomed Informatics. 2019;95:103208.
Doherty AR, Smith-Byrne K, Ferreira T, Holmes MV, Holmes C, Pulit SL, et al. GWAS identifies 14 loci for device-measured physical activity and sleep duration. Nat Commun. 2018;9(1):1–8.
ADNI. http://adni.loni.usc.edu/. Accessed 9 June 2020.
AddNeuroMed. https://emif-catalogue.eu//c/adcohort. Accessed 9 June 2020.
Stucki RA, Urwyler P, Rampa L, Muri R, Mosimann UP, Nef T. A web-based non-intrusive ambient system to measure and classify activities of daily living. J Med Internet Res. 2014;16(7):e175. https://doi.org/10.2196/jmir.3465.
Akl A, Snoek J, Mihailidis A. Generalized linear models of home activity for automatic detection of mild cognitive impairment in older adults. Conf Proc IEEE Eng Med Biol Soc. 2014;2014:680–3.
Kirste T, Hoffmeyer A, Koldrack P, Bauer A, Schubert S, Schroder S, et al. Detecting the effect of Alzheimer’s disease on everyday motion behavior. J Alzheimers Dis. 2014;38(1):121–32. https://doi.org/10.3233/JAD-130272.
Dodge H, Mattek N, Austin D, Hayes T, Kaye J. In-home walking speeds and variability trajectories associated with mild cognitive impairment. Neurology. 2012;78(24):1946–52. https://doi.org/10.1212/WNL.0b013e318259e1de.
Dubbelman MA, Verrijp M, Facal D, Sánchez‐Benavides G, Brown LJ, van der Flier WM, Jokinen H, Lee A, Leroi I, Lojo‐Seoane C, Milošević V. The influence of diversity on the measurement of functional impairment: an international validation of the Amsterdam IADL Questionnaire in eight countries. Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring. 2020;12(1):e12021. https://doi.org/10.1002/dad2.12021.
Acknowledgements
We would like to acknowledge and thank members of the RADAR-AD Patient Advisory Board for their input to the protocol. The following consortium members contributed to the design of the RADAR-AD study (sorted by affiliated partner and alphabetically): Maximilian Buegler1, Richard Fischer1, Robbert Harms1, Irene B Meier1, Ioannis Tarnanas1, Ana Diaz2, Jean Georges2, Dianne Gove2, Casper de Boer3, Marijn Muurling3, Pieter Jelle Visser3, Ioannis Kompatsiaris4, Ioulietta Lazarou4, Lampros Mpaltadoros4, Spiros Nikolopoulos4, Asterios Papastergiou4, Thanos Stavropoulos4, Dimitris Strantsalis4, Holger Froehlich5, Martin Hoffman-Apitius5, Meemansa Sood5, Nikolay Manyakov6, Vaibhav A Narayan6, Jerry G Novak6, Dorota Religa7, Emilia Schwertner7, Juraj Secnik7, Bengt Winblad7, Dag Aarsland8, Pauline Conde8, Amos Folarin8, Grace Lavelle8, Andrew P Owens8, Andrew McCarthy9, Aidan Nickerson9, Janneke Boere10, Bruna Consiglio10, Yoanna Daskalova10, Alexander Duyndam10, Irene Kanter-Schlifke10, Vera J M Nies10, Pieter Stolk10, Herman Verheij10, Neva Coello11, Jelena Curcic11, Gul Erdemli11, Tilo Hache11, Kristin Hannesdottir11, Alex Sverdlov11, Vanessa Vallejo11, Eric Yang11, Ariel Dowling12, Rouba Kozak12, Melissa Naylor12, Rodrigo Palma dos Reis12, Gene Shin12, Joris Borgdorff13, Elisa Cirillo13, Keyvan Hedayati13, Nivethika Mahasivam13, Aidan Doherty14, Chris Hinds14, Ivan Koychev14, Claire Lancaster14, Sebastien Libert14, Federica Lucivero14, Yuhao Wu14, Andre Durudas15.
1Altoida Inc., Houston, USA; 2Alzheimer Europe, Luxembourg, Luxembourg; 3Amsterdam UMC, Amsterdam, The Netherlands; 4Centre for Research and Technology Hellas, Thessaloniki, Greece; 5 Fraunhofer Institute for Algorithms and Scientific Computing, Bonn, Germany; 6Janssen Pharmaceutica NV, Beerse, Belgium; 7Karolinska Institutet, Stockholm, Sweden; 8 Kings College London, London, UK; 9Eli Lilly and Company, Indianapolis, USA; 10Lygature, Utrecht, The Netherlands; 11Novartis Institutes for Biomedical Research, Cambridge, Massachusetts, USA; 12Takeda Pharmaceuticals International, Cambridge, Massachusetts; 13The Hyve, Utrecht, The Netherlands; 14University of Oxford, Oxford, UK; 15Modis, Temse, Belgium (funded by Janssen Pharmaceutica NV).
Research of Alzheimer Center Amsterdam is part of the neurodegeneration research program of Amsterdam Neuroscience. Alzheimer Center Amsterdam is supported by Stichting Alzheimer Nederland and Stichting VUmc fonds. Dag Aarsland is a Royal Society Wolfson Research Merit Award Holder and would like to thank the Wolfson Foundation and the Royal Society for their support. Federica Lucivero acknowledges the Welcome Centre for Ethics and Humanities, grant number 203132.
Funding
This project has received funding from the Innovative Medicines Initiative 2 Joint Undertaking under grant agreement No. 806999. This joint undertaking receives support from the European Union’s Horizon 2020 research and innovation programme and EFPIA. See www.imi.europa.eu for more details. This paper represents independent research partly funded by the National Institute for Health Research (NIHR) Biomedical Research Centre at South London and Maudsley NHS Foundation Trust and King’s College London. The views expressed are those of the author and not necessarily those of the NHS, the NIHR, or the Department of Health and Social Care.
Author information
Authors and Affiliations
Consortia
Contributions
MM and CvdB were major contributors to the manuscript. DR and IK are the leads of the partner sites in Stockholm and Oxford and contributed to the design of the research protocol. RK, HV, VJMN, AD, KH, FL, CH, NM, AD, APO, VAN, DA, and PJV are leaders of the different work packages within the project and contributed heavily to the design of the study. MS and HF contributed to the “Modelling of the data” section. KH and GE provided extensive feedback to the manuscript to improve it significantly. CL and CH contributed to the “Device selection”, “Feature extraction”, and “Data platform” sections. TGS, SN, and IK are involved in the second sub-study and provided the text regarding this sub-study. NM contributed to the “Statistical analysis plan” and “Device selection” sections. APO contributed to the “Selection of relevant functional domains” section. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
RK is an employee of Takeda Pharmaceuticals International Co. and holds stock options in both Pfizer Inc. and Takeda Pharmaceuticals International Co. IK receives consultancy fees from Mantrah Ltd. (mantrah.us), a digital technology company developing products for maintaining independence of people with cognitive impairment. CH is principal investigator on the Digital Biomarkers for Dementia project which is co-funded by Eli Lilly and Company and F. Hoffmann-La Roche Ltd. GE and KH are both currently employed by Novartis. NVM and VAN are employees of Janssen Pharmaceutica NV and may hold stock options or shares in the company. DA has received research support and/or honoraria from Astra-Zeneca, H. Lundbeck, Novartis Pharmaceuticals, Biogen, and GE Health and served as a paid consultant for H. Lundbeck, Eisai, Heptares, and Mentis Cura.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Muurling, M., de Boer, C., Kozak, R. et al. Remote monitoring technologies in Alzheimer’s disease: design of the RADAR-AD study. Alz Res Therapy 13, 89 (2021). https://doi.org/10.1186/s13195-021-00825-4
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s13195-021-00825-4