Study overview
A total of 123 patients living with CVD, AD/MCI, FTD, PD, or ALS were contacted. Of these, 44 agreed to participate and another six agreed to review the study information letter. Due to the COVID-19 pandemic and the need to terminate recruitment efforts based on local restrictions, 39 participants completed the study. The primary reason for declining participation was general research study fatigue, which may have been related to the study site that afforded many, on-going opportunities for study participation.
Participant characteristics
Participants were sampled from the five cohorts as follows: 10 CVD, 8 AD/MCI, 5 FTD, 11 PD, and 5 ALS. The median age was 68 (45–83) years and 14 (36%) participants were females. Table 1 summarizes demographic and clinical characteristics of participants, presented overall and for each of the five disease cohorts. The study partner for most participants (n = 36, 92%) was a spouse or partner, while three participants were enrolled with a friend or sibling (median age was 65 (41–80) years and 27 (69%) study partners were females). Previous work within ONDRI showed similar group composition when a study partner was required [54]. All participants completed the baseline clinic visit, at-home monitoring period, and discharge visit; however, not all participant/study partner pairs completed all clinical scales or the de-brief interviews.
Table 1 Participant characteristics Non-wear by location
The full device set was worn for the first 4 days, after which time the chest device battery was deplete and the device was removed. All four limb devices continued to be worn for the remaining 2 days. Given our interest in potential differences in adherence between the limb and chest devices, the effect of wear location was examined for this 4-day period. Median non-wear rates ranged from 1.2 to 1.5% per day (17–22 min/day) across all wear locations (Fig. 2). Non-wear rate was significantly different dependent upon wear location (\({\chi }_{(4)}^{2}\)= 14.355, p = 0.006) Post-hoc testing revealed a significant difference between the chest compared to the left wrist (p = 0.03) and right wrist (p = 0.02), with greater non-wear rates occurring for both wrists versus the chest. Four participants had non-wear rates that were classified as outliers (exceeded the upper quartile by 1.5 times the interquartile range) for more than one wear location (e.g., both ankles), but only one participant had non-wear rates classified as outliers for all wear locations. Data from one participant were omitted due to a device issue and another due to an unrelated ankle issue that prevented the device from being worn. Analysis was based on data from 37 participants.
Multi-sensor non-wear
As noted, evaluation of non-wear based on time of day, wear duration, and between individual study participants considered multi-sensor non-wear to be any time when less than three limb devices were worn (i.e. two or more limb devices were removed). Multi-sensor non-wear analyses were based on data from 37 participants (as described above).
Group level non-wear
Multi-sensor non-wear, as defined, ranged from 0 to 30.3% of the study period. Within each cohort, multi-sensor non-wear occurred for a median (range) of 2.3% of time in AD/MCI (0–11.4%) and CVD (0.3–8.1%), 2.0% of time in FTD (0–2.2%), 1.5% of time in PD (0–30.3%), and 0.9% of time in ALS (0.5–18.6%). Overall, participants wore a minimum of three devices for a median of 5 days and 21 h (98.2%) of the six 24-h periods included in the analysis.
Multi-sensor non-wear was significantly different based on time of day (Z = − 3.394, p < 0.001), with non-wear occurring more often during the day (median = 2.4%, range = 0–28.9%) than at night (median = 0%, range = 0–32.9%) (Fig. 3a). Multi-sensor non-wear rates increased over the course of the wear period (T = 1.769, p = 0.04) (Fig. 3b; median non-wear rates of 0, 22, 12, 15, 16, and 24 min from first to sixth day).
Individual level non-wear
Each participant’s non-wear volume and pattern are illustrated in Fig. 4. Thirty-one participants (84%) adhered to multi-sensor wear for more than 95% of the study period. According to self-reported device removal logs (n = 29), bathing was the most common reason for device removal (as instructed) and only two participants noted the removal of devices due to discomfort. The five participants with the greatest non-wear rates were identified for further examination based on the outlier criterion (equated to total non-wear greater than 5%). One of these participants (ALS5) presented with moderately severe disability (mRS score of 4), chose not to complete the cognitive assessment (MoCA), and noted concern about wearing the devices in public, specifically due to challenges with communication and a desire to avoid having to explain the sensor wearing to others. Among the remaining four participants whose non-wear was identified as an outlier, MoCA scores ranged from 24 to 28, mRS scores were between 0 and 2, PSQI scores ranged from 0 to 7, GAD-7 scores ranged from 2 to 5, and QIDS-SR scores ranged from 2 to 8. As seen in Fig. 4, these four participants accumulated non-wear predominantly in a single, long bout (one early in collection period, three later in the collection period), whereas the participant who presented with a more distinct clinical profile (ALS5) accrued non-wear in several bouts of a moderate length. Reasons for higher non-wear values noted in these participants’ logs included longer periods of time spent bathing, unintended extended removal (e.g., forgot to put back on) and life interruptions. There was no explanation provided for the extended removal in the participant presenting with the highest amount (~ 30%) of multi-sensor non-wear (PD6).
De-brief interviews
De-brief interviews were conducted with 35 participants and 27 study partners. Twenty-five of these interviews were participant/study partner pairs with interviews conducted separately. Two participant/study partner pairs declined an interview (one participant with communication difficulties, one participant with study fatigue), ten interviews were conducted with participants only, and two interviews were conducted with study partners only. In the cases where one in the pair did not interview, the reason was either that they were unavailable (one study partner) or they agreed with responses provided by their partner (nine study partners, two participants).
Participant perspectives
Overall, participants reported no considerable problems wearing multiple devices for the study duration. Qualitative analysis of the de-brief interviews resulted in four themes related to user experience with the sensors and acceptability of the device wearing protocol: comfort, ease of use, the degree of interference with activities of daily living (ADLs), and appearance. For a summary of findings with representative quotes, see Table 2.
Table 2 Summary of findings from qualitative thematic analysis of de-brief interviews with participants and study partners Most participants identified comfort as the key consideration related to device acceptance. Several participants distinguished between the materials that were used to affix the wrist versus ankle devices, with some noting a preference for the feeling of the medical-grade wrap that was used on the ankles. Some participants commented that the ECG adhesive was itchy or that they experienced discomfort, particularly upon removal. Comments related to ease of use were also common. Several participants noted that the devices would “move around”, with a few expressing that they were uncertain about the appropriate level of tightness for the ankle strapping and therefore, that the easily adjustable wrist strap was ideal. Conversely, one participant with significant atrophy of the forearm (ALS cohort) found that the watch strap could not be tightened enough and noted an interest in using the ankle wrap for the wrist. Two participants, who had difficulties with upper limb motor control, required assistance to attach and remove the devices and commented on the importance of a design that would enable independent use.
Although most participants did not suggest that the device set impeded their ability to perform ADLs, a few noted devices catching on clothing during dressing or on the bed sheets during sleep. Based on the instruction to remove devices for bathing or swimming, some were concerned about the sensors contacting water during ADLs such as washing dishes. Many participants commented on device size or appearance and a few mentioned that they avoided certain situations while wearing the devices (e.g., avoided wearing shorts even though it was hot) or attempted to conceal them on at least one occasion (e.g., wedding). Four participants used the word “bulky” to describe the devices and most participants who commented on size also explicitly stated a desire for smaller and slimmer devices. Despite these comments, most participants reported that the sensor set was not obtrusive, with two participants stating they “did not mind” if others saw that they were wearing devices as part of a study.
Beyond the four central themes related to user experience that emerged from the interviews, participants also made broader comments about the remote monitoring approach. A few participants expressed reluctance to wear the devices for markedly longer periods of time than the one-week study period (e.g., 6 months). Two participants explicitly stated that their willingness to wear the devices for a week stemmed from a belief that they would be able to provide valuable information to their clinician that could benefit their health and the health of people living with their disease.
Study partner perspectives
Generally, study partners expressed that they did not have any concerns with devices used in this study. Several study partners commented on the practical aspects of device-wearing, including a desire for devices to be thinner to make them more manageable in daily life (Table 2). Some study partners also commented on the potential utility of receiving real-time feedback or summary results from the sensor data, with three explicitly stating an interest in learning more about disease-related outcomes such as medication impact or fall risk and health-related behaviors such as sleep quality.