Abstract
Background
Digital health technologies enable patients to make a personal contribution to the improvement of their health by enabling them to manage their health. In order to exploit the potential of digital health technologies, Internet-based networking between patients and health care providers is required. However, this networking and access to digital health technologies are less prevalent in sociodemographically deprived cohorts. The paper explores how the use of digital health technologies, which connect patients with health care providers and health insurers has changed during the COVID-19 pandemic.
Methods
The data from a German-based cross-sectional online study conducted between April 29 and May 8, 2020, were used for this purpose. A total of 1.570 participants were included in the study. Accordingly, the influence of sociodemographic determinants, subjective perceptions, and personal competencies will affect the use of online booking of medical appointments and medications, video consultations with providers, and the data transmission to health insurers via an app.
Results
The highest level of education (OR 1.806) and the presence of a chronic illness (OR 1.706) particularly increased the likelihood of using online booking. With regard to data transmission via an app to a health insurance company, the strongest increase in the probability of use was shown by belonging to the highest subjective social status (OR 1.757) and generation Y (OR 2.303). Furthermore, the results show that the higher the subjectively perceived restriction of the subjects' life situation was due to the COVID-19 pandemic, the higher the relative probability of using online booking (OR 1.103) as well as data transmission via an app to a health insurance company (OR 1.113). In addition, higher digital literacy contributes to the use of online booking (OR 1.033) and data transmission via an app to the health insurer (OR 1.034).
Conclusions
Socially determined differences can be identified for the likelihood of using digital technologies in health care, which persist even under restrictive conditions during the COVID-19 pandemic. Thus, the results indicate a digital divide with regard to the technologies investigated in this study.
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Background
E-health applications are considered as promising technologies that enable patients to positively participate in improving their state of health. These technologies support patients, e.g. in actively monitoring their own health condition and thereby participating in medical treatment and therapy decisions [1]. E-health encompasses all the apps that serve for the treatment and care of patients using modern information and communication media. As an overall term, it summarizes a broad spectrum of technological apps that process health information electronically, exchange it via secure connections between the actors involved, and thereby support the medical and therapeutic treatment processes [2]. As a subset of e-Health applications, mHealth supports health-related self-management by using mobile devices and health-related apps to monitor, measure, and analyze health-related data [3, 4].
E-Health and mHealth technologies are currently used in the context of individual health promotion, to support lifestyle changes, for the diagnosis and treatment of diseases, and for more efficient health care in structurally deprived and resource-poor regions. [5, 6]. For example, apps installed on smartphones and online-based video consultations offer patients the possibility of location-independent medical consultations as well as the exchange of health-related data with medical care providers [7]. However, it was found that the use of mHealth and health-related apps in Germany is below average: Only 28% of the inhabitants in Germany who have access to the Internet are using these kinds of apps to manage their health. Another 13% who have used health apps have stopped using them at some point [4, 8]. The results from a survey conducted in Germany between March and April 2020 shows that 33% of Germans have already used online booking for appointments [9]. Only 2% of the study participants [9] used an online-based video consultation with their doctor during the May survey period 2020, which was offered by every second outpatient care provider respectively 52% in May 2020 [10]. Moreover, the use of digital health technologies depends on the extent to which individuals and patients have sufficient technical infrastructure and access to the Internet [11]. The problem here is that access to the Internet and the availability of the necessary hardware are unevenly distributed in society. This situation is described by the term “digital divide” and refers to the fact that mostly socially deprived cohorts participate less in the digital transformation and benefit less from it [11,12,13].
In addition, as part of the ongoing processes of increasing digitalization, users are faced with the challenge of checking the personal and health-related relevance of information made available by digital health technologies to ensure that they can subsequently use the information in such a way that they are able to take responsibility for managing their own state of health and thereby contribute to an independent improvement in their individual state of health [8]. This means that, for example, simply owning a smartphone is not sufficient to ensure the adequate use of a health-related app and to be able to use digital health technologies appropriately and effectively [6]. In addition, a sufficiently high level of health literacy is required among users [6].
The exemplary results of previous studies show that the use of digital health technologies correlates with the level of health literacy and that high health literacy is associated with the more frequent use of Internet-based information searches on health-related topics and issues [14, 15]. Furthermore, health literacy varies by sociodemographic characteristics, such as age, migration status, and subjectively perceived social status, and to be less pronounced in the cohorts of lower socioeconomic status [16]. In particular, older people are considered to be an exemplary cohort who are less likely to use digital health technologies because they perceive their technical skills and their subjective assessment of digital competence to be insufficiently developed. [17]. Accordingly, it can be assumed that inequalities in access to digital health technologies will continue to increase and that the potential of digital health technologies to reduce such inequalities must be utilized and exploited [18, 19].
Since the outbreak of COVID-19 at the turn of 2019/2020, more than 170 million people worldwide in over 190 countries were infected with the COVID-19 virus, with more than 3.5 million deaths reported by the end of May 2021 [20, 21]. In Germany, more than 3.6 million confirmed infections with COVID-19 occurred, resulting in more than 86.000 deaths [22]. Almost all areas of life are affected by the impact of the COVID-19 pandemic [23]. For example, the care of COVID-19 patients involves a high expenditure of medical, material, and human resources, reflected by the incidence that treatment capacities for COVID-19 patients were reserved by canceling or postponing elective surgeries and preventive examinations to provide necessary intensive care treatment capacities for COVID-19 patients [24]. In addition to the expenditure of infrastructural and intensive care resources, healthcare professionals suffer from the physical and psychological stress associated with caring for COVID-19 patients, manifested in depression, distress, and subjectively poor perceived health [25].
Pandemic-related impacts arising outside the health care system include the fear of an infection with COVID-19 and dying from COVID-19 in the general population, as well as feelings of helplessness and depression due to social distancing and isolation, and concerns about getting fired because of the significantly decreased national economy and thus being unable to provide a living for themselves or their families [26,27,28,29]. In education, school and university closures occurred to contain the spread of the virus, including a transition to web-based lectures and homeschooling [30, 31].
Moreover, social epidemiological studies from the United States and the United Kingdom suggest that the risk of being infected with COVID-19, experiencing a severe illness course, or dying from the virus is more pronounced in socially or socioeconomically deprived populations compared to cohorts of higher socioeconomic status [32]. In addition, as regards the higher risk of contracting the disease when socioeconomic stratification is taken into consideration [32], the elderly are considered as a particularly vulnerable group of people during the COVID-19 pandemic [33, 34]. During the pandemic, the above-mentioned potentials of digital health technologies become apparent. Here, e-Health related technologies facilitate the exchange of treatment-relevant patient data between care providers or between patients and care providers by providing documents tailored to the individual needs of patients, thus enabling patient-centered care and treatment [35]. In combination with social distancing measures, these types of technologies open new ways to provide health services and support [36]. Digital health technologies / video consultations and conferences are suitable, for example, for location-independent health care and the monitoring of those who are chronically ill, for example, diabetics and pregnant women, since the risk of infection can be decreased, especially for these vulnerable cohort, by reducing contacts [36, 37]. Furthermore, digital health technologies can be used to disseminate trusted information about COVID-19 to the general population, which can improve people’s understanding of the disease and the provision of relevant healthcare services [38]. Some e-Health related technologies combine these functions by using an integrated tool for education, self-assessment, symptom monitoring and self-triage for COVID-19 for asymptomatic and symptomatic COVID-19 patients. It could be seen that unnecessary patient visits due to COIVD-19 were avoided to provide treatment capacities for emergency treatments and to contain the spread of the virus by the surveillance of COVID-19 infections supported by these kind of technologies [39, 40]. Nevertheless, Tebeje and Klein [35] concluded that most of present digital technologies which are used to overcome COVID-19 failed to provide information regarding cost-effectiveness and effectiveness.
Besides the potentials of these kinds of digital health technologies, there is the risk that the use of digital health technologies could generate new access barriers and inequalities. The elderly, in particular, are generally considered to be the population group with the poorest access to Internet-based technologies in this regard. [41]. The study by van Deursen [34] is an example of these barriers and inequalities regarding access to online-based information offerings about the virus in divergent social populations during COVID-19. The study investigated the information search on COVID-19-related information using the Internet during the COVID-19 pandemic. This study investigated the degree of need in the Dutch population to seek information about COVID-19 using the Internet and the influence of sociodemographic factors on COVID-19-related information seeking. The results showed that socioeconomically deprived as well as older cohorts are less able to use the Internet to obtain information about COVID-19-related topics than individuals with higher socioeconomic backgrounds. The relevant determinants here include lower levels of formal education, older age, poorer general literacy skills, and pre-existing physical infirmities. Therefore, the COVID-19 pandemic can be seen as reinforcing already existing digital inequalities [34]. Accordingly, during the COVID-19 pandemic, in particular, individuals need to be provided with evidence-based information about the virus so that they adopt preventive behaviors to counteract the fears about the virus and intentionally disseminated misinformation [42].
Therefore, it can be stated that pre-existing social and health inequalities are perpetuated in the digital setting and era and, accordingly, further empirical surveys are needed to better understand the influence of socio-demographic factors and health literacy on the use of digital health technologies. Furthermore, the current empirical research projects do not sufficiently consider the multicausal network of needs, attitudes, and reservations toward digital health technologies and the resulting target-group-specific and needs-based differentiation of eHealth technologies [11, 43].
Accordingly, this study pursues answering the question of whether or to what extent the use of digital health technologies has changed since the shutdown in Germany to control the COVID-19 pandemic and what influence divergent sociodemographic factors, subjective perceptions, and personal health literacy skills have on the use of digital health technologies, such as the online booking of medical appointments and medications, online-based video consultations with health care providers, and the transmission of health-related data via an app to health insurers.
The associated research hypotheses are as follows:
Hypothesis No. 1
The use of online booking of medical appointments and medications, online-based video consultations with health care providers, and the transmission of health-related data via an app to health insurers changed during the COVID-19 pandemic compared to before the COVID-19 pandemic.
Hypothesis No. 2
The younger the age group and the higher the socio-economic status, the more frequently the health technologies surveyed are used.
Hypothesis No. 3
The use of the digital health technologies increases according to the subjectively perceived restriction of the life situation related to the COVID-19 pandemic.
Hypothesis No. 4
The use of the digital health technologies increases according to the general health literacy, COVID-19-related health literacy, and digital literacy.
Methods
Study design
The results obtained are based on a partial analysis of the cross-sectional survey “Digital divide in relation to health literacy during the COVID-19 pandemic”. 7.239 people between 18- and 74-years old living in Germany were invited to complete an online questionnaire. A total of 1.953 people participated, and 1.570 individuals were included in the sample. The composition of the quota sample corresponds to the current distribution of age, gender, and residence in a federal state (not crossed) according to the Eurostat 2018 database. In the sample, the proportion of people with low education is larger than the national average. The study participants were recruited via Respondi AG, which is an external provider of online surveys. The external provider ensured anonymity and data protection guidelines in accordance with the General Data Protection Regulation (GDPR) at all times.
The data collection took place from April 29 to May 8, 2020. The timing of the study fell within the period when the first relaxations came into effect on April 20, 2020 after the shutdown of March 22, 2020 [44]. The questionnaire was broad in scope and captured the impact of the COVID-19 pandemic in different areas of life as well as health care, aspects of health, and as a focus, health literacy. For the purposes of this study, however, the focus will be on the use of digital health care technologies.
In the study period the numbers of infections were significantly lower with approximately 167.000 infected persons and 7.300 deaths [45] compared to the previously described situation at the time of submission in 2021. The study is a snapshot of the very specific circumstances regarding social life, COVID-19 exposure and burden as well as coping capabilities of the population and society.
Measurement and operationalization
Use of digital health technologies before and since the shutdown to control the COVID-19-pandemic
The following three e-health services in outpatient care that are offered in Germany were examined: Use of online-based booking of doctor's appointments and medications, use of video consultation, and transmission of health-related data via an app to a health insurance company. The questions were closed-ended wherein the participants could answer either Yes or No. The study participants, who declared that they had already used a digital health service before or during the COVID-19 pandemic shutdown, were classified as users. All the items were combined into one score, with a range of values from 0 to 3.
Analogous health care services in the ambulatory health care sector during COVID-19
The following variables were recorded under the general term analogous care situation in outpatient health care: Interruption of ongoing treatment due to the fear of a COVID-19 infection, difficulty in obtaining a medical appointment, cancellation of a medical appointment due to the fear of a COVID-19 infection, and cancellation of a medical appointment to protect relatives from a COVID-19 infection. The aforementioned variables depict care situations that occurred in outpatient analog medical care during the COVID-19 pandemic shutdown, thereby potentially influencing the use of digital health technologies. The aforementioned variables were recorded during the study on a four-point Likert scale (1 = Do not agree at all to 4 = Fully agree). The response categories Do not agree at all and Rather does not agree were recoded into the variable Not appeared. The response categories Fully Agree and Rather agree were recoded into the category Appeared.
Sociodemographics
The following sociodemographic factors were included: Age, gender, migration status, education,, and subjective social status (SSS).
In contrast to the usual classification, a distinction is made here between the age groups based on generations in order to identify potential generational differences / effects regarding the usage of these digital health technologies [46]. The age generations are composed as follows: Traditionalists (born 1922–1955); Baby Boomers (born 1956–1965); Generation X (born 1966–1980); Generation Y (born 1981–1995); Generation Z (born 1996 and later). The educational level was collected using the CASMIN educational classification system [47]. It was followed by categorization into low, medium, and high education groups [48]. SSS was collected based on self-assessment. This was done by individual assignment on a ladder with levels from 1 (lowest social status) to 10 (highest social status) [49]. Following Höbel et al. [50], the study participants were assigned a low (scale values 1–4), medium (scale values 5–6), and high (scale values 7–10) SSS.
The classification into the migration status category followed the recommendation of Schenk et al. [51]. A migration status exists if both parents were born in another country or the respondent has not lived in Germany since birth and at least one parent was born abroad, or their native language is not German.
The residence was categorized as follows: Rural area (up to 5.000 inhabitants); Small town (5.001–20.000 inhabitants); Medium-sized city (20.001–100.000 inhabitants); Urban city (more than 100.000 inhabitants) [52]
Health-related variables, Chronic illness
The operationalization of the variable subjective health was based on the subjective assessment (poor, less good, satisfactory, good to very good) of the personal health status [53]. For the subsequent analysis, two categories were formed, which were operationalized as follows: less good/bad; good/very good health. In addition, the study participants were asked whether they were suffering from a chronic illness. The answer was given here with the help of the dichotomous expressions of yes or no.
Subjectively perceived restriction of the life situation due to COVID-19
The participants were asked about their subjective perception of the COVID-19 pandemic and the extent to which they felt burdened, threatened, or restricted by COVID-19, which they indicated on a five-point Likert scale (1 = not at all to 5 = very much).
From these three items (Threat, Burden, Restriction due to COVID-19), a sum score was formed for the subjectively perceived restriction of the life situation, which could assume values between 3 and 15. Reliability analysis using Cronbach's alpha yielded a value of 0.793, which represents a sufficiently high inter-item correlation. This scale was designed as part of this study. The exclusion of any variable in the reliability analysis did not indicate an increase (Cronbach's alpha 0.600–0.784) of the inter-item correlation.
General health literacy, COVID-19-related health literacy, and digital literacy
The general health literacy (GHL) was determined by a sum of six items on a five-point Likert scale (5 = very easy to 1 = very difficult), referring to Schaeffer et al. 2016 [54]. Therefore, the score can assume values between 6 and 30. A higher score indicates a higher GHL. Reliability analysis by Cronbach's alpha yielded a value of 0.895 and was, therefore, a sufficiently high internal consistency. COVID-19-related health literacy (COV-19-HL) was measured in the form of a scale sum value based on 10 items on a five-point Likert scale (1 = Does not apply at all to 5 = Applies completely). Conceptually, the measurement follows the recommendations of Okan et al. [55]. Therefore, a score between a minimum of 10 and a maximum of 50 could be achieved. Accordingly, a higher score here also means better COV-19-HL. The reliability analysis using Cronbach's alpha yielded a value of 0.830. The digital literacy (DL) was also formed with the use of a sum score in accordance to [56, 57] as a new scale for measuring the digital competence, which comprises the response options of a five-point Likert scale (1 = Don't agree at all to 5 = Agree completely) [56, 57]. Consequently, the sum score can assume values between 11 and 55. Reliability analysis using Cronbach's alpha yielded a value of 0.893, which also represents a sufficiently high inter-item correlation. Here, the scale only focuses on the competencies "Information and media literacy" and "Digital problem solving". The competencies "Communication and Collaboration" and "Content Creation" were not operationalized in this study. Moreover, the assessment of digital literacy does not only include the Internet, but also digital media as a whole.
Data analysis
The statistical analysis included a descriptive presentation of the sample, a before-and-after comparison, and bivariate as well as multivariate procedures. The preparation of the data set and the subsequent data analysis were carried out with IBM SPSS 26.
The analysis of the before-after comparison of the dichotomous characteristic values regarding the use of the listed digital health technologies, based on the McNemar test, serves to test research hypothesis No. 1. Furthermore, an additional bivariate analysis is performed to test whether the extent of the outpatient analog care situation influences the use of the online-based booking of doctor appointments and medications, use of a video consultation, and transmission of patient-relevant data via an app to a health insurance company during the COVID-19 pandemic. To test research hypothesis No. 2, a bivariate analysis is conducted regarding the use of digital health services. The hypothesis was tested with the help of the stratification of sociodemographic characteristics. For the analysis, the variables of education level (CASMIN education classification system), SSS, subjective health status, chronic illness, gender, age generations, and migration status were enrolled. Since the requirements for parametric tests were not completely fulfilled, non-parametric test procedures (Kruskal–Wallis test/Wilcoxon-Mann–Whitney test) were used. To test research hypotheses No. 3 and No. 4, a block wise and inclusion-based binary logistic regression analysis is performed to determine the influence of sociodemographic factors, subjective feelings, and personal health literacy, in addition to the relative probability of using the addressed digital health technologies during the COVID-19 pandemic. Because of the low uptake of video consultation, this type of regression analysis was not performed as part of the multivariate analysis.
Previous results of an earlier conducted survey [34] indicate that the seeking of digital information during COVID-19 is associated with socioeconomic and sociodemographic factors. Consequently, the first block of the model primarily includes sociodemographic influencing factors. In the second step, the model was expanded to include the variable of subjectively perceived restriction experienced by the study participants in the wake of the COVID-19 pandemic. Considering the previous blocks and their associated variables, GHL, COV-19-HL, and DL were included in the third model. In addition, in each of the following regression models, the reference groups are consistent and categorized as follows:
-
Gender (reference: male)
-
Age group (reference: traditionalists)
-
Migration status (reference: migration background existing)
-
Education (reference: low formal education)
-
Chronic illness (reference: no chronic illness)
-
Subjective social status (reference: low SSS)
-
Subjective health status (reference: less good/poor health)
-
Residence (reference: rural area)
Results
Description of the sample
A total of 1.570 participants (see Table 1) responded to the online survey, including 785 women and 785 men. Generation X is most frequently represented in this sample with 27.8%. 8.4% of the test participants have a migration background. 41.5% of the participants classify themselves as having a medium SSS. In the education category, the medium level of education predominates with 51.7%; almost every second participant (47.2%) suffers from a chronic illness. At the same time, 62.2% of the study participants stated that they assessed their subjective health status as good to very good. Most of the participants (67.1%) do not have a residence in an urban city.
Use of digital health services before and since the shutdown to contain the COVID-19 pandemic
Before the COVID-19 outbreak, online booking was the most commonly used service at 34.5%. A total of 18.8% of respondents reported that they had already used an app to transmit data about health-related information to their health insurer. In comparison, the respondents were less likely to use a video consultation at 4.1% (see Fig. 1). The study showed that online booking was still used most frequently (21.6%) and video consultations the least frequently (5.4%) by the study participants. With regard to the use of online booking and the digital transmission of health-related data via an app to a health insurance company, a significant decrease was observed. On the other hand, a significant increase (1.3%) in the use of video consultations was found.
Use of digital health technologies and the utilization of analog health care services since the shutdown to contain the COVID-19 pandemic
Overall, it appears that, despite the influence of the COVID 19 pandemic, the majority of participants did not stop using analog care services in ambulatory health care and, therefore, they were less likely to use the aforementioned digital health technologies (see Table 2).
55.6% of the participants who canceled their medical treatment due to the fear of a COVID-19 infection did not use any of the named digital health technologies. A subsequent significance test showed that the use of digital health technologies was significantly higher (p < 0.001) in the cohort that canceled treatment than in the cohort that did not. To the extent that problems were encountered in making appointments, more than half (54.1%) did not use any of the technologies mentioned. The subsequent significance test revealed a significantly higher use (p < 0.001) of digital health technologies among those subjects who had problems making a medical appointment compared with the cohort who had no problems. 59.8% of the participants who canceled their medical appointment because of their fear of COVID-19 infection did not use a digital health technology. The following interferential statistical test was able to attest to significantly higher use (p < 0.001) in the cohort who canceled the appointment than the cohort who did not. 63.9% of the respondents who canceled their scheduled medical appointment to protect loved ones from a COVID-19 infection did not use digital health technology. Again, the interference statistical test showed that, in the cohort of canceling an appointment, digital health technology use was significantly higher (p <0.050) compared with the individuals who attended the appointment anyway.
Sociodemographic differences regarding the use of booking, video consultations, and the transmission of health-related data via an app to health insurers
Regarding the use of digital health technologies, the results show that with the increase of age or belonging to an older generation, the use of digital health technologies decreases. The following interferential statistical test showed that the use of digital health technologies was significantly higher in Generation Z compared to all the other groups (see Table 3). The use of digital health technologies is the highest among subjects with a higher SSS compared to the two other SSS groups. It was found that the use of digital health technologies by respondents from rural areas was significantly lower than in an urban and medium-sized city. In addition, the use of digital health technologies was significantly lower in a small town compared to a medium-sized city. Similar and significant results can also be found for education: the higher the level of education was, the higher the use of the aforementioned health technologies. Participants with a chronic illness used digital health technologies significantly more often (MRank813.03) than healthy participants (MRank760.89). Participants with migration background used digital health technologies significant more frequently (MRank851.75) than subjects without a migration background (MRank779.42). No significant gender differences were identified.
Logistic regression analysis: online booking of a doctor’s appointment / medication
The dependent variable in the following regression model is the use of an online booking of a doctor’s appointment. The following variables of model 1 have a significant influence on the probability of using an online booking of a doctor’s appointment in ranked order: High educational status, chronic illness, no migration status (see Table 4). In model 2, the variable no migration status was no longer found to be significant influencing factors. In addition, the variable subjectively perceived restriction of the life situation turns out to be a statistically significant influencing factor. In model 3, high SSS can no longer be identified as a significant influencing factor. In contrast, the variable “no migration status” was identified as a major influence factor, as in model 1. In addition, DL was identified as a significant variable influencing the probability of use. In model 3, a high educational status, chronic illness, and the subjectively perceived restriction of the life situation continue to exert a significant influence on the probability of use. Across all models, having the highest formal level of education (OR 2.119 [CI 1.454–3.087]; OR 2.122 [CI 1.454–3.097]; OR 1.806 [CI 1.228–2.657]) and having a chronic illness (OR 1.819 [CI 1.374–2.410]; OR 1.808 [CI 1.362–2.401]; OR 1.706 [CI 1.706–2.227]) significantly increased the likelihood of using online booking compared with the reference groups.
Logistic regression: data transmission of health-related data via an app to a health insurance company
The dependent variable in the following regression model is the use of an app for the transmission of health-related data to a health insurance company. The following variables in model 1 have a significant impact on the likelihood of transmitting health-related information to health insurers via an app in ranked order: Generation Y, Generation Z, high educational status, SSS, chronic illness, medium educational status, and female gender (see Table 5). In model 2, the variables already significant in model 1 continued to be significant influencing factors. The inclusion of the variable subjectively perceived restriction of the life situation also proved to be a significant influencing factor. In model 3, the high educational status no longer appeared to be significant influencing factors compared with models 1 and 2. In model 3, the variable DL proved to be a significant influencing factor. The other significant influencing factors from model 1 and 2 were also found to be significant under the influence of the variables from model 3. The blockwise inclusion of the variables from computational models increased the coefficient of determination and thereby contributed to an improved model fit. Both Generation Y (OR 2.335 CI [1.297–4.203]; OR 2.271 [CI 1.254–4.114]; OR 2.303 [CI 1.268–4.185]) and Generation Z (OR 2.194 [CI 1.090–4.414]; OR 2.097 [CI 1.036–4.3245]; OR 2.212 [CI 1,268- 4.585]) showed a significantly increased relative probability of use compared to the reference group. It is notable that, under the influence of contextual health literacy, both mean and high educational status could no longer be identified as significant influencing factors.
Discussion
Key findings
In general, the analysis of the cross-sectional data indicates that no increase in the use of the selected digital health technologies could be identified. The results indicate that, before the onset of the COVID-19 pandemic, except for video consultation, the study participants were more likely to use online booking or data transmission to health insurance than during or since the shutdown to contain the COVID-19 pandemic. Regarding the use of online booking, our findings are in with the EPatient Survey [9] which shows that online booking was the most frequently used digital health technology in Germany. The limited use of online-based video consultations can probably be explained by the fact that this technology was not widely provided by health care professionals and, therefore, not available to the participants [10]. In addition to the aspect of infrastructural availability of the technologies mentioned, further empirical findings indicate that intrapersonal and interpersonal factors influence the use of digital technologies, such as a lack of understanding of the potential benefits of digital health technologies, concerns about the data security of personal health-related information, operating difficulties, and the lack of recommendations and advice from trustworthy sources and from family and friends [58]. Moreover, it appears that the use of digital health technologies was more frequent in the cohort that forwent analogous health care services due to COVID-19. Nonetheless, the impact of the COVID-19 pandemic on the delivery of analogous health care services does not appear to be of central and exclusive influence favoring a more frequent use of the selected digital health technologies. Despite the changing analogous health care services, there was relatively lower use of digital health technologies as a result of the pandemic. As a result, hypothesis No. 1 can be confirmed, in that the COVID-19 pandemic changed the use of the health technologies mentioned for this study, but in a different direction than expected.
The results of the bivariate analysis and binary logistic regression analyses confirm the influence of age, SSS, educational status, and suffering from a chronic illness on the use of the highlighted health technologies. A closer look at the bivariate analysis (see Table 2) shows that digital health technology use follows a sociodemographic or socioeconomic gradient, with more privileged cohorts using the technologies listed here more frequently. Furthermore, the results of the binary logistic regression analyses indicate being part of a younger age generation, a higher level of education, and a higher SSS. With regard to the use of data transmission to a health insurance company, it could be shown that the probability of use was increased by more than twice in Generation Y and Z compared to the traditionalists. In terms of the data transmission Generation Y and Generation Z were found to be significantly more likely to use the service. We also identified suffering a chronic illness as a significant influencing variable that increased the use and likelihood of an online booking of a doctor’s appointment and the transmission of health-related data via an app to a health insurance company. Consequently, hypothesis No. 2 can also be confirmed, particularly regarding data transmission via app to the health insurer. Therefore, the results obtained here are consistent with comparable surveys that also found more frequent use of digital health-related technologies among younger participants [34, 59, 60]. Furthermore, the results of the survey here indicate that the relative likelihood of use of data transmission was significantly lower for women compared to men, but this result contrasts and is not in clear agreement with the results of the bivariate analyses and findings of previously conducted studies. In these surveys, it was found that women tended to use digital health technologies more frequently than men [11, 59]. Heponiemi et al. [61] mention further potential reasons why deprived groups in particular are less likely to use digital technologies and more likely to receive in-person services. Online services seem to be more suitable for uncomplicated or general health problems, as these can be dealt with in a standardized way. In contrast, health-related problems in disadvantaged cohorts appear to be more complex, which cannot be captured and managed through online-based and standardized processes. This requires cross-sectoral and coordinated interventions by multidisciplinary service providers, which digital technologies cannot provide. A significant predictor was subjectively perceived restriction of life situation related to the COVID-19 pandemic. The results of the study show that, with the increase of the subjectively perceived restriction of the life situation by one point, the relative probability of using online booking and data transmission via an app to a health insurance company increased by 10.4% and 11.2%, respectively. As a result, hypothesis No. 3 can be confirmed. A higher subjectively perceived the restriction of life situation is associated with a higher likelihood of use. Increasing DL by one point significantly increases the probability of using online booking and data transmission via app by 3.3% and 3.4%, respectively. Based on the data available here, however, GHL and COV-19-HL can be identified as non-significant influencing factors. Therefore, hypothesis No. 4 can only be confirmed in terms of the DL. Therefore, the results between the study here and the findings described earlier are consistent with caveats.
Limitations
In the case of the present online survey, it can be reasonably assumed that there may already be a bias in the fact that, on average, participants were more Internet- or technology-savy than the population they represent. In addition, the availability of online video consultations needs to be critically examined, as only slightly more than half of the health care providers offered such a consultation option. Accordingly, a distortion of the video consultation hours used due to a non-area-wide offer cannot be ruled out.
Furthermore, a differentiated consideration of the participants who have a migration status according to the definition here is necessary. Here, too, it can be reasonably assumed that there is a systematic bias in that the participants with a migration status were also more Internet- or technology-savvy on average than the cohort they represented, thereby not allowing a generalization regarding the overall population. It also cannot be ruled out that biases exist between subjectively self-assessed health literacy and actual health literacy and the possibility that participants over- or underestimated their level of competence.
Conclusion
Based on the findings obtained here, it can be concluded that the selected digital health technologies can help to ensure access to health services for all social groups, which were restricted by COVID-19. At the same time, however, it is also clear to see a digital divide stratified by sociodemographic and socioeconomic determinants. Although the participants tend to be technology-savy, the use of these digital health technologies seems to be low across all population groups. While the COVID-19 pandemic appears to be an exceptionally strong influencing factor, the present results suggest that digital health technology use is related to external influencing factors that were not measured in this study. Future research projects should examine interpersonal and intrapersonal influencing factors in more detail to identify the reasons for the nonuse of digital health technologies, to derive interventions designed to potentially compensate for existing disparities, and to contribute to the development of health technology-related digital divide research.
Availability of data and materials
The data of the study are not publicly archived. It is only possible to grant access to the data in individual cases after consultation with the authors.
Change history
07 November 2021
The original article was missing a statement declaring the funding covered by Projekt DEAL. This statement has been added.
Abbreviations
- CI:
-
Confidence interval
- COV-19-HL:
-
COVID-19-related health literacy
- DL:
-
Digital literacy
- GHL:
-
General health literacy
- MRank :
-
Mean rank
- n.s.:
-
Not significant
- OR:
-
Odds ratio
- Sig:
-
Significance
- SSS:
-
Subjective social status
References
Brodie M, Flournoy RE, Altman DE, Blendon RJ, Benson JM, Rosenbaum MD. Health information, the Internet, and the digital divide. Health Aff. 2000;19:255–65.
Bundesministerium für Gesundheit: E-Health. https://www.bundesgesundheitsministerium.de/service/begriffe-von-a-z/e/e-health.html (2020). Accessed 25. Jan 2021.
Gmelin A, Chancen durch die Digitalisierung des Gesundheitswesens in Deutschland. In: Pfannstiel MA, Holl F, Swoboda WJ, editors. mHealth-Anwendungen für chronisch Kranke. Trends, Entwicklungen, Technologien. Wiesbaden: Springer Gabler; 2020. p. 11–26.
Evers-Wölk, M. Oertel, B., Sonk, M. & Jacobs, M.: Gesundheits-Apps. In: Gesundheits-Apps. Innovationsanalyse. Büro für Technikfolgen-Abschätzung beim Deutschen Bundestag. 2018 https://www.tab-beim-bundestag.de/de/pdf/publikationen/berichte/TAB-Arbeitsbericht-ab179.pdf. Accessed 18 May 2021.
Zeeb H, Pigeot I, Schüz B. Digital Public Health – Rasanter technischer Fortschritt, aber viele offene Public-Health-Fragen. Bundesgesundheitsblatt. 2020;2:135–6.
Albrecht UV. Kapitel Kurzfassung. In: UV. Albrecht, editor. Chancen und Risiken von Gesundheits-Apps (CHARISMHA). Hannover. Medizinische Hochschule Hannover; 2016. p. 14–47.
Lux T. E-Health. In: T. Knollmann, editor. Handbuch Digitale Wirtschaft. Wiesbaden: Springer Gabler; 2020. p. 1151–1168.
GfK SE. Health and fitness tracking. Berlin: Global GfK survey; 2016.
EPatient Analytics. E-Patient-Survey. Berlin; 2020
Silberzahn T, Richter L, Biesdorf S, Hehner S, Daub M, Evers M, Deetjen U, Messemer J, Niedermann F, Rudolph T. eHealth Monitor 2020 – zentrale Ergebnisse. In: Deutschlands Weg in die digitale Gesundheitsversorgung. McKinsey. 2020 https://www.mckinsey.de/~/media/mckinsey/locations/europe%20and%20middle%20east/deutschland/news/presse/2020/2020-11-12%20ehealth%20monitor/ehealth%20monitor%202020.pdf Accessed 25 Jan 2021.
Cornejo Müller A, Wachtler B, Lampert T. Digital Divide – Soziale Unterschiede in der Nutzung digitaler Gesundheitsangebote. Bundesgesundheitsbl. 2020;63:185–91.
Robinson L, Cotten SR, Ono H, Quan-Haase A, Mesch G, Chen W, Schulz J, Hale TM, Stern MJ. Digital inequalities and why they matter. Inf Commun Soc. 2015;18:569–82.
Van Dijk J. The deepening divide: inequality in the information society. Thousand Oaks, London, New Delhi: Sage publications; 2005.
Nölke L, Mensing M, Krämer A, Hornberg C. Sociodemographic and health-(care-)related characteristics of online health information seekers: a cross sectional German study. BMC Public Health. 2015;15:31.
Sarkar U, Karter AJ, Liu JY. The literacy divide: health literacy and the use of an Internet-based patient portal in an integrated health system – results from the Diabetes Study of Northern California (DISTANCE). J Health Commun. 2010;15(Suppl 2):183–96.
Schaeffer D, Berens EM, Vogt D. Gesundheitskompetenz der Bevölkerung in Deutschland. Ergebnisse einer repräsentativen Befragung Dtsch Ärztebl. 2017;114:53–60.
Berner F, Endter C, Hagen C. Ältere Menschen und Digitalisierung. Erkenntnisse und Empfehlungen des Achten Altersbericht. Berlin: Deutsches Zentrum für Altersfragen; 2020 https://www.bmfsfj.de/blob/159456/3dab099fb5eb39d9fba72f6810676387/achter-altersbericht-kurzfassung-data.pdf. Accessed 25. Jan 2021
Mcauley A. Digital health interventions: widening access or widening inequalities? Public Health. 2014;128:1118–20.
Zhang X, Pérez-Stable E, Bourne PE, Peprah E, Duru K, Breen N, Berrigan D, Wood F, Jackson JS, Wong DWS, Denn J. Big data science: opportunities and challenges to address minority health and health disparities in the 21st century. Ethnicity Disease. 2017; 27: 95–106.
World Health Organization: WHO Coronavirus (COVID-19) Dashboard. https://covid19.who.int (2021). Accessed 18. May 2021.
United Nations. Auswirkungen von COVID-19 auf die Gesundheit und Pandemiebekämpfung. In: Kurzdossier: COVID-19 und die allgemeine Gesundheitsversorgung. United Nations. 2020 https://www.un.org/Depts/german/gs/COVID-19-UHC.pdf. Accessed 18 May 2021.
Robert Koch-Institut. COVID-19 Dashboard. https://experience.arcgis.com/experience/478220a4c454480e823b17327b2bf1d4 (2021). Accessed 20. May 2021.
Skoda EM, Spura A, De Bock F, Schweda A, Dörrie N, Fink M, Musche V, Weismüller B, Benecke A, Kohler H, Junne F, Graf J, Bäuerle A, Teufel M. Veränderung der psychischen Belastung in der COVID-19-Pandemie in Deutschland: Ängste, individuelles Verhalten und die Relevanz von Informationen sowie Vertrauen in Behörden. Bundesgesundheitsbl. 2021;64:322–33.
Nepogodiev D. Elective surgery cancellations due to the COVID-19 pandemic: global predictive modelling to inform surgical recovery plans. BJS Society Ltd. 2020;107:1440–9.
Schulze S, Holmberg C. Bedeutung und Belastung von Pflegekräften während der Corona-Krise Importance of and burden on nursing staff during the corona crisis. Public Health Forum. 2021;29:32–5.
International Federation of Red Cross and Red Crescent Societies: Common reactions and behaviors in epidemics. In: Mental Health and Psychosocial Support for Staff, Volunteers and Communities in an Outbreak of Novel Coronavirus. International Federation of Red Cross and Red Crescent Societies. 2020 https://reliefweb.int/sites/reliefweb.int/files/resources/MHPSS-in-nCoV-2020_ENG.pdf. Accessed 18 May 2021.
Kaiser Family Foundation: The Implications of COVID-19 for Mental Health and Substance Use. https://www.kff.org/coronavirus-covid-19/issue-brief/the-implications-of-covid-19-for-mental-health-and-substance-use/ (2021). Accessed 18 May 2021.
Statistisches Bundesamt: Wirtschaftliche Auswirkungen. Bruttoinlandsprodukt (BIP) Wirtschaftswachstum. https://www.destatis.de/DE/Themen/Querschnitt/Corona/Wirtschaft/kontextinformationen-wirtschaft.html#BIP (2021). Accessed 18 May 2021.
Statistisches Bundesamt: Wirtschaftliche Auswirkungen. Bruttoinlandsprodukt (BIP) Wirtschaftswachstum. https://www.destasis.de/DE/Themen/Querschnitt/Corona/Wirtschaft/kontextinformationen-wirtschaft.html#BIP (2021). Accessed 18 May 2021.
Deutschlandfunk. Rückblick 2020. Chronologie eines Schuljahres in der Coronakrise. 2020. https://www.deutschlandfunk.de/rueckblick-2020-chronologie-eines-schuljahrs-in-der.680.de.html?dram:article_id=489919. Accessed 25 May 2021.
Winde M, Werner SD, Gumbmann B, Hieronimus S. Einleitung. In: Future Skills – Diskussionspapier 4. Hochschulen, Corona und jetzt?. Stifterverband Bildung. Wissenschaft. Innovation/McKinsey. 2020. https://www.future-skills.net/download/file/fid/340 Accessed 28 May 2021.
Wachtler B, Michalski N, Nowossadeck E, Diercke M, Wahrendorf M, Santos-Hövener C, Lampert T, Hoebel J. Sozioökonomische Ungleichheit und COVID-19 – Eine Übersicht über den internationalen Forschungsstand. Journal of Health Monitoring. 2020;5:3–18.
Morgan C, Rose, N. Multidisciplinary research priorities for the COVID-19 pandemic The lancet. Psychiatry. 2020;7: e33.
Van Deursen, JAM. Digital inequality during a pandemic: quantitative study of differences in COVID-19-related internet uses and outcomes among the general population. J Med Internet Res. 2020; 22:e20073.
Tebeje HT, Klein J. Applications of e-health to support person-centered health care at the time of COVID-19 pandemic. Telemedicine and e-health.2021;27:150–158
Khilnani A, Schulz J, Robinson L. The COVID-19-pandemic: new concerns and connections between eHealth and digital inequalities. J Inf Commun Ethics Soc. 2020. https://doi.org/10.1108/JICES-04-2020-0052.
Okereafor K, Adebola O, Djehaiche R. Exploring the potential of telemedicine and other non-contact electronic health technologies in controlling the spread of the novel coronavirus disease (COVID-19). Int J IT Eng (IJITE).2020; 8:1–13
WHO Regionalbüro Europa, editor. Verschärfung und Anpassung von Maßnahmen zum Schutz der öffentlichen Gesundheit während Übergangsphasen der COVID-19-Pandemie. Grundsatzüberlegungen für die Europäische Region der WHO. Kopenhagen. WHO Regionalbüro Europa; 2020.
Judson TJ, Odisho AY, Neinstein AB, Chao J, Williams A, Miller C, Moriaty T, Gleason N, Intinarelli G, Gonzales R. Rapid design and implementation of an integrated patient self-triage and self-scheduling tool for COVID-19. J Am Med Inform Assoc. 2020;27:860–6.
Timmers T, Janssen L, Stohr J, Murk JL, Berrevoets MAH. Using eHealth to support COVID-19 education, self-assessment, and symptom monitoring in the Netherlands: observational study. JMIR Mhealth Uhealth. 2020;8: e19822
Huxhold O, Otte K. Internetzugang und Internetnutzung in der zweiten Lebenshälfte. In: Deutscher Alterssurvey 01/2019. Deutsches Zentrum für Altersfragen. Berlin. 2019. https://www.ssoar.info/ssoar/bitstream/handle/document/65804/ssoar-2019-huxhold_et_al-Internetzugang_und_Internetnutzung_in_der.pdf?sequence=1&isAllowed=y&lnkname=ssoar-2019-huxhold_et_al-Internetzugang_und_Internetnutzung_in_der.pdf. Accessed 25 Jan 2021
Gostomzyk J. Sozialmedizin in Zeiten der Corona-Pandemie. Gesundheitswesen. 2020;82:379–80.
Dockweiler R, Razum O. Digitalisierte Gesundheit: neue Herausforderungen für Public Health. Gesundheitswesen. 2016;2016(78):5–7.
Mitteldeutscher Rundfunk. Die Chronik der Corona-Krise. 2020. https://www.mdr.de/nachrichten/politik/corona-chronik-chronologie-coronavirus-100.html#sprung11. Accessed 25 Jan 2021.
Robert Koch-Institut. Täglicher Lagebericht des RKI zur Coronavirus-Krankheit-2019 (COVID-19). Robert Koch-Institut. 2020 https://www.rki.de/DE/Content/InfAZ/N/Neuartiges_Coronavirus/Situationsberichte/2020-05-08-de.pdf?__blob=publicationFile. Accessed 20. May 2021
Vill BV. Preis der Sesshaftigkeit. Eine psychodynamische Betrachtung der Immobilie. Berlin: Springer; 2019.
Lechert Y, Schroedter JH, Lüttinger P. Die Umsetzung der Bildungsklassifikation CASMIN für die Volkszählung 1970, die Mikrozensus-Zusatzerhebung 1971 und die Mikrozensen 1976–2004. Mannheim; 2006.
Kohler M, Schmich P, Winkelhage O, Jentsch F. Studienkonzeption, Durchführung und Datensatzbeschreibung - 1. Fassung. In: Der Telefonische Gesundheitssurvey 2006. Robert Koch-Insitut. 2006. https://www.who.int/fctc/reporting/Annex3_Telephone_Health_Survey_2006.pdf. Accessed 25 Jan 2021.
Adler NE, Epel ES, Castelazzo G, Ickovics JR. Relationship of subjective and objective social status with psychological and physiological functioning: Preliminary data in healthy White women. Health Psychology. 2000;19:586–92.
Hoebel J, Kuntz B, Müters S, Lampert T, Subjektiver Sozialstatus und gesundheitsbezogene Lebensqualität bei Erwachsenen in Deutschland. Ergebnisse der Allgemeinen Bevölkerungsumfrage der Sozialwissenschaften (ALLBUS 2010). Gesundheitswesen. 2013;75: 643–651.
Schenk L, Bau AM, Borde T, Butler J, Lampert T, Neuhauser H, Razum O, Weilandt, C. Mindestindikatorensatz zur Erfassung des Migrationsstatus. Empfehlungen für die epidemiologische Praxis. Bundesgesundheitsblatt Gesundheitsforschung Gesundheitsschutz. 2006;49: 853–860.
Bundesinstitut für Bau-, Stadt- und Raumforschung: Laufende Stadtbeobachtung – Raumabgrenzungen. Stadt- und Gemeindetypen in Deutschland. https://www.bbsr.bund.de/BBSR/DE/forschung/raumbeobachtung/Raumabgrenzungen/deutschland/gemeinden/StadtGemeindetyp/StadtGemeindetyp.html (2020). Accessed 19. May 2021.
Robert Koch-Institut, editor. Beiträge zur Gesundheitsberichterstattung des Bundes. Daten und Fakten. Ergebnisse der Studie „Gesundheit in Deutschland akutell 2012“. Berlin. Robert Koch-Institut; 2014.
Schaeffer D, Vogt D, Berens EM, Hurrelmann. Gesundheitskompetenz der Bevölkerung in Deutschland – Ergebnisbericht. Bielefeld; 2016
Okan O, Sørensen K, Messer M. COVID-19: a guide to good practice on keeping people well informed. 2020. https://theconversation.com/covid-19-a-guide-to-good-practice-on-keeping-people-well-informed-134046. Accessed 25 Jan 2021
Norgaard O, Furstrand D, Klokker L, Karnoe A, Batterham R, Kayser L, Osborne RH. The e-health literacy framework: A conceptual framework for characterizing e-health users and their interaction with e-health systems. Knowl Manag E-learning. 2015;7:522–40.
Norman CD, Skinner HA. eHealth Literacy. Essential Skills for Consumer Health in a Networked World. J Med Internet Res. 2006;8: e9.
O´Connor S, Hanlon P, O´Donnell A, Garcia S, Glanville J, Mair FS. Understanding factors affecting patient and public engagement and recruitment to digital health interventions: a systematic review of qualitative studies. BMC Medical Informatics and Decision Making. 2016;16: 1–15.
Kontos E, Blake KD, Chou WYS, Prestin A. Predictors of eHealth usage: insights on the digital divide from the health information national trends survey 2012. J Med Internet Res. 2014; 16: e172.
Bhuyan SS, Lu N, Chandak A, Kim H, Wyant D, Bhatt J, Kedia S, Chang CF. Use of mobile health applications for health-seeking behavior among US adults. J Med Syst. 2016;40:153.
Heponiemi T, Jormanainen V, Leemann L, Manderbacka K, Aalto AM, Hyppönen H. Digital divide in perceived benefits of online health care and social welfare services: national cross-sectional survey study. J Med Internet Res. 2020;22:e17616.
Acknowledgements
We acknowledge the support provided by Deutsche Forschungsgemeinschaft (DFG) and the Open Access Publishing Fund of Osnabrück University.
Funding
The article’s processing charges were funded by Deutsche Forschungsgemeinschaft (DFG). The DFG did not influence the study design, analysis, interpretation, or writing of the manuscript. Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
BB designed this study. BB and NAG carried out the data preparation and data management. The data analysis was performed by NH with the help of NAG, LS, BB, and UH. The manuscript was written by NH. All of the authors read and critically reviewed the final manuscript and approved the final version for publication.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
At the University of Osnabrück, it is not mandatory to obtain an ethics vote for empirical surveys. The Ethics Committee only becomes active upon request (§ 3(1) Code of procedure of the Ethics Committee of the University of Osnabrück). In this study, an online survey was conducted on topics that, in the authors' view, do not require an ethics committee approval. No disadvantages or harms could be identified in the questions asked; this was also confirmed by the cognitive interviews conducted. Only a few, already extensively tested or validated questions on health (SOEP, WHO) are included in the online questionnaire. The online survey does not deal with medical questions and is non-experimental and non-invasive. Standards, such as the Declaration of Helsinki, the Principles and Review Procedures of Research Ethics in the Social and Economic Sciences (RatSWD Output 9), were taken into account. The survey was conducted by an online survey institute (respondi AG). Before registering in the panel, the participants of the studies are informed about the data collection at respondi, the forwarding of the data in anonymised form and the evaluation of the data by the commissioning party (the study organisers) as well as data protection. Respondi declares that all answers will be evaluated anonymously, which means the answers cannot be matched to the panel member. Personal data will never be forwarded on to a third party. Furthermore, panel members will be informed about the remuneration for participating in studies. The panel members agree to participate in market and social research surveys via the panel. By registering, the TOC and data protection guidelines are actively clicked on and accepted. After registration, the panel members will be invited to participate in the survey. The survey takes place via the website https://mingle.respondi.com/?lang_id=3. Whether you want to take part in a survey or not is entirely up to panel member. Participants are informed that participation is voluntary, that the study can be cancelled at any time and that membership of the panel can be terminated at any time without incurring any disadvantages.
Consent for publication
Not applicable.
Competing interests
The authors declare that there is no conflict of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Hannemann, N., Götz, NA., Schmidt, L. et al. Patient connectivity with healthcare professionals and health insurer using digital health technologies during the COVID-19 pandemic: a German cross-sectional study. BMC Med Inform Decis Mak 21, 250 (2021). https://doi.org/10.1186/s12911-021-01605-8
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12911-021-01605-8