Abstract
Given the limited availability and accessibility of onsite cognitive behavioral therapy for insomnia (CBT-I), other CBT-I settings, such as internet-delivered CBT-I (iCBT-I), have been proposed. The primary aim of the study was to compare the efficacy of available CBT-I settings on insomnia severity. A systematic review and frequentist network meta-analysis of available CBT-I settings was performed. PsycINFO, PsycARTICLES, MEDLINE, PubMed, and CINAHL were searched for randomized controlled trials (RCTs) investigating any CBT-I settings in adults with insomnia disorder. The systematic literature search (3851 references) resulted in 52 RCTs. For the primary outcome insomnia severity, all examined CBT-I settings except smartphone-delivered CBT-I yielded significant effects when compared to WL. Large standardized mean differences were found for individual onsite CBT-I (− 1.27;95%CI − 1.70, − 0.84), group-delivered CBT-I (− 1.00;95%CI − 1.42. − 0.59), telehealth (− 1.28;95%CI − 2.06, − 0.50), and guided bibliotherapy (− 0.99;95%CI − 1.67, − 0.32). Both guided iCBT-I (− 0.71;95%CI − 1.18, − 0.24) and unguided iCBT-I (− 0.78;95%CI − 1.18, − 0.38) yielded medium effect sizes. The results underline that health care systems should intensify their efforts to provide synchronously-delivered CBT-I (individual onsite, group-delivered, and telehealth), and particularly individual onsite CBT-I, given its solid evidence base. Medium to large effect sizes for iCBT-I and guided bibliotherapy indicate that self-help settings may be a viable alternative when synchronously-delivered CBT-I is not available.
Similar content being viewed by others
Introduction
Insomnia disorder is one of the most prevalent mental disorders1. It is estimated that up to a third of primary care patients fulfill the diagnostic criteria2,3. The disorder has a high burden of disease and impacts the quality of life and daytime functioning4. Moreover, insomnia is a risk factor for other somatic and mental health conditions5,6,7 and creates high societal costs due to work absenteeism and presenteeism as well as health care usage8,9. Given its high prevalence and impact on an individual and societal level, the treatment of insomnia disorder is of high public health relevance.
Yet, the provision of care for insomnia disorder, which is currently mainly conducted by primary care physicians, is a major challenge for health care systems. Clinical guidelines recommend cognitive behavioral therapy for insomnia (CBT-I) as the first-line treatment10,11. However, given the scarce availability and accessibility of trained CBT-I providers, only a fraction of the people suffering from insomnia disorder receive guideline-compliant treatment12,13. As a result, alternative CBT-I settings have been proposed to enhance the dissemination of CBT-I. These proposed settings range from self-help programs, such as internet-delivered CBT-I (iCBT-I) or bibliotherapy to settings where patients and therapists communicate via video or chat. Pairwise meta-analyses provide preliminary support for some of these alternative settings14,15,16,17. However, evidence comparing alternative CBT-I settings to the first-line way of providing CBT-I in an individual onsite setting is scarce.
For depressive disorder and other mental health and somatic conditions, preliminary evidence indicates that digitalized cognitive behavioral therapy (CBT), at least if therapeutically guided, can be as effective as onsite CBT18,19,20. Across all investigated mental health and somatic conditions, the overall results of Carlbring et al. indicated equivalence between digitalized and onsite CBT20. Yet, in the case of insomnia, their analysis of two studies pointed to a larger effect of onsite CBT-I. However, this effect did not reach significance. Moreover, subgroup analyses of two recent meta-analyses indicated that onsite CBT-I may be superior to self-help CBT-I15,21.
On a study level, studies comparing efficacy between various CBT-I settings are limited, and the existing evidence is contradictory. One study indicated the noninferiority of guided iCBT-I when comparing it to onsite group-delivered CBT-I (group)22. Moreover, no significant differences between unguided iCBT-I and individual onsite CBT-I (F2F) were found in a study of military personnel23. While these studies point to a comparable efficacy of onsite CBT-I and iCBT-I, two other studies indicate that onsite CBT-I may be superior to iCBT-I. In a comparison of guided iCBT-I, F2F, and waiting list control (WL), F2F yielded larger effects at all assessment points24. Moreover, a recent noninferiority trial comparing unguided iCBT-I to F2F found significantly lower levels of insomnia severity for F2F25.
A better understanding of the comparative efficacy of available CBT-I settings would contribute to the discussion how alternative CBT-I settings can improve the care for insomnia and how resources should be allocated. Network meta-analyses offer a possibility to compare different interventions/settings, even if they have not been investigated head to head in randomized controlled trials (RCTs)26.
Hence, the present study aims to compare the efficacy of CBT-I settings using the framework of a frequentist network meta-analysis. The following specific research questions are addressed by synthesizing RCTs examining adult patients with insomnia disorder:
-
1.
How do CBT-I settings compare in their efficacy on insomnia severity measured via self-report questionnaires?
-
2.
How do CBT-I settings compare in their efficacy on sleep quality as well as on subjectively reported (i.e., via sleep diary or self-report questionnaire), and objectively measured (i.e., via polysomnography or actigraphy) sleep-related outcomes (i.e., total sleep time, sleep efficiency, sleep onset latency, and wake after sleep onset)?
-
3.
How do CBT-I settings compare in their efficacy on response, remission, and intervention completion rates?
Given the contradictory existing evidence, no a-priori hypotheses have been set.
Methods
Search strategy and selection criteria
This systematic review and frequentist network meta-analysis was conducted according to the PRISMA extension statement for network meta-analyses (Supplementary Appendix S1)27.
The databases PsycINFO, PsycARTICLES, MEDLINE, PubMed, and CINAHL were searched for publications from 1987, which is the publication date of DSM-III-R28, until November 23rd, 2021. Terms indicative of insomnia disorder, CBT-I, and CBT-I components were combined for the search string. The search string per database is detailed in Supplementary Appendix S2. The electronic database searches were supplemented with manual searches for published, unpublished, and ongoing RCTs in ClinicalTrials.gov, by screening the reference lists of included studies, and by contacting experts of the field (i.e., the European Insomnia Network).
Only RCTs published in English or German were eligible for inclusion. Participants were adult patients with insomnia disorder diagnosed following the DSM-529, DSM-IV-TR30, DSM-IV31, DSM-III-R28, or consistent criteria. Studies defining comorbid conditions or shift work as inclusion criteria were excluded. Thus, comorbid conditions were allowed, provided they were not an inclusion criterion for the respective study. Interventions of interest were CBT-I, which was conceptualized as interventions incorporating at least one cognitive component (e.g., cognitive restructuring, cognitive control, paradoxical intention, worry time), one behavioral component (i.e., stimulus control, sleep restriction), and education about sleep. CBT-I was not allowed to be investigated in combination with other treatments (e.g., bright light therapy, pharmacotherapy). Eligible comparison conditions were either another CBT-I setting or sleep hygiene education (SHE), psychological placebo, WL, treatment as usual (TAU), or active contact control. Studies were ineligible if they compared, according to our categorization (see Table 1), the same CBT-I settings with varying intensity against each other (e.g., varying intensities of guidance in guided iCBT-I as in32,33) without another comparison condition. Outcome measures eligible for inclusion were standardized self-report questionnaires or data from actigraphy/polysomnography for insomnia severity, sleep quality, subjectively reported or objectively measured sleep parameters (i.e., total sleep time, sleep efficiency, sleep onset latency, wake after sleep onset), response, remission, or intervention completion rates. A detailed description of the outcome data is provided in Supplementary Table S1.
Identified records were managed using Citavi37. After manually removing duplicates, titles and abstracts of the identified studies were screened. LSi and LSt independently selected the studies. Outcome data (expressed as means and standard deviations) were independently extracted by LSi and LSt. Conflicts were resolved by discussion. If means and standard deviations were not provided, they were calculated from the available statistical indices as described in the Cochrane Handbook38. Information on study design features, sample characteristics, and intervention characteristics were extracted.
Data analysis
The primary outcome was the standardized mean difference (SMD) from pre- to post-treatment of insomnia severity measured via self-report. All standardized self-report questionnaires measuring insomnia severity were allowed. See Supplementary Table S1 for an overview of the secondary outcomes.
Data was prepared for the analysis using Python39 and analyzed using R (version 4.2.040). Random-effect frequentist network meta-analyses were fitted using the R package netmeta (version 2.1), which automatically accounts for multi-arm studies41,42. SMDs with 95% confidence intervals (CI) were calculated for all continuous outcomes. Dichotomous data were transformed using the Freeman-Tukey double arcsine transformation to calculate SMDs. WL was used as the reference treatment in all forest plots. P-Scores were used to estimate the relative rankings within the frequentist network43.
CBT-I settings and control conditions were classified according to the description provided in each study. Table 1 details all possible nodes. To visualize the network, network plots were created using the function netgraph() of the R package netmeta (version 2.1)41.
Assessment of heterogeneity and inconsistencies
A common estimate for the heterogeneity variance was assumed for all comparisons. The presence of statistical heterogeneity and inconsistencies were assessed using Higgins's I2 and Cochran's Q (Qwithindesigns for a test of heterogeneity within designs and Qbetweendesigns for a test of inconsistencies between designs). Moreover, heterogeneity and inconsistencies were analyzed via independent path decompositions visualized by net heat plots44.
Risk of bias and publication bias
Risk of bias was assessed independently by LSi and LSt using the Cochrane Risk of Bias tool 2 (RoB 2.045) for the primary outcome insomnia severity. Risk of bias was evaluated for (1) the randomization process, (2) deviations from the intended intervention, (3) missing outcome data, (4) measurement of the outcome, and (5) selection of the reported outcome. Any discrepancies were resolved by consensus and arbitration by consulting a third reviewer (FB). We decided against calculating an overall risk of bias rating following the recommendations by Jüni et al.46. Comparison-adjusted funnel plots comparing CBT-I settings against the control conditions were produced to explore publication bias or other small-study effects.
The study was prospectively registered on the Open Science Framework (https://osf.io/py4eq). There were no deviations from the study registration. There was no funding source for this study.
Results
The systematic literature search identified a total of 3851 references. Finally, 52 studies22,23,24,25,35,36,47,48,49,50,51,52,53,54,55,56,57,58,59,60,61,62,63,64,65,66,67,68,69,70,71,72,73,74,75,76,77,78,79,80,81,82,83,84,85,86,87,88,89,90,91,92, including 12,544 participants, fulfilled our eligibility criteria and were included in this network meta-analysis. The detailed study selection process and reasons for exclusion are outlined in the PRISMA flow chart in Fig. 1. Characteristics of the included studies are reported in Supplementary Table S2, and details on the interventions and control conditions with their classification into the respective nodes of the network are reported in Table 1. The included studies had a median sample size of 91 participants (range 10 to 3755), with a mean age of 43.4 years and 70.6% being female.
Study selection process. 1by contacting experts of the field (i.e., the mailing list of the European Insomnia Network). Adapted from: Page et al.93.
Forty-four studies investigating a total of 4662 participants were included in the network meta-analysis for insomnia severity. The following self-report questionnaires were used to measure insomnia severity: the Insomnia Severity Index94 (k = 37), the Insomnia Symptom Questionnaire95 (k = 3), the Sleep Condition Indicator96 (k = 2), the Athens Insomnia Scale97 (k = 1), and the eight-item insomnia subscale of the SLEEP-5098 (k = 1). A well-connected network (Fig. 2) was found for the primary outcome insomnia severity. The network consisted of 13 nodes and was based on 66 pairwise comparisons. Figure 3 shows the forest plot presenting the SMDs of all available settings compared to WL. Results indicated significant effects of all examined CBT-I settings except smartphone. Neither of the CBT-I settings was superior to another. Large effect sizes were found for F2F (− 1.27, 95%CI − 1.70 to − 0.84), group (− 1.00, 95%CI − 1.42 to − 0.59), telehealth (− 1.28, 95%CI − 2.06 to − 0.50), and guided bibliotherapy (− 0.99, 95%CI − 1.67 to − 0.32). Both guided iCBT-I (− 0.71, 95% CI − 1.18 to − 0.24) and unguided iCBT-I (− 0.78, 95%CI − 1.18 to − 0.38) yielded medium effect sizes. P-Scores were the largest for F2F and telehealth (0.88 and 0.84, respectively; Supplementary Appendix S3). Substantial heterogeneity and inconsistencies were found (I2 = 95.5%; Qwithindesigns = 733.90, p < 0.0001; Qbetweendesigns = 210.72, p < 0.0001). Inconsistencies and sources of heterogeneity were explored using net heat plots (Supplementary Fig. S2).
Network plot insomnia severity. The most direct evidence came from the pairwise comparisons of guided iCBT-I to WL, unguided iCBT-I to WL, and group to WL. Smartphone was not strongly attached to the network, with only one study comparing it to SHE. The network plots were created using the function netgraph() of the R package netmeta (version 2.141) in the software R (version 4.2.040).
The network graphs of the secondary outcomes, the forest plots presenting the SMDs of all available nodes compared to WL, the respective net heat plots, information on the network meta-analyses, and P-Scores are presented in the supplementary material (Supplementary Figs. S1 and S2, Supplementary Table S3 and Supplementary Appendix S3).
Results indicated significant effects of all examined CBT-I settings except unguided bibliotherapy for subjective sleep quality. Medium effect sizes were found for guided bibliotherapy (0.73, 95%CI 0.40 to 1.06), F2F (0.71, 95%CI 0.49 to 0.92), smartphone (0.68, 95%CI 0.14 to 1.21), and group (0.68, 95%CI 0.42 to 0.93). For the subjective total sleep time, significant effects for unguided bibliotherapy (0.28, 95%CI 0.15 to 0.41), group (0.27, 95%CI 0.14 to 0.39), and guided iCBT-I (0.21, 95%CI 0.12 to 0.30) were found. For subjective sleep efficiency, significant effects were found for all examined CBT-I settings except unguided bibliotherapy. A large effect size was found for group (0.85, 95%CI 0.59 to 1.12), medium effect sizes were found for guided bibliotherapy (0.70, 95%CI 0.30 to 1.09), F2F (0.52, 95%CI 0.25 to 0.78), and telehealth (0.52, 95%CI 0.07 to 0.96). Results indicated significant effects of all examined CBT-I settings on subjective sleep onset latency. Medium effect sizes were found for guided bibliotherapy (− 0.49, 95%CI − 0.69 to − 0.29), telehealth (− 0.45, 95%CI − 0.68 to − 0.22), group (− 0.40, 95%CI: − 0.51 to − 0.29), and F2F (− 0.40, 95%CI − 0.53 to − 0.27). Results indicated significant effects of all examined CBT-I settings on subjective wake after sleep onset. Medium effect sizes were found for group (− 0.64, 95%CI − 0.85 to − 0.44), telehealth (− 0.61, 95%CI − 1.05 to − 0.16), and F2F (− 0.48, 95%CI: − 0.71 to − 0.26). All examined CBT-I settings except telehealth yielded a significant reduction of the objective total sleep time compared to WL. Medium negative effect sizes were found for group (− 0.73, 95%CI − 0.95 to − 0.51), unguided iCBT-I (− 0.61, 95%CI: − 1.08 to − 0.15), and F2F (− 0.51, 95%CI − 0.81 to − 0.22). None of the examined CBT-I settings yielded significant effects on objective sleep efficiency. Significant effects of F2F (− 0.47, 95%CI − 0.75 to − 0.18), telehealth (− 0.55, 95%CI − 0.97 to − 0.14), and SHE (− 0.38, 95%CI − 0.70 to − 0.05) on objective sleep onset latency were found. None of the examined CBT-I settings yielded significant effects on objective wake after sleep onset. Significant effects of guided bibliotherapy (0.89, 95%CI 0.36 to 1.41), telehealth (0.77, 95%CI 0.02 to 1.51), F2F (0.69, 95%CI 0.18 to 1.19), group (0.49, 95%CI 0.17 to 0.82), and guided iCBT-I (0.30, 95%CI 0.04 to 0.56) were found for response rates. Significant effects for remission rates were found for telehealth (0.88, 95%CI 0.15 to 1.60), F2F (0.76, 95%CI 0.27 to 1.25), guided bibliotherapy (0.66, 95%CI 0.24 to 1.09), and unguided iCBT-I (0.39, 95%CI 0.03 to 0.74). Results showed significant negative effects for group (− 0.38, 95%CI − 0.63 to − 0.13), unguided iCBT-I (− 0.29, 95%CI − 0.52 to − 0.06), and guided iCBT-I (− 0.25, 95%CI − 0.49 to − 0.02) on intervention completion rates.
A summary graph of the RoB 2.0 rating and a detailed rating for all included studies per domain is provided in the supplementary material (Supplementary Figs. S3 and S4). The most common sources of risk of bias were missing outcome data and bias in the measurement of the outcome. The comparison-adjusted funnel plots (Supplementary Fig. S5) of all examined outcomes appeared symmetrical.
Discussion
Given the current treatment gap that can be partially attributed to the low scalability of onsite CBT-I, it is crucial to compare the potential of alternative CBT-I settings. Across outcomes, we did not find evidence for the superiority of any CBT-I setting. For the primary outcome insomnia severity, large effect sizes were found for individual onsite CBT-I, group-delivered CBT-I, telehealth, and guided bibliotherapy. Both guided iCBT-I and unguided iCBT-I yielded medium effect sizes. Similarly, across most other subjective sleep-related outcomes, F2F, group, guided bibliotherapy, and telehealth yielded the largest effect sizes and largest P-Scores.
Consistent with a previous meta-analysis on objective sleep-related outcomes99, no significant effects were found for objective sleep efficiency and wake after sleep onset. Medium negative effects, thus a reduction of objective total sleep time, were found for all settings except for telehealth. This reduction may be due to sleep restriction and stimulus control which aim to increase sleep pressure100. Conversely, small positive effects for subjective total sleep time, indicating increases, were found for unguided bibliotherapy, group, and guided iCBT-I, which may be attributable to a decrease of the subjective–objective sleep discrepancy that has been observed after CBT-I101. The settings SHE, telehealth, and F2F yielded a small effect on objective sleep onset latency. In general, the results align with existing evidence indicating that the observed effects of CBT-I are more substantial in self-reported outcome parameters compared to objectively measured outcome parameters99.
Guided bibliotherapy yielded a large effect size for response, and telehealth yielded a large effect size for remission. However, given the limited number of studies investigating these outcomes and the limited number of studies investigating guided bibliotherapy and telehealth, these results should be interpreted carefully. Interestingly, group had a larger negative effect size for intervention completion than guided or unguided iCBT-I. However, the network meta-analysis on intervention completion rates should be interpreted with caution, given the heterogeneous reporting of these data.
In accordance with previous meta-analyses, onsite CBT-I (i.e., group and F2F) tended to yield larger effects than iCBT-I15,21. As F2F was ranked among the first for the majority of outcomes and given its solid evidence base, the expansion of F2F in all health care systems appears to be crucial. Group may be a resource-saving alternative if few CBT-I providers are available. In this context, intervention retention should be closely monitored, given that attrition rates may potentially be elevated in a group setting. While only four of the included studies investigated telehealth, the results point to the potential of telehealth. As telehealth could be particularly relevant for (remote) areas where the number of qualified CBT-I providers is low, improving the evidence base for this setting seems timely.
Where an expansion of synchronous communication settings (i.e., F2F, group, or telehealth) is not possible or only possible to a limited extent, it should be built upon the potential of self-help settings that have been proven to be effective. This study's findings align with previous pairwise meta-analyses confirming the efficacy of self-help CBT-I14,15,16,102. For bibliotherapy, guidance appears to be a crucial factor: whereas guided bibliotherapy achieved a large effect size, unguided bibliotherapy did not significantly differ from WL. However, it must be noted that only four studies investigated guided bibliotherapy. Guided bibliotherapy might be an interesting alternative for patients who are skeptical of digitalized CBT-I programs or in areas with limited internet- and end-user device coverage. However, as therapists have no access to patients' progress in the intervention unless patients share it, guidance (e.g., via telephone) might be difficult in routine care. Hence, further investigations on the efficacy and feasibility of guided bibliotherapy are desirable.
Our analyses and current evidence14,15,16,17 indicate that guided and unguided iCBT-I should be considered to improve the dissemination of CBT-I in routine care. In line with the literature, medium effect sizes were found for most subjective sleep-related outcomes for guided and unguided iCBT-I. Interestingly, unguided iCBT-I did not differ from guided iCBT-I for most outcomes. These findings contrast a recently published network meta-analysis where guided iCBT-I achieved a higher ranking than unguided iCBT-I for subjective sleep-related outcome data103. Hasan et al.103 classified iCBT-I programs featuring virtual therapists (e.g.,35,36,53,76,104) as guided. In line with other works investigating the impact of guidance105,106, we defined iCBT-I programs as guided if they featured some kind of human support due to the influence of human support on scalability. Thus, all iCBT-I programs that supported patients solely using automated processes were classified as unguided in our study, even if they provided individualized support to the patients (e.g., via tailoring the intervention/using virtual therapists). By employing this node specification criterion, interventions that vary in their intensity of individualized support were lumped together. While it seems likely that the intensity of individualized support influences the examined outcomes, we decided against splitting the nodes for two reasons: First, information describing the intensity of support is often limited, impacting the feasibility to distinguish reliably between low and high intensities. Second, given that the nodes were already relatively small, a further subdivision could have impacted the network symmetry and the estimations. Nevertheless, given the medium effect sizes, iCBT-I, and in particular unguided iCBT-I, could have a major impact on the diminishment of the treatment gap and thus reach patients who would currently not receive any CBT-I.
Yet, for the implementation of iCBT-I in routine care, attrition appears to be a major challenge. Our analysis of the intervention completion rates underlines previous works that patients in iCBT-I are likely to terminate the intervention prematurely107. Interestingly, our analysis indicated that guided and unguided iCBT-I achieved comparable effects on intervention completion. Thus, automated individualized support may achieve similar results as the support provided by a human. Nonetheless, one has to keep in mind that we are speaking of comparable low and not comparable high completion rates. Particularly as it can be expected that intervention completion rates will be even lower in real-world settings compared to research settings108. This highlights the need to expand investigations of factors influencing attrition and possible countermeasures. A scoping review indicated the potential of various engagement strategies (e.g., personalization, peer support, gamification)109. However, the review also illustrated that experimental investigations of the effectiveness of the various engagement strategies are scarce. Therefore, research should focus on factors influencing attrition, how engagement strategies could foster retention in iCBT-I and whether they differ between guided and unguided iCBT-I.
The evidence base of this systematic review and network meta-analyses has some important limitations that should be considered when interpreting the results. First, some CBT-I settings were less commonly investigated than others. For example, only one study examined smartphone79, four guided bibliotherapy48,51,68,80, and four telehealth49,61,62,66. Moreover, for some outcomes (e.g., insomnia severity), the network was based on data from many studies and consisted of many different nodes, while for other outcomes (e.g., objective sleep-related outcomes), few data existed, and consequently, the corresponding networks were rather small. Furthermore, the included studies yielded a considerable risk of bias, particularly because rates of missing outcome data were high. Additionally, substantial heterogeneity and inconsistencies were found in several of the examined outcomes. While we set a strict a-priori definition of full CBT-I, there was still variance in the components comprising CBT-I, which may have contributed to both statistical and clinical heterogeneity. The differing implementation of the CBT-I settings, particularly of iCBT-I, may have contributed to the heterogeneity. In many research articles, the description of the settings (e.g., description of guidance in iCBT-I) was rather scarce, which may have led to the wrong categorization of interventions. Thus, future studies should provide a detailed description of study design features that may affect the outcomes, making also further subdivisions (e.g., on the intensity of individualized support) feasible. The differential efficacy of available CBT-I settings across subgroups (e.g., insomnia patients on or off sleep medication, patients with mental or somatic comorbidity, etc.) is crucial to give insights on which treatment is best for the individual patient. Yet, we decided against conducting further subgroup analyses as subgroup analyses result in split networks and thus data loss and because other parameters might not be equally distributed across different subgroups. Nevertheless, it is important to bear in mind that the presence of comorbidity or sleep medication use may be a possible confounder. Last, given the heterogeneous and often lacking reporting of negative effects110, we decided against analyzing negative effects in this study.
Currently, CBT-I is hardly available in the health care systems. Alternative CBT-I settings (in particular self-help settings such as iCBT-I and guided bibliotherapy) can help to enhance the scalability of CBT-I. Medium to large effect sizes for iCBT-I and guided bibliotherapy indicate that these self-help settings may be a viable alternative when synchronous communication settings are not available. Therefore, self-help interventions can complement care and reach patients who would otherwise not receive CBT-I or refuse onsite treatment. This study did not provide evidence for the superiority of any settings. However, synchronous communication settings (i.e., F2F, group, and telehealth) yielded the largest effect sizes. Given the large effect size and the strong evidence base for F2F, the latter should be considered as first-line treatment. Hence, it is essential to improve the structure of onsite care accordingly as the first and foremost task for improved global insomnia-related health.
Data availability
All data generated during this study are included in this published article (and its online supplementary materials).
References
Morin, C. M. & Benca, R. Chronic insomnia. Lancet 379, 1129–1141 (2012).
Krakow, B., Ulibarri, V. A., Romero, E. A. & McIver, N. D. A two-year prospective study on the frequency and co-occurrence of insomnia and sleep-disordered breathing symptoms in a primary care population. Sleep Med. 14, 814–823 (2013).
Shochat, T., Umphress, J., Israel, A. G. & Ancoli-Israel, S. Insomnia in primary care patients. Sleep 22, S359–S365 (1999).
Kyle, S. D., Morgan, K. & Espie, C. A. Insomnia and health-related quality of life. Sleep Med. Rev. 14, 69–82 (2010).
Hertenstein, E. et al. Insomnia as a predictor of mental disorders: A systematic review and meta-analysis. Sleep Med. Rev. 43, 96–105 (2019).
Jansen, P. R. et al. Genome-wide analysis of insomnia in 1,331,010 individuals identifies new risk loci and functional pathways. Nat. Genet. 51, 394–403 (2019).
Sofi, F. et al. Insomnia and risk of cardiovascular disease: A meta-analysis. Eur. J. Prev. Cardiol. 21, 57–64 (2014).
Daley, M. et al. Insomnia and its relationship to health-care utilization, work absenteeism, productivity and accidents. Sleep Med. 10, 427–438 (2009).
Kessler, R. C. et al. Insomnia and the performance of US workers: Results from the America Insomnia Survey. Sleep 34, 1161–1171 (2011).
Qaseem, A. et al. Management of chronic insomnia disorder in adults: A clinical practice guideline from the American college of physicians. Ann. Intern. Med. 165, 125–133 (2016).
Riemann, D. et al. European guideline for the diagnosis and treatment of insomnia. J. Sleep Res. 26, 675–700 (2017).
Koffel, E., Bramoweth, A. D. & Ulmer, C. S. Increasing access to and utilization of cognitive behavioral therapy for insomnia (CBT-I): A narrative review. J. Gen. Intern. Med. 33, 955–962 (2018).
Morin, C. M. Cognitive behavioral therapy for chronic insomnia: State of the science versus current clinical practices. Ann. Intern. Med. 163, 236–237 (2015).
Zachariae, R., Lyby, M. S., Ritterband, L. M. & O’Toole, M. S. Efficacy of internet-delivered cognitive-behavioral therapy for insomnia—A systematic review and meta-analysis of randomized controlled trials. Sleep Med. Rev. 30, 1–10 (2016).
Soh, H. L., Ho, R. C., Ho, C. S. & Tam, W. W. Efficacy of digital cognitive behavioural therapy for insomnia: A meta-analysis of randomised controlled trials. Sleep Med. 75, 315–325 (2020).
Ho, F. Y. Y. et al. Self-help cognitive-behavioral therapy for insomnia: A meta-analysis of randomized controlled trials. Sleep Med. Rev. 19, 17–28 (2015).
Sharafkhaneh, A. et al. Telemedicine and insomnia: A comprehensive systematic review and meta-analysis. Sleep Med. 90, 117–130 (2022).
Moshe, I. et al. Digital interventions for the treatment of depression: A meta-analytic review. Psychol. Bull 147, 749–786 (2021).
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H. & Hedman, E. Guided Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: A systematic review and meta-analysis. World Psychiatry 13, 288–295 (2014).
Carlbring, P., Andersson, G., Cuijpers, P., Riper, H. & Hedman-Lagerlöf, E. Internet-based vs. face-to-face cognitive behavior therapy for psychiatric and somatic disorders: An updated systematic review and meta-analysis. Cogn. Behav. Ther. 47, 1–18 (2018).
van Straten, A. et al. Cognitive and behavioral therapies in the treatment of insomnia: A meta-analysis. Sleep Med. Rev. 38, 3–16 (2018).
Blom, K. et al. Internet-vs. group-delivered cognitive behavior therapy for insomnia: A randomized controlled non-inferiority trial. Behav. Res. Ther. 70, 47–55 (2015).
Taylor, D. J. et al. Internet and in-person cognitive behavioral therapy for insomnia in military personnel: A randomized clinical trial. Sleep J. Sleep Sleep Disord. Res. 40, 1–12 (2017).
Lancee, J., Van Straten, A., Morina, N., Kaldo, V. & Kamphuis, J. H. Guided online or face-to-face cognitive behavioral treatment for insomnia: A randomized wait-list controlled trial. Sleep 39, 183–191 (2016).
Kallestad, H. et al. Mode of delivery of cognitive behaviour therapy for insomnia: A randomized controlled non-inferiority trial of digital and face- to-face therapy. Sleep 44, 1–12 (2021).
Schwarzer, G., Carpenter, J. R. & Rücker, G. Network meta-analysis. In Meta-analysis with R 187–216 (Springer, 2015) https://doi.org/10.1007/978-3-319-21416-0.
Hutton, B. et al. The PRISMA extension statement for reporting of systematic reviews incorporating network meta-analyses of health care interventions: Checklist and explanations. Ann. Intern. Med. 162, 777–784 (2015).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders: DSM-III-R (American Psychiatric Association, 1987).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (DSM-5®) (American Psychiatric Pub, 2013).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (American Psychiatric Association, 2000).
American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders 4th edn. (American Psychiatric Publishing Inc, 1994).
Lancee, J., van den Bout, J., Sorbi, M. J. & van Straten, A. Motivational support provided via email improves the effectiveness of internet-delivered self-help treatment for insomnia: A randomized trial. Behav. Res. Ther. 51, 797–805 (2013).
Forsell, E. et al. Proof of concept for an adaptive treatment strategy to prevent failures in internet-delivered CBT: A single-blind randomized clinical trial with insomnia patients. Am. J. Psychiatry 176, 315–323 (2019).
Edinger, J. D. et al. Behavioral and psychological treatments for chronic insomnia disorder in adults: An American Academy of Sleep Medicine systematic review, meta-analysis, and GRADE assessment. J. Clin. Sleep Med. 17, 263–298 (2021).
Freeman, D. et al. The effects of improving sleep on mental health (OASIS): A randomised controlled trial with mediation analysis. Lancet Psychiatry 4, 749–758 (2017).
Espie, C. A. et al. Effect of digital cognitive behavioral therapy for insomnia on health, psychological well-being, and sleep-related quality of life: A randomized clinical trial. JAMA Psychiat. 76, 21–30 (2019).
Swiss Academic Software GmbH. Citavi 6. (2021).
Higgins, J. P. T. et al. Cochrane Handbook for Systematic Reviews of Interventions (Wiley, 2019).
Van Rossum, G. & Drake, F. L. Python 3 Reference Manual (CreateSpace, 2009).
R Core Team. R: A Language and Environment for Statistical Computing (R Foundation for Statistical Computing, 2021).
Rücker, G. et al. netmeta: Network Meta-Analysis using Frequentist Methods. R package version 2.0-1 0–1 (2021).
Schwarzer, G., Carpenter, J. R. & Rücker, G. Network Meta-Analysis. In Meta-analysis with R 187–216 (2015).
Rücker, G. & Schwarzer, G. Ranking treatments in frequentist network meta-analysis works without resampling methods. BMC Med. Res. Methodol. 15, 1–9 (2015).
Krahn, U., Binder, H. & König, J. Visualizing inconsistency in network meta-analysis by independent path decomposition. BMC Med. Res. Methodol. 14, 1–12 (2014).
Sterne, J. A. C. et al. RoB 2: A revised tool for assessing risk of bias in randomised trials. BMJ 366, I4898 (2019).
Jüni, P., Witschi, A., Bloch, R. & Egger, M. The hazards of scoring the quality of clinical trials for meta-analysis. J. Am. Med. Assoc. 282, 1054–1060 (1999).
Alessi, C. et al. Cognitive behavioral therapy for insomnia in older veterans using nonclinician sleep coaches: Randomized controlled trial. J. Am. Geriatr. Soc. 64, 1830–1838 (2016).
Arnedt, J. T. et al. Randomized controlled trial of telephone-delivered cognitive behavioral therapy for chronic insomnia. Sleep 36, 353–362 (2013).
Arnedt, J. T. et al. Telemedicine versus face-to-face delivery of cognitive behavioral therapy for insomnia: A randomized controlled noninferiority trial. Sleep 44, 1–11 (2021).
Ballesio, A., Devoto, A. & Lombardo, C. Cognitive behavioural therapy for insomnia reduces ruminative thinking. Sleep Biol. Rhythms 16, 371–372 (2018).
Bastien, C. H., Morin, C. M., Ouellet, M. C., Blais, F. C. & Bouchard, S. Cognitive-behavioral therapy for insomnia: Comparison of individual therapy, group therapy, and telephone consultations. J. Consult. Clin. Psychol. 72, 653–659 (2004).
Bothelius, K., Kyhle, K., Espie, C. A. & Broman, J.-E. Manual-guided cognitive-behavioural therapy for insomnia delivered by ordinary primary care personnel in general medical practice: A randomized controlled effectiveness trial. J. Sleep Res. 22, 688–696 (2013).
Cheng, P. et al. Efficacy of digital CBT for insomnia to reduce depression across demographic groups: A randomized trial. Psychol. Med. 49, 491–500 (2019).
Drake, C. L. et al. Treating chronic insomnia in postmenopausal women: A randomized clinical trial comparing cognitive-behavioral therapy for insomnia, sleep restriction therapy, and sleep hygiene education. Sleep 42, 1–11 (2019).
Edinger, J. D., Wohlgemuth, W. K., Radtke, R. A., Marsh, G. R. & Quillian, R. E. Cognitive behavioral therapy for treatment of chronic primary insomnia: A randomized controlled trial. JAMA 285, 1856–1864 (2001).
Edinger, J. D., Wohlgemuth, W. K., Radtke, R. A., Coffman, C. J. & Carney, C. E. Dose-response effects of cognitive-behavioral insomnia therapy: A randomized clinical trial. Sleep 30, 203–212 (2007).
Edinger, J. D. et al. Cognitive behavioral therapy for patients with primary insomnia or insomnia associated predominantly with mixed psychiatric disorders: A randomized clinical trial. Sleep 32, 499–510 (2009).
Espie, C. A., Inglis, S. J., Tessier, S. & Harvey, L. The clinical effectiveness of cognitive behaviour therapy for chronic insomnia: Implementation and evaluation of a sleep clinic in general medical practice. Behav. Res. Ther. 39, 45–60 (2001).
Espie, C. A. et al. Randomized clinical effectiveness trial of nurse-administered small-group cognitive behavior therapy for persistent insomnia in general practice. Sleep 30, 574–584 (2007).
Espie, C. A. et al. A randomized, placebo-controlled trial of online cognitive behavioral therapy for chronic insomnia disorder delivered via an automated media-rich web application. Sleep 35, 769–781 (2012).
Gehrman, P. et al. Randomized noninferiority trial of telehealth delivery of cognitive behavioral treatment of insomnia compared to in-person care. J. Clin. Psychiatry 82, 1–7 (2021).
Gieselmann, A. & Pietrowsky, R. The effects of brief chat-based and face-to-face psychotherapy for insomnia: A randomized waiting list controlled trial. Sleep Med. 61, 63–72 (2019).
Hagatun, S. et al. The short-term efficacy of an unguided internet-based cognitive-behavioral therapy for insomnia: A randomized controlled trial with a six-month nonrandomized follow-up. Behav. Sleep Med. 17, 137–155 (2017).
Ho, F. Y. Y., Chung, K.-F., Yeung, W.-F., Ng, T.H.-Y. & Cheng, S.K.-W. Weekly brief phone support in self-help cognitive behavioral therapy for insomnia disorder: Relevance to adherence and efficacy. Behav. Res. Ther. 63, 147–156 (2014).
Ho, F. Y. Y. et al. The efficacy of integrated cognitive behavioral therapy (CBT) and acupressure versus CBT for insomnia: A three-arm pilot randomized controlled trial. Sleep Med. 87, 158–167 (2021).
Holmqvist, M., Vincent, N. & Walsh, K. Web- vs telehealth-based delivery of cognitive behavioral therapy for insomnia: A randomized controlled trial. Sleep Med. 15, 187–195 (2014).
Irwin, M. R. et al. Cognitive behavioral therapy vs. Tai Chi for late life insomnia and inflammatory risk: A randomized controlled comparative efficacy trial. Sleep 37, 1543–1552 (2014).
Jernelov, S. et al. Efficacy of a behavioral self-help treatment with or without therapist guidance for co-morbid and primary insomnia–a randomized controlled trial. BMC Psychiatry 12, 5 (2012).
Johann, A. F. et al. Cognitive behavioural therapy for insomnia does not appear to have a substantial impact on early markers of cardiovascular disease: A preliminary randomized controlled trial. J. Sleep Res. 29, 1–11 (2020).
Kaldo, V. et al. An open-ended primary-care group intervention for insomnia based on a self-help book—A randomized controlled trial and 4-year follow-up. J. Sleep Res. 29, 1–9 (2020).
Krieger, T. et al. A randomized controlled trial comparing guided internet-based multi-component treatment and internet-based guided sleep restriction treatment to care as usual in insomnia. Sleep Med. 62, 43–52 (2019).
Kyle, S. D. et al. The effects of digital cognitive behavioural therapy for insomnia on cognitive function: A randomised, controlled trial. Sleep 43, zsaa034 (2020).
Lancee, J., van den Bout, J., van Straten, A. & Spoormaker, V. I. Internet-delivered or mailed self-help treatment for insomnia? A randomized waiting-list controlled trial. Behav. Res. Ther. 50, 22–29 (2012).
Lancee, J., Eisma, M. C., van Straten, A. & Kamphuis, J. H. Sleep-related safety behaviors and dysfunctional beliefs mediate the efficacy of online CBT for insomnia: A randomized controlled trial. Cogn. Behav. Ther. 44, 406–422 (2015).
Lopez, R. et al. French language online cognitive behavioral therapy for insomnia disorder: A randomized controlled trial. Front. Neurol. 10, 1–9 (2019).
Lorenz, N., Heim, E., Roetger, A., Birrer, E. & Maercker, A. Randomized controlled trial to test the efficacy of an unguided online intervention with automated feedback for the treatment of insomnia. Behav. Cogn. Psychother. 47, 287–302 (2019).
Lovato, N., Lack, L., Wright, H. & Kennaway, D. J. Evaluation of a brief treatment program of cognitive behavior therapy for insomnia in older adults. Sleep 37, 117–126 (2014).
Lovato, N., Lack, L. & Kennaway, D. J. Comparing and contrasting therapeutic effects of cognitive-behavior therapy for older adults suffering from insomnia with short and long objective sleep duration. Sleep Med. 22, 4–12 (2016).
Majd, N. R. et al. Efficacy of a theory-based cognitive behavioral technique app-based intervention for patients with insomnia: Randomized controlled trial. J. Med. Internet Res. 22, 1–17 (2020).
Mimeault, V. & Morin, C. M. Self-help treatment for insomnia: Bibliotherapy with and without professional guidance. J. Consult. Clin. Psychol. 67, 511–519 (1999).
Morin, C. M., Kowatch, R., Barry, T. & Walton, E. Cognitive-behavior therapy for late-life insomnia. J. Consult. Clin. Psychol. 61, 137–146 (1993).
Ritterband, L. M. et al. Efficacy of an Internet-based behavioral intervention for adults with insomnia. Arch. Gen. Psychiatry 66, 692–698 (2009).
Ritterband, L. M. et al. Effect of a web-based cognitive behavior therapy for insomnia intervention with 1-year follow-up: A randomized clinical trial. JAMA Psychiat. 74, 68–75 (2017).
Sandlund, C., Hetta, J., Nilsson, G. H., Ekstedt, M. & Westman, J. Improving insomnia in primary care patients: A randomized controlled trial of nurse-led group treatment. Int. J. Nurs. Stud. 72, 30–41 (2017).
Sato, D., Yoshinaga, N., Nagai, E., Nagai, K. & Shimizu, E. Effectiveness of internet-delivered computerized cognitive behavioral therapy for patients with insomnia who remain symptomatic following pharmacotherapy: Randomized controlled exploratory trial. J. Med. Internet Res. 21, 1–12 (2019).
Strom, L., Pettersson, R. & Andersson, G. Internet-based treatment for insomnia: A controlled evaluation. J. Consult. Clin. Psychol. 72, 113–120 (2004).
Taylor, D. J. et al. A pilot randomized controlled trial of the effects of cognitive-behavioral therapy for insomnia on sleep and daytime functioning in college students. Behav. Ther. 45, 376–389 (2014).
Taylor, D. J. et al. Impact of cognitive behavioral therapy for insomnia disorder on sleep and comorbid symptoms in military personnel: A randomized clinical trial. Sleep 41, 1–11 (2018).
van der Zweerde, T. et al. Nurse-guided internet-delivered cognitive behavioral therapy for insomnia in general practice: Results from a pragmatic randomized clinical trial. Psychother. Psychosom. 89, 174–184 (2020).
van Straten, A. et al. Guided Internet-delivered cognitive behavioural treatment for insomnia: A randomized trial. Psychol. Med. 44, 1521–1532 (2014).
Vincent, N. & Lewycky, S. Logging on for better sleep: RCT of the effectiveness of online treatment for insomnia. Sleep 32, 807–815 (2009).
Wong, K.-Y., Chung, K.-F. & Au, C.-H. Low-intensity cognitive behavioral therapy for insomnia as the entry of the stepped-care model in the community: A randomized controlled trial. Behav. Sleep Med. 19, 378–394 (2021).
Page, M. J. et al. The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ 372, n71. https://doi.org/10.1136/bmj.n71 (2021).
Bastien, C. H., Vallières, A. & Morin, C. M. Validation of the insomnia severity index as an outcome measure for insomnia research. Sleep Med. 2, 297–307 (2001).
Spielman, A. J., Saskin, P. & Thorpy, M. J. Treatment of chronic insomnia by restriction of time in bed. Sleep 10, 45–56 (1987).
Espie, C. A. et al. The sleep condition indicator: A clinical screening tool to evaluate insomnia disorder. BMJ Open 4, e004183 (2014).
Soldatos, C. R., Dikeos, D. G. & Paparrigopoulos, T. J. Athens Insomnia Scale: Validation of an instrument based on ICD-10 criteria. J. Psychosom. Res. 48, 555–560 (2000).
Spoormaker, V. I., Verbeek, I., van den Bout, J. & Klip, E. C. Initial validation of the SLEEP-50 questionnaire. Behav. Sleep Med. 3, 227–246 (2005).
Mitchell, L. J., Bisdounis, L., Ballesio, A., Omlin, X. & Kyle, S. D. The impact of cognitive behavioural therapy for insomnia on objective sleep parameters: A meta-analysis and systematic review. Sleep Med. Rev. 47, 90–102 (2019).
Kyle, S. D. et al. Sleep restriction therapy for insomnia is associated with reduced objective total sleep time, increased daytime somnolence, and objectively impaired vigilance: Implications for the clinical management of insomnia disorder. Sleep 37, 229–237 (2014).
Crönlein, T. et al. Changes in subjective-objective sleep discrepancy following inpatient cognitive behavior therapy for insomnia. Behav. Ther. 50, 994–1001 (2019).
Ho, F. Y. Y., Chan, C. S., Lo, W.-Y. & Leung, J.C.-Y. The effect of self-help cognitive behavioral therapy for insomnia on depressive symptoms: An updated meta-analysis of randomized controlled trials. J. Affect. Disord. 265, 287–304 (2020).
Hasan, F. et al. Comparative efficacy of digital cognitive behavioral therapy for insomnia: A systematic review and network meta-analysis. Sleep Med. Rev. 61, 101567 (2021).
Kyle, S. D. et al. The effects of digital cognitive behavioral therapy for insomnia on cognitive function: A randomized controlled trial. Sleep 43, 1–12 (2020).
Musiat, P., Johnson, C., Atkinson, M., Wilksch, S. & Wade, T. Impact of guidance on intervention adherence in computerised interventions for mental health problems: A meta-analysis. Psychol. Med. 52, 229–240 (2022).
Shim, M., Mahaffey, B., Bleidistel, M. & Gonzalez, A. A scoping review of human-support factors in the context of Internet-based psychological interventions (IPIs) for depression and anxiety disorders. Clin. Psychol. Rev. 57, 129–140 (2017).
Horsch, C., Lancee, J., Beun, R. J., Neerincx, M. A. & Brinkman, W. P. Adherence to technology-mediated insomnia treatment: A meta-analysis, interviews, and focus groups. J. Med. Internet Res. 17, e214 (2015).
Baumel, A., Edan, S. & Kane, J. M. Is there a trial bias impacting user engagement with unguided e-mental health interventions? A systematic comparison of published reports and real-world usage of the same programs. Transl. Behav. Med. 9, 1020–1033 (2019).
Saleem, M. et al. Understanding engagement strategies in digital interventions for mental health promotion: Scoping review. JMIR Ment. Health 8, 1–17 (2021).
Condon, H. E., Maurer, L. F. & Kyle, S. D. Reporting of adverse events in cognitive behavioural therapy for insomnia: A systematic examination of randomised controlled trials. Sleep Med. Rev. 56, 101412 (2021).
Acknowledgements
We thank Corinna Heiser and Laura Buchheit for their support in the study selection and data extraction process.
Funding
Open Access funding enabled and organized by Projekt DEAL.
Author information
Authors and Affiliations
Contributions
L.Si. initiated the study. All authors developed the design of the study. L.Si. and L.St. conducted the systematic literature searches, extracted the data, and rated the risk of bias of included studies. B.F. and L.Si. conducted the data analysis. All authors have contributed to the further writing, and have approved the final manuscript.
Corresponding author
Ethics declarations
Competing interests
HB and KS are (principle) investigators of several third-party funded projects on e/m-health interventions, amongst others online-based interventions for insomnia. All other authors declare no conflict of interest.
Additional information
Publisher's note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Simon, L., Steinmetz, L., Feige, B. et al. Comparative efficacy of onsite, digital, and other settings for cognitive behavioral therapy for insomnia: a systematic review and network meta-analysis. Sci Rep 13, 1929 (2023). https://doi.org/10.1038/s41598-023-28853-0
Received:
Accepted:
Published:
DOI: https://doi.org/10.1038/s41598-023-28853-0
- Springer Nature Limited
This article is cited by
-
Evaluation and management of insomnia in the clinical practice in Italy: a 2023 update from the Insomnia Expert Consensus Group
Journal of Neurology (2024)
-
Efficacy of Remote Cognitive Behavioural Therapy for Insomnia in Improving Health Status of Patients with Insomnia Symptoms: A Meta-analysis
Cognitive Therapy and Research (2024)
-
Investigating non-inferiority of internet-delivered versus face-to-face cognitive behavioural therapy for insomnia (CBT-I): a randomised controlled trial (iSleep well)
Trials (2024)
-
Co-morbid Insomnia and Sleep Apnoea (COMISA): Latest Research from an Emerging Field
Current Sleep Medicine Reports (2023)