Abstract
Our aim was to study enrollment and completion levels for the internet-based and telephone-assisted Finnish Strongest Families Smart Website (SFSW) parent training intervention, for parents of young children with disruptive behavior before and after the COVID-19 lockdown period. Population-based screening was carried out on 39,251 children during routine check- ups at 4 years of age. The parents of children scoring at least 5 on the Strengths and Difficulties Questionnaire were assessed against inclusion and exclusion criteria. Associations with enrollment or completion were analyzed using logistic regression models. The effects of COVID-19 restrictions on these were estimated using interrupted timeseries analysis. Of 39,251 families, 4894 screened positive and met the eligibility criteria. Of those, 3068 (62.6%) decided to enroll in the SFSW program and 2672 (87.1%) of those families completed it. The highest level of disruptive behavior (OR 1.33, 95% CI 1.12–1.57, p < 0.001) and overall severity of difficulties (OR 2.22, 95% CI 1.91–2.57, p < 0.001) were independently associated with enrollment. Higher parental education was associated with enrollment and completion. Higher paternal age was associated with enrollment, and parent depressive symptoms with non-completion. The SFSW enrollment did not significantly change following the COVID-19 restrictions, while the completion rate increased (COVID-19 completion OR 1.75, 95% CI 1.22–2.50, p = 0.002). Guided digital parenting interventions increase the sustainability of services, by addressing the child mental health treatment gap and ensuring service consistency during crisis situations.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
A significant proportion of children with mental health problems do not receive any mental health services. This gap between the high prevalence of mental health disorders and low treatment utilization has been recognized as a matter of worldwide concern. To address the treatment gaps, it is important that evidence-based interventions are implemented in real life settings [1]. Parenting interventions have demonstrated efficacy in addressing disruptive behavior problems in children [2,3,4,5]. However, there are barriers to implementing parental training in public health settings [6]. Barriers to successful implementation include high cost, poor access, inconvenience, and low treatment fidelity [7, 8].
Internet-assisted, remote interventions have emerged as a way to reduce treatment gaps, because they offer affordable, accessible, and feasible services, and address challenges related to treatment fidelity [9]. Internet-assisted parent training interventions are not only effective, but also flexible and can overcome typical barriers to treatment, such as travelling, cost and the availability of nearby services [4, 5, 7, 10]. Successful implementation of digital interventions is related to enrollment and completion of the program. However, there is a notable problem with participation in digital mental health interventions in the real world [11, 12].
There is a lack of large-scale studies that examine enrollment and completion rates during the implementation of digital parent training programs. However, studies conducted in other settings on factors associated with enrollment and completion in digital parenting interventions, may provide valuable insights. Findings indicate that initial parenting confidence, parental agreement, internet usage, and program format could predict program completion, while demographic and clinical variables often do not [13,14,15]. Collectively, such studies underscore the multifaceted nature of engagement in digital parenting interventions and the necessity of addressing these factors to optimize program outreach through understanding of what works for whom [13,14,15,16].
This paper focuses on the Finnish Strongest Families Smart Website (SFSW) parenting program [10, 17, 18], which has been implemented nationwide in the Finnish primary healthcare system. Four-year-old children are screened during the free child healthcare checkups that are offered to all parents. The target group for the intervention is the parents of those children with disruptive behaviors, such as temper tantrums, oppositional behavior and aggression. It has previously been reported that the SFSW program has a lasting and positive effect on decreasing child behavior problems during a randomized controlled trial and implementation studies [4, 5, 19, 20].
This study examined two distinct topics relating to overall participation in the implementation of SFSW: enrollment and completion. The first aim of the study was to examine program enrollment and completion rates. The enrollment rate was defined as the proportion of families who fulfilled the screening criteria for the targeted intervention, and chose to participate. The completion rate was defined as the proportion of families who completed the whole program. The second aim was to explore demographics, parenting styles, parent and child psychopathology and parent perceptions of the severity of the child’s problems associated with enrollment or completion. Finally, since during the COVID-19 pandemic interruptions occurred in other nationwide services [21], we tested if interruptions in enrollment and completion rates occurred in SFSW.
Methods
Intervention and implementation
The SFSW parenting intervention program is aimed at the parents of 4-year-old children with disruptive behavior difficulties [10]. Parents are provided with a password-controlled interactive website that provides them with a series of e-learning modules with psychoeducative reading material, audio and video examples and home assignments, and they also receive weekly calls from a trained coach [17]. The coaches are health care professionals with special training for this intervention, including education about conduct problems, parent training and digital interventions. The coaches attended weekly group case conferences led by a coach supervisor, made self-assessments after each call and got regular feedback from their supervisor.
The program is designed to teach the parents the skills that they can use to cope with difficult situations in their everyday lives and to form a close relationship with their child. The need to practice these techniques with their child between sessions and the ongoing objectives are individually tailored to the parent and child during the weekly coaching calls. The SFSW program is based on positive parenting, social learning theory and cognitive behavioral therapy and consists of 10 weekly sessions. It includes seven weeks of basic skills covering positive, active, and self-controlled parenting and three weeks on enhancing and generalizing skills. There is an optional 11th booster session after the program has been completed. Mean duration of weekly calls was 37.3 (SD 11.0) minutes and mean duration of weekly website access was 45.3 (SD 19.3) minutes, respectively. The average total duration of the program is therefore 13.8 (SD 4.3) hours. Details of the weekly session are shown in Table S1.
By summer 2021, the SFSW program had been implemented in 99/309 (32%) of the Finnish municipalities and that was the end point chosen for this study. We included all families who were invited to take part in the program from the start of its implementation on January 1, 2015 until June 30, 2021. This ensured that every participant included in this report would have either rejected the invitation to take part, completed the program or not completed the program. The implementation of the program included constant collaboration with respected referral systems and ongoing training for local public health nurses who took care of screening procedures at local child health clinics.
Screening was conducted at the standard 4-year-old healthcare checkup by trained nurses using the conduct problems subscale of the Strengths and Difficulties Questionnaire (SDQ). The parents were also sent a questionnaire asking for demographic information one month before the scheduled checkup and asked to bring the questionnaire to the checkup appointment. The questionnaires were then sent to the research center, along with the SDQ screening results [17].
The inclusion criteria for being invited to take part in the SFSW were two-fold. The first was a score of 5 or higher on the SDQ Conduct Scale, which corresponded to an 80th percentile cut-off point. The second was that the parents reported that the child has at least minor difficulties, based on the SDQ supplementary item that asked about the severity of the overall problems. Our exclusion criteria were that the child was not able to speak in full sentences and that at least one parent was taking part in another intervention. We also excluded children who met the diagnostic criteria for autism or pervasive development disorder, Down syndrome, fetal alcohol syndrome, mental retardation, or a genetic diagnosis that would lead to mental retardation.
The recruitment and enrollment process started at the child health center. The nurses encouraged the parents to participate in the program if the SDQ screening process was positive. If the child met the SDQ inclusion criteria, the parents received a phone call from SFSW recruitment staff, who confirmed that the exclusion criteria did not apply. They then introduced the parents to the SFSW. Confirmed enrollment was defined as when the family was deemed eligible and provided their formal consent on the intervention website. The intervention started with an introductory call to the parents by a coach.
Our key priorities included engagement and completion. To improve engagement, reminders were sent to parents who stopped interacting with their individual learning program. This started with an automated message and was followed up by a phone call from the coach within a week if the parents remained inactive. The weekly coaching phone calls were scheduled when the parents had free time and were most receptive to the program content. During these calls the coaches provided constant positive feedback about the parents’ use of skills in order to keep them focused and motivated. This also emphasized the importance of parents providing positive feedback to their children. The parents needed to continue with the individual learning on the website to receive the coaching calls.
Measures and variables
The primary outcomes were enrollment to the program and program completion. We also included questions about demographics, parent reports of child psychopathology and perceived difficulties, parent psychopathology, and parenting styles.
Enrollment was defined as accepting the invitation to take part in the intervention after an introductory phone call from a member of the research team. Families that enrolled in the intervention and completed at least 10 weekly sessions were defined as completers. The 11th session was an optional booster call after the program ended to discuss how the goals of the program had been achieved, and that is why it was not a criterion for completion.
Three subscales of the validated Finnish version of the SDQ [22] were used to assess child psychopathology: conduct problems, emotional symptoms, and hyperactivity/inattention. Each subscale was measured by 5 distinct items, with three possible responses the caregiver is using to describe the child’s behavior: not true, somewhat true, and certainly true (minimum score for each subscale was 0 and maximum score 10). The conduct problem scale was categorized into three groups (scoring 5, 6–7 and above 7). These represented the 80th, 90th and 95th percentile cutoffs for the study sample, respectively. The emotional symptoms scale was dichotomized at the 90th percentile as 2 or less and 3 or more. The hyperactivity/inattention scale was similarly dichotomized at the 90th percentile as 6 or less and 7 or more. An item asking about the level of the child’s overall difficulties was also included in the SDQ supplement. It asked whether the children had overall difficulties in one or more of the following areas: emotions, concentration, behavior, or being able to get along with people. Our study used three reported categories: no, minor, and more severe difficulties. The SDQ supplement also asked how long the child’s difficulties had been present and these were categorized as less than 1 year vs. 1 year or more.
The 21-item Depression Anxiety Stress Scale (DASS-21) [23] was used to measure parental depression, anxiety and stress. Each of the three DASS-21 subscales, depression, anxiety, and stress, has seven items. Each item has four possible responses ranging from “does not apply to me at all” to “apply to me very much or most of the time” (minimum score for each subscale is 0 and maximum score is 42).
The 30-item Parenting Scale (PS), revised by Rhoades & O’Leary [24] and used in previous Strongest Families studies [10] measuring parenting styles was used. PS has three subscales: laxness and over-reactivity each consist of five items and hostility that consists of three items. Each item is rated using a 7-point scale, covering the spectrum between two opposites (minimum score for each subscale is 1 and maximum score is 7).
We felt it was important to take account of the national COVID-19 restrictions in Finland. To do this, we created separate dummy variables appointing indicating times: before the national pandemic lockdown on March 16 2020, and during the restrictions from that date until June 30 2021. Lastly, the monthly count for families enrolling into the program was used to see if there were any sudden changes in the numbers enrolling in the program.
Statistical analysis
Logistic regression analyses were conducted to analyze enrollment and completion odds. We analyzed which explanatory variables increase the odds of enrollment and completion separately. Univariate logistic regressions were performed and all significant variables (p-value < 0.05) were included in the multivariate logistic regressions. All multivariate models were adjusted for the child’s sex.
The effects of the COVID-19 pandemic restrictions on enrollment rates were inspected with an interrupted time series analysis [25]. We fitted linear time trends into the time series regressions and included the separate dummy variable outlined above to represent Finnish COVID-19 restrictions after March 16, 2020. Step change models were fitted [25] to inspect if there was a change in enrollment. In addition, we included calendar month as a categorical predictor in the models to adjust for seasonal effects [25]. We also inspected if there was a drop in the number of parental interventions that started in 2020 or from January to June 2021 to see if there was any possible higher selection bias at any point.
All continuous variables were standardized to 0 mean and unit variance. Odds-Ratios (OR), 95% CI and p-value are reported for all analyses. Statistical analysis was conducted with R-software version 4.3.0 [26].
Results
The flow chart of screening, enrollment and completion is presented in Fig. 1. Altogether 39,251 children were screened for disruptive behavior and 4894 families (12.3%) met the eligibility criteria for the intervention.
Characteristics associated with child disruptive behaviors
Table 1 presents the demographic and child psychopathology variables of the families who fulfilled the criteria of having disruptive behavior when screened for the targeted parent training intervention. Multivariate analyses that included demographic variables showed that being screened positive was independently associated with the child being male rather than female (OR 1.62, 95% CI 1.52–1.73, p < 0.001) and living in another household structure that did not include both biological parents (OR 1.36, 95% CI 1.23–1.50, p < 0.001). Mothers’ age of 35 years or above was associated with a smaller chance of being screen positive in comparison to 25–35 years of age (OR 0.91, 95% CI 0.84–0.98, p = 0.014). Lower paternal education was associated with being screened positive but this did not remain significant when the data were controlled with other variables in the multivariate analyzes.
Psychopathology variables were not included in the multivariate analysis, as child disruptive behavior was part of screening criteria. All psychopathology measures were strongly associated with being screened positive in the univariate analyzes.
Characteristics associated with enrollment
The percentage of families who were invited to take part and actually enrolled in the program was 62.7% (95% CI 62.7–64.1%). As shown in Table 2 multivariate analyzes, enrollment was associated with the highest level (> 95th percentile cutoff point) of child’s disruptive behavior (OR 1.33, 95% CI 1.12–1.57, p < 0.001), major severe difficulties (OR 2.22, 95% CI 1.91–2.57, p < 0.001) and long- term difficulties (OR 1.31, 95% CI 1.14–1.51, p < 0.001). Comorbid emotional problems (> 90th percentile cutoff point) were also associated with enrollment (OR 1.25, 95% CI 1.07–1.46, p = 0.006). The results remained the same when child psychopathology measures were analyzed as continuous variables (Table S2). However, lower maternal and paternal education were associated with non-enrollment, as shown in Table 2. Younger paternal age was associated with non-enrollment.
Characteristics associated with completion
Of those who enrolled, 87.1% (95% CI 85.9–88.3%) completed the whole program, and 89.1% (95% CI 88.0–90.2%) completed all of the seven basic skills training sessions. Families who did not complete the intervention had a median of three training sessions (mean 3.5, standard deviation 2.6).
As shown in Table 3, child psychopathology was not associated with program completion. Parents with depressive symptoms were less likely to have completed the program (OR 0.83, 95% CI 0.72–0.97). Lower maternal and paternal education were independently associated with non-completion. More than 80% of the parents with vocational or high school education completed the program. Among parents who had completed only the obligatory 9 years of schooling, 64.9% of mothers and 77.1% of fathers finished the program.
The impact of COVID-19 restrictions on enrollment and completion
Program enrollment and completion rates based on pre- and during-COVID-19 restrictions time are presented in Fig. 2. There was no statistically significant step-change in the enrollment rate at the onset of COVID-19 restrictions (OR for enrollment: 0.95, 95% CI 0.78–1.16, p = 0.60), although a linear increase over time in enrollment was estimated (OR for enrollment per year: 1.08, 95% CI 1.02–1.12, p = 0.005). However, for completing the program, a statistically significant increase in completion rate was estimated at the onset of COVID-19 restrictions (OR for completion step-change: 1.75, 95% CI 1.22–2.50, p = 0.002); the linear underlying trend for completion was not statistically significant (OR 0.93, 95% CI 0.85–1.02, p = 0.15); (Table S3).
Discussion
This study reported key elements in the transition from evidence-based psychosocial interventions to implementation in real-world clinical practice. Our study findings provide important guidance for organizations and stakeholders planning early, population-based interventions for preschool children who face a high risk of later adversities.
The SFSW program is unique because it is based on screening children from the general population during routine primary health checkups at 4 years of age. Children who screened positive were more likely to be males, did not live in households with both of their biological parents and had less educated fathers. They also had more severe and comorbid psychopathology. These findings were in line with previous research about risk factors associated with disruptive behavior and comorbidity [27].
The program enrollment rate was 62.7% and completion rate was 87.1%. The enrollment rate of the parents of children with the highest level of disruptive behavior was 71.4%. These findings suggest that the SFSW implementation may reach children with the highest risk for developing adversities later in development [28, 29]. We are not aware of studies presenting enrollment and completion rates of a similar program under nationwide implementation. However, we could examine our metrics in relation to resembling programs that were examined under trial settings. A systematic review examining enrollment data across more than 50 studies of behavioral parent training programs report enrollment rates that are not higher than 75% [30]. While these rates are lower than the one we reported in this paper, we note that it is difficult to make such comparisons as enrollment in a study is influenced by factors related to the trial being conducted. In terms of completion rates, different studies examining the usage of digital parent training programs report a mean percentage of completed sessions around 70% [7, 31]. Therefore, the 87% completion rate shown in the present study can be considered exceptionally high.
Lower parental education and younger paternal age were associated with not enrolling in the program, while lower parental education and parental psychopathology were associated with not completing it. Additionally, parental depression independently lowered completion rates, in line with previous research [32, 33]. Our study found that more parents with vocational or high school education completed the program than those who had only completed the obligatory 9 years of school education. Other studies have found that parents with lower education levels were associated with a higher probability of non-participation [30, 34].
The present study covered the implementation of the program before and during part of the COVD-19 pandemic. There is a need for society to learn how mental health support systems work during crises [35]. Our results indicate that program enrollment or completion did not decrease during the pandemic. In fact, the completion rate increased at the start of the Finnish COVID-19 restrictions. Our findings support the assumption that remote, digitally-based interventions that have already been implemented may be able to increase the sustainability of services during crises.
The high enrollment and completion rates were probably due to the complementary components of the program, namely the phone coaching, psychoeducational Internet-based material and the accessible and convenient remote delivery of the intervention. The context of the program was well-defined, including the clear definition of the target population and the well-defined inclusion and exclusion criteria. The program also had a clear structure, including the description of the core components, which was practiced through modelling, practice, feedback, and support. Fidelity to the intervention was ensured by the implementation phase, the way the program was conducted, and the telephone coaching was centralized and supervised, and the systematic quality assurance provided by the digital platform. The well-trained coaches received constant support and feedback and formed good relationships with the parents [17], which is central to the success of any intervention [36]. The remote delivery of the program was much easier for the parents than face-to-face interventions, because they did not need to leave home or work or make childcare arrangements. These benefits were particularly evident during the COVID-19 restrictions. It is likely that all these factors motivated the parents to complete the intervention.
It has previously been emphasized that a solid framework and a structured implementation plan are needed for the successful transition from evidence-based psychosocial interventions to real-world clinical practice [37]. We systematically followed a structured plan during the implementation process [17]. The SFSW program contained core implementation drivers that facilitated the process when the intervention was implemented in the primary healthcare settings. In addition, the program was effectively administered by holding regular meetings with the directors of child and family services and providing them with user-friendly reports. Media coverage also raised awareness of the program, which made it easier to recruit families and increased the perceived value of the program [17]. We believe that this is one explanation for the rising trend in the enrollment rate. In fact, all of these implementation components probably played a crucial role in enrolling parents in the program.
Limitations
There were some limitations to our study. Only parental reports of child behavior were used in the analyses. It would have been helpful to validate these reports through direct observations of their parenting, clinical observations, or teacher ratings. Qualitative information from interviews with healthcare personnel and parents might have provided more information about the reasons for not enrolling in the program and not completing it. Unfortunately, we did not collect detailed information about reasons for non-enrollment or non-completion.
Conclusions
This study shows that the SFSW program resulted in high enrollment and completion rates. There is a huge worldwide need to provide parental training, and only a small proportion of those who need it actually receive evidence-based treatment for their children’s disruptive behavioral problems. Using Internet technology to move interventions outside traditional clinics and into people’s homes can provide better access to mental health services. Web-based interventions can also remove the barriers associated with face-to-face interventions. However, there is a challenge with getting parents with lower education levels or psychiatric morbidity to participate in such programs.
The enrollment and completion rates did not decrease during Finland’s COVID-19 restrictions. This emphasizes the importance of providing remote interventions to increase the sustainability of child mental health services during global crises, such as new pandemics, wars, and environmental catastrophes.
Data availability
No datasets were generated or analysed during the current study.
References
Kazdin AE (2017) Addressing the treatment gap: a key challenge for extending evidence-based psychosocial interventions. Behav Res Ther 88:7–18. https://doi.org/10.1016/j.brat.2016.06.004
Burkey MD, Hosein M, Morton I et al (2018) Psychosocial interventions for disruptive behaviour problems in children in low- and middle-income countries: a systematic review and meta-analysis. J Child Psychol Psychiatry 59:982–993. https://doi.org/10.1111/jcpp.12894
Dretzke J, Davenport C, Frew E et al (2009) The clinical effectiveness of different parenting programmes for children with conduct problems: a systematic review of randomised controlled trials. Child Adolesc Psychiatry Ment Health 3:7. https://doi.org/10.1186/1753-2000-3-7
Sourander A, McGrath PJ, Ristkari T et al (2016) Internet-assisted parent training intervention for disruptive behavior in 4-year-old children: a randomized clinical trial. JAMA Psychiat 73:378. https://doi.org/10.1001/jamapsychiatry.2015.3411
Sourander A, McGrath PJ, Ristkari T et al (2018) Two-year follow-up of internet and telephone assisted parent training for disruptive behavior at age 4. J Am Acad Child Adolesc Psychiatry 57:658-668.e1. https://doi.org/10.1016/j.jaac.2018.07.001
Weisenmuller C, Hilton D (2021) Barriers to access, implementation, and utilization of parenting interventions: considerations for research and clinical applications. Am Psychol 76:104–115. https://doi.org/10.1037/amp0000613
Baumel A, Pawar A, Kane JM, Correll CU (2016) Digital parent training for children with disruptive behaviors: systematic review and meta-analysis of randomized trials. J Child Adolesc Psychopharmacol 26:740–749. https://doi.org/10.1089/cap.2016.0048
Michelson D, Davenport C, Dretzke J et al (2013) Do evidence-based interventions work when tested in the “real world?” a systematic review and meta-analysis of parent management training for the treatment of child disruptive behavior. Clin Child Fam Psychol Rev 16:18–34. https://doi.org/10.1007/s10567-013-0128-0
Ebert DD, Van Daele T, Nordgreen T et al (2018) Internet- and mobile-based psychological interventions: applications, efficacy, and potential for improving mental health: a report of the EFPA E-health taskforce. Eur Psychol 23:167–187. https://doi.org/10.1027/1016-9040/a000318
McGrath PJ, Sourander A, Lingley-Pottie P et al (2013) Remote population-based intervention for disruptive behavior at age four: study protocol for a randomized trial of Internet-assisted parent training (Strongest Families Finland-Canada). BMC Public Health 13:985. https://doi.org/10.1186/1471-2458-13-985
Baumel A, Muench F, Edan S, Kane JM (2019) Objective user engagement with mental health apps: systematic search and panel-based usage analysis. J Med Internet Res 21:e14567. https://doi.org/10.2196/14567
Fleming T, Bavin L, Lucassen M et al (2018) Beyond the trial: systematic review of real-world uptake and engagement with digital self-help interventions for depression, low mood, or anxiety. J Med Internet Res 20:e199. https://doi.org/10.2196/jmir.9275
Baker S, Sanders MR (2017) Predictors of program use and child and parent outcomes of a brief online parenting intervention. Child Psychiatry Hum Dev 48:807–817. https://doi.org/10.1007/s10578-016-0706-8
Day JJ, Baker S, Dittman CK et al (2021) Predicting positive outcomes and successful completion in an online parenting program for parents of children with disruptive behavior: an integrated data analysis. Behav Res Ther 146:103951. https://doi.org/10.1016/j.brat.2021.103951
Engelbrektsson J, Salomonsson S, Högström J et al (2023) Is internet-based parent training for everyone? Predictors and moderators of outcomes in group vs. internet-based parent training for children with disruptive behavior problems. Behav Res Ther 171:104426. https://doi.org/10.1016/j.brat.2023.104426
Dadds MR, Sicouri G, Piotrowska PJ et al (2019) Keeping parents involved: predicting attrition in a self-directed, online program for childhood conduct problems. J Clin Child Adolesc Psychol 48:881–893. https://doi.org/10.1080/15374416.2018.1485109
Ristkari T, Kurki M, Suominen A et al (2019) Web-based parent training intervention with telephone coaching for disruptive behavior in 4-year-old children in real-world practice: implementation study. J Med Internet Res 21:e11446. https://doi.org/10.2196/11446
Ristkari T, Mishina K, Lehtola M et al (2020) Public health nurses’ experiences of assessing disruptive behaviour in children and supporting the use of an Internet-based parent training programme. Scand J Caring Sci 34:420–427. https://doi.org/10.1111/scs.12744
Sourander S, Sourander A, Hinkka-Yli-Salomäki S et al (2022) An internet-based parent training with telephone coaching on managing disruptive behavior in children at special family counseling centers during the COVID-19 pandemic: feasibility study. JMIR Pediatr Parent 5:e40614. https://doi.org/10.2196/40614
Sourander A, Ristkari T, Kurki M et al (2022) Effectiveness of an internet-based and telephone-assisted training for parents of 4-year-old children with disruptive behavior: implementation research. J Med Internet Res 24:e27900. https://doi.org/10.2196/27900
Wan Mohd Yunus WMA, Kauhanen L, Sourander A et al (2022) Registered psychiatric service use, self-harm and suicides of children and young people aged 0–24 before and during the COVID-19 pandemic: a systematic review. Child Adolesc Psychiatry Ment Health 16(1):15. https://doi.org/10.1186/s13034-022-00452-3
Borg A-M, Kaukonen P, Joukamaa M, Tamminen T (2014) Finnish norms for young children on the Strengths and Difficulties Questionnaire. Nord J Psychiatry 68:433–442. https://doi.org/10.3109/08039488.2013.853833
Henry JD, Crawford JR (2005) The short-form version of the Depression Anxiety Stress Scales (DASS-21): construct validity and normative data in a large non-clinical sample. Br J Clinic Psychol 44:227–239. https://doi.org/10.1348/014466505X29657
Rhoades KA, O’Leary SG (2007) Factor structure and validity of the parenting scale. J Clin Child Adolesc Psychol 36:137–146. https://doi.org/10.1080/15374410701274157
Bhaskaran K, Gasparrini A, Hajat S et al (2013) Time series regression studies in environmental epidemiology. Int J Epidemiol 42:1187–1195. https://doi.org/10.1093/ije/dyt092
(2023) R: A language and environment for statistical computing [Computer software]. Version 4.3.0. Vienna, Austria: R Core Team
Peverill M, Dirks MA, Narvaja T et al (2021) Socioeconomic status and child psychopathology in the United States: a meta-analysis of population-based studies. Clin Psychol Rev 83:101933. https://doi.org/10.1016/j.cpr.2020.101933
Bevilacqua L, Hale D, Barker ED, Viner R (2018) Conduct problems trajectories and psychosocial outcomes: a systematic review and meta-analysis. Eur Child Adolesc Psychiatry 27:1239–1260. https://doi.org/10.1007/s00787-017-1053-4
Sourander A, Jensen P, Davies M et al (2007) Who is at greatest risk of adverse long-term outcomes? The finnish from a boy to a man study. J Am Acad Child Adolesc Psychiatry 46:1148–1161. https://doi.org/10.1097/chi.0b013e31809861e9
Chacko A, Jensen SA, Lowry LS et al (2016) Engagement in behavioral parent training: review of the literature and implications for practice. Clin Child Fam Psychol Rev 19:204–215. https://doi.org/10.1007/s10567-016-0205-2
Day JJ, Sanders MR (2018) Do parents benefit from help when completing a self-guided parenting program online? A randomized controlled trial comparing Triple P Online with and without telephone support. Behav Ther 49:1020–1038
Gopalan G, Goldstein L, Klingenstein K et al (2010) Engaging families into child mental health treatment: updates and special considerations. J Can Acad Child Adolesc Psychiatry 19:182–196
Gross D, Belcher HME, Budhathoki C et al (2018) Does parent training format affect treatment engagement? A randomized study of families at social risk? J Child Fam Stud 27:1579–1593
Reyno SM, McGrath PJ (2006) Predictors of parent training efficacy for child externalizing behavior problems—a meta-analytic review. J Child Psychol Psychiatry 47:99–111. https://doi.org/10.1111/j.1469-7610.2005.01544.x
Fagherazzi G, Goetzinger C, Rashid MA et al (2020) Digital health strategies to fight COVID-19 worldwide: challenges, recommendations, and a call for papers. J Med Internet Res 22:e19284. https://doi.org/10.2196/19284
Flückiger C, Del Re AC, Wampold BE, Horvath AO (2018) The alliance in adult psychotherapy: a meta-analytic synthesis. Psychotherapy 55:316–340. https://doi.org/10.1037/pst0000172
Vis C, Mol M, Kleiboer A et al (2018) Improving implementation of eMental health for mood disorders in routine practice: systematic review of barriers and facilitating factors. JMIR Ment Health 5:e20. https://doi.org/10.2196/mental.9769
Funding
Open Access funding provided by University of Turku (including Turku University Central Hospital). This research was supported by the Research Council of Finland (decision number: 345546). This project has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (grant agreement No. 101020767) and by the Research Council of Finland (decision number: 345546).
Author information
Authors and Affiliations
Contributions
S.L. and A.S. wrote the initial draft of the manuscript. Statistical analyses were conducted by S.L., S.H-Y-S. A.S., T.R., M.Ki. and M.Ku conducted investigation. S.L. and S.H-Y-S prepared figures and tables. S.L., A.S. S.H-Y-S. and A.B. validated research data. All authors contributed to review & editing of the article.
Corresponding author
Ethics declarations
Conflict of interest
Dr. Sourander is the founder and director of Digifamilies, which provides evidence-based treatments to Finnish public health services. The authors declare no other conflicts of interest. All authors read and approved the final manuscript.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Lintula, S., Sourander, A., Hinkka-Yli-Salomäki, S. et al. Enrollment and completion rates of a nationwide guided digital parenting program for children with disruptive behavior before and during COVID-19. Eur Child Adolesc Psychiatry (2024). https://doi.org/10.1007/s00787-024-02523-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s00787-024-02523-6