Abstract
GenerationPMTO is a theory- and evidence-based behavioral parenting program widely implemented in the past three decades. This systematic review and meta-analysis examined the effectiveness of twenty GenerationPMTO studies on parenting and child adjustment among 3893 families in six countries. Hedges’ g from studies with pretest–posttest-controlled designs were computed and robust variance estimation (RVE) was used to deal with the effect size dependency. Results showed that GenerationPMTO significantly promoted parenting and child adjustment with moderate to high levels of heterogeneity. Specifically, GenerationPMTO improved parental discipline, parenting monitoring, skill encouragement, child externalizing problems, and child internalizing problems. Subgroup analyses revealed several important moderators, including type of comparison group, measurement, informant, risk of bias, etc. Intervention effects were quite robust across countries and multiple demographic characteristics. No publication bias across studies for parenting and child adjustment was detected. The revised Cochrane risk of bias for randomized trials (RoB 2) procedure was used to assess risk of bias within the included studies. Some studies showed a higher level of risk due to problems with the randomization process, missing data, low measurement quality, and reporting bias. Due to lack of data, we did not examine intervention effects on parental mental health or couple relationship quality. Future studies should test mediation models to understand the mechanisms of change and to identify moderators in order to understand the high levels of heterogeneity in GenerationPMTO studies.
Similar content being viewed by others
Data Availability
All materials including the template data collection form, codebook, a clean dataset used for all analyses, and analytic code in RStudio are available in an Open Science Framework (OSF) repository: https://osf.io/p8ty5/?view_only=9627eef9ba1e4de997f1ea713e4cee2c.
References
Articles included in the meta-analysis are marked with *
American Psychiatric Association. (2013). Disruptive, impulse-control, and conduct disorders. In Diagnostic and statistical manual of mental disorders (5th ed.). https://doi.org/10.1176/appi.books.9780890425596.
*Akin, B. A., Lang, K., McDonald, T. P., Yan, Y., & Little, T. (2018a). Randomized study of PMTO in foster care: Six-month parent outcomes. Research on Social Work Practice, 28(7), 810–826. https://doi.org/10.1177/1049731517703746
*Akin, B. A., Lang, K., Yan, Y., & McDonald, T. P. (2018b). Randomized trial of PMTO in foster care: 12-month child well-being, parenting, and caregiver functioning outcomes. Children and Youth Services Review, 95, 49–63. https://doi.org/10.1016/j.childyouth.2018.10.018
*Akin, B. A., Lang, K., McDonald, T. P., Yan, Y., & Little, T. (2019). Randomized trial of PMTO in foster care: Six-month child well-being outcomes. Research on Social Work Practice, 29(2), 206–222. https://doi.org/10.1177/1049731516669822
Barlow, J., & Coren, E. (2018). The effectiveness of parenting programs: A review of Campbell reviews. Research on Social Work Practice, 28(1), 99–102. https://doi.org/10.1177/1049731517725184
*Bjørknes, R., & Manger, T. (2013). Can parent training alter parent practice and reduce conduct problems in ethnic minority children? A randomized controlled trial. Prevention Science, 14(1), 52–63. https://doi.org/10.1007/s11121-012-0299-9
Birdsong, D., & Molis, M. (2001). On the evidence for maturational constraints in second-language acquisition. Journal of Memory and Language, 44(2), 235–249. https://doi.org/10.1006/jmla.2000.2750
*Bjørknes, R., Kjøbli, J., Manger, T., & Jakobsen, R. (2012). Parent training among ethnic minorities: Parenting practices as mediators of change in child conduct problems. Family Relations, 61(1), 101–114. https://doi.org/10.1111/j.1741-3729.2011.00683.x
Buchanan-Pascall, S., Gray, K. M., Gordon, M., & Melvin, G. A. (2018). Systematic review and meta-analysis of parent group interventions for primary school children aged 4–12 years with externalizing and/or internalizing problems. Child Psychiatry & Human Development, 49(2), 244–267. https://doi.org/10.1007/s10578-017-0745-9
*Buenabad, N. G. A., Ramos, R. S., Schwartz, S., López, M. L. G., Juárez, A. D. D., Gallegos, A. B. O., et al. (2020). Cluster randomized trial of a multicomponent school-based program in Mexico to prevent behavioral problems and develop social skills in children. Child & Youth Care Forum, 49(3), 343–364. https://doi.org/10.1007/s10566-019-09535-3
*Bullard, L., Wachlarowicz, M., DeLeeuw, J., Snyder, J., Low, S., Forgatch, M., & DeGarmo, D. (2010). Effects of the Oregon model of parent management training (PMTO) on marital adjustment in new stepfamilies: A randomized trial. Journal of Family Psychology, 24(4), 485. https://doi.org/10.1037/a0020267
*Chesmore, A. A., Piehler, T. F., & Gewirtz, A. H. (2018). PTSD as a moderator of a parenting intervention for military families. Journal of Family Psychology, 32(1), 123. https://doi.org/10.1037/fam0000366
*Cioffi, C. C., DeGarmo, D. S., & Jones, J. A. (2021). Participation in the fathering through change intervention reduces substance use among divorced and separated fathers. Journal of Substance Abuse Treatment, 120, 108142. https://doi.org/10.1016/j.jsat.2020.108142
*DeGarmo, D. S., & Forgatch, M. S. (2007). Efficacy of parent training for stepfathers: From playful spectator and polite stranger to effective stepfathering. Parenting: Science and Practice, 7(4), 331–355. https://doi.org/10.1080/15295190701665631
DeGarmo, D. S., & Gewirtz, A. H. (2018). A recovery capital and stress-buffering model for post-deployed military parents. Frontiers in Psychology, 9, 1832. https://doi.org/10.3389/fpsyg.2018.01832
Deković, M., Asscher, J. J., Hermanns, J., Reitz, E., Prinzie, P., & Van Den Akker, A. L. (2010). Tracing changes in families who participated in the home-start parenting program: Parental sense of competence as mechanism of change. Prevention Science, 11(3), 263–274. https://doi.org/10.1007/s11121-009-0166-5
Feinberg, M. E. (2020). Designing evidence-based public health and prevention programs: Expert program developers explain the science and art. Routledge.
Fernandez, M. A., & Eyberg, S. M. (2009). Predicting treatment and follow-up attrition in parent-child interaction therapy. Journal of Abnormal Child Psychology, 37(3), 431–441. https://doi.org/10.1007/s10802-008-9281-1
*Forgatch, M. S., & DeGarmo, D. S. (1999). Parenting through change: An effective prevention program for single mothers. Journal of Consulting and Clinical Psychology, 67(5), 711–724. https://doi.org/10.1037//0022-006x.67.5.711
Forgatch, M. S., & Gewirtz, A. H. (2017). The evolution of the Oregon model of parent management training. Evidence-Based Psychotherapies for Children and Adolescents, 3, 85–102.
Forgatch, M. S., & Patterson, G. R. (2010). Parent management training—Oregon model: An intervention for antisocial behavior in children and adolescents. In J. R. Weisz & A. E. Kazdin (Eds.), Evidence-based psychotherapies for children and adolescents (pp. 159–177). The Guilford Press.
*Forgatch, M. S., DeGarmo, D. S., & Beldavs, Z. G. (2005). An efficacious theory-based intervention for stepfamilies. Behavior Therapy, 36(4), 357–365. https://doi.org/10.1016/S0005-7894(05)80117-0
*Forgatch, M. S., Patterson, G. R., Degarmo, D. S., & Beldavs, Z. G. (2009). Testing the Oregon delinquency model with 9-year follow-up of the Oregon divorce study. Development and Psychopathology, 21(2), 637–660. https://doi.org/10.1017/S0954579409000340
Forgatch, M. S., Snyder, J. J., Patterson, G. R., Pauldine, M. R., Chaw, Y., Elish, K., Harris, J. B., & Richardson, E. B. (2016). Resurrecting the chimera: Progressions in parenting and peer processes. Development and Psychopathology, 28(3), 689–706. https://doi.org/10.1017/S0954579416000250
*Fossum, S., Kjøbli, J., Drugli, M. B., Handegård, B. H., Mørch, W. T., & Ogden, T. (2014). Comparing two evidence-based parent training interventions for aggressive children. Journal of Children’s Services, 9(4), 319–329. https://doi.org/10.1108/JCS-04-2014-0021
Gardner, F., Montgomery, P., & Knerr, W. (2016). Transporting evidence-based parenting programs for child problem behavior (age 3–10) between countries: Systematic review and meta-analysis. Journal of Clinical Child & Adolescent Psychology, 45(6), 749–762. https://doi.org/10.1080/15374416.2015.1015134
Gewirtz, A. (2020). Comparing web, group and telehealth formats of a military parenting program. Regents of the University of Minnesota. Retrieved from https://apps.dtic.mil/sti/citations/AD1123821.
Gewirtz, A. H., Erbes, C. R., Polusny, M. A., Forgatch, M. S., & DeGarmo, D. S. (2011). Helping military families through the deployment process: Strategies to support parenting. Professional Psychology: Research and Practice, 42(1), 56–62. https://doi.org/10.1037/a0022345
Gewirtz, A. H., DeGarmo, D. S., & Zamir, O. (2016). Effects of a military parenting program on parental distress and suicidal ideation: After deployment adaptive parenting tools. Suicide and Life-Threatening Behavior, 46, S23–S31. https://doi.org/10.1111/sltb.12255
*Gewirtz, A. H., DeGarmo, D. S., & Zamir, O. (2018). After deployment, adaptive parenting tools: 1-year outcomes of an evidence-based parenting program for military families following deployment. Prevention Science, 19(4), 589–599. https://doi.org/10.1007/s11121-017-0839-4
*Gewirtz, A. H., Lee, S. S., August, G. J., & He, Y. (2019). Does giving parents their choice of interventions for child behavior problems improve child outcomes? Prevention Science, 20(1), 78–88. https://doi.org/10.1007/s11121-018-0865-x
*Gewirtz, A. H., Snyder, J., Zamir, O., Zhang, J., & Zhang, N. (2019). Effects of the after deployment: Adaptive parenting tools (ADAPT) intervention on fathers and their children: A moderated mediation model. Development and Psychopathology, 31(5), 1837–1849. https://doi.org/10.1017/S0954579419001238
*Hagen, K. A., Ogden, T., & Bjørnebekk, G. (2011). Treatment outcomes and mediators of parent management training: A one-year follow-up of children with conduct problems. Journal of Clinical Child & Adolescent Psychology, 40(2), 165–178. https://doi.org/10.1080/15374416.2011.546050
*He, Y. (2016). Which treatment do parents prefer?: A randomized preference trial to inform personalization of a parent training program. [Doctoral Dissertation, University of Minnesota].
*He, Y., Gewirtz, A. H., Lee, S., & August, G. (2018). Do parent preferences for child conduct problem interventions impact parenting outcomes? A pilot study in community children’s mental health settings. Journal of Marital and Family Therapy, 44(4), 716–729. https://doi.org/10.1111/jmft.12310
Higgins, J. P., Altman, D. G., Gøtzsche, P. C., Jüni, P., Moher, D., Oxman, A. D., et al. (2011). The Cochrane collaboration’s tool for assessing risk of bias in randomised trials. The BMJ, 343, D5928. https://doi.org/10.1136/bmj.d5928
Holtrop, K., Parra-Cardona, J. R., & Forgatch, M. S. (2014). Examining the process of change in an evidence-based parent training intervention: A qualitative study grounded in the experiences of participants. Prevention Science, 15(5), 745–756. https://doi.org/10.1007/s11121-013-0401-y
*Kjøbli, J., & Ogden, T. (2012). A randomized effectiveness trial of brief parent training in primary care settings. Prevention Science, 13(6), 616–626. https://doi.org/10.1007/s11121-012-0289-y
*Kjøbli, J., Hukkelberg, S., & Ogden, T. (2013). A randomized trial of group parent training: Reducing child conduct problems in real-world settings. Behaviour Research and Therapy, 51(3), 113–121.
*Kjøbli, J., Zachrisson, H. D., & Bjørnebekk, G. (2018). Three randomized effectiveness trials—one question: Can callous-unemotional traits in children be altered? Journal of Clinical Child & Adolescent Psychology, 47(3), 436–443. https://doi.org/10.1080/15374416.2016.1178123
Leijten, P., Dishion, T. J., Thomaes, S., Raaijmakers, M. A. J., Orobio de Castro, B., & Matthys, W. (2015). Bringing parenting interventions back to the future: How randomized microtrials may benefit parenting intervention efficacy. Clinical Psychology: Science and Practice, 22(1), 47–57. https://doi.org/10.1111/cpsp.12087
Leijten, P., Gardner, F., Landau, S., Harris, V., Mann, J., Hutchings, J., Beecham, J., Bonin, E.-M., & Scott, S. (2018). Research review: Harnessing the power of individual participant data in a meta-analysis of the benefits and harms of the Incredible Years parenting program. Journal of Child Psychology and Psychiatry, 59(2), 99–109. https://doi.org/10.1111/jcpp.12781
*López-Zerón, G., Parra-Cardona, J. R., & Yeh, H. H. (2020). Addressing immigration-related stress in a culturally adapted parenting intervention for Mexican-origin immigrants: Initial positive effects and key areas of improvement. Family Process, 59(3), 1094–1112. https://doi.org/10.1111/famp.12481
*Maaskant, A. M., van Rooij, F. B., Overbeek, G. J., Oort, F. J., & Hermanns, J. M. (2016). Parent training in foster families with children with behavior problems: Follow-up results from a randomized controlled trial. Children and Youth Services Review, 70, 84–94. https://doi.org/10.1016/j.childyouth.2016.09.005
*Maaskant, A. M., van Rooij, F. B., Overbeek, G. J., Oort, F. J., Arntz, M., & Hermanns, J. M. (2017). Effects of PMTO in foster families with children with behavior problems: A randomized controlled trial. Journal of Child and Family Studies, 26(2), 523–539. https://doi.org/10.1007/s10826-016-0579-2
Menting, A. T., de Castro, B. O., & Matthys, W. (2013). Effectiveness of the Incredible Years parent training to modify disruptive and prosocial child behavior: A meta-analytic review. Clinical Psychology Review, 33(8), 901–913. https://doi.org/10.1016/j.cpr.2013.07.006
Morris, S. B. (2008). Estimating effect sizes from pretest-posttest-control group designs. Organizational Research Methods, 11(2), 364–386. https://doi.org/10.1177/1094428106291059
Muñoz, R. F., Mrazek, P. J., & Haggerty, R. J. (1996). Institute of medicine report on prevention of mental disorders: Summary and commentary. American Psychologist, 51(11), 1116–1122. https://doi.org/10.1037/0003-066X.51.11.1116
*Ogden, T., & Hagen, K. A. (2008). Treatment effectiveness of parent management training in Norway: A randomized controlled trial of children with conduct problems. Journal of Consulting and Clinical Psychology, 76(4), 607–621. https://doi.org/10.1037/0022-006X.76.4.607
Ouzzani, M., Hammady, H., Fedorowicz, Z., & Elmagarmid, A. (2016). Rayyan—a web and mobile app for systematic reviews. Systematic Reviews, 5(1), 1–10. https://doi.org/10.1186/s13643-016-0384-4
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., et al. (2021). The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. PLoS Medicine., 18(3), e1003583. https://doi.org/10.1371/journal.pmed.1003583
*Parra-Cardona, J. R., Bybee, D., Sullivan, C. M., Rodríguez, M. M. D., Tams, L., & Bernal, G. (2017). Examining the impact of differential cultural adaptation with Latina/o immigrants exposed to adapted parent training interventions. Journal of Consulting and Clinical Psychology, 85(1), 58. https://doi.org/10.1037/0022-006X.76.4.607
Patterson, G. R. (1982). Coercive family process (Vol. 3). Castalia Publishing Company.
Patterson, G. R. (2005). The next generation of PMTO models. The Behavior Therapist, 28(2), 25–32.
Patterson, G. R. (2016). Coercion theory: The study of change. In The Oxford handbook of coercive relationship dynamics (pp. 7–22).
Patterson, G. R., & Reid, J. B. (1984). Social interactional processes within the family: The study of the moment-by-moment family transactions in which human social development is imbedded. Journal of Applied Developmental Psychology, 5(3), 237–262.
Patterson, G., Forgatch, M., & DeGarmo, D. (2010). Cascading effects following intervention. Development and Psychopathology, 22(4), 949–970. https://doi.org/10.1017/S0954579410000568
*Piehler, T. F., Ausherbauer, K., Gewirtz, A., & Gliske, K. (2018). Improving child peer adjustment in military families through parent training: The mediational role of parental locus of control. The Journal of Early Adolescence, 38(9), 1322–1343. https://doi.org/10.1177/0272431616678990
*Reed, A., Snyder, J., Staats, S., Forgatch, M. S., DeGarmo, D. S., Patterson, G. R., Low, S., Sinclair, R., & Schmidt, N. (2013). Duration and mutual entrainment of changes in parenting practices engendered by behavioral parent training targeting recently separated mothers. Journal of Family Psychology, 27(3), 343–354. https://doi.org/10.1037/a0032887
Sanders, M. R. (2012). Development, evaluation, and multinational dissemination of the triple P-positive parenting program. Annual Review of Clinical Psychology, 8(1), 345–379. https://doi.org/10.1146/annurev-clinpsy-032511-143104
Sanders, M. R., Kirby, J. N., Tellegen, C. L., & Day, J. J. (2014). The triple P-positive parenting program: A systematic review and meta-analysis of a multi-level system of parenting support. Clinical Psychology Review, 34(4), 337–357. https://doi.org/10.1016/j.cpr.2014.04.003
*Scavenius, C., Chacko, A., Lindberg, M. R., Granski, M., Vardanian, M. M., Pontoppidan, M., Hansen, H., & Eiberg, M. (2020). Parent management training Oregon model and family-based services as usual for behavioral problems in youth: A national randomized controlled trial in Denmark. Child Psychiatry & Human Development, 51(5), 839–852. https://doi.org/10.1007/s10578-020-01028-y
*Sigmarsdóttir, M., Degarmo, D. S., Forgatch, M. S., & Guðmundsdóttir, E. V. (2013). Treatment effectiveness of PMTO for children’s behavior problems in Iceland: Assessing parenting practices in a randomized controlled trial. Scandinavian Journal of Psychology, 54(6), 468–476. https://doi.org/10.1111/sjop.12078
*Sigmarsdóttir, M., Thorlacius, Ö., Guðmundsdóttir, E. V., & DeGarmo, D. S. (2015). Treatment effectiveness of PMTO for children’s behavior problems in Iceland: Child outcomes in a nationwide randomized controlled trial. Family Process, 54(3), 498–517. https://doi.org/10.1111/famp.12109
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H. Y., Corbett, M. S., Eldridge, S. M., Emberson, J. R., Hernán, M. A., Hopewell, S., Hróbjartsson, A., Junqueira, D. R., Jüni, P., Kirkham, J. J., Lasserson, T., Li, T., et al. (2019). RoB 2: A revised tool for assessing risk of bias in randomised trials. The BMJ, 366, I4898. https://doi.org/10.1136/bmj.l4898
*Thijssen, J., Vink, G., Muris, P., & de Ruiter, C. (2017). The effectiveness of parent management training—Oregon model in clinically referred children with externalizing behavior problems in The Netherlands. Child Psychiatry & Human Development, 48(1), 136–150. https://doi.org/10.1007/s10578-016-0660-5
*Tømmerås, T., & Kjøbli, J. (2017). Family resources and effects on child behavior problem interventions: A cumulative risk approach. Journal of Child and Family Studies, 26(10), 2936–2947. https://doi.org/10.1007/s10826-017-0777-6
Tømmerås, T., Kjøbli, J., & Forgatch, M. (2018). Benefits of child behavior interventions for parent well-being. Family Relations, 67(5), 644–659. https://doi.org/10.1111/fare.12344
Viechtbauer, W. (2010). Conducting meta-analyses in R with the metafor package. Journal of Statistical Software, 36(3), 1–48. https://doi.org/10.18637/jss.v036.i03
*Wachlarowicz, M., Snyder, J., Low, S., Forgatch, M., & DeGarmo, D. (2012). The moderating effects of parent antisocial characteristics on the effects of Parent Management Training-Oregon (PMTO™). Prevention Science, 13(3), 229–240. https://doi.org/10.1007/s11121-011-0262-1
Weber, L., Kamp-Becker, I., Christiansen, H., & Mingebach, T. (2019). Treatment of child externalizing behavior problems: A comprehensive review and meta–meta-analysis on effects of parent-based interventions on parental characteristics. European Child & Adolescent Psychiatry, 28(8), 1025–1036. https://doi.org/10.1007/s00787-018-1175-3
Webster-Stratton, C. (1999). How to promote children’s social and emotional competence. Sage.
Yap, M. B., Morgan, A. J., Cairns, K., Jorm, A. F., Hetrick, S. E., & Merry, S. (2016). Parents in prevention: A meta-analysis of randomized controlled trials of parenting interventions to prevent internalizing problems in children from birth to age 18. Clinical Psychology Review, 50, 138–158. https://doi.org/10.1016/j.cpr.2016.10.003
*Zhang, N., Zhang, J., Gewirtz, A. H., & Piehler, T. F. (2018). Improving parental emotion socialization in military families: Results of a randomized controlled trial. Journal of Family Psychology, 32(8), 1046–1056. https://doi.org/10.1037/fam0000461
*Zhang, N., Zhang, J., & Gewirtz, A. H. (2019). Do less mindful mothers show better parenting via improvements in trait mindfulness following a military parent training program? Frontiers in Psychology, 10, 909. https://doi.org/10.3389/fpsyg.2019.00909
Feingold, A. (2015). Confidence interval estimation for standardized effect sizes in multilevel and latent growth modeling. Journal of consulting and clinical psychology, 83(1), 157.
Institute of Medicine (1994), Reducing Risks for Mental Disorders: Frontiers for Preventive Intervention Research, National Academies, Washington, DC.
DeGarmo, D. S., & Jones, J. A. (2019). Fathering Through Change (FTC) intervention for single fathers: Preventing coercive parenting and child problem behaviors. Development and Psychopathology, 31(5), 1801-1811.
Sandler, I., Wolchik, S. A., Cruden, G., Mahrer, N. E., Ahn, S., Brincks, A., & Brown, C. H. (2014). Overview of meta-analyses of the prevention of mental health, substance use and conduct problems. Annual review of clinical psychology, 10, 243.
Sandler, I., Ingram, A., Wolchik, S., Tein, J. Y., & Winslow, E. (2015). Long‐term effects of parenting‐focused preventive interventions to promote resilience of children and adolescents. Child Development Perspectives, 9(3), 164–171.
Acknowledgements
We thank Dr. Neveen Ali Saleh Darawshy and Dr. Alyssa Pintar Breen for helping with the coding process.
Funding
The authors received no financial support for the research.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
Dr. Gewirtz is the principal investigator of interventions included here (ADAPT and ADAPT4U). Dr. Gewirtz did not extract or analyze data or perform risk of bias assessments in the review.
Registration and Protocol
This systematic review was registered in the international prospective register of systematic reviews, PROSPERO (ID: CRD42020155106) prior to literature search and data extraction. During the review process, several amendments were made and they can be found in the supplementary materials in the Open Science Framework (OSF) repository: https://osf.io/p8ty5/?view_only=9627eef9ba1e4de997f1ea713e4cee2c.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Cai, Q., Chan, A.C.Y., Lee, SK. et al. Effectiveness of GenerationPMTO to Promote Parenting and Child Adjustment: A Meta-Analytic Review. Clin Child Fam Psychol Rev 25, 702–719 (2022). https://doi.org/10.1007/s10567-022-00400-9
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10567-022-00400-9