Skip to main content

Advertisement

SpringerLink
Log in

The Role of Moderators and Mediators in Implementing and Evaluating Intellectual and Developmental Disabilities-Related Policies and Practices

  • REVIEW ARTICLE
  • Published:
Journal of Developmental and Physical Disabilities Aims and scope Submit manuscript

Abstract

This article describes a comprehensive framework for incorporating moderator and mediator variables in program logic models and theory development as a useful way to better implement and evaluate policies and practices in the field of intellectual and developmental disabilities related (IDD). Firstly, an overview of [program] logic models in the field of IDD is provided. Secondly, we present the role of moderator and mediator variables in program logics models. Thirdly, the role of moderators and mediators is explained in relation to outcomes through a systematic review in the Web of Science. Fourthly, a discussion about the role that moderator and mediator variables play in theory development is presented. Fifthly, a comprehensive framework for incorporating moderator and mediator variables into program logic models is proposed. This comprehensive framework involves testing specific relations between well-defined and operatized moderator and/or mediator variables that may influence and impacts policies and practices’ outcomes. When mediators and moderators are considered and included in program logic models, the effect of interventions, practices and policies can be better understood and therefore enhanced.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  • Arias, V. B., Gómez, L. E., Morán, L., Alcedo, M. A., Monsalve, A., & Fontanil, Y. (2018). Does quality of life differ for children with autism spectrum disorder and intellectual disability compared to children without autism? Journal of Autism and Developmental Disorders, 48(1), 123–136. https://doi.org/10.1007/s10803-017-3289-8.

    Article  PubMed  Google Scholar 

  • Baron, R. M., & Kenny, D. A. (1986). The moderator-mediator variable distinction in social psychological research: Conceptual, strategic and statistical considerations. Journal of Personality and Social Psychology, 51, 1173–1182. https://doi.org/10.1037/0022-3514.51.6.1173.

    Article  PubMed  Google Scholar 

  • Bollen, K. A. (1998). Structural equation models. New York: Wiley.

    Google Scholar 

  • Bortolotti, L. (2008). An introduction to the philosophy of science. Malden, MA: Polity.

    Google Scholar 

  • Bradley, J. (2013). When does a conceptual framework become a theory? Reflections from an accidental theorist. Evaluation and Program Planning, 38, 67–70.

    Article  Google Scholar 

  • Chen, H. T. (1990). Theory-driven evaluations. Newbury Park, California: Sage.

    Google Scholar 

  • Chen, H. T. (2004). Practical program evaluation: Assessing and improving planning, implementation, and effectiveness. Thousand Oaks, CA: Sage. https://doi.org/10.1177/1356389005055528.

  • Claes, C., van Hove, G., Vandervelde, S., van Loon, J., & Schalock, R. L. (2012). The influence of support strategies, environmental factors, and client characteristics on quality of life-related outcomes. Research in Developmental Disabilities, 33, 93–103. https://doi.org/10.1016/j.ridd.2011.08.024.

    Article  Google Scholar 

  • Claes, C., Ferket, N., Vandevelde, S., Verlet, D., & De Maeyer, J. (2017). Disability policy evaluation: Combining logic models and systems thinking. Intellectual and Developmental Disabilities, 55(4), 247–257. https://doi.org/10.1352/1934-9556-55.4.247.

    Article  PubMed  Google Scholar 

  • Cummins, R. A. (2005). Moving from the quality of life concept to a theory. Journal of Policy and Practice in Intellectual Disabilities, 49, 698–706. https://doi.org/10.1111/j.1365-2788.2005.00738.x.

    Article  Google Scholar 

  • Davies, R. (2004). Scale, complexity and the representation of theories of change. Special Issue: European Evaluation Society Conference, 10(1), 101–121.

    Google Scholar 

  • De Ruysscher, C., Claes, C., Lee, T., Cui, F., van Loon, J., De Maeyer, J., & Schalock, R. L. (2017). A systems approach to social entrepreneurship. Voluntas, 28(6), 2530–2545. https://doi.org/10.1007/s11266-016-9704-5.

    Article  Google Scholar 

  • Donaldson, S. I. (2007). Program theory-driven evaluation science. New York: Lawrence Erlbaum Associates.

    Book  Google Scholar 

  • Farmer, C. (2012). Demystifying moderators and mediators in intellectual developmental disabilities research: A primer and review of the literature. Journal of Intellectual Disability Research, 56, 1148–1160.

    Article  PubMed  Google Scholar 

  • Felce, D., & Emerson, E. (2001). Living with support in a home in the community: Predictors of behavioral development and household and community activity. Mental Retardation and Developmental Disabilities Research, 34, 23–41. https://doi.org/10.1002/mrdd.1011.

  • Frazier, P. A., Tix, A. P., & Barron, K. E. (2004). Testing moderator and mediator effects in counseling psychology research. Journal of Counseling Psychology, 51, 115–134. https://doi.org/10.1037/0022-0167.51.1.115.

    Article  Google Scholar 

  • Gardner, J. F., & Carran, D. (2005). Attainment of personal outcomes by people with developmental disabilities. Mental Retardation, 43, 157–174. https://doi.org/10.1352/0047-6765(2005)43[157:AOPOBP]2.0.CO;2.

    Article  PubMed  Google Scholar 

  • Gómez, L. E., & Verdugo, M. A. (2016). Outcomes evaluation. En R. L. Schalock & K. D. Keith (Eds.), Cross-cultural quality of life: Enhancing the lives of persons with intellectual disability (2nd ed.) (pp. 71–80). Washington, DC: American Association on Intellectual and Developmental Disabilities.

  • Gómez, L. E., Verdugo, M. A., Arias, B., & Arias, V. (2011). A comparison of alternative models of individual quality of life for social service recipients. Social Indicators Research, 101, 109–126. https://doi.org/10.1007/s11205-010-9639-y.

    Article  Google Scholar 

  • Gómez, L. E., Arias, B., Verdugo, M. A., & Navas, P. (2012). An outcomes-based assessment of quality of life in social services. Social Indicators Research, 106, 81–93. https://doi.org/10.1007/s11205-011-9794-9.

    Article  Google Scholar 

  • Gómez, L. E., Verdugo, M. A., Arias, B., Navas, P., & Schalock, R. L. (2013). The development and use of provider profiles at the organization and systems level. Evaluation and Program Planning, 40, 17–26. https://doi.org/10.1016/j.evalprogplan.2013.05.001.

    Article  PubMed  Google Scholar 

  • Gómez, L. E., Peña, E., Arias, B., & Verdugo, M. A. (2016). Impact of individual and organizational variables on quality of life. Social Indicators Research, 125(2), 649–664. https://doi.org/10.1007/s11205-014-0857-6.

    Article  Google Scholar 

  • Hair, J. F., Black, B., Babin, B., J., Anderson, R. E., & Tatham, R. L. (2006). Multivariate Data Analysis (6th Ed.). Upper Saddle River, New Jersey: Pearson Education Inc.

  • Hansen, M., Alkin, M. C., & Wallace, T. L. (2013). Depicting the logic of three evaluation theories. Evaluation and Program Planning, 38, 34–43. https://doi.org/10.1016/j.evalprogplan.2012.03.012.

    Article  PubMed  Google Scholar 

  • Hayes, A., & Matthes, J. (2009). Computational procedures for probing interactions in OLS and logistic regression: SPSS and SAS implementations. Behavior Research Methods, 41, 924–936.

    Article  PubMed  Google Scholar 

  • Hayes, A. F., Montoya, A. K., & Rockwood, N. J. (2017). The analysis of mechanisms and their contingencies: PROCESS versus structural equation modeling. Australasian Marketing Journal, 25, 76–81. https://doi.org/10.1016/j.ausmj.2017.02.001.

    Article  Google Scholar 

  • Kaplan, S. A., & Garrett, K. E. (2005). The use of logic models by community-based initiatives. Evaluation and Program Planning, 28, 167–172. https://doi.org/10.1016/j.evalprogplan.2004.09.002.

  • MacKinnon, D. P. (2008). Introduction to statistical mediation analysis. New York: Erlbaum.

    Google Scholar 

  • MacKinnon, D. P. (2011). Integrating mediators and moderators in research design. Research on Social Work Practice, 21(6), 675–681. https://doi.org/10.1177/1049731511414148.

    Article  PubMed  PubMed Central  Google Scholar 

  • Mark, M. M. (2008). Building a better evidence base for evaluation theory: Beyond general calls to a framework of types of research on evaluation. In N. L. Smith & P. Brandon (Eds.), Fundamental issues in evaluation (pp. 111–134). New York, NY: Guilford Press.

    Google Scholar 

  • Millar, A., Simeone, R. S., & Carnevale, J. T. (2001). Logic models: A systems tool for performance management. Evaluation and Program Planning, 24(1), 73–81. https://doi.org/10.1016/S0149-7189(00)00048-3.

    Article  Google Scholar 

  • Morán, L., Gómez, L. E., Malcedo, M. A., & Pedrosa, N. (2019). Gender differences in social inclusion of youth with autism and intellectual disability. Journal of Autism and Developmental Disorders, 49, 2980–2989. https://doi.org/10.1007/s10803-019-04030-z.

    Article  PubMed  Google Scholar 

  • Muthén, B., & Asparouhov, T. (2015). Causal effects in mediation modeling: An introduction with applications to latent variables. Structural Equation Modeling: A Multidisciplinary Journal, 22(1), 12–23. https://doi.org/10.1080/10705511.2014.935843.

    Article  Google Scholar 

  • Newton-Smith, W. H. (Ed.). (2001). A companion to the philosophy of science. London, UK: Blackwell.

    Google Scholar 

  • Owen, J. M. (2006). Program evaluation: Forms and approaches. Sydney: Allen and Unwin.

    Google Scholar 

  • Perry, J., & Felce, D. (2005). Factors associated with outcomes in community group homes. American Journal on Mental Retardation, 110, 121–135. https://doi.org/10.1352/0895-8017(2005)110<121:FAWOIC>2.0.CO;2.

    Article  PubMed  Google Scholar 

  • Preacher, K., & Hayes, A. (2004). SPSS and SAS procedures for estimating indirect effects in simple mediation models. Behavior Research Methods, Instruments, & Computers, 36, 717–731.

    Article  Google Scholar 

  • Rogers, P. J. (2008). Using programme theory to evaluate complicated and complex aspects of interventions. Evaluation, 14(1), 29–48.

    Article  Google Scholar 

  • Rosipal, R., & Krämer, N. (2006). Overview and recent advances in partial least squares. In C. Saunders, M. Grobelnik, S. Gunn, & J. Shawe-Taylor (Eds.), Subspace, latent structure and feature selection (pp. 34–51). Berlin: Springer.

    Chapter  Google Scholar 

  • Schalock, R. L. (2018). Seis ideas que están cambiando el campo de las discapacidades intelectuales y del desarrollo en todo el mundo [six ideas that are changing the IDD field internationally]. Siglo Cero, 49(1), 7–19.

    Google Scholar 

  • Schalock, R. L., & Bonham, G. S. (2003). Measuring outcomes and managing for results. Evaluation and Program Planning, 26(3), 229–235. https://doi.org/10.1016/S0149-7189(03)00027-2.

    Article  Google Scholar 

  • Schalock, R. L., & Verdugo, M. A. (2012a). A leadership guide for today’s disabilities organizations: Overcoming challenges and making change happen. Baltimore: Brookes.

    Google Scholar 

  • Schalock, R. L., & Verdugo, M. A. (2012b). A conceptual and measurement framework to guide policy development and systems change. Journal of Policy and Practice in Intellectual Disabilities, 9, 63–72.

    Article  Google Scholar 

  • Schalock, R. L., & Verdugo, M. A. (2013). The transformation of disabilities organizations. Intellectual and Developmental Disabilities, 51, 273–286.

    Article  PubMed  Google Scholar 

  • Schalock, R. L., Keith, K. D., Verdugo, M. A., & Gomez, L. E. (2010). Quality of life model development and use in the field of intellectual disability. In R. Kober (Ed.), Enhancing the quality of life of people with intellectual disabilities: From theory to practice (pp. 17–32). New York: Springer.

    Chapter  Google Scholar 

  • Schalock, R. L., Verdugo, M. A. y Gómez, L. E. (2011). Evidence-based practices in the field of intellectual and developmental disabilities: An international consensus approach. Evaluation and Program Planning, 34, 273–282. https://doi.org/10.1016/j.evalprogplan.2010.10.004.

  • Schalock, R. L., Verdugo, M. A., Gómez, L. E., & Reinders, H. S. (2016a). Moving us toward a theory of individual quality of life. American Journal on Intellectual and Developmental Disabilities, 121, 1–12. https://doi.org/10.1352/1944-7558-121.1.1.

    Article  PubMed  Google Scholar 

  • Schalock, R. L., Verdugo, M. A., & Lee, T. (2016b). A systematic approach to an organization’s sustainability. Evaluation and Program Planning, 56, 56–63. https://doi.org/10.1016/j.evalprogplan.2016.03.005.

    Article  PubMed  Google Scholar 

  • Schalock, R. L., Verdugo, M. A., & Gómez, L. E. (2017). Translating the quality of life concept into practice. In N. Singh, M. L. Wehmeyer, & K. Shogren (Eds.), Handbook of positive psychology in intellectual and developmental disabilities: Translating research into practice (pp. 115–126). New York: Springer.

    Chapter  Google Scholar 

  • Schalock, R. L., Thompson, J. R., & Tassé, M. J. (2018a). A systematic approach to personal support plans. Washington, DC: American Association on Intellectual and Developmental Disabilities.

    Google Scholar 

  • Schalock, R. L., Verdugo, M. A., & van Loon, J. (2018b). Understanding organization transformation in evaluation and program planning. Evaluation and Program Planning, 67, 53–60.

    Article  PubMed  Google Scholar 

  • Sexton, E., King-Kallimanis, B., Layte, R., & Hickey, A. (2015). Does resilience rest on relationships? Exploring social context and personal resources as moderators of the effect of disability on quality of life in older adults. Quality of Life Research, 24(Supl. 1), 45–46.

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (2014). The definition of context and its application in the field of intellectual disability. Journal of Policy and Practice in Intellectual Disabilities, 11, 109–116. https://doi.org/10.1111/jppi.12077.

    Article  Google Scholar 

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (2015). Using context as an integrative framework to align policy goals, supports, and outcomes in intellectual disability. Intellectual and Developmental Disabilities, 53, 367–376. https://doi.org/10.1352/1934-9556-53.5.367.

    Article  PubMed  Google Scholar 

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (2017). An integrated approach to disability policy development, implementation, and evaluation. Intellectual and Developmental Disabilities, 55(4), 258–268. https://doi.org/10.1352/1934-9556-55.4.258.

    Article  PubMed  Google Scholar 

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (2018a). The responsibility to build contexts that enhance human functioning and promote valued outcomes for people with intellectual disability: Strengthening system responsiveness. Intellectual and Developmental Disabilities, 56, 287–300. https://doi.org/10.1352/1934-9556-56.5.287.

    Article  PubMed  Google Scholar 

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (2018b). The use of a context-based change model to unfreeze the status quo and drive valued outcomes. Journal of Policy and Practice in Intellectual Disabilities, 15, 101–109. https://doi.org/10.1111/jppi.12233.

    Article  Google Scholar 

  • Shogren, K. A., Luckasson, R., & Schalock, R. L. (in press). Using a multi-dimensional model to analyze context and enhance personal outcomes. In Intellectual and developmental disabilities Retrieved from http://aaidd.org/docs/default-source/default-document-library/shogren2.pdf?sfvrsn=6b8e3621_0.

  • Smedema, S. M., Chan, F., Yaghmaian, R. A., Cardoso, E. D., Muller, V., Keegan, J., ..., Ebener, D. J. (2015). The Relationship of Core Self-Evaluations and Life Satisfaction in College Students with Disabilities: Evaluation of a Mediator Model. Journal of Postsecondary Education and Disability, 28(3), 341–358.

  • Stancliffe, R., Abery, B., & Smith, J. (2000). Personal control and the ecology of community living settings: Beyond living unit size and type. American Journal on Mental Retardation, 105(6), 431–454. https://doi.org/10.1352/0895-8017(2000)105<0431:PCATEO>2.0.CO;2.

    Article  PubMed  Google Scholar 

  • Stride, C. B., Gardner, S. E., Catley, N., & Thomas, F. (2015). Mplus code for mediation. In Moderation and moderated mediation models Available at http://www.offbeat.group.shef.ac.uk/FIO/models_and_index.pdf.

    Google Scholar 

  • Tassé, M. J., Schalock, R. L., Balboni, G., Bersani, H. J., Borthwick-Duffy, S. A., Spreat, S., et al. (2012). The construct of adaptive behavior: Its conceptualization, measurement, and use in the field of intellectual disability. American Journal of Intellectual and Developmental Disabilities, 117(4), 291–303. https://doi.org/10.1352/1944-7558-117.4.291.

    Article  Google Scholar 

  • Taylor-Powell, E., & Henert, E. (2008). Developing a logic model: Teaching and training guide. Madison: University of Wisconsin-Extension Retrieved from http://www.uwex.edu/ces/pdande/evaluation/pdf/lmguidecomplete.pdf.

    Google Scholar 

  • Verdugo, M. A. (2018). Conceptos clave que explican los cambios en las discapacidades intelectuales y del desarrollo en España key concepts and principles that explain changes in the provision of supports for intellectual and developmental disabilities in Spain. Siglo Cero, 49(1), 35–52.

    Google Scholar 

  • Verdugo, M. A., Navas, P., Gómez, L. E., & Schalock, R. L. (2012). The concept of quality of life and its role in enhancing human rights in the field of intellectual disability. Journal of Intellectual Disability Research, 56(2), 1036–1045. https://doi.org/10.1111/j.1365-2788.2012.01585.x.

    Article  PubMed  Google Scholar 

  • Verdugo, M. A., Jenaro, C., Calvo, I., & Navs, P. (2017). Disability policy implementation from a cross-cultural perspective. Intellectual and Developmental Disabilities, 55(4), 234–246.

    Article  PubMed  Google Scholar 

  • Verdugo, M. A., Fernández, M., Gómez, L. E., Amor, A., & Aza, A. (in press). Predictive factors of quality of life in acquired brain injury. International Journal of Clinical and Health Psychology. https://doi.org/10.1016/j.ijchp.2019.06.004.

  • Walsh, P. N., Emerson, E., Lobb, C., Hatton, C., Bradley, V., Schalock, R. L., & Moseley, C. (2010). Supported accommodation for people with intellectual disabilities and quality of life: An overview. Journal of Policy and Practices in Intellectual Disabilities, 7, 137–142.

    Article  Google Scholar 

  • Wang, L. &, Preacher, K. J. (2014). Moderated mediation analysis using Bayesian methods. Structural Equation Modeling: A Multidisciplinary Journal, 22(2), 249–263. https://doi.org/10.1080/10705511.2014.935256.

  • Wasserman, D. L. (2010). Using a systems orientation and foundational theory to enhance theory-driven human service program evaluations. Evaluation and Program Planning, 33(2), 67–80. https://doi.org/10.1016/j.evalprogplan.2009.06.005.

    Article  PubMed  Google Scholar 

  • Zuna, N. I., Turnbull, A., & Summers, J. A. (2009). Family quality of life: Moving from measurement to application. Journal of Policy and Practices in Intellectual Disabilities, 6, 25–31.

    Article  Google Scholar 

Download references

Acknowledgements

This work was supported by the Ministry of Economy and Competitiveness (R&D Projects, 2012, 2015) (grant number PSI2012-33139 and PSI2015-65193-P).

Author information

Authors and Affiliations

  1. Department of Psychology, University of Oviedo, Plaza Feijoo, s/n, 33003, Oviedo, Spain

    Laura E. Gómez

  2. Hastings College, Hastings, NE, USA

    Robert L. Schalock

  3. Institute on Community Integration (INICO), University of Salamanca, Salamanca, Spain

    Miguel A. Verdugo

Authors
  1. Laura E. Gómez
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Robert L. Schalock
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Miguel A. Verdugo
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Laura E. Gómez.

Ethics declarations

Ethical Approval

This article does not contain any studies with human or animal participants performed by any of the authors.

Informed Consent

As such no informed consent was needed in this study.

Conflict of Interest

The authors declare that they have no conflict of interest.

Additional information

The work described has not been published previously and it is not under consideration for publication elsewhere. ALL authors have made an active contribution to the conception and design and/or analysis and interpretation of the data and/or the drafting of the paper and ALL have critically reviewed its content and have approved the final version submitted for publication.

Its publication is approved by all authors and by the responsible authorities where the work was carried out. If accepted, it will not be published elsewhere in the same form, in English or in any other language, including electronically without the written consent of the copyright-holder. The authors ensure that writing is free from bias by using people-first language.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gómez, L.E., Schalock, R.L. & Verdugo, M.A. The Role of Moderators and Mediators in Implementing and Evaluating Intellectual and Developmental Disabilities-Related Policies and Practices. J Dev Phys Disabil 32, 375–393 (2020). https://doi.org/10.1007/s10882-019-09702-3

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10882-019-09702-3

Keywords

Search

Navigation