Advertisement

Journal of Child and Family Studies

, Volume 26, Issue 2, pp 424–436 | Cite as

Parental Empowerment: Construct Validity and Reliability of a Dutch Empowerment Questionnaire (EMPO)

  • Harm Damen
  • Jan W. Veerman
  • Ad A. Vermulst
  • Rozemarijn Nieuwhoff
  • Ronald E. de Meyer
  • Ron H. J. Scholte
Original Paper

Abstract

In this study, the construct validity and reliability of the Empowerment questionnaire (EMPO) that was developed in Dutch youth care was examined. The 12-item EMPO focuses on measuring parental empowerment in raising their children. The three components of psychological empowerment (intrapersonal, interactional, and behavioral) form the rationale for the EMPO. Non-clinical (n = 673) and clinical (n = 1,212) data were used. Construct validity was tested by the factorial structure, measurement invariance, correlations with other instruments (PSQ-S and SDQ), and empowerment differences between the two groups. Reliability was determined by testing the internal consistency and test-retest reliability. The results show that the factorial validity of the EMPO was sufficient to good, the EMPO was measurement invariant for various subgroups, and the EMPO scales were negatively correlated with parenting stress (PSQ-S) and child behavioral problems scales (SDQ). Furthermore, the clinical group was less empowered, and the correlation between parental empowerment and child behavioral problems was stronger in this group. In addition, both groups of parents had relatively high scores on the interactional component. In the clinical group, however, parental scores on the interactional component were less correlated with scores on the intrapersonal and behavioral components. Finally, reliability analyses showed a largely sufficient to good internal consistency and test-retest reliability. The EMPO seems to be an instrument with sufficient to good construct validity and reliability. Further research is recommended regarding the underlying assumptions, other aspects of validity, representativeness, and the way it should be used as a tool by professionals for supporting parental empowerment.

Keywords

Parental empowerment Psychological empowerment Youth care Questionnaire Construct validity Reliability 

Notes

Acknowledgments

We would like to thank the parents and Pactum employees (youth care) and the employees of the CONRISQ Group (care of youth and adults) for their cooperation in this study.

Funding

This study was funded by Pactum. Grant Number: n.a.

Compliance with Ethical Standards

Conflict of interest

The authors declare that they have no conflict ofinterest.

Ethical approval

All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and/or national research committee and with the 1964 Helsinki Declaration and its later amendments or comparable ethical standards.

Informed consent

Informed consent was obtained from all individual participants included in the study.

References

  1. Akey, T. M., Marquis, J. G., & Ross, M. E. (2000). Validation of scores on the psychological empowerment scale: A measure of empowerment for parents of children with a disability. Educational and Psychological Measurement, 60, 419–438. doi: 10.1177/00131640021970637.CrossRefGoogle Scholar
  2. Asparouhov, T., & Muthén, B. O. (2006). Robust chi square difference testing with mean and variance adjusted test statistics. Mplus Web Notes: No. 10. Unpublished manuscript. Retrieved from https://www.statmodel.com/download/webnotes/webnote10.pdf.
  3. Bentler, P. M. (1990). Comparative fit indexes in structural models. Psychological Bulletin, 107, 238–246. doi: 10.1037/0033-2909.107.2.238.CrossRefPubMedGoogle Scholar
  4. Bentler, P. M. (2009). Alpha, dimension-free, and model-based internal consistency reliability. Psychometrika, 74, 137–143. doi: 10.1007/s11336-008-9100-1.CrossRefPubMedPubMedCentralGoogle Scholar
  5. Bolt, A. (2006). Het Gezin Centraal, handboek voor ambulante hulpverleners [Family Centred Therapy, manual for ambulant social workers]. Amsterdam: SWP.Google Scholar
  6. Bot, S. (2013). Het verband tussen ervaren problemen en gebruik van geïndiceerde zorg [Relationship between experienced problems and use of indicated care]. Terecht in de jeugdzorg [Reference to youth care]. Den Haag: Sociaal en Cultureel Planbureau. Bot (red.)Google Scholar
  7. Bruns, E. J., Suter, J. C., & Leverentz-Brady, K. M. (2006). Relations between program and system variables and fidelity to the wraparound process for children and families. Psychiatric Services, 57, 1586–1593. doi: 10.1176/appi.ps.57.11.1586.CrossRefPubMedGoogle Scholar
  8. Cattaneo, L. B., & Chapman, R. (2010). The process of empowerment: a model for use in research and practice. American Psychologist, 65, 646–659.CrossRefPubMedGoogle Scholar
  9. Chen, F. F. (2007). Sensitivity of goodness of fit indexes to lack of measurement invariance. Structural Equation Modeling-a Multidisciplinary Journal, 14, 464–504.CrossRefGoogle Scholar
  10. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi: 10.1207/s15328007sem0902_5.CrossRefGoogle Scholar
  11. Christens, B. D., Peterson, N. A., & Speer, P. W. (2011). Community participation and psychological empowerment: testing reciprocal causality using a cross-lagged panel design and latent constructs. Health Education & Behavior, 38, 339–347. doi: 10.1177/1090198110372880.CrossRefGoogle Scholar
  12. Cohen, J., & Cohen, P. (1983). Applied multiple regression/correlation analysis for the behavioral sciences. Hillsdale, NJ: Erlbaum.Google Scholar
  13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. 2nd Edition. Hillsdale: Lawrence Erlbaum.Google Scholar
  14. Cronbach, L. J. (2004). My current thoughts on coefficient alpha and successor procedures. Educational and Psychological Measurement, 64, 391–418.CrossRefGoogle Scholar
  15. Evers, A., Lucassen, W., Meijer, R., & Sijtsma, S. (2010). COTAN Beoordelingssysteem voor de kwaliteit van tests [COTAN Assessment system for the quality of tests]. Amsterdam: NIP.Google Scholar
  16. Farber, M. L. Z., & Maharaj, R. (2005). Empowering high-risk families of children with disabilities. Research on Social Work Practice, 15, 501–515. doi: 10.1177/1049731505276412.CrossRefGoogle Scholar
  17. Goedhart, A., Treffers, F., & Van Widenfelt, B. (2003). Vragen naar psychische problemen bij kinderen en adolescenten [Measuring psychological problems in children and adolescents]: Strengths and Difficulties Questionnaire (SDQ). Maandblad Geestelijke Volksgezondheid, 58, 1018–1035.Google Scholar
  18. Goodman, R. (1997). The Strengths and Difficulties Questionnaire: a research note. Journal of Child Psychology and Psychiatry, 38, 581–586.CrossRefPubMedGoogle Scholar
  19. Graves, K. N., & Shelton, T. L. (2007). Family empowerment as a mediator between family-centered systems of care and changes in child functioning: Identifying an important mechanism of change. Journal of Child & Family Studies, 16, 556–566.CrossRefGoogle Scholar
  20. Hermanns, J., Van de Venne, L., & Leseman, P. (1997). Home-Start geëvalueerd [Home-Start evaluated]. Amsterdam: SCO-Kohnstamm Instituut.Google Scholar
  21. Holden, D. J., Crankshaw, E., Nimsch, C., Hinnant, L. W., & Hund, L. (2004). Quantifying the impact of participation in local tobacco control groups on the psychological empowerment of involved youth. Health Education & Behavior, 31, 615–628. doi: 10.1177/1090198104268678.CrossRefGoogle Scholar
  22. Hooper, D., Coughlan, J., & Mullen, M. (2008). Structural equation modelling: guidelines for determining model fit. Electronic Journal of Business Research Methods, 6, 53–60.Google Scholar
  23. Kim, E. S., & Yoon, M. (2011). Testing measurement invariance: a comparison of multiple-group categorical CFA and IRT. Structural Equation Modeling-a Multidisciplinary Journal, 18, 212–228. doi: 10.1080/10705511.2011.557337.CrossRefGoogle Scholar
  24. Koren, P. E., Dechillo, N., & Friesen, B. J. (1992). Measuring empowerment in families whose children have emotional disabilities: a brief questionnaire. Rehabilitation Psychology, 37, 305–321. doi: 10.1037/0090-5550.37.4.305.CrossRefGoogle Scholar
  25. Kutash, K., Duchnowski, A. J., Green, A. L., & Ferron, J. M. (2011). Supporting Parents Who Have Youth with Emotional Disturbances Through a Parent-to-Parent Support Program: A Proof of Concept Study Using Random Assignment. Administration and Policy in Mental Health and Mental Health Services Research, 38, 412–427. doi: 10.1007/s10488-010-0329-5.CrossRefPubMedGoogle Scholar
  26. Lee, I. A., & Preacher, K. J. (2013). Calculation for the test of the difference between two dependent correlations with one variable in common [Computer software]. Available from: http://quantpsy.org.
  27. Lietz, C. A. (2011). Theoretical adherence to family centered practice: Are strengths-based principles illustrated in families’ descriptions of child welfare services? Children and Youth Services Review, 33, 888–893. doi: 10.1016/j.childyouth.2010.12.012.CrossRefGoogle Scholar
  28. Marsh, H. W., Hau, K. T., & Wen, Z. (2004). In search of golden rules: Comment on hypothesis-testing approaches to setting cutoff values for fit indexes and dangers in overgeneralizing Hu and Bentler’s (1999) findings. Structural equation modeling, 11, 320–341.CrossRefGoogle Scholar
  29. Martinez, K., Perez, E. A., Ramirez, R., Canino, G., & Rand, C. (2009). The role of caregivers’ depressive symptoms and asthma beliefs on asthma outcomes among low-income puertorican children. Journal of Asthma, 46, 136–141. doi: 10.1080/02770900802492053.CrossRefPubMedPubMedCentralGoogle Scholar
  30. McDonald, R. P. (1978). Generalizability in factorable domains: domain validity and generalizability. Educational and Psychological Measurement, 38, 75–79. doi: 10.1177/001316447803800111.CrossRefGoogle Scholar
  31. McDonald, R. P. (1999). Test theory: a unified treatment. Mahwah, NJ: Erlbaum.Google Scholar
  32. Minjarez, M. B., Mercier, E. M., Williams, S. E., & Hardan, A. Y. (2013). Impact of pivotal response training group therapy on stress and empowerment in parents of children with autism. Journal of Positive Behavior Interventions, 15, 71–78. doi: 10.1177/1098300712449055.CrossRefGoogle Scholar
  33. Muthén, L. K., & Muthén, B. O. (1998). Mplus User’s Guide. Seventh Edition Los Angeles, CA: Muthén & Muthén. -2013Google Scholar
  34. Nachshen, J. S., & Minnes, P. (2005). Empowerment in parents of school-aged children with and without developmental disabilities. Journal of Intellectual Disability Research, 49, 889–904.CrossRefPubMedGoogle Scholar
  35. Nieuwboer, C. C., Fukkink, R. G., & Hermanns, J. M. A. (2015). Single session email consultation for parents: an evaluation of its effect on empowerment. British Journal of Guidance & Counselling, 43, 131–143. doi: 10.1080/03069885.2014.929636.CrossRefGoogle Scholar
  36. Peterson, N. A. (2014). Empowerment theory: clarifying the nature of higher-order multidimensional constructs. American Journal of Community Psychology, 53, 96–108. doi: 10.1007/s10464-013-9624-0.CrossRefPubMedGoogle Scholar
  37. Peterson, N. A., Lowe, J. B., Hughey, J., Reid, R. J., Zimmerman, M. A., & Speer, P. W. (2006). Measuring the intrapersonal component of psychological empowerment: Confirmatory factor analysis of the Sociopolitical Control Scale. American Journal of Community Psychology, 38, 287–297. doi: 10.1007/s10464-006-9070-3.CrossRefPubMedGoogle Scholar
  38. Powell, D. S., Batsche, C. J., Ferro, J., Fox, L., & Dunlap, G. (1997). A strength-based approach in support of multi-risk families: Principles and issues. Topics in Early Childhood Special Education, 17, 1–26.CrossRefGoogle Scholar
  39. Preacher, K. J. (2002). Calculation for the test of the difference between two independent correlation coefficients [Computer software]. Available from http://quantpsy.org.
  40. Rappaport, J. (1987). Terms of empowerment exemplars of prevention: toward a theory for community psychology. American Journal of Community Psychology, 15, 121–148. doi: 10.1007/bf00919275.CrossRefPubMedGoogle Scholar
  41. Revelle, W., & Zinbarg, R. E. (2009). Coefficients Alpha, Beta, Omega, and the glb: comments on Sijtsma. Psychometrika, 74, 145–154. doi: 10.1007/s11336-008-9102-z.CrossRefGoogle Scholar
  42. Robbins, V., Johnston, J., Barnett, H., Hobstetter, W., Kutash, K., Duchnowski, A. J., & Annis, S. (2008). Parent to parent: A synthesis of the emerging literature. Tampa, FL: University of South Florida, The Louis de la Parte Florida Mental Health Institute, Department of Child & Family Studies.Google Scholar
  43. Schäfer, W., Kroneman, M., Boerma., W., Van den Berg, M., Westert, G., Devillé, W., & Van Ginneken, E. (2010). The Netherlands: Health system review. Health Systems in Transition, 12, 121–229.Google Scholar
  44. Scheel, M. J., & Rieckmann, T. (1998). An empirically derived description of self-efficacy and empowerment for parents of children identified as psychologically disordered. American Journal of Family Therapy, 26, 15–27. doi: 10.1080/01926189808251083.CrossRefGoogle Scholar
  45. Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350–353.CrossRefGoogle Scholar
  46. Schouten, R. (2013). Beleid ‘Eigen kracht’ door de jaren heen [‘Own strength’ policy through the years]. Utrecht: Nederlands Jeugd Instituut.Google Scholar
  47. Sijtsma, K. (2009). On the use, the misuse, and the very limited usefulness of Cronbach’s alpha. Psychometrika, 74, 107–120. doi: 10.1007/s11336-008-9101-0.CrossRefPubMedGoogle Scholar
  48. Singh, N. N., Curtis, W. J., Ellis, C. R., Nicholson, M. W., Villani, T. M., & Wechsler, H. A. (1995). Psychometric analysis of the family empowerment scale. Journal of Emotional and Behavioral Disorders, 3, 85–91.CrossRefGoogle Scholar
  49. Slot, N. W., & Spanjaard, H. J. M. (2009). Competentiegerichte residentiële hulp voor kinderen en adolescenten [Competence-based residential care for children and adolescents]. Baarn, Netherlands: Intro.Google Scholar
  50. Spanjaard, H., & Haspels, M. (2005). Families First. Handleiding voor gezinsmedewerkers (6e druk) [Families First: manual for family workers. 6th edition. Utrecht: Nederlands Jeugdinstituut.Google Scholar
  51. Steenkamp, J. B., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national research. Journal of Consumer Research, 25, 78–90. doi: 10.1086/209528.CrossRefGoogle Scholar
  52. Steiger, J. H. (1980). Tests for comparing elements of a correlation matrix. Psychological Bulletin, 87, 245–251.CrossRefGoogle Scholar
  53. Steiger, J. H. (1998). A note on multiple sample extensions of the RMSEA fit index. Structural Equation Modeling-a Multidisciplinary Journal, 5, 411–419. doi: 10.1080/10705519809540115.CrossRefGoogle Scholar
  54. Stone, L. L., Janssens, J. M. A. M., Vermulst, A. A., Van der Mater, M., Engels, R. C., & Otten, R. (2015). The Strengths and Difficulties Questionnaire: psychometric properties of the parent and teacher version in children aged 4–7. BMC Psychology, 3, 1–12. http://www.biomedcentral.com/2050-7283/3/4.CrossRefGoogle Scholar
  55. Turnell, A., & Edwards, S. (1999). ‘Signs of safety: A solution and safety oriented approach to child protection casework’. New York: Norton.Google Scholar
  56. Van Pagée, R. (2003). Eigen Kracht in Nederland: van model naar invoering [Family Group Conference in The Netherlands: from model to implementation]. Amsterdam: SWP.Google Scholar
  57. Van Regenmortel, T. (2009). Empowerment as challenging framework for social inclusion and modern care. Journal of Social Intervention: Theory and Practice, 18, 22–24.Google Scholar
  58. Vermulst, A. A., Kroes, G., De Meyer, R. E., Nguyen, L., & Veerman, J. W. (2015). Handleiding OBVL [Manual Parenting Stress Questionnaire]. Nijmegen: Praktikon.Google Scholar
  59. Verzaal, H. (2002). Empowerment in de jeugdzorg [Empowerment in youth care]. PhD Thesis. Amsterdam: Universiteit van Amsterdam.Google Scholar
  60. Vuorenmaa, M., Halme, N., Åstedt-Kurki, P., Kaunonen, M., & Perälä, M. L. (2014). The validity and reliability of the Finnish Family Empowerment Scale (FES): a survey of parents with small children. Child Care Health and Development, 40, 597–606. doi: 10.1111/cch.12081.CrossRefGoogle Scholar
  61. Vuorenmaa, M., Perälä, M. L., Halme, N., Kaunonen, M., & Åstedt-Kurki, P. (2016). Associations between family characteristics and parental empowerment in the family, family service situations and the family service system. Child Care Health and Development, 42, 25–35. doi: 10.1111/cch.12267.CrossRefGoogle Scholar
  62. Wakimizu, R., Fujioka, H., Yoneyama, A., Iejima, A., & Miyamoto, S. (2011). Factors associated with the empowerment of Japanese families raising a child with developmental disorders. Research in Developmental Disabilities, 32, 1030–1037. doi: 10.1016/j.ridd.2011.01.037.CrossRefPubMedGoogle Scholar
  63. Weiss, J. A., Cappadocia, M. C., MacMullin, J. A., Viecili, M., & Lunsky, Y. (2012). The impact of child problem behaviors of children with ASD on parent mental health: The mediating role of acceptance and empowerment. Autism, 16, 261–274. doi: 10.1177/1362361311422708.CrossRefPubMedGoogle Scholar
  64. Weiss, J. A., MacMullin, J. A., & Lunsky, Y. (2015). Empowerment and parent gain as mediators and moderators of distress in mothers of children with autism spectrum disorders. Journal of Child and Family Studies, 24, 2038–2045. doi: 10.1007/s10826-014-0004-7.CrossRefGoogle Scholar
  65. Zimmerman, M. A. (1990). Taking aim on empowerment research: On the distinction between individual and psychological conceptions. American Journal of Community Psychology, 18, 169–177. doi: 10.1007/bf00922695.CrossRefGoogle Scholar
  66. Zimmerman, M. A. (1995). Psychological empowerment: issues and illustrations. American Journal of Community Psychology, 23, 581–599. doi: 10.1007/bf02506983.CrossRefPubMedGoogle Scholar
  67. Zimmerman, M. A. (2000). Empowerment theory: psychological, organizational, and community levels of analysis. In J. Rappaport, E. Seidman (Eds.), Handbook of community psychology. New York: Kluwer academic/Plenum Publishers.Google Scholar
  68. Zimmerman, M. A., & Rappaport, J. (1988). Citizen participation, perceived control, and psychological empowerment. American Journal of Community Psychology, 16, 725–750. doi: 10.1007/bf00930023.CrossRefPubMedGoogle Scholar
  69. Zimmerman, M. A., & Warschausky, S. (1998). Empowerment theory for rehabilitation research: Conceptual and methodological issues. Rehabilitation Psychology, 43, 3–16. doi: 10.1037//0090-5550.43.1.3.CrossRefGoogle Scholar
  70. Zinbarg, R., Revelle, W., Yovel, I., & Li, W. (2005). Cronbach’s α, Revelle’s β, and McDonald’s ωh: Their relations with each other and two alternative conceptualizations of reliability. Psychometrika, 70, 1–11. doi: 10.1007/s11336-003-0974-7.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Harm Damen
    • 1
    • 2
  • Jan W. Veerman
    • 3
  • Ad A. Vermulst
    • 2
  • Rozemarijn Nieuwhoff
    • 1
  • Ronald E. de Meyer
    • 2
  • Ron H. J. Scholte
    • 2
  1. 1.PactumArnhemThe Netherlands
  2. 2.Praktikon, Radboud UniversityNijmegenThe Netherlands
  3. 3.Behavioural Science InstituteRadboud UniversityNijmegenThe Netherlands

Personalised recommendations