Abstract
In contrast to the burgeoning research on the subjective well-being (SWB) of children in the general population, the SWB of children and young people in out of home care (OHC) has received far less research and policy attention. To ensure that policy and practice interventions can effectively improve the lives of children and young people in OHC, there is an urgent need for reliable and valid measures of their SWB. The current study begins to address this knowledge gap, providing an in-depth examination of the psychometric properties of the “Your Life, Your Care” survey. The reliability and validity of the survey questions were examined using classic test theory, item response theory, confirmatory factor analysis and logistic regression. Analysing data from 1221 participants aged 11–18 years, we found that all the survey questions were a reliable and valid measure of SWB except for questions on feelings about family contact and bullying. More importantly, the results indicated that SWB of children and young people in OHC was a multi-dimensional construct that can be operationally defined and measured as feeling good and functioning effectively at both individual and interpersonal levels. The theoretical, methodological and practical implications of these findings are discussed.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Notes
See International Survey of Children’s Well-being (ISCWB) http://www.isciweb.org/
The Children’s Society, Good Childhood Report 2017, see www.childrenssociety.org.uk
See International Survey of Children’s Well-being www.isciweb.org
References
Alliance for Children in Care and Care Leavers. (2016). A New Vision. http://www.tactcare.org.uk/content/uploads/2017/01/alliance-for-children-in-care-a-new-vision.pdf. Accessed 09 April 2019.
Allin, P., & Hand, D. J. (2017). New statistics for old? — Measuring the well-being of the UK. Journal of the Royal Statistical Society. Series A: Statistics in Society, 180(1), 3–24. https://doi.org/10.1111/rssa.12188.
American Educational Research Association, American Psychological Association, National Council on Measurement in Education, & Joint Committee on Standards for Educational and Psychological Testing (U.S.). (2014). Standards for educational and psychological testing. US: American Educational Research Association.
Bache, I., & Reardon, L. (2013). An idea whose time has come? Explaining the rise of the well-being in British politics. Political Studies, 61(4), 898–914. https://doi.org/10.1111/1467-9248.12001.
Ben-Arieh, A. (2005). Where are the children? Children’s role in measuring and monitoring their well-being. Social Indicators Research, 74(3), 573–596. https://doi.org/10.1007/s11205-004-4645-6.
Bradshaw, J. (Ed.). (2016). The Well-being of Children in the UK (4th Ed). Bristol, United Kingdom: Policy Press. https://doi.org/10.1332/policypress/9781447325628.001.0001.
Bradshaw, J., Crous, G., Rees, G., & Turner, N. (2017). Comparing children’s experiences of schools-based bullying across countries. Children and Youth Services Review, 80, 171–180. https://doi.org/10.1016/j.childyouth.2017.06.060.
Bronfenbrenner, U. (1979). The ecology of human development: Experiments by nature and design. Cambridge: Harvard University Press.
Byrne, B. M. (1994). Structural equation modeling with EQS and EQS-windows: Basic concepts, applications, and programming. Thousand Oaks: Sage Publications.
Casas, F., & Rees, G. (2015). Measures of children’s subjective well-being: Analysis of the potential for cross-national comparisons. Child Indicators Research, 8(1), 49–69. https://doi.org/10.1007/s12187-014-9293-z.
Children’s Commissioner for England (2015). State of the Nation: Children in Care. www.childrenscommissioner.gov.uk/wp-content/uploads/2017/06/Care-monitor-v12_1.pdf. Accessed 06 June 2019.
Cooke, P. J., Melchert, T. P., & Connor, K. (2016). Measuring well-being: A review of instruments. The Counseling Psychologist, 44(5), 730–757. https://doi.org/10.1177/0011000016633507.
Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16(3), 297–334. https://doi.org/10.1007/BF02310555.
De Ayala, R. J. (2009). The theory and practice of item response theory. New York: The Guilford Press.
Department for Education. (2018). Children Looked After in England Including Adoption: 2017 to 2018. https://www.gov.uk/government/statistics/children-looked-after-in-england-including-adoption-2017-to-2018. Accessed 09 April 2019.
DiBello, L. V., & Stout, W. (2007). Guest editors’ introduction and overview: IRT-based cognitive diagnostic models and related methods. Journal of Educational Measurement, 44(4), 285–291. https://doi.org/10.1111/j.1745-3984.2007.00039.x.
Diener, R., Lucas, R. E., Schimmack, U., & Helliwell, J. F. (2009). Well-being for public policy. New York: Oxford University Press. https://doi.org/10.1093/acprof:oso/9780195334074.001.0001.
Donovan, M. A., Drasgow, F., & Probst, T. M. (2000). Does computerizing paper-and-pencil job attitude scales make a difference? New IRT analyses offer insight. Journal of Applied Psychology, 85(2), 305–313. https://doi.org/10.1037/0021-9010.85.2.305.
Embretson, S. E., & Reise, S. P. (2000). Item response theory for psychologists. Mahwah: Lawrence Erlbaum.
Fox, J. P. (2010). Bayesian item response modeling: Theory and applications. London/New York: Springer Science+Business Media. https://doi.org/10.1007/978-1-4419-0742-4.
Finch, W. H., Jr., & French, B. F. (2015). Latent variable modeling with R. New York: Routledge.
Fontanella, L., Villano, P., & Di Donato, M. (2016). Attitudes towards Roma people and migrants: A comparison through a Bayesian multidimensional IRT model. Quality & Quantity, 50(2), 471–490. https://doi.org/10.1007/s11135-014-0158-9.
Forgeard, M. J. C., Jayawickreme, E., Kern, M. L., & Seligman, M. E. P. (2011). Doing the right thing: Measuring well-being for public policy. International Journal of Wellbeing, 1(1), 79–106. https://doi.org/10.5502/ijw.v1i1.15.
Fraley, R. C., Waller, N. G., & Brennan, K. A. (2000). An item response theory analysis of self-report measures of adult attachment. Journal of Personality and Social Psychology, 78(2), 350–365. https://doi.org/10.1037/0022-3514.78.2.350.
Fredrickson, B. (2009). Positivity. Oxford: Oneworld Publications.
Gilligan, R. (2000). Promoting resilience in children in foster care. In G. Kelly & R. Gilligan (Eds.), Issues in Foster Care: Policy, practice and research (pp. 107–126). London: Jessica Kingsley Publishers.
Gittleman, M. G., Klein, M. H., Smider, N. A., & Essex, M. J. (1998). Recollections of parental behaviour, adult attachment and mental health: Mediating and moderating effects. Psychological Medicine, 28(6), 1443–1455. https://doi.org/10.1017/S0033291798007533.
Guio, A.-C., Pomati, M., Najera, H., Gordon, D., & Marlier, E. (2018). Towards an EU measure of child deprivation. Child Indicators Research, 11(3), 835–860. https://doi.org/10.1007/s12187-017-9491-6.
Guttman, L. (1945). A basis for analyzing test-retest reliability. Psychometrika, 10(4), 255–282. https://doi.org/10.1007/BF02288892.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2014). Multivariate data analysis: Pearson new international edition (7th ed.). Essex: Pearson Education Limited.
Hone, L. C., Jarden, A., Schofield, G., & Duncan, S. (2014). Measuring flourishing: The impact of operational definitions on the prevalence of high levels of wellbeing. International Journal of Wellbeing, 4(1), 62–90. https://doi.org/10.5502/ijw.v4i1.4.
Hu, L.-t., & Bentler, P. M. (1998). Fit indices in covariance structure modeling: Sensitivity to underparameterized model misspecification. Psychological Methods, 3(4), 424–453. https://doi.org/10.1037/1082-989X.3.4.424.
Huppert, F. A. (2009). Psychological well-being: Evidence regarding its causes and consequences. Applied Psychology: Health and Well-Being, 1(2), 137–164. https://doi.org/10.1111/j.1758-0854.2009.01008.x.
Kaye-Tzadok, A., Kim, S. S., & Main, G. (2017). Children’s subjective well-being in relation to gender — What can we learn from dissatisfied children? Children and Youth Services Review, 80, 96–104. https://doi.org/10.1016/j.childyouth.2017.06.058.
Keyes, C. L. M. (2003). Promoting a life worth living: Human development from the vantage points of mental illness and mental health. In R. M. Lerner, F. Jacobs, & D. Wertlieb (Eds.), Promoting positive child, adolescent and family development: A handbook of program and policy innovations (pp. 257–274). CA: Sage Publications. https://doi.org/10.4135/9781452233642.n87.
Kline, R. B. (2016). Principles and practice of structural equation modeling (4th ed.). New York/London: The Guilford Press.
Kuder, G. F., & Richardson, M. W. (1937). The theory of the estimation of test reliability. Psychometrika, 2(3), 151–152. https://doi.org/10.1007/BF02288391.
Layard, R. (2005). Happiness: Lessons from a new science. United Kingdom: Penguin.
Main, G. (2014). Child poverty and children’s subjective well-being. Child Indicators Research, 7(3), 451–472. https://doi.org/10.1007/s12187-014-9237-7.
Masten, A., Best, K., & Garmezy, N. (1990). Resilience and development: Contributions from the study of children who overcome adversity. Development and Psychopathology, 2(4), 425–444. https://doi.org/10.1017/S0954579400005812.
McDonald, R. P. (1978). Generalizability in factorable domains: Domain validity and generalizability 1. Educational and Psychological Measurement, 38(1), 75–79. https://doi.org/10.1177/001316447803800111.
McDonald, R. P. (1999). Test theory: A unified treatment. New York: Routledge.
Muthén, L. K., & Muthén, B. O. (1998-2011). Mplus User's Guide (6th ed.). Los Angeles: Muthén & Muthén.
National Audit Office. (2019). Pressures on Children’s Social Care. https://www.nao.org.uk/wp-content/uploads/2019/01/Pressures-on-Childrens-Social-Care.pdf. Accessed 09 April 2019.
Office of National Statistics (ONS). (2012). Initial findings from the consultation on proposed domains and measures of National Well-being. https://www.ahsw.org.uk/userfiles/files/ONS_initial_findings.pdf. Accessed 09 April 2019.
Office of National Statistics (ONS). (2018a). Loneliness - what characteristics and circumstances are associated with feeling lonely? https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/articles/lonelinesswhatcharacteristicsandcircumstancesareassociatedwithfeelinglonely/2018-04-10. Accessed 09 April 2019.
Office of National Statistics (ONS). (2018b). Children’s Well-being Measures. https://www.ons.gov.uk/peoplepopulationandcommunity/wellbeing/datasets/childrenswellbeingmeasures. Accessed 09 April 2019.
Organisation for Economic Co-operation and Development (OECD). (2018). Measuring well-being and Progress: Well-being research. http://www.oecd.org/statistics/measuring-well-being-and-progress.htm. Accessed 09 April 2019.
Primi, C., Morsanyi, K., Chiesi, F., Donati, M. A., & Hamilton, J. (2016). The development and testing of a new version of the cognitive reflection test applying item response theory (IRT). Journal of Behavioral Decision Making, 29(5), 453–469. https://doi.org/10.1002/bdm.1883.
Reckase, M. D. (2009). Multidimensional item response theory. London/New York: Springer Science+Business Media.
Reise, S. P., Rodriguez, A., Spritzer, K. L., & Hays, R. D. (2018). Alternative approaches to addressing non-Normal distributions in the application of IRT models to personality measures. Journal of Personality Assessment, 100(4), 363–374. https://doi.org/10.1080/00223891.2017.1381969.
Revelle, W. (1979). Hierarchical cluster analysis and the internal structure of tests. Multivariate Behavioral Research, 14(1), 57–74. https://doi.org/10.1207/s15327906mbr1401_4.
Revelle, W., & Zinbarg, R. E. (2009). Coefficients alpha, beta, omega, and the glb: Comments on Sijtsma. Psychometrika, 74(1), 145–154. https://doi.org/10.1007/s11336-008-9102-z.
Rutter, M. (1987). Psychosocial resilience and protective mechanisms. American Journal of Orthopsychiatry, 57(3), 316–331. https://doi.org/10.1111/j.1939-0025.1987.tb03541.x.
Ryder, R., Edwards, A., & Clements, K. (2017). Measuring the Wellbeing of Children in Care: Views from the Frontline and Opportunities for Change. https://www.ncb.org.uk/sites/default/files/field/attachment/Measuring%20the%20wellbeing%20of%20children%20in%20care_Final%20report.pdf. Accessed 09 April 2019.
Sebba, J., Berridge, D., Luke, N., Fletcher, J., Bell, K., Strand, S., Thomas, S., Sinclair, I., & O’Higgins, A. (2015). The educational Progress of looked after children in England: Linking care and educational data. Rees Centre/University of Bristol. http://reescentre.education.ox.ac.uk/wordpress/wp-content/uploads/2015/11/EducationalProgressLookedAfterChildrenOverviewReport_Nov2015.pdf. Accessed 09 April 2019.
Seligman, M. E. P. (2002). Authentic happiness: Using the new positive psychology to realize your potential for lasting fulfillment. New York: The Free Press.
Seligman, M. E. P. (2011). Flourish. A visionary new understanding of happiness and well-being. New York: Free Press.
Seligman, M. E. P., & Csikszentmihalyi, M. (2000). Positive psychology: An introduction. American Psychologist, 55(1), 5–14. https://doi.org/10.1037/0003-066X.55.1.5.
Selwyn, J., Wood, M., & Newman, T. (2017). Looked after children and young people in England: Developing measures of subjective well-Being. Child Indicators Research, 10(2), 363–380. https://doi.org/10.1007/s12187-016-9375-1.
Selwyn, J., Magnus, L., & Stuijfzand, B. (2018). Our Lives, Our Care: Looked after children’s views on their well-being in 2017. https://www.basw.co.uk/system/files/resources/basw_81008-9.pdf. Accessed 20 June 2019.
Stiglitz, J. E., Sen, A., & Fitoussi, J.-P. (2008). Report by the Commission on the Measurement of Economic Performance and Social Progress. https://ec.europa.eu/eurostat/documents/118025/118123/Fitoussi+Commission+report. Accessed 09 April 2019.
The Children’s Society. (2008). Happy and They Know It: Developing a Well-being Framework Based on Young People Consultation. https://www.childrenssociety.org.uk/sites/default/files/tcs/research_docs/Happy%20and%20they%20know%20it%20-%20Developing%20a%20well-being%20framework%20based%20on%20young%20people%20consultation.pdf. Accessed 09 April 2019.
The Children’s Society. (2018). The Good Childhood Report 2018. https://www.childrenssociety.org.uk/what-we-do/resources-and-publications/the-good-childhood-report-2018. Accessed 09 April 2019.
Ungar, M. (2004). Nurturing hidden resilience in troubled youth. Toronto: University of Toronto Press. https://doi.org/10.3138/9781442677975.
Ungar, M., Ghazinour, M., & Richter, J. (2013). Annual research review: What is resilience within the social ecology of human development? Journal of Child Psychology and Psychiatry and Allied Disciplines, 54(4), 348–366. https://doi.org/10.1111/jcpp.12025.
United Nations Convention on the Rights of the Child (UNCRC). (1991). Convention on the Rights of the Child. https://downloads.unicef.org.uk/wp-content/uploads/2010/05/UNCRC_PRESS200910web.pdf?_ga=2.152931705.1760705325.1554831008-1673119809.1554831008. Accessed 09 April 2019.
Weijers, D., & Jarden, A. (2013). The science of happiness for policymakers: An overview. Journal of Social Research & Policy, 4(2), 21–40.
Wood, M., & Selwyn, J. (2017). Looked after children and young people’s views on what matters to their subjective well–being. Adoption & Fostering, 41(1), 20–34. https://doi.org/10.1177/0308575916686034.
Zickar, M. J. (2001). Conquering the next frontier: Modeling personality data with item response theory. In B. W. Roberts & R. Hogan (Eds.), Decade of behaviour: Personality psychology in the workplace (pp. 141–160). Washington, DC: American Psychological Association. https://doi.org/10.1037/10434-006.
Acknowledgments
The Hadley Trust funded the development of the surveys. Coram Voice (a children’s rights charity) recruited and supported all the local authorities who chose to use the “Your Life, Your Care” survey. Their work was essential to the successful running and dissemination of the findings in each local authority.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of Interest
The authors declare that they have no conflict of interest.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Zhang, M.F., Selwyn, J. The Subjective Well-Being of Children and Young People in out of Home Care: Psychometric Analyses of the “Your Life, your Care” Survey. Child Ind Res 13, 1549–1572 (2020). https://doi.org/10.1007/s12187-019-09658-y
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s12187-019-09658-y