Advertisement

Social Indicators Research

, Volume 100, Issue 1, pp 37–60 | Cite as

Investigating the Substantive Aspect of Construct Validity for the Satisfaction with Life Scale Adapted for Children: A Focus on Cognitive Processes

  • Anne M. Gadermann
  • Martin Guhn
  • Bruno D. Zumbo
Article

Abstract

The objective of this study was to investigate the substantive aspect of construct validity of the Satisfaction with Life Scale adapted for Children (SWLS-C; Gadermann et al. in Soc Indic Res 96:229–247, 2010). Specifically, the study examined the cognitive processes of children when responding to the items of the SWLS-C to find out how they interpret and respond to the items. Think-aloud protocol interviews were conducted with 55 students in grades 4–7 (58% girls, mean age of 11 years, ranging from 8.8 to 12.8 years) and content analysis was used to analyze the data. The findings indicate that most children had no difficulty in understanding the items, and used mainly two strategies for responding to the items: (1) an absolute strategy, in which children used absolute statements to indicate the presence or absence of something that is important for their judgment of their satisfaction with life, and (2) a relative strategy, in which children used relative or comparative statements. In the absolute statements, children primarily referred to social relationships, personal characteristics, time use, and possessions. In the relative statements, the children primarily compared what they have to (a) what they want (b) what they had in the past, (c) what other people have, and (d) what they feel they need. Furthermore, most children considered it important that information on their life satisfaction is obtained. The results are discussed with regard to multiple discrepancies theory (Michalos in Soc Indic Res 16:347–413, 1985) and previous empirical findings. The results provide insights into children’s cognitive processes when responding to items on life satisfaction and provide validity evidence that the SWLS-C is an appropriate measure to assess life satisfaction in children of this age.

Keywords

Satisfaction with Life Scale adapted for Children Life satisfaction Subjective well-being Children Cognitive processes Construct validity 

References

  1. American Educational Research Association, American Psychological Association, & National Council on Measurement in Education. (1999). Standards for educational and psychological testing. Washington, DC: American Psychological Association.Google Scholar
  2. Barofsky, I., Meadows, K., & McColl, E. (2003). Cognitive aspects of survey methodology and quality of life assessment: Summary of meeting. Quality of Life Research, 12, 281–282.CrossRefGoogle Scholar
  3. Bee, H. (1989). The developing child (5th ed.). New York: Harper & Row Publishers.Google Scholar
  4. Ben-Arieh, A. (2005). Where are the children? Children’s role in measuring and monitoring their well-being. Social Indicators Research, 74, 573–596.CrossRefGoogle Scholar
  5. Ben-Arieh, A. (2006). Is the study of the “state of our children” changing? Re-visiting after 5 years. Children and Youth Services Review, 28, 799–811.CrossRefGoogle Scholar
  6. Ben-Arieh, A., & Goerge, R. M. (2001). Beyond the numbers: How do we monitor the state of our children? Children and Youth Services Review, 23, 603–631.CrossRefGoogle Scholar
  7. Ben-Arieh, A., & Goerge, R. M. (Eds.). (2006). Indicators of children’s well-being: Understanding their role, usage and policy influence. Dordrecht, The Netherlands: Springer Academic Publishers.Google Scholar
  8. Ben-Arieh, A., Kaufman, H. N., Andrews, B. A., Goerge, R. M., Lee, B. J., & Aber, J. L. (2001). Measuring and monitoring children’s well-being. Dordrecht, The Netherlands: Kluwer Academic Press.Google Scholar
  9. Berg, B. L. (2004). Qualitative research methods for the social sciences (5th ed.). Boston: Pearson Education.Google Scholar
  10. Böhm, A. (2004). Theoretical coding: Text analysis in grounded theory. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 270–275). London: Sage Publications.Google Scholar
  11. Cizek, G. J., Rosenberg, S. L., & Koons, H. H. (2008). Sources of validity evidence for educational and psychological tests. Educational and Psychological Measurement, 68, 397–412.CrossRefGoogle Scholar
  12. Collins, D. (2003). Pretesting survey instruments: An overview of cognitive methods. Quality of Life Research, 12, 229–238.CrossRefGoogle Scholar
  13. Cremeens, J., Eiser, C., & Blades, M. (2006a). A qualitative investigation of school-aged children’s answers to items from a generic quality of life measure. Child: Care, Health and Development, 33, 83–89.CrossRefGoogle Scholar
  14. Cremeens, J., Eiser, C., & Blades, M. (2006b). Characteristics of health-related self-report measures for children aged three to eight years: A review of the literature. Quality of Life Research, 15, 739–754.CrossRefGoogle Scholar
  15. De Civita, M., Regier, D., Alamgir, A. H., Anis, A. H., Fitzgerald, M. J., & Marra, C. A. (2005). Evaluating health-related quality-of-life studies in paediatric populations. Some conceptual, methodological and developmental considerations and recent applications. Pharmacoeconomics, 23, 659–685.CrossRefGoogle Scholar
  16. Dew, T., & Huebner, E. S. (1994). Adolescents’ perceived quality of life: An exploratory investigation. Journal of School Psychology, 32, 185–199.CrossRefGoogle Scholar
  17. Dey, I. (1993). Qualitative data analysis: A user-friendly guide for social scientists. London: Routledge.CrossRefGoogle Scholar
  18. Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The Satisfaction with Life Scale. Journal of Personality Assessment, 49, 71–75.CrossRefGoogle Scholar
  19. Diener, E., Suh, E. M., Lucas, R. E., & Smith, H. L. (1999). Subjective well-being: Three decades of progress. Psychological Bulletin, 125, 276–302.CrossRefGoogle Scholar
  20. Ericsson, K. A., & Simon, H. A. (1980). Verbal reports as data. Psychological Review, 87, 215–251.CrossRefGoogle Scholar
  21. Fox, J. E., Houston, B. K., & Pittner, M. S. (1983). Trait anxiety and children’s cognitive behaviors in an evaluative situation. Cognitive Therapy and Research, 7, 149–154.CrossRefGoogle Scholar
  22. Frones, I. (2007). Theorizing indicators. Social Indicators Research, 83, 5–23.CrossRefGoogle Scholar
  23. Gadermann, A. M., Schonert-Reichl, K. A., & Zumbo, B. D. (2010). Investigating validity evidence of the Satisfaction with Life Scale adapted for Children. Social Indicators Research, 96, 229–247.CrossRefGoogle Scholar
  24. Greenspoon, P. J., & Saklofske, D. H. (1997). Validity and reliability of the Multidimensional Students’ Life Satisfaction Scale with Canadian children. Journal of Psychoeducational Assessment, 15, 138–155.CrossRefGoogle Scholar
  25. Holsti, O. R. (1969). Content analysis for the social sciences and humanities. Reading, MA: Addison-Wesley Publishing Company.Google Scholar
  26. Huebner, E. S. (1991). Correlates of life satisfaction in children. School Psychology Quarterly, 6, 103–111.CrossRefGoogle Scholar
  27. Huebner, E. S., & Alderman, G. L. (1993). Convergent and discriminant validation of a children’s life satisfaction scale: Its relationship to self- and teacher-reported psychological problems and school functioning. Social Indicators Research, 30, 71–82.CrossRefGoogle Scholar
  28. Huebner, E. S., Drane, W., & Valois, R. F. (2000). Levels and demographic correlates of adolescent life satisfaction reports. School Psychology International, 21, 281–292.CrossRefGoogle Scholar
  29. Huebner, E. S., Suldo, S. M., Smith, L. C., & McKnight, C. G. (2004). Life satisfaction in children and youth: Empirical foundations and implications for school psychologists. Psychology in the Schools, 41, 81–93.CrossRefGoogle Scholar
  30. Lodge, J., Harte, D. K., & Tripp, G. (1998). Children’s self-talk under conditions of mild anxiety. Journal of Anxiety Disorders, 12, 153–176.CrossRefGoogle Scholar
  31. Lodge, J., Tripp, G., & Harte, D. K. (2000). Think-aloud, thought-listing, and video-mediated recall procedures in the assessment of children’s self-talk. Cognitive Therapy and Research, 24, 399–418.CrossRefGoogle Scholar
  32. Man, P. (1991). The influence of peers and parents on youth life satisfaction in Hong Kong. Social Indicators Research, 24, 347–365.CrossRefGoogle Scholar
  33. Mayring, P. (2004). Qualitative content analysis. In U. Flick, E. von Kardoff, & I. Steinke (Eds.), A companion to qualitative research (pp. 266–269). London: Sage Publications.Google Scholar
  34. McColl, E., Meadows, K., & Barofsky, I. (2003). Cognitive aspects of survey methodology and quality of life assessment. Quality of Life Research, 12, 217–218.CrossRefGoogle Scholar
  35. Messick, S. (1989). Validity. In R. L. Linn (Ed.), Educational measurement (3rd ed., pp. 12–103). New York: Macmillan.Google Scholar
  36. Messick, S. (1995). Validity of psychological assessment: Validation of inferences from person’s responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749.CrossRefGoogle Scholar
  37. Michalos, A. C. (1985). Multiple discrepancies theory. Social Indicators Research, 16, 347–413.CrossRefGoogle Scholar
  38. Michalos, A. C. (1991). Global report on student well-being: Life satisfaction and happiness (Vol. 1). New York: Springer.Google Scholar
  39. Neuendorf, K. A. (2002). The content analysis guidebook. Thousand Oaks, CA: Sage Publications.Google Scholar
  40. Rebok, G., Riley, A., Forrest, C., Starfield, B., Green, B., Robertson, J., et al. (2001). Elementary school-aged children’s reports of their health: A cognitive interviewing study. Quality of Life Research, 10, 59–70.CrossRefGoogle Scholar
  41. Riley, A. W. (2004). Evidence that school-age children can self-report on their health. Ambulatory Pediatrics, 4, 371–376.CrossRefGoogle Scholar
  42. Schilling, L. S., Dixon, J. K., Knafl, K. A., Grey, M., Ives, B., & Lynn, M. R. (2007). Determining content validity of a self-report instrument for adolescents using a heterogeneous expert panel. Nursing Research, 56, 361–366.CrossRefGoogle Scholar
  43. Schwarz, N. (1999). Self-reports: How the questions shape the answers. American Psychologist, 54, 93–105.CrossRefGoogle Scholar
  44. Sirken, M. G., & Schechter, S. (1999). Interdisciplinary survey methods research. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 1–10). New York: Wiley.Google Scholar
  45. Stewart, J. L., Lynn, M. R., & Mishel, M. H. (2005). Evaluating content validity for children’s self-report instruments using children as content experts. Nursing Research, 54, 414–418.CrossRefGoogle Scholar
  46. Stone, W. L., & Lemanek, K. L. (1990). Developmental issues in children’s self-reports. In A. M. La Greca (Ed.), Through the eyes of the child: Obtaining self-reports from children and adolescents. Boston: Allyn & Bacon.Google Scholar
  47. Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage Publications.Google Scholar
  48. Willis, G. B., DeMaio, T. J., & Harris-Kojetin, B. (1999). Is the Bandwagon headed to the methodological promised land? Evaluating the validity of cognitive interviewing techniques. In M. G. Sirken, D. J. Herrmann, S. Schechter, N. Schwarz, J. M. Tanur, & R. Tourangeau (Eds.), Cognition and survey research (pp. 133–153). New York: Wiley.Google Scholar
  49. Young, M. H., Miller, B. C., Norton, M. C., & Hill, E. J. (1995). The effect of parental supportive behaviors on life satisfaction of adolescent offspring. Journal of Marriage & Family, 57, 813–822.CrossRefGoogle Scholar
  50. Zumbo, B. D. (2007). Validity: Foundational issues and statistical methodology. In C. R. Rao & S. Sinharay (Eds.), Handbook of statistics, Vol. 26: Psychometrics (pp. 45–79). Amsterdam: Elsevier Science B. V.Google Scholar
  51. Zumbo, B. D. (2009). Validity as contextualized and pragmatic explanation, and its implications for validation practice. In R. W. Lissitz (Ed.), The concept of validity: Revisions, new directions and applications (pp. 65–82). Charlotte, NC: Information Age Publishing.Google Scholar

Copyright information

© Springer Science+Business Media B.V. 2010

Authors and Affiliations

  • Anne M. Gadermann
    • 1
  • Martin Guhn
    • 1
  • Bruno D. Zumbo
    • 1
  1. 1.University of British ColumbiaVancouverCanada

Personalised recommendations