Preliminary Development and Validation of the Social and Emotional Health Survey for Secondary School Students

Abstract

This study reports on the preliminary development and validation of the Social and Emotional Health Survey (SEHS) with a sample of 4,189 (51 % female) California students in Grades 8, 10, and 12. The SEHS was designed to measure the psychological building blocks of adolescents’ positive mental health and is operationalized in the present study by a theoretical model comprised of 12 measured indicators that form four first-order domains (belief-in-self, belief-in-others, emotional competence, and engaged living) that, in turn, contribute to one underlying, second-order meta-construct called covitality. This study was the first to investigate the validity and utility of the adolescent covitality construct, which is conceptualized as the synergistic effect of positive mental health resulting from the interplay among multiple positive-psychological building blocks. Findings from confirmatory factor analyses, invariance analysis, and latent means testing all supported the theoretical model underlying the SEHS, indicating that the second-order covitality model was the best fit for both males and females. Results from a path-modeling analysis indicated that covitality was a strong predictor of students’ subjective well-being (operationalized as a composite of life satisfaction, positive affect, and negative affect), and findings from additional concurrent validity analyses indicated that adolescents’ covitality level was significantly associated with self-reported academic achievement, perceptions of school safety, substance use, and experiences of depressive symptoms. Implications for theory, practice, and future research are discussed.

This is a preview of subscription content, log in to check access.

Fig. 1
Fig. 2

References

  1. Aminzadeh, K., Denny, S., Utter, J., Milfont, T. L., Ameratunga, S., Teevale, T., et al. (2013). Neighbourhood social capital and adolescent self-reported wellbeing in New Zealand: A multilevel analysis. Social Science and Medicine, 84(May), 13–21. doi:10.1016/j.socscimed.2013.02.012.

    Article  Google Scholar 

  2. Ang, R. P., & Goh, D. H. (2010). Cyberbullying among adolescents: The role of affective and cognitive empathy, and gender. Child Psychiatry and Human Development, 41, 387–397. doi:10.1007/s10578-010-0176-3.

    Article  Google Scholar 

  3. Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238–246. doi:10.1037/0033-2909.107.2.238.

    Article  Google Scholar 

  4. Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino, CA: Multivariate Software.

    Google Scholar 

  5. Berzonsky, M. D. (2011). A social-cognitive perspective on identity construction. In S. J. Schwartz, K. Luyckx, & V. L. Vignoles (Eds.), Handbook of identity theory and research (pp. 55–76). New York, NY: Springer.

    Google Scholar 

  6. Buckley, M., Storino, M., & Saarni, C. (2003). Promoting emotional competence in children and adolescents: Implications for school psychologists. School Psychology Quarterly, 18, 177–191. doi:10.1521/scpq.18.2.177.21855.

    Article  Google Scholar 

  7. California Department of Education. (n.d.). California school district secondary school survey results fall 2009/spring 2010: Core module A. Retrieved from http://chks.wested.org/resources/a-text_0910.pdf.

  8. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255. doi:10.1207/S15328007SEM0902_5.

    Article  Google Scholar 

  9. Daniel, M. H. (1997). Intelligence testing: Status and trends. American Psychologist, 52, 1038–1045.

    Article  Google Scholar 

  10. Durlak, J. A., Weissberg, R. P., Dymnicki, A. B., Taylor, R. D., & Schellinger, K. B. (2011). The impact of enhancing students’ social and emotional learning: A meta-analysis of school-based interventions. Child Development, 82, 405–432. doi:10.1111/j.1467-8624.2010.01564.x.

    Article  Google Scholar 

  11. Eaton, D. A., Kann, L., Kinchen, S., Shanklin, S., Flint, K. H., Hawkins, J., et al. (2012). Youth risk behavior surveillance—United States, 2011. MMWR, Morbidity and Mortality Weekly Report, 61(4), 1–168.

  12. Ey, S., Hadley, W., Allen, D. N., Palmer, S., Klosky, J., Deptula, D., et al. (2005). A new measure of children’s optimism and pessimism: The Youth Life Orientation Test. Journal of Child Psychology and Psychiatry, 46, 548–558. doi:10.1111/j.1469-7610.2004.00372.x.

    Article  Google Scholar 

  13. Froh, J. J., Bono, G., & Emmon, R. (2010). Being grateful is beyond good manners: Gratitude and motivation to contribute to society among early adolescents. Motivation and Emotion, 34, 144–157. doi:10.1007/s11031-010-9163-z.

    Article  Google Scholar 

  14. Froh, J. J., Fan, J., Emmons, R. A., Bono, G., Huebner, E. S., & Watkins, P. (2011). Measuring gratitude in youth: Assessing the psychometric properties of adult gratitude scales in children and adolescents. Psychological Assessment, 23, 311–324. doi:10.1037/a0021590.

    Article  Google Scholar 

  15. Furlong, M. J., Froh, J. J., Muller, M. E., & Gonzalez, V. The role of gratitude in fostering school bonding. In D. J. Shernoff & J. Bempechat (Eds.), National Society for the Study of Education yearbook: Engaging youth in schools: Empirically-based model to guide future innovations. New York, NY: Teachers College Record (in press).

  16. Furlong, M. J., Ritchey, K. M., & O’Brennan, L. M. (2009). Developing norms for the California Resilience Youth Development Module: Internal assets and school resources subscales. California School Psychologist, 14, 35–46.

    Article  Google Scholar 

  17. Furlong, M. J., You, S., Renshaw, T. L., O’Malley, M. D., & Rebelez, J. (2013). Preliminary development of the positive experiences at School Scale for elementary school children. Child Indicators Research. Advanced online publication. doi:10.1007/s12187-013-9193-7.

  18. Gillham, J., Adams-Deutsch, Z., Werner, J., Reivich, K., Coulter-Heindl, V., Linkins, M., et al. (2011). Character strengths predict subjective well-being during adolescence. The Journal of Positive Psychology, 6, 31–44. doi:10.1080/17439760.2010.536773.

    Article  Google Scholar 

  19. Gilman, R., Huebner, E. S., & Furlong, M. J. (Eds.). (2009). Handbook of positive psychology in schools. New York, NY: Routledge.

    Google Scholar 

  20. Greenberg, M. T., Weissberg, R. P., O’Brien, M. U., Zins, J. E., Fredericks, L., Resnik, H., et al. (2003). Enhancing school-based prevention and youth development through coordinated social, emotional, and academic learning. American Psychologist, 58, 466–474. doi:10.1037/0003-066X.58.6-7.466.

    Article  Google Scholar 

  21. Hanson, T. L., & Kim, J. O. (2007). Measuring resilience and youth development: the psychometric properties of the Healthy Kids Survey. (Issues & Answers Report, REL 2007–No. 034). Washington, DC: U.S. Department of Education, Institute of Education Sciences, National Center for Education Evaluation and Regional Assistance, Regional Educational Laboratory West. Retrieved from http://ies.ed.gov/ncee/edlabs.

  22. Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi:10.1080/10705519909540118.

    Article  Google Scholar 

  23. Huebner, E. S. (1991). Initial development of the Students’ Life Satisfaction Scale. School Psychology International, 12, 231–243. doi:10.1177/0143034391123010.

    Article  Google Scholar 

  24. Huebner, E. S. (1995). The Students’ Life Satisfaction Scale: An assessment of psychometric properties with black and white elementary school students. Social Indicators Research, 34, 315–323. doi:10.1007/BF01078690.

    Article  Google Scholar 

  25. Hughes, A. A., & Kendall, P. C. (2009). Psychometric properties of the positive and negative affect scale for children (PANAS-C) in children with anxiety disorders. Child Psychiatry and Human Development, 40, 343–352. doi:10.1007/s10578-009-0130-4.

    Article  Google Scholar 

  26. Jimerson, S. R., Sharkey, J. D., Nyborg, V., & Furlong, M. J. (2004). Strength-based assessment and school psychology: A summary and synthesis. The California School Psychologist, 9, 9–19.

    Article  Google Scholar 

  27. Jones, C. N., You, S., & Furlong, M. J. (2013). A preliminary examination of covitality as integrated well-being in college students. Social Indicators Research, 111, 511–526. doi:10.1007/s11205-012-0017-9.

    Article  Google Scholar 

  28. Kamphaus, R. W., & Reynolds, C. R. (2007). BASC-2 Behavioral and Emotional Screening System manual. Bloomington, MN: Pearson.

    Google Scholar 

  29. Kelly, R. M., Hills, K. J., Huebner, E. S., & McQuillin, S. (2012). The longitudinal stability and dynamics of group membership in the dual-factor model of mental health: Psychosocial predictors of mental health. Canadian Journal of School Psychology, 27, 337–355. doi:10.1177/0829573512458505.

    Article  Google Scholar 

  30. Keyes, C. L. M. (2005). Mental Illness and/or mental health? Investigating axioms of the complete state model of health. Journal of Consulting and Clinical Psychology, 73, 539–548. doi:10.1037/0022-006X.73.3.539.

    Article  Google Scholar 

  31. Keyes, C. L. M. (2007). Promoting and protecting mental health as flourishing: A complimentary strategy for improving national mental health. American Psychologist, 62, 95–108. doi:10.1037/0003-066X.62.2.95.

    Article  Google Scholar 

  32. Kirschman, K. J. B., Johnson, R. J., Bender, J. A., & Roberts, M. C. (2009). Positive psychology for children and adolescents: Development, prevention, and promotion. In S. J. Lopez & C. R. Snyder (Eds.), The Oxford handbook of positive psychology (2nd ed., pp. 133–148). Oxford: New York, NY.

    Google Scholar 

  33. Kling, K. C., Hyde, J. S., Showers, C. J., & Buswell, B. N. (1999). Gender differences in self-esteem: A meta-analysis. Psychological bulletin, 125, 470–500.

    Article  Google Scholar 

  34. Knoop, H. H. (2011). Education in 2025: How positive psychology can revitalize education. In S. I. Donaldson, M. Csikszentmihalyi, & J. Nakamura (Eds.), Applied positive psychology: Improving everyday life, health, schools, work, and society (pp. 97–116). New York, NY: Routledge.

    Google Scholar 

  35. Larson, R. W. (2000). Toward a psychology of positive youth development. American Psychologist, 55, 170–183. doi:10.1037/0003-066X.55.1.170.

    Article  Google Scholar 

  36. Laurent, J., Catanzaro, S. J., Joiner, T. E, Jr, Rudolph, K. D., Potter, K. I., Lambert, S., et al. (1999). A measure of positive and negative affect for children: Scale development and preliminary validation. Psychological Assessment, 11, 326–338. doi:10.1037//1040-3590.11.3.326.

    Article  Google Scholar 

  37. Lewis, A. D., Huebner, E. S., Malone, P. S., & Valois, R. F. (2011). Life satisfaction and student engagement in adolescents. Journal of Youth and Adolescence, 40, 249–262. doi:10.1007/s10964-010-9517-6.

    Article  Google Scholar 

  38. Long, R. F., Huebner, E. S., Wedell, D. H., & Hills, K. J. (2012). Measuring school-related subjective well-being in adolescents. American journal of Orthopsychiatry, 82, 50–60. doi:10.1111/j.1939-0025.2011.01130.x.

    Article  Google Scholar 

  39. Lufi, D., & Cohen, A. (1987). A scale for measuring persistence in children. Journal of Personality Assessment, 51, 178–185. doi:10.1207/s15327752jpa5102_2.

    Article  Google Scholar 

  40. Lyons, M. D., Huebner, E. S., Hills, K. J., & Shinkareva, S. V. (2012). The dual-factor model of mental health: Further study of the determinants of group differences. Canadian Journal of School Psychology, 27, 183–196. doi:10.1177/0829573512443669.

    Article  Google Scholar 

  41. Masten, A. S. (2001). Ordinary magic: Resilience process in development. American Psychologist, 56, 227–238. doi:10.1037//0003-066X.56.3.227.

    Article  Google Scholar 

  42. Masten, A. S., Cutuli, J. J., Herbers, J. E., & Reed, M. G. (2009). Resilience in development. In S. J. Lopez & C. R. Snyder (Eds.), The Oxford handbook of positive psychology (2nd ed., pp. 117–132). Oxford: New York, NY.

    Google Scholar 

  43. Oberle, E., Schonert-Reichl, K. A., & Thomson, K. C. (2010). Understanding the link between social and emotional well-being and peer relations in early adolescence: Gender-specific predictors of peer acceptance. Journal of Youth and Adolescence, 39, 1330–1342. doi:10.1007/s10964-009-9486-9.

    Article  Google Scholar 

  44. Ostaszewski, K., & Zimmerman, M. A. (2006). The effects of cumulative risks and promotive factors on urban adolescent alcohol and other drug use: A longitudinal study of resiliency. American Journal of Community Psychology, 38, 237–249. doi:10.1007/s10464-006-9076-x.

    Article  Google Scholar 

  45. Park, N. (2004). The role of subjective well-being in positive youth development. The Annals of the American Academy of Political and Social Science, 591, 25–39. doi:10.1177/0002716203260078.

    Article  Google Scholar 

  46. Proctor, C., Maltby, J., & Linley, P. A. (2011). Strengths use as a predictor of well-being and health-related quality of life. Journal of Happiness Studies, 12, 153–169. doi:10.1007/s10902-009-9181-2.

    Article  Google Scholar 

  47. Renshaw, T. L., Furlong, M. J., Dowdy, E., Rebelez, J., Smith, D. C., O’Malley, M. D., Lee, S.-Y., & Strøm, I.F. Covitality: A synergistic conception of adolescents’ mental health. In M. J. Furlong, R. Gilman, & E. S. Huebner (Eds.), Handbook of positive psychology in the schools (2nd ed). New York, NY: Routledge (in press).

  48. Rohrbeck, C. A., Azar, S. T., & Wagner, P. E. (1991). Child Self-Control Rating Scale: Validation of a child self-report measure. Journal of Clinical Child and Adolescent Psychology, 20, 179–183. doi:10.1207/s15374424jccp2002_9.

    Article  Google Scholar 

  49. Scales, P. C. (1999). Reducing risks and building developmental assets: Essential actions for promoting adolescent health. Journal of School Health, 69, 113–119. doi:10.1111/j.1746-1561.1999.tb07219.x.

    Article  Google Scholar 

  50. Scales, P. C., Benson, P. L., Leffert, N., & Blyth, D. A. (2000). Applied Developmental Science, 4, 27–46. doi:10.1207/S1532480XADS0401_3.

    Article  Google Scholar 

  51. Scales, P. C., Benson, P. L., & Roehlkepartain, E. C. (2011). Adolescent thriving: The role of sparks, relationships, and empowerment. Journal of youth and adolescence, 40, 263–277. doi:10.1007/s10964-010-9578-6.

    Article  Google Scholar 

  52. Scales, P. C., Benson, P. L., Roehlkepartain, E. C., Semsa, A., & Van Dulmen, M. (2006). The role of developmental assets in predicting academic achievement: A longitudinal study. Journal of Adolescence, 29, 691–708. doi:10.1016/j.adolescence.2005.09.001.

    Article  Google Scholar 

  53. Schunk, D. H., & Meece, J. L. (2006). Self-efficacy development in adolescence. In F. Parjares & T. C. Urdan (Eds.), Self-efficacy beliefs of adolescents (pp. 71–96). Charlotte, NC: Information Age Publishers.

    Google Scholar 

  54. Sharkey, J. D., Furlong, M. J., Dowdy, E., Felix, E. D., Grimm, L., & Ritchey, K. (2012). The United States Safe Schools/Healthy Students Initiative: Turning a national initiative into local action. In S. R. Jimerson, A. B. Nickerson, M. J. Mayer, & M. J. Furlong (Eds.), The handbook of school violence and school safety: International research and practice (pp. 487–502). New York, NY: Routledge.

    Google Scholar 

  55. Shekhtmeyster, Z., Sharkey, J. D., & You, S. (2011). The influence of multiple ecological assets on substance use patterns of diverse adolescents. School Psychology Review, 40, 386–404.

    Google Scholar 

  56. Steenkamp, J.-B. E. M., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of Consumer Research, 25, 78–90. http://www.jstor.org/stable/10.1086/209528.

  57. Steiger, J. H., & Lind, A. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City, IA

  58. Stewart, D., & Wang, D. (2013). Building resilience through school-based health promotion: a systematic review. International Journal of Mental Health Promotion. First published online Feb 28, 2013. doi:10.1080/14623730.2013.770319.

  59. Suldo, S. M., & Shaffer, E. J. (2008). Looking beyond psychopathology: The dual-factor model of mental health in youth. School Psychology Review, 37, 52–68.

    Google Scholar 

  60. Suldo, S. M., Thalji, A., & Ferron, J. (2011). Longitudinal academic outcomes predicted by early adolescents’ subjective well-being, psychopathology, and mental health status yielded from a dual-factor model. The Journal of Positive Psychology, 6, 17–30. doi:10.1080/17439760.2010.536774.

    Article  Google Scholar 

  61. Terry, P. C., Lane, A. M., Lane, H. J., & Keohane, L. (1999). Development and validation of a mood measure for adolescents. Journal of Sports Sciences, 17, 861–872. doi:10.1080/026404199365425.

    Article  Google Scholar 

  62. Torsheim, T., Aaroe, L. E., & Wold, B. (2001). Sense of coherence and school-related stress as predictors of subjective health complaints in early adolescence: Interactive, indirect or direct relationships? Social Science and Medicine, 53, 603–614. doi:10.1016/S0277-9536(00)00370-1.

    Article  Google Scholar 

  63. Tough, P. (2012). How children succeed: Grit, curiosity, and the hidden power of character. New York, NY: Houghton Mifflin Harcourt.

    Google Scholar 

  64. Villodas, F., Villodas, M. T., & Roesch, S. (2011). Examining the factor structure of the positive and negative affect schedule (PANAS) in a multiethnic sample of adolescents. Measurement and Evaluation in Counseling and Development, 44, 193–203. doi:10.1177/0748175611414721.

    Article  Google Scholar 

  65. Waterman, A. S. (1982). Identity development from adolescence to adulthood: An extension of theory and review of research. Developmental Psychology, 18, 341–358.

    Article  Google Scholar 

  66. Winheller, S., Hattie, J. A., & Brown, G. T. (2013). Factors influencing early adolescents’ mathematics achievement: High-quality teaching rather than relationships. Learning Environments Research. First published online 31, January 2013. doi:10.1007/s10984-012-9106-6

  67. Yuan, K. H., & Bentler, P. M. (2000). Three likelihood-based methods for mean and covariance structure analysis with nonnormal missing data. Sociological Methodology, 30, 165–200. doi:10.1111/0081-1750.00078.

    Article  Google Scholar 

  68. Zins, J. E., Bloodworth, M. R., Weissberg, R. P., & Walberg, H. J. (2007). The scientific base linking social and emotional learning to school success. Journal of Educational and Psychological Consultation, 17, 191–210. doi:10.1080/10474410701413145.

    Article  Google Scholar 

Download references

Author information

Affiliations

Authors

Corresponding author

Correspondence to Sukkyung You.

Rights and permissions

Reprints and Permissions

About this article

Cite this article

Furlong, M.J., You, S., Renshaw, T.L. et al. Preliminary Development and Validation of the Social and Emotional Health Survey for Secondary School Students. Soc Indic Res 117, 1011–1032 (2014). https://doi.org/10.1007/s11205-013-0373-0

Download citation

Keywords

  • Covitality
  • Mental health
  • Positive psychology
  • Positive youth development
  • Social-emotional learning
  • Subjective well-being
  • Resilience