Advertisement

Applied Research in Quality of Life

, Volume 12, Issue 2, pp 343–367 | Cite as

Development and Validation of the Social Emotional Health Survey–Higher Education Version

  • Michael J. FurlongEmail author
  • Sukkyung You
  • Mark Shishim
  • Erin Dowdy
Article

Abstract

We report on the development of the Social Emotional Health Survey-Higher Education (SEHS-HE), a multidimensional measure of covitality (the combinatorial effects of multiple positive psychological constructs). Scale development was carried out over 18 months involving five phases: conceptual grounding and item pool generation; cognitive interviews and item refinement; pilot survey and item reduction; structural validation survey and analyses; and, validity and stability analyses. Starting with a pool of 72 items, item selection and reduction was carried out using a sample of 771 college students. A second sample of 1,413 students (63.5 % female, mean age 20.0 years) completed the refined 48-item measure. Confirmatory factor analyses found acceptable fit for the SEHS-HE higher-order covitality latent structure. A final set of 36 items consisted of four latent traits (each comprised of three measured subscales): belief-in-self (subscales: self-efficacy, persistence, self-awareness), belief-in-others (subscales: family support, institutional support, peer support), emotional competence (subscales: cognitive reappraisal, empathy, self-regulation), and engaged living (subscales: gratitude, zest, optimism). Complete invariance was found for males and females with small effect size differences on latent mean scores. Evidence supported the SEHS-HE total score’s concurrent and predictive validity for students’ subjective well-being (r = .72, r = .65, respectively) and psychological distress (r = −.56, r = −.45, respectively). The 4-month stability coefficient for the SEHS-HE total score was .82, indicating it measures trait-like psychological constructs. The discussion focuses on the uses of the SEHS-HE in support of mental health programs, and refinement of the conceptual understanding of the covitality construct.

Keywords

Covitality College students Social emotional health Well-being Social Emotional Health Survey-Higher Education 

Supplementary material

11482_2016_9464_MOESM1_ESM.pdf (221 kb)
ESM 1 (PDF 221 kb)

References

  1. American College Health Association. (2014). American College Health Association-National College Health Assessment II: Reference group executive summary. Hanover: Author. Available from: www.acha-ncha.org/docs/ACHA-NCHA-II_ReferenceGroup_ExecutiveSummary_Spring2014.pdf.
  2. Antony, M. M., Beiling, P. J., Cox, B. J., Ens, M. W., & Swinson, R. P. (1998). Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample. Psychological Assessment, 10, 176–181. doi: 10.1037/1040-3590.10.2.176.CrossRefGoogle Scholar
  3. Bembenutty, H. (2009). Academic delay of gratification, self-regulation of learning, gender differences, and expectancy-value. Personality and Individual Differences, 46, 347–352. doi: 10.1016/j.paid.2008.10.028.CrossRefGoogle Scholar
  4. Bentler, P. M. (1990). Comparative fit indices in structural models. Psychological Bulletin, 107, 238–246. doi: 10.1037/0033-2909.107.2.238.CrossRefGoogle Scholar
  5. Bentler, P. M. (2006). EQS 6 structural equations program manual. Encino: Multivariate Software.Google Scholar
  6. Center for Collegiate Mental Health. (2015). 2014 annual report. Publication No. STA 15–30. Available from: http://ccmh.psu.edu/wp-content/uploads/sites/3058/2015/02/2014-CCMH-Annual-Report.pdf.
  7. Chen, F. F., Sousa, K. H., & West, S. G. (2005). Testing measurement invariance of second-order factor models. Structural Equation Modeling, 12, 471–492. doi: 10.1207/S15328007SEM1203_7.CrossRefGoogle Scholar
  8. Cheung, G. W., & Rensvold, R. B. (2002). Evaluating goodness-of-fit indexes for testing measurement invariance. Structural Equation Modeling, 9, 233–255.CrossRefGoogle Scholar
  9. Crawford, J. R., & Henry, J. D. (2004). The Positive and Negative Affect Schedule (PANAS): construct validity, measurement properties and normative data in a large non-clinical sample. British Journal of Clinical Psychology, 43, 245–265. doi: 10.1348/0144665031752934.CrossRefGoogle Scholar
  10. Crisp, R. J., & Turner, R. N. (2014). Essential social psychology (3rd ed.). Thousand Oaks: Sage.Google Scholar
  11. Davis, M. H. (1983). The effects of dispositional empathy on emotional reactions and helping: a multidimensional approach. Journal of Personality, 51(2), 167–184. http://search.proquest.com/docview/616861092?accountid=14522.CrossRefGoogle Scholar
  12. Deci, E. L., & Ryan, R. M. (2014). The importance of autonomy for development and well-being. In B. W. Sokol, F. M. E. Grouzet, & U. Miller (Eds.), Self-regulation and autonomy: Social and developmental dimensions of human conduct (pp. 19–46). New York: Cambridge University Press.Google Scholar
  13. Denering, L. L., & Spear, S. E. (2012). Routine use of screening and brief intervention for college students in a university counseling center. Journal of Psychoactive Drugs, 44, 318–324. doi: 10.1080/02791072.2012.718647.CrossRefGoogle Scholar
  14. Diener, E., Emmons, R. A., Larsen, R. J., & Griffin, S. (1985). The satisfaction with life scale. Journal of Personality Assessment, 49, 71–75. doi: 10.1207/s15327752jpa4901_13.CrossRefGoogle Scholar
  15. Dowdy, E., Furlong, M. J., Raines, T. C., Price, M., Murdock, J., & Bovery, B. (2014). Enhancing school-based mental health services with a preventive and promotive approach to universal screening for complete mental health. Journal of Educational and Psychology Consultation, 25, 1–20. doi: 10.1080/10474412.2014.929951.Google Scholar
  16. Downs, A., Boucher, L. A., Campbell, D. G., & Dasse, M. (2013). Development and initial validation of the symptoms and assets screening scale. Journal of American College Health, 61(3), 164–174. doi: 10.1080/07448481.2013.773902.CrossRefGoogle Scholar
  17. Durand-Bush, K., McNeil, K., Harding, M., & Dobransky, J. (2015). Investigating stress, psychological well-being, mental health functioning, and self-regulation capacity among university undergraduate students: Is this population optimally functioning? Canadian Journal of Counselling and Psychotherapy / Revue canadienne de counseling et de psychothérapie, 49(3). Available at: <http://cjc-rcc.ucalgary.ca/cjc/index.php/rcc/article/view/2807>. Date accessed 01 Jan 2016.
  18. Eisenberg, N., & Fabes, R. (1990). Empathy: conceptualization, measurement, and relation to prosocial behavior. Motivation and Emotion, 14, 131–149.CrossRefGoogle Scholar
  19. Eisenberg, D., Hunt, J., Speer, N., & Zivin, K. (2011). Mental health service utilization among college students in the United States. Journal of Nervous and Mental Disease, 199, 301–308. doi: 10.1097/NMD.0b013e3182175123.CrossRefGoogle Scholar
  20. Elliott, S. N., Gresham, F., & Witt, J. C. (Eds.). (2013). Handbook of behavior therapy in education. New York: Springer Science & Business Media.Google Scholar
  21. Farabaugh, A., Nyer, M., Holt, D., Baer, L., Petrie, S., DiPierro, M., & Mischoulon, D. (2015). Screening for suicide risk in the college population. Journal of Rational-Emotive & Cognitive-Behavior Therapy, 33, 78–94. doi: 10.1007/s10942-014-0203-6.CrossRefGoogle Scholar
  22. Ferguson, R. F., Phillips, S. F., Rowley, J. F. S., & Friedlander, J. W. (2015). The influence of teaching: beyond standardized test scores: Engagement, mindsets, and agency. Boston: The Achievement Gap Initiative at Harvard University. Available from: www.agi.harvard.edu/projects/TeachingandAgency.pdf.
  23. Froh, J. J., Fan, J., Emmons, R. A., Bono, G., Huebner, E. S., & Watkins, P. (2011). Measuring gratitude in youth: assessing the psychometric properties of adult gratitude scales in children and adolescents. Psychological Assessment, 23, 311–324.CrossRefGoogle Scholar
  24. Fullchange, A., & Furlong, M. J. (2016). An exploration of effects of bullying victimization from a complete mental health perspective. Sage Open, (January-March), 1–12. doi: 10.1177/2158244015623593.
  25. Furlong, M. J., You, S., Renshaw, T. L., O’Malley, M. D., & Rebelez, J. (2013). Preliminary development of the Positive Experiences at School Scale for elementary school children. Child Indicators Research, 6, 753–775. doi: 10.1007/s12187-013-9193-7.CrossRefGoogle Scholar
  26. Furlong, M. J., You, S., Renshaw, T. L., Smith, D. C., & O’Malley, M. D. (2014). Preliminary development and validation of the Social and Emotional Health Survey for secondary students. Social Indicators Research, 117, 1011–1032. doi: 10.1007/s11205-013-0373-0.CrossRefGoogle Scholar
  27. Gehlbach, H., & Barge, S. (2012). Anchoring and adjusting in questionnaire responses. Basic and Applied Social Psychology, 34, 417–433. doi: 10.1080/019735333.2012.711691.CrossRefGoogle Scholar
  28. Giancola, J. K., Grawitch, M. J., & Borchert, D. (2009). Dealing with the stress of college: a model for adult students. Adult Education Quarterly, 59, 246–263. doi: 10.1177/0741713609331479.CrossRefGoogle Scholar
  29. Hill, R. M., Yaroslavsky, I., & Pettit, J. W. (2015). Enhancing depression screening to identify college students at risk for persistent depressive symptoms. Journal of Affective Disorders, 174, 1–6. doi: 10.1016/j.jad.2014.11.025.CrossRefGoogle Scholar
  30. Hone, L. C., Jarden, A., Schofield, G. M., & Duncan, S. (2014). Measuring flourishing: the impact of operational definitions on the prevalence of high levels of wellbeing. International Journal of Wellbeing, 4, 62–90. doi: 10.5502/ijw.v4i1.4.CrossRefGoogle Scholar
  31. Hu, L., & Bentler, P. (1999). Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55. doi: 10.1080/10705519909540118.CrossRefGoogle Scholar
  32. Hunt, J., & Eisenberg, D. (2010). Mental health problems and help-seeking behavior among college students. Journal of Adolescent Health, 46, 3–10. doi: 10.1016/j.jadohealth.2009.08.008.CrossRefGoogle Scholar
  33. Ibrahim, A. K., Kelly, S. J., Adams, C. E., & Glazebrook, C. (2013). A systematic review of studies of depression prevalence in university students. Journal of Psychiatric Research, 47, 391–400. doi: 10.1155/2013/373857.CrossRefGoogle Scholar
  34. Ito, A., Smith, D. C., You, S., Shimoda, Y., & Furlong, M. J. (2015). Validation and utility of the social emotional health survey-secondary for Japanese students. Contemporary School Psychology, 19, 243–252. doi: 10.1007/s40688-015-0068-4.CrossRefGoogle Scholar
  35. Jones, C., You, S., & Furlong, M. J. (2013). A preliminary examination of covitality as integrated well-being in college students. Social Indicators Research, 111, 511–526. doi: 10.1007/s11205-012-0017-9.CrossRefGoogle Scholar
  36. Joshanloo, M., Wissing, M. P., Khumalo, I. P., & Lamers, S. M. A. (2013). Measurement invariance of the Mental Health Continuum-Short Form (MHC-SF) across three cultural groups. Personality and Individual Differences, 55, 755–759. doi: 10.1016/j.paid.2013.06.002.CrossRefGoogle Scholar
  37. Keefer, K. V. (2015). Self-report assessments of emotional competencies: a critical look at methods and meanings. Journal of Psychoeducational Assessment, 33, 3–23. doi: 10.1177/0734282914550381.CrossRefGoogle Scholar
  38. Keyes, C. L. M. (2009). Brief description of the Mental Health Continuum–Short Form (MHC-SF). Available: www.sociology.emory.edu/ckeyes/ [Online, 29 December 2015].
  39. Keyes, C. L. M., Eisenberg, D., Geraldine, S., Perry, G. S., Dube, S. R., Kroenke, K., & Dhingra, S. S. (2012). The relationship of level of positive mental health with current mental disorders in predicting suicidal behavior and academic impairment in college students. Journal of American College Health, 60, 126–133. doi: 10.1080/07448481.2011.608393.CrossRefGoogle Scholar
  40. Kia-Keating, M., You, S., Moore, S., Liu, S., & Furlong, M. J. (2016). Structural validity of the depression, anxiety, and stress scale-21 for U.S. college students. Manuscript under review.Google Scholar
  41. Kim, E., Dowdy, E., & Furlong, M. J. (2014). An exploration of using a dual-factor model in school-based mental health screening. Canadian Journal of School Psychology, 29, 127–140. doi: 10.1177/0829573514529567.CrossRefGoogle Scholar
  42. Kim, J. E., Saw, A., & Zane, N. (2015). The influence of psychological symptoms on mental health literacy of college students. American Journal of Orthopsychiatry, 85, 620–630. doi: 10.1037/ort0000074.CrossRefGoogle Scholar
  43. Kitchener, B. A., & Jorm, A. F. (2008). Mental health first aid: an international programme for early intervention. Early Intervention Psychiatry, 2(1), 55–61. doi: 10.1111/j.1751-7893.2007.00056.x.CrossRefGoogle Scholar
  44. Kratsas, G. (n.d.). 30 great schools promoting healthy living on campus. Great Values Colleges website. Available form: www.greatvaluecolleges.net/30-great-schools-promoting-healthy-living-on-campus/.
  45. Lee, S., You, S., & Furlong, M. J. (2015). Validation of the social emotional health survey for Korean school students. Child Indicators Research.. doi: 10.1007/s12187-014-9294-y.
  46. Lenzi, M., Furlong, M. J., Dowdy, E., Sharkey, J. D., Gini, G., & Altoè, G. (2015). The quantity and variety across domains of psychological and social assets associated with school victimization. Psychology of Violence, 5, 411–421. doi: 10.1037/a0039696.CrossRefGoogle Scholar
  47. Leppink, E., Odlaug, B. L., Lust, K., Christenson, G., Derbyshire, K., & Grant, J. E. (2014). Losing control: assaultive behavior as a predictor of impulse control disorders in young adults. Comprehensive Psychiatry, 55, 1831–1836. doi: 10.1016/j.comppsych.2014.07.012.CrossRefGoogle Scholar
  48. Lim, Y.-J. (2015). Relations between virtues and positive mental health in a Korea sample: a multiple indictors multiple causes (MIMIC) model approach. International Journal of Psychology, 50, 272–278. doi: 10.1002/ijop.12096.CrossRefGoogle Scholar
  49. Lovibond, S. H., & Lovibond, P. F. (1995). Manual for the depression anxiety stress scales. Sydney: Psychology Foundation.Google Scholar
  50. Low, K. G. (2011). Flourishing, substance use, and engagement in students entering college- A preliminary study. Journal of American College Health, 59, 555–561. doi: 10.1080/07448481.2011.563432.CrossRefGoogle Scholar
  51. MacCann, C., Fogarty, G. J., Zeidner, M., & Roberts, R. D. (2011). Coping mediates the relationship between emotional intelligence (EI) and academic achievement. Contemporary Educational Psychology, 36, 60–70. doi: 10.1016/j.cedpsych.2010.11.002.CrossRefGoogle Scholar
  52. Maddi, S. R., Harvey, R. H., Khoshaba, D. M., Fazel, M., & Resurreccion, N. (2012). The relationship of and some other relevant variables to college performance. Journal of Humanistic Psychology, 52, 190–205. doi: 10.1177/0022167811422497.CrossRefGoogle Scholar
  53. Marsh, C. N., & Wilcoxen, S. (2015). Underutilization of mental health services among college students: an examination of system-related barriers. Journal of College Student Psychotherapy, 29, 227–243. doi: 10.1080/87568225.2015.1045783.CrossRefGoogle Scholar
  54. Mayordomo-Rodríguez, T., Meléndez-Moral, J. C., Viguer-Segui, P., & Sales-Galán, A. (2015). Coping strategies as predictors of well-being in youth adult. Social Indicators Research, 122, 479–489. doi: 10.1007/s11205-014-0689-4.CrossRefGoogle Scholar
  55. Meehl, P. E. (1990). Why summaries of research on psychological theories are often uninterpretable. Psychological Reports, 66 (Monograph Supplement 1-Vol. 66), 195–244.Google Scholar
  56. Moore, S. A., Wildales-Benetiz, O., Carnazzo, K. W., Kim, E. K., Moffa, K., & Dowdy, E. (2015). Conducting universal complete mental health screening via student self-report. Contemporary School Psychology, 19, 253–267. doi: 10.1007/s40688-015-0062-x.CrossRefGoogle Scholar
  57. Nadinloyi, K. B., Hajloo, N., Garamaleki, N. S., & Sadeghi, H. (2013). The study efficacy of time management training on increase academic time management of students. Procedia-Social and Behavioral Sciences, 84, 134–138. doi: 10.1016/j.sbspro.2013.06.523.CrossRefGoogle Scholar
  58. Pennell, C., Boman, P., & Mergler, A. (2015). Covitality constructs as predictors of psychological well-being and depression for secondary school students. Contemporary School Psychology, 19, 276–285. doi: 10.1007/s40688-015-0067-5.CrossRefGoogle Scholar
  59. Qualter, P., Dacre Pool, L., Gardner, K. J., Ashley-Kot, S., Wise, A., & Wols, A. (2015). The Emotional Self-Efficacy Scale: adaptation and validation for young adolescents. Journal of Psychoeducational Assessment, 33, 33–45. doi: 10.1177/0734282914550383.CrossRefGoogle Scholar
  60. Quoidbach, J., Mikolajczak, M., & Gross, J. J. (2015). Positive interventions: an emotion regulation perspective. Psychological Bulletin, 141, 655–693. doi: 10.1037/a0038648.CrossRefGoogle Scholar
  61. Raghavan, R. (2014). Improving the identification of mental health need on college campuses. Journal of Adolescent Health, 55, 598–599. doi: 10.1016/j.jadohealth.2014.08.007.CrossRefGoogle Scholar
  62. Renshaw, T. R. (2016). Technical adequacy of the Positive Experiences at School Scale with Adolescents. Journal of Psychoeducational Assessment. First published online January 2016. doi: 10.1177/0734282915627920.
  63. Renshaw, T. L., & Bolognino, S. J. (2015). The College Student subjective wellbeing questionnaire: A brief, multidimensional measure of undergraduate’s covitality. Journal of Happiness Studies, 1–22. First online: 17 December 2014. doi:  10.1007/s10902-014-9606-4.
  64. Renshaw, T. L., Furlong, M. J., Dowdy, E., Rebelez, J., Smith, D. C., O’Malley, I., & Strom, I. F. (2014). Covitality: A synergistic conception of adolescents’ mental health. In M. J. Furlong, R. Gilman, & E. S. Huebner (Eds.), Handbook of positive psychology in schools (2nd ed., pp. 12–32). New York: Routledge/Taylor & Francis.Google Scholar
  65. Robinson-Cimpian, J. P. (2014). Inaccurate estimation of disparities due to mischievous responders: several suggestions to assess conclusions. Educational Researcher, 43, 171–185. doi: 10.3102/0013189X14534297.CrossRefGoogle Scholar
  66. Seligman, M. E. P. (2011). Flourish: A visionary new understanding of happiness and well-being. New York: Simon & Schuster.Google Scholar
  67. Standing, L., Sproule, R., & Khouzam, N. (1991). Empirical statistics: IV. illustrating meehl’s sixth law of soft psychology: everything correlates with everything. Psychological Reports, 69, 123–126. doi: 10.2466/PR0.69.5.123-126.CrossRefGoogle Scholar
  68. Steiger, J. H., & Lind, A. (1980). Statistically based tests for the number of common factors. Paper presented at the annual meeting of the Psychometric Society, Iowa City.Google Scholar
  69. Terry, M. L., Leary, M. R., & Mehta, S. (2013). Self-compassion as a buffer against homesickness, depression, and dissatisfaction in the transition to college. Self and Identity, 12, 278–290. doi: 10.1080/15298868.2012.667913.CrossRefGoogle Scholar
  70. Vandenberg, R. J., & Lance, C. E. (2000). A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Research Methods, 3, 4–70. doi: 10.1177/109442810031002.CrossRefGoogle Scholar
  71. Villegas-Gold, R., & Yoo, H. C. (2014). Coping with discrimination among Mexican American college students. Journal of Counseling Psychology, 61, 404–413. doi: 10.1037/a0036591.CrossRefGoogle Scholar
  72. Wang, C., Yang, C., Jiang, X., & Furlong, M. J. (2016). Validation of social emotional health survey-primary for Chinese students. Manuscript under review.Google Scholar
  73. Watson, D., Clark, L. A., & Tellegen, A. (1988). Development and validation of brief measures of positive and negative affect: the PANAS Scales. Journal of Personality and Social Psychology, 47, 1063–1070. doi: 10.1037/0022-3514.54.6.1063.CrossRefGoogle Scholar
  74. Weiss, A., & Luciano, M. (2015). The genetics and evolution of covitality. In A. Weiss (Ed.), Genetics of psychological well-being: The role of heritability and genetics in positive psychology (pp. 146–160). New York: Oxford University Press.CrossRefGoogle Scholar
  75. Weiss, A., King, J. E., & Enns, R. M. (2002). Subjective well-being is heritable and genetically correlated with dominance in chimpanzees (Pan troglodytes). Journal of Personality and Social Psychology, 83, 1141–1149. doi: 10.1371/journal.pone.0095741.CrossRefGoogle Scholar
  76. You, S., Furlong, M. J., Dowdy, E., Renshaw, T. L., Smith, D. C., & O’Malley, M. D. (2014). Further validation of the Social and Emotional Health Survey for high school students. Applied Research in Quality of Life, 9, 997–1015. doi: 10.1007/s11482-013-9282-2.CrossRefGoogle Scholar
  77. You, S., Furlong, M., Felix, E., & O’Malley, M. (2015). Validation of the Social and Emotional Health Survey for five sociocultural groups: multigroup invariance and latent mean analyses. Psychology in the Schools, 52, 349–362. doi: 10.1002/pits.21828.CrossRefGoogle Scholar
  78. Zachariah, S., Boman, P., Mergler, A., & Furlong, M. J. (2015). Effect of self-deception on well-being and anxiety in university students. Cogent Psychology, 2, 1–17. doi: 10.1080/23311908.2014.993850.Google Scholar

Copyright information

© Springer Science+Business Media Dordrecht and The International Society for Quality-of-Life Studies (ISQOLS) 2016

Authors and Affiliations

  • Michael J. Furlong
    • 1
    Email author
  • Sukkyung You
    • 2
  • Mark Shishim
    • 3
  • Erin Dowdy
    • 4
  1. 1.International Center for School-Based Youth DevelopmentUniversity of California Santa BarbaraSanta BarbaraUSA
  2. 2.College of EducationHankuk University of Foreign StudiesSeoulSouth Korea
  3. 3.Academic InitiativesUniversity of California Santa BarbaraSanta BarbaraUSA
  4. 4.Department of Counseling, Clinical, and School PsychologyUniversity of California Santa BarbaraSanta BarbaraUSA

Personalised recommendations