Research in Higher Education

, Volume 57, Issue 6, pp 768–793 | Cite as

Developing and Evaluating the Culturally Engaging Campus Environments (CECE) Scale: An Examination of Content and Construct Validity

  • Samuel D. MuseusEmail author
  • Duan Zhang
  • Mee Joo Kim


The purpose of the current examination was to develop a scale to measure campus environments and their impact on the experiences and outcomes of diverse student populations. The Culturally Engaging Campus Environments (CECE) Scale was designed to measure the nine elements of college environments that foster success among diverse populations. Authors utilize a variety of techniques to examine the content and construct validity of the CECE Scale using a sample of 499 undergraduates across three institutions. Results indicate that the CECE Scale exhibits a high level of content and construct validity and could be a useful tool for measuring campus environments and their impact on student experiences and outcomes. Implications for future research and practice are discussed.


Diversity Campus environments Persistence Retention Success 


  1. Antonio, A. L. (2004). Diversity and the influence of friendship groups in college. The Review of Higher Education, 25(1), 63–89.CrossRefGoogle Scholar
  2. Antonio, A. L., Chang, M. J., Hakuta, K., Kenny, D. A., Levin, S., & Milem, J. F. (2004). Effects of racial diversity on complex thinking in college students. Psychological Science, 15(8), 507–510.CrossRefGoogle Scholar
  3. Astin, A. W. (1993). What matters in college? Four critical years revisited. San Francisco: Jossey-Bass.Google Scholar
  4. Astin, A. W., & Sax, L. J. (1998). How undergraduates are affected by service participation. Journal of College Student Development, 39(3), 251–263.Google Scholar
  5. Attinasi, L. C. Jr. (1989). Getting in: Mexican Americans’ perceptions of university attendance and the implications for freshman year persistence. Journal of Higher Education, 60(3), 247–277.Google Scholar
  6. Bensimon, E. (2007). The underestimated significance of practitioner knowledge in the scholarship on student success. The Review of Higher Education, 30(4), 441–469.Google Scholar
  7. Braxton, J. M., & Lien, L. A. (2000). The viability of academic integration as a central construct in Tinto’s interactionalist theory of student departure. In J. M. Braxton (Ed.), Reworking the student departure puzzle (pp. 11–28). Nashville: Vanderbilt University Press.Google Scholar
  8. Braxton, J. M., Sullivan, A. S., & Johnson, R. M. (1997). Appraising Tinto’s theory. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 12, pp. 71–96). San Francisco: Jossey-Bass.Google Scholar
  9. Cabrera, A. F., Nora, A., & Castañeda, M. B. (1992). The role of finances in the persistence process: A structural model. Research in Higher Education, 33(5), 571–594.Google Scholar
  10. Cabrera, A., Nora, A., Pascarella, E. T., Terenzini, P. T., & Hagedorn, L. (1999). Campus racial climate and the adjustment of students to college: A comparison between White students and African-American students. Journal of Higher Education, 70, 134–160.Google Scholar
  11. Cabrera, A., Stampen, J., & Hansen, W. (1990). Exploring the effects of ability to pay on persistence in college. The Review of Higher Education, 13(3), 306–366.Google Scholar
  12. Chang, M. J. (2001). Is it more than about getting along? The broader educational relevance of reducing students’ racial biases. Journal of College Student Development, 42(2), 93–105.Google Scholar
  13. Chang, M. J., Astin, A. W., & Kim, D. (2004). Cross-racial interaction among undergraduates: Some consequences, causes and patterns. Research in Higher Education, 45(5), 529–552.CrossRefGoogle Scholar
  14. Chang, M. J., Denson, D., Saenz, V., & Misa, K. (2006). The educational benefits of sustaining cross-racial interaction among undergraduates. Journal of Higher Education, 77(3), 430–455.Google Scholar
  15. Cronbach, L. J., & Meehl, P. E. (1955). Construct validity in psychological tests. Psychological Bulletin, 52(4), 281–302.CrossRefGoogle Scholar
  16. Curtin, R., Presser, S., & Singer, E. (2000). The effects of response rate changes on the index of consumer sentiment. Public Opinion Quarterly, 64, 413–428.CrossRefGoogle Scholar
  17. Dennis, J. M., Phinney, J. S., & Chuateco, L. I. (2005). The role of motivation, parental support, and peer support in the academic success of ethnic minority first-generation college students. Journal of College Student Development, 46(3), 223–236.CrossRefGoogle Scholar
  18. Dowd, A. C., Sawatzky, M., & Korn, R. (2011). Theoretical foundations and a research agenda to validate measures of intercultural effort. The Review of Higher Education, 35(1), 17–44.CrossRefGoogle Scholar
  19. Enders, C. K. (2003). Using the expectation maximization algorithm to estimate coefficient alpha for scales with item-level missing data. Psychological Methods, 8(3), 322–337.CrossRefGoogle Scholar
  20. Eyler, J. S., & Giles, D. E, Jr. (1999). Where’s the learning in service-learning? San Francisco: Jossey-Bass.Google Scholar
  21. Fosnacht, K., Sarraf, S., Howe, E., & Peck, L. (2013). How important are high response rates for college surveys? Paper presented at the annual forum of the Association for Institutional Research, Long Beach, CA.Google Scholar
  22. Fullilove, R. E., & Treisman, E. M. (1990). Mathematics achievement among African American undergraduates at the University of California, Berkeley: An evaluation of the mathematics workshop program. The Journal of Negro Education, 59(3), 463–478.CrossRefGoogle Scholar
  23. Gloria, A. M., Castellanos, J., López, A., & Rosales, R. (2005). An examination of academic non-persistence decisions of Latino undergraduates. Hispanic Journal of Behavioral Sciences, 27, 202–223.CrossRefGoogle Scholar
  24. Gonzalez, K. P. (2003). Campus culture and the experiences of Chicano students in a predominantly White university. Urban Education, 37(2), 193–218.Google Scholar
  25. Graham, J. W. (2009). Missing data analysis: Making it work in the real world. Annual Review of Psychology, 60, 549–576.CrossRefGoogle Scholar
  26. Graham, J. W., Cumsille, P. E., & Elek-Fisk, E. (2003). Methods for handling missing data. In J. A. Schinka & W. F. Velicer (Eds.), Handbook of psychology: Research methods in psychology (Vol. 2, pp. 87–114). New York: Wiley.Google Scholar
  27. Groves, R. M. (2006). Nonresponse rates and nonresponse bias in household surveys. Public Opinion Quarterly, 70(5), 646–675.CrossRefGoogle Scholar
  28. Guiffrida, D. A. (2003). African American student organizations as agents of social integration. Journal of College Student Development, 44(3), 304–319.CrossRefGoogle Scholar
  29. Guiffrida, D. A. (2005). Othermothering as a framework for understanding African American students’ definitions of student-centered faculty. Journal of Higher Education, 76(6), 701–723.CrossRefGoogle Scholar
  30. Guiffrida, D. A. (2006). Toward a cultural advancement of Tinto’s theory. The Review of Higher Education, 29(4), 451–472.Google Scholar
  31. Hu, L. T., & Bentler, P. M. (1999). Cutoff criteria for fit indexes in covariance structure analysis: Conventional criteria versus new alternatives. Structural Equation Modeling, 6, 1–55.CrossRefGoogle Scholar
  32. Hurtado, S. (1992). The campus racial climate: Contexts and conflict. Journal of Higher Education, 63(5), 539–567.Google Scholar
  33. Hurtado, S., Alvarez, C. L., Guillermo-Wann, C., Cuellar, M., & Arellano, L. (2012). A model for diverse learning environments: The scholarship on creating and assessing conditions for student success. In M. B. Paulsen (Ed.), Higher education: Handbook of theory and research (Vol. 27, pp. 41–122). New York, NY: Springer.Google Scholar
  34. Hurtado, S., & Carter, D. (1997). Effects of college transition and perceptions of the campus racial climate on Latina/o college students’ sense of belonging. Sociology of Education, 70, 324–345.CrossRefGoogle Scholar
  35. IBM Corp. (2013). IBM SPSS statistics for windows, version 22.0. Armonk, NY: IBM Corp.Google Scholar
  36. Jenkins, D. (2006). What community college policies and practices are effective in promoting student success? A study of high- and low-impact institutions. New York: Community College Research Center.Google Scholar
  37. Kelloway, K. E. (1995). Structural equation modeling in prespective. Journal of Organizational Behavior, 16, 215–224.CrossRefGoogle Scholar
  38. Kiang, P. N. (2002). Stories and structures of persistence: Ethnographic learning through research and practice in Asian American Studies. In Y. Zou & H. T. Trueba (Eds.), Advances in ethnographic research: From our theoretical and methodological roots to post-modern critical ethnography (pp. 223–255). Lanham: Rowman & Littlefield.Google Scholar
  39. Kiang, P. N. (2009). A thematic analysis of persistence and long-term educational engagement with Southeast Asian American college students. In L. Zhan (Ed.), Asian American voices: Engaging, empowering, enabling (pp. 21–58). New York: NLN Press.Google Scholar
  40. Kuh, G. D., Kinzie, J., Schuh, J. H., Whitt, E. J., & Associates. (2005). Student success in college: Creating conditions that matter. San Francisco: Jossey-Bass.Google Scholar
  41. Kuh, G. D., & Love, P. G. (2000). A cultural perspective on student departure. In J. M. Braxton (Ed.), Reworking the student departure puzzle (pp. 196–212). Nashville: Vanderbilt University Press.Google Scholar
  42. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28, 563–575.CrossRefGoogle Scholar
  43. Locker, D. (1993). Effects of non-response on estimates derived from an oral health survey of older adults. Community Dentistry and Oral Epidemiology, 21, 108–113.CrossRefGoogle Scholar
  44. Massey, D. S., & Tourangeau, R. (2013). Where do we go from here? Nonresponse and social measurement. The ANNALS of the American Academy of Political and Social Science, 645, 222–236.CrossRefGoogle Scholar
  45. Museus, S. D. (2008). The role of ethnic student organizations in fostering African American and Asian American students’ cultural adjustment and membership at predominantly White institutions. Journal of College Student Development, 49(6), 568–586.CrossRefGoogle Scholar
  46. Museus, S. D. (2011). Using cultural perspectives to understand the role of ethnic student organizations in Black students’ progress to the end of the pipeline. In D. E. Evensen & C. D. Pratt (Eds.), The end of the pipeline: A journey of recognition for African Americans entering the legal profession (pp. 162–172). Durham, NC: Carolina Academic Press.Google Scholar
  47. Museus, S. D. (2013). Asian Americans and Pacific Islanders: A national portrait of growth, diversity, and inequality. In S. D. Museus, D. C. Maramba, & R. T. Teranishi (Eds.), The misrepresented minority: New insights on Asian Americans and Pacific Islanders, and their implications for higher education. Stylus: Sterling.Google Scholar
  48. Museus, S. D. (2014). The Culturally Engaging Campus Environments (CECE) Model: A new theory of college success among racially diverse student populations. In M. B. Paulsen (Ed.), Higher Education: Handbook of Theory and Research (pp. 189–227). New York: Springer.CrossRefGoogle Scholar
  49. Museus, S. D., Lam, S., Huang, C., Kem, P., & Tan, K. (2012). Cultural integration in campus subcultures: Where the cultural, academic, and social spheres of college life collide. In S. D. Museus & U. M. Jayakumar (Eds.), Creating campus cultures: Fostering success among racially diverse student populations (pp. 106–129). New York: Routledge.Google Scholar
  50. Museus, S. D., & Neville, K. (2012). Delineating the ways that key institutional agents provide racial minority students with access to social capital in college. Journal of College Student Development, 53(3), 436–452.CrossRefGoogle Scholar
  51. Museus, S. D., Nichols, A. H., & Lambert, A. (2008). Racial differences in the effects of campus racial climate on degree completion: A structural model. The Review of Higher Education, 32(1), 107–134.Google Scholar
  52. Museus, S. D., & Quaye, S. J. (2009). Toward an intercultural perspective of racial and ethnic minority college student persistence. The Review of Higher Education, 33(1), 67–94.CrossRefGoogle Scholar
  53. Museus, S. D., & Ravello, J. N. (2010). Characteristics of academic advising that contribute to racial and ethnic minority student success at predominantly White institutions. NACADA Journal, 30(1), 47–58.CrossRefGoogle Scholar
  54. Museus, S. D., Shiroma, K., Dizon, J. P., & Nguyen, P. C. (in press). A qualitative examination of the impact of community cultural connections on Southeast Asian American college student success. Journal of College Student Development (accepted).Google Scholar
  55. Muthén, L. K. & Muthén, B. O. (1998–2012). Mplus user’s guide (7th ed.). Los Angeles: Muthén & Muthén.Google Scholar
  56. National Center for Education Statistics [NCES]. (2012). Graduation rates of first-time postsecondary students who started as full-time degree/certificate-seeking students, by sex, race/ethnicity, time to completion, and level and control of institution where student started: Selected cohort entry years, 1996 through 2007. Retrieved from
  57. Nora, A. (2001). The depiction of significant others in Tinto’s “rites of passages”: A reconceptualization of the influence of family and community in the persistence process. Journal of College Student Retention, 3(1), 41–56.CrossRefGoogle Scholar
  58. Nora, A., Cabrera, A., Hagedorn, L., & Pascarella, E. T. (1996). Differential impacts of academic and social experiences of college-related behavioral outcomes across different ethnic and gender groups at four-year institutions. Research in Higher Education, 37(4), 427–451.CrossRefGoogle Scholar
  59. Nora, A., & Crisp, G. (2009). Hispanics and higher education: An overview of research, theory, and practice. In J. C. Smart (Ed.), Higher education: Handbook of theory and research (Vol. XXIV, pp. 317–353). New York: Springer.CrossRefGoogle Scholar
  60. Pascarella, E. T., & Terenzini, P. T. (2005). How college affects students: A third decade of research (Vol. 2). San Francisco: Jossey-Bass.Google Scholar
  61. Perneger, T. V., Chamot, E., & Bovier, P. A. (2005). Nonresponse bias in a survey of patient perceptions of hospital care. Medical Care, 43(4), 374–380.CrossRefGoogle Scholar
  62. Peytchev, A. (2013). Consequences of survey nonresponse. The ANNALS of the American Academy of Political and Social Science, 645, 88–111.CrossRefGoogle Scholar
  63. Pike, G. R. (2012). NSSE benchmarks and institutional outcomes: A note on the importance of considering the intended uses of a measure in validity studies. Research in Higher Education, 54(2), 149–170.CrossRefGoogle Scholar
  64. Rendón, L. I. (1994). Validating culturally diverse students: Toward a new model of learning and student development. Innovative Higher Education, 19(1), 33–51.CrossRefGoogle Scholar
  65. Rendón, L. I., Jalomo, R. E., & Nora, A. (2000). Theoretical considerations in the study of minority student retention in higher education. In J. Braxton (Ed.), Reworking the student departure puzzle (pp. 127–156). Nashville: Vanderbilt University Press.Google Scholar
  66. Rendón, L. I., & Muñoz, S. M. (2011). Revisiting validation theory: Theoretical foundations, applications, and extensions. Enrollment Management Journal: Student Access, Finance, and Success in Higher Education, 5(2), 12–33.Google Scholar
  67. Renn, K. A. (2000). Patterns of situational identity among biracial and multiracial college students. Review of Higher Education, 23, 399–420.CrossRefGoogle Scholar
  68. Rungtusanatham, M. (1998). Let’s not overlook content validity. Decision Line, 29, 10–13.Google Scholar
  69. Schafer, J. L., & Graham, J. W. (2002). Missing data: Our view of the state of the art. Psychological Methods, 7, 147–177.CrossRefGoogle Scholar
  70. Schmitt, N., & Ostroff, C. (1986). Operationalizing the “behavioral consistency” approach: Selection test development based on a content-oriented strategy. Personnel Psychology, 39, 91–108.CrossRefGoogle Scholar
  71. Schultz, K. S., Whitney, D. J., & Zickar, M. J. (2013). Measurement theory in action: Case studies and exercises. New York: Routledge.Google Scholar
  72. Sedlacek, W. E. (1987). Black students on White campuses: 20 years of research. Journal of College Student Personnel, 28, 485–495.Google Scholar
  73. Thompson, C. E., & Fretz, B. R. (1991). Predicting the adjustment of Black students at predominantly White institutions. Journal of Higher Education, 62(4), 437–450.CrossRefGoogle Scholar
  74. Tierney, W. G. (1992). An anthropological analysis of student participation in college. Journal of Higher Education, 63(6), 603–618.CrossRefGoogle Scholar
  75. Tierney, W. G. (1999). Models of minority college-going and retention: Cultural integrity versus cultural suicide. The Journal of Negro Education, 68(1), 80–91.CrossRefGoogle Scholar
  76. Tinto, V. (1987). Leaving college: Rethinking the causes and cures of student attrition. Chicago: University of Chicago Press.Google Scholar
  77. Tinto, V. (1993). Leaving college: Rethinking the causes and cures of student attrition (2nd ed.). Chicago: University of Chicago Press.Google Scholar
  78. Williams, L. J. (1995). Covariance structure modeling in organizational research: Problems with the method versus applications of the method. Journal of Organizational Behavior, 16, 225–234.CrossRefGoogle Scholar
  79. Wilson, F. R., Pan, W., & Schumsky, D. A. (2012). Recalculation of the critical values for Lawshe’s content validity ratio. Measurement and Evaluation in Counseling and Development, 45, 197–210.CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  1. 1.Indiana UniversityBloomingtonUSA
  2. 2.University of DenverDenverUSA
  3. 3.University of WashingtonSeattleUSA

Personalised recommendations