Identifying and Using Secondary Datasets to Answer Policy Questions Related to School-Based Counseling: A Step-by-Step Guide

Chapter

Abstract

This chapter expands knowledge of national secondary datasets with the aim of increasing policy relevant research related to school-based counseling. A brief review of benefits and challenges of national and international secondary datasets is provided. A six-step research process (i.e., gaining access to the data, becoming familiar with and evaluating the data, preparing the data for analysis, conducting appropriate analyses, interpreting results and examining policy implications, and describing the limitations of the study/data) is presented as a step-by-step guide to conducting research studies with these national and international secondary datasets. Potential policy relevant research questions pertinent to school-based counseling are discussed.

References

  1. Adams, J. R., Benshoff, J. M., & Harrington, S. Y. (2007). An examination of referrals to the school counselor by race, gender, and family structure. Professional School Counseling, 10, 389–398.CrossRefGoogle Scholar
  2. Allen, K. (2010). A bullying intervention system: Reducing risk and creating support for aggressive students. Preventing School Failure, 54(3), 199–209. doi: 10.1080/10459880903496289.CrossRefGoogle Scholar
  3. Allison, P. D. (2003). Missing data techniques for structural equation modeling. Journal of Abnormal Psychology, 112(4), 545–557.CrossRefPubMedGoogle Scholar
  4. American School Counselor Association. (2014). Mindsets and behaviors for student success: K–12 college-and career-readiness standards for every student. Alexandria, VA: Author.Google Scholar
  5. Baraldi, A. N., & Enders, C. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37.CrossRefPubMedGoogle Scholar
  6. Byrne, B. M. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming. New York: Routledge.Google Scholar
  7. Bryan, J., Day-Vines, N., Griffin, D., & Moore-Thomas, C. (2012). The disproportionality dilemma: Patterns of teacher referrals to school counselors for disruptive behavior. Journal of Counseling and Development, 90, 177–190.Google Scholar
  8. Bryan, J., Day-Vines, N. L., Holcomb-McCoy, C., & Moore-Thomas, C. (2010). Using national education longitudinal data sets in school counseling research. Counselor Education and Supervision, 49(4), 266–279.CrossRefGoogle Scholar
  9. Bryan, J., & Henry, L. (2012). A model for building school–family–community partnerships: Principles and process. Journal of Counseling and Development, 90, 408–420. doi: 10.1002/j.1556-6676.2012.00052.x.CrossRefGoogle Scholar
  10. Bryan, J., Holcomb-McCoy, C., Moore-Thomas, C., & Day-Vines, N. (2009). Who sees the school counselor for college information? A national study. Professional School Counseling, 12, 280–291.Google Scholar
  11. Bryan, J., Moore-Thomas, C., Day-Vines, N., & Holcomb-McCoy, C. (2011). School counselors as social capital: The effects of high school college counseling on college application rates. Journal of Counseling and Development, 89, 190–199.CrossRefGoogle Scholar
  12. Bryan, J., Moore-Thomas, C., Day-Vines, N., Holcomb-McCoy, C., & Mitchell, N. M. (2009). Characteristics of students who receive school counseling services: Implications for practice and research. Journal of School Counseling, 7(21), 1–29. Retrieved from http://jsc.montana.edu/articles/v7n21.pdf.
  13. Bryan, J., Moore-Thomas, C., Gaenzle, S., Kim, J., Lin, C., & Na, G. (2012). The effects of school bonding on high school seniors’ academic achievement. Journal of Counseling and Development, 90, 467–480.Google Scholar
  14. Bryan, J., Young, A., Griffin, D., & Henry, L. (2016). Preparing students for higher education: How school counselors can foster college readiness and access. In J. L. DeVitis & P. Sasso (Eds.), Higher education and society (pp. 149–172). New York: Peter Lang.Google Scholar
  15. Carey, J. C., & Martin, I. (2015). A review of the major school counseling policy studies in the United States: 2000–2014. Amherst, MA: Center for School Counseling Outcome Research and Evaluation. Retrieved from http://www.counseling.org/docs/default-source/resources---school-counselors/carey-and-martin-2015-policy-research-monograph.pdf?sfvrsn=8.
  16. Cheslock, J. J., & Rios-Aguilar, C. (2011). Multilevel analysis in higher education research: A multidisciplinary approach. In J. Smart & M. Paulsen (Eds.), Higher education: Handbook of theory and research (Vol. 26, pp. 85–123). The Netherlands: Springer.Google Scholar
  17. Cholewa, B., Burkhardt, C. K., & Hull, M. F. (2015). Are school counselors impacting underrepresented students’ thinking about postsecondary education? A nationally representative study. Professional School Counseling, 19(1), 144–154.CrossRefGoogle Scholar
  18. Coker, J. K., & Borders, L. D. (2001). An analysis of environmental and social factors affecting adolescent problem drinking. Journal of Counseling & Development, 79, 200–208.CrossRefGoogle Scholar
  19. Collins, L. M., & Lanza, S. T. (2013). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (2nd ed.). New York: John Wiley & Sons.Google Scholar
  20. Croninger, R. G., & Lee, V. E. (2001). Social capital and dropping out of high school: Benefits to at-risk students of teachers’ support and guidance. Teachers College Record, 103, 548–581.CrossRefGoogle Scholar
  21. Dumais, S. A. (2009). The academic attitudes of American teenagers, 1990–2002: Cohort and gender effects on math achievement. Social Science Research, 38(4), 767–780.Google Scholar
  22. Dumais, S. A. (2008). Cohort and gender differences in extracurricular participation: The relationship between activities, math achievement, and college expectations. Sociological Spectrum, 29(1), 72–100.CrossRefGoogle Scholar
  23. Engberg, M. E., & Gilbert, A. J. (2014). The counseling opportunity structure: Examining correlates of four-year college going rates. Research in Higher Education, 55(3), 219–244.CrossRefGoogle Scholar
  24. Espelage, D. (2015). Data needs for emerging research issues in bully and violence prevention: Strengths and limitations of the National Center for Educational Statistics data sets. AERA Open, 1(3), doi: http://dx.doi.org/10.1177/2332858415604147.
  25. Espelage, D. L. (2014). Using NCES surveys to understand school violence and bullying. Paper Prepared for the National Academy of Education’s Workshop to Examine Current and Potential Uses of NCES Longitudinal Surveys by the Education Research Community, Washington, DC. Retrieved from http://www.naeducation.org/cs/groups/naedsite/documents/webpage/naed_160696.pdf.
  26. Farrington, C. A., Roderick, M., Allensworth, E., Nagaoka, J., Keyes, T. S., Johnson, D. W., & Beechum, N. O. (2012). Teaching adolescents to become learners. The role of noncognitive factors in shaping school performance: A critical literature review. Chicago: University of Chicago Consortium on Chicago School Research. Retrieved from https://consortium.uchicago.edu/sites/default/files/publications/Noncognitive Report.pdf.Google Scholar
  27. Foote, M. Q., & Bartell, T. G. (2011). Pathways to equity in mathematics education: How life experiences impact researcher positionality. Educational Studies in Mathematics, 78(1), 45–68.CrossRefGoogle Scholar
  28. Glover, D. (2002). What makes a good “policy paper”? Ten examples (no. sp200205t1). Economy and environment program for Southeast Asia (EEPSEA). Retrieved from https://idl-bnc.idrc.ca/dspace/bitstream/10625/27168/1/118102.pdf.
  29. Grammer, J. K., Coffman, J. L., Ornstein, P. A., & Morrison, F. J. (2013). Change over time: Conducting longitudinal studies of children’s cognitive development. Journal of Cognition and Development, 14(4), 515–528. Retrieved from http://curran.web.unc.edu/files/2015/03/BainterCurran2015.pdf.CrossRefPubMedPubMedCentralGoogle Scholar
  30. Griffith, D. M., Neighbors, H. W., & Johnson, J. (2009). Using national data sets to improve the health and mental health of Black Americans: Challenges and opportunities. Cultural Diversity and Ethnic Minority Psychology, 15(1), 86.CrossRefPubMedGoogle Scholar
  31. Hahs-Vaughn, D. L. (2017). Applied multivariate statistical concepts. Abingdon, UK/Oxon/New York: Routledge.Google Scholar
  32. Hahs-Vaughn, D. L. (2007). Using NCES national datasets for evaluation of postsecondary issues. Assessment & Evaluation in Higher Education, 32(3), 239–254. http://education.ufl.edu/educational-research/files/2011/01/Hahs-Vaughn_2007_Using-NCES-datasets.pdf.CrossRefGoogle Scholar
  33. Hahs-Vaughn, D. L. (2006). Analysis of data from complex samples. International Journal of Research & Method in Education, 29(2), 165–183.CrossRefGoogle Scholar
  34. Hahs-Vaughn, D. L. (2005). A primer for using and understanding weights with national datasets. Journal of Experimental Education, 73(3), 221–248. Retrieved from http://education.ufl.edu/educational-research/files/2011/01/Hahs-Vaughn_2005_Using-weights-with-national-datasets.pdf.CrossRefGoogle Scholar
  35. Hahs-Vaughn, D. L., McWayne, C. M., Bulotsky-Shearer, R. J., Wen, X., & Faria, A. M. (2011b). Complex sample data recommendations and troubleshooting. Evaluation Review, 0193841X11412070. Retrieved from https://www.researchgate.net/profile/Rebecca_Bulotsky-Shearer/publication/51245439_Complex_sample_data_recommendations_and_troubleshooting/links/53da4e0b0cf2e38c633676b6.pdf.
  36. Hahs-Vaughn, D. L., McWayne, C. M., Bulotsky-Shearer, R. J., Wen, X., & Faria, A. M. (2011a). Methodological considerations in using complex survey data: An applied example with the head start family and child experiences survey. Evaluation Review, 35(3), 269–303. Retrieved from https://www.researchgate.net/profile/Rebecca_Bulotsky-Shearer/publication/51245439_Complex_sample_data_recommendations_and_troubleshooting/links/53da4e0b0cf2e38c633676b6.pdf.CrossRefPubMedGoogle Scholar
  37. Herrold, K., & O’Donnell, K. (2008). Parent and Family Involvement in Education, 2006–07 school year, from the National Household Education Surveys Program of 2007 (NCES 2008–050). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.Google Scholar
  38. Hofferth, S. L. (2005). Secondary data analysis in family research. Journal of Marriage and Family, 67(4), 891–907.CrossRefGoogle Scholar
  39. Kim, J., & Bryan, J. (2017). A first step to a conceptual framework of parent empowerment: Exploring relationships between parent empowerment and academic performance in a national sample. Journal of Counseling and Development, 95(2), 168–179.CrossRefGoogle Scholar
  40. Kluwin, T. N., & Morris, C. S. (2006). Lost in a giant database: The potentials and pitfalls of secondary analysis for deaf education. American Annals of the Deaf, 151(2), 121–128.CrossRefGoogle Scholar
  41. Lanza, S. T., & Cooper, B. R. (2016). Latent class analysis for developmental research. Child Development Perspectives, 10(1), 59–64. doi: 10.1111/cdep.12163.CrossRefGoogle Scholar
  42. Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168. http://doi.org/10.1007/s11121-011-0201-1.CrossRefPubMedPubMedCentralGoogle Scholar
  43. Lapan, R. T., Wells, R., Petersen, J., & McCann, L. A. (2014). Stand tall to protect students: School counselors strengthening school connectedness. Journal of Counseling & Development, 92(3), 304–315.CrossRefGoogle Scholar
  44. Lauritsen, J. L. (2015). The devil is in the details: Crime and victimization research with the National Crime Victimization Survey. In M. D. Maltz & S. K. Rice (Eds.), Envisioning criminology: Researchers on research as a process of discovery (pp. 191–197). Cham, Switzerland: Springer International Publishing.CrossRefGoogle Scholar
  45. Lee, S., & Smith-Adcock, S. (2005). A model of girls’ school delinquency: School bonding and reputation. Professional School Counseling, 9(1), 78–87.CrossRefGoogle Scholar
  46. Lynch, M. F. (2012). Using multilevel modeling in counseling research. Measurement and Evaluation in Counseling and Development, 45(3), 211–224.CrossRefGoogle Scholar
  47. Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43, 304–316. 0013189X14545513.CrossRefGoogle Scholar
  48. Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Thousand Oaks, CA: Sage.Google Scholar
  49. McMahon, H. G., Mason, E., Daluga-Guenther, N., & Ruiz, A. (2014). An ecological model of professional school counseling. Journal of Counseling & Development, 92(4), 459–471.CrossRefGoogle Scholar
  50. Milner, H. R. (2007). Race, culture, and researcher positionality: Working through dangers seen, unseen, and unforeseen. Educational Researcher, 36(7), 388–400.CrossRefGoogle Scholar
  51. Mueller, C. E., & Hart, C. O. (2011). Effective use of secondary data analysis in gifted education research: Opportunities and challenges. Gifted Children, 4(2), 3. Retrieved from http://docs.lib.purdue.edu/cgi/viewcontent.cgi?article=1048&context=giftedchildren.
  52. Nagaoka, J., Farrington, C. A., Roderick, M., Allensworth, E., Keyes, T. S., Johnson, D. W., & Beechum, N. O. (2013). Readiness for college: The role of Noncognitive factors and context. Voices in Urban Education, 38, 45–52.Google Scholar
  53. Nathans, L. L., Nimon, K., & Walker, D. A. (2013). Use of the multiple lens approach to multiple regression findings with a national dataset. Multiple Linear Regression Viewpoints, 39(1), 25–33. Retrieved from http://mlrv.ua.edu/2013/vol39_1/Nathans%20et%20al..pdf.Google Scholar
  54. O’Connor, C., Lewis, A., & Mueller, J. (2007). Researching “Black” educational experiences and outcomes: Theoretical and methodological considerations. Educational Researcher, 36, 541–552.CrossRefGoogle Scholar
  55. Orletsky, D., Middleton, J. A., & Sloane, F. (2015). A review of three large-scale datasets critiquing item design, data collection, and the usefulness of claims. In J. A. Middleton, J. Cai, & S. Hwang (Eds), Large-Scale Studies in Mathematics Education (pp. 311–334). Research in Mathematics Education Series. Springer International Publishing. Springer.Google Scholar
  56. Osborne, J. (2011). Best practices in using large, complex samples: The importance of using appropriate weights and design effect compensation. Practical Assessment Research and Evaluation, 16, 1–7. Retrieved from http://pareonline.net/pdf/v16n12.pdf.Google Scholar
  57. O’Connell, A. A., & McCoach, D. B. (2008). Multilevel modeling of educational data. Charlotte, NC: Information Age Publishing.Google Scholar
  58. Peugh, J. L. (2010). A practical guide to multilevel modeling. Journal of School Psychology, 48(1), 85–112.CrossRefPubMedGoogle Scholar
  59. Peugh, J. L., & Enders, C. K. (2004). Missing data in educational research: A review of reporting practices and suggestions for improvement. Review of Educational Research, 74(4), 525–556.CrossRefGoogle Scholar
  60. Perna, L. W., & Titus, M. A. (2005). The relationship between parental involvement as social capital and college enrollment: An examination of racial/ethnic group differences. Journal of Higher Education, 76, 485–518.CrossRefGoogle Scholar
  61. Schneider, B., Carnoy, M., Kilpatrick, J., Schmidt, W. H., & Shavelson, R. J. (2007). Estimating causal effects using experimental and observational designs. Washington, DC: American Educational Research Association. Retrieved from http://documents.library.nsf.gov/edocs/LB1028.E77-2007-PDF-Estimating-Causal-effects-using-experimental-and-observational-designs.pdf.Google Scholar
  62. Schlomer, G. L., Bauman, S., & Card, N. A. (2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57, 1–10.CrossRefPubMedGoogle Scholar
  63. Snijders, T. A., & Bosker, T. A. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Los Angeles: Thousand Oaks: Sage.Google Scholar
  64. Stapleton, L. M., & Thomas, S. L. (2008). The use of national datasets for teaching and research: Source and issues. In A. O’Connell & B. McCoach (Eds.), Multilevel modeling of educational (pp. 11–59). Charlotte, NC: Information Age Publishing.Google Scholar
  65. Strayhorn, T. L. (2009). Accessing and analyzing national databases. In T. J. Kowalski & T. J. Lasley II (Eds.), Handbook of data-based decision making in education (pp. 105–122). New York: Routledge.Google Scholar
  66. St. John, E. P. (2004). Public policy and research on college access: Lessons learned from NCES research and state evaluation studies. In E. P. S. John (Ed.), Public policy and college access: Investigating the federal and state roles in equalizing postsecondary opportunity, readings on equal education (Vol. 19, pp. 181–196). New York: AMS Press.Google Scholar
  67. Suh, S., Suh, J., & Houston, I. (2007). Predictors of categorical at-risk high school dropouts. Journal of Counseling and Development, 85(2), 196.CrossRefGoogle Scholar
  68. Swadener, E. B. (1990). Children and families “at risk:” etiology, critique, and alternative paradigms. The Journal of Educational Foundations, 4(4), 17.Google Scholar
  69. Trusty, J. (2002). African Americans’ educational expectations: Longitudinal causal models for women and men. Journal of Counseling & Development, 80, 332–345.CrossRefGoogle Scholar
  70. Trusty, J., & Niles, S. G. (2003). High-school math courses and completion of the bachelor’s degree. Professional School Counseling, 7, 99–107.Google Scholar
  71. Trusty, J., & Niles, S. G. (2004). Realized potential or lost talent: High school variables and bachelor’s degree completion. The Career Development Quarterly, 53, 2–15.CrossRefGoogle Scholar
  72. United States Department of Education. (2010). Anti-bullying policies: Examples of provision in state laws. Key policy letter from the Education Secretary and Deputy Secretary. Retrieved from http://www2.ed.gov/policy/gen/guid/secletter/101215/html.
  73. Warren, J. R. (2015). The Future of NCES’s Longitudinal Student Surveys. AERA Open, 1(2), 2332858415587910. Retrieved from http://ero.sagepub.com/content/1/2/2332858415587910.full OR http://ero.sagepub.com/content/spero/1/2/2332858415587910.full.pdf.
  74. Wells, R. (2016). Large national datasets. In F. K. Stage & K. Manning (Eds.), Research in the college context: Approaches and methods (2nd ed., p. 106-?). New York: Routledge.Google Scholar
  75. Wells, R. S., Lynch, C. M., & Seifert, T. A. (2011). Methodological options and their implications: An example using secondary data to analyze Latino educational expectations. Research in Higher Education, 52(7), 693–716. Retrieved from https://www.researchgate.net/profile/Ryan_Wells2/publication/225768412_Methodological_Options_and_their_Implications_An_Example_Using_Secondary_Data_to_Analyze_Latino_Educational_Expectations/links/0f317535c5ac351646000000.pdf.CrossRefGoogle Scholar
  76. Wennberg, K. (2005). Entrepreneurship research through databases: Measurement and design issues. New England Journal of Entrepreneurship, 8(2), 3. Retrieved from http://digitalcommons.sacredheart.edu/cgi/viewcontent.cgi?article=1148&context=neje.
  77. Whiston, S. C. (2002). Response to the past, present, and future of school counseling: Raising some issues. Professional School Counseling, 5, 148–155.Google Scholar
  78. Wilcox, A., & Hirschfield, A. (2007). A framework for deriving policy implications from research. University of Huddersfield: Applied Criminology Centre. Retrieved from http://www.scopic.ac.uk/documents/Huddersfield_1.pdf
  79. Willms, J. D. (2011). Managing and using secondary data sets with multidisciplinary research teams. In K. H. Trzesniewski, M. Brent Donnellan, & R. E. Lucas (Eds.), Secondary data analysis: An introduction for psychologists (pp. 27–38). Washington, DC: American Psychological Association. x, 245 pp.http://dx.doi.org/10.1037/12350-002.
  80. Zhang, L. (2010). The use of panel data models in higher education policy studies. In J. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 25, pp. 307–349). Dordrecht, The Netherlands: Springer.CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  1. 1.The Pennsylvania State UniversityState CollegeUSA
  2. 2.Ball State UniversityMuncieUSA
  3. 3.Loyola University MarylandBaltimoreUSA

Personalised recommendations