Skip to main content

Identifying and Using Secondary Datasets to Answer Policy Questions Related to School-Based Counseling: A Step-by-Step Guide

  • Chapter
  • First Online:
International Handbook for Policy Research on School-Based Counseling

Abstract

This chapter expands knowledge of national secondary datasets with the aim of increasing policy relevant research related to school-based counseling. A brief review of benefits and challenges of national and international secondary datasets is provided. A six-step research process (i.e., gaining access to the data, becoming familiar with and evaluating the data, preparing the data for analysis, conducting appropriate analyses, interpreting results and examining policy implications, and describing the limitations of the study/data) is presented as a step-by-step guide to conducting research studies with these national and international secondary datasets. Potential policy relevant research questions pertinent to school-based counseling are discussed.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 279.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Adams, J. R., Benshoff, J. M., & Harrington, S. Y. (2007). An examination of referrals to the school counselor by race, gender, and family structure. Professional School Counseling, 10, 389–398.

    Article  Google Scholar 

  • Allen, K. (2010). A bullying intervention system: Reducing risk and creating support for aggressive students. Preventing School Failure, 54(3), 199–209. doi:10.1080/10459880903496289.

    Article  Google Scholar 

  • Allison, P. D. (2003). Missing data techniques for structural equation modeling. Journal of Abnormal Psychology, 112(4), 545–557.

    Article  PubMed  Google Scholar 

  • American School Counselor Association. (2014). Mindsets and behaviors for student success: K–12 college-and career-readiness standards for every student. Alexandria, VA: Author.

    Google Scholar 

  • Baraldi, A. N., & Enders, C. K. (2010). An introduction to modern missing data analyses. Journal of School Psychology, 48(1), 5–37.

    Article  PubMed  Google Scholar 

  • Byrne, B. M. (2016). Structural equation modeling with AMOS: Basic concepts, applications, and programming. New York: Routledge.

    Google Scholar 

  • Bryan, J., Day-Vines, N., Griffin, D., & Moore-Thomas, C. (2012). The disproportionality dilemma: Patterns of teacher referrals to school counselors for disruptive behavior. Journal of Counseling and Development, 90, 177–190.

    Google Scholar 

  • Bryan, J., Day-Vines, N. L., Holcomb-McCoy, C., & Moore-Thomas, C. (2010). Using national education longitudinal data sets in school counseling research. Counselor Education and Supervision, 49(4), 266–279.

    Article  Google Scholar 

  • Bryan, J., & Henry, L. (2012). A model for building school–family–community partnerships: Principles and process. Journal of Counseling and Development, 90, 408–420. doi:10.1002/j.1556-6676.2012.00052.x.

    Article  Google Scholar 

  • Bryan, J., Holcomb-McCoy, C., Moore-Thomas, C., & Day-Vines, N. (2009). Who sees the school counselor for college information? A national study. Professional School Counseling, 12, 280–291.

    Google Scholar 

  • Bryan, J., Moore-Thomas, C., Day-Vines, N., & Holcomb-McCoy, C. (2011). School counselors as social capital: The effects of high school college counseling on college application rates. Journal of Counseling and Development, 89, 190–199.

    Article  Google Scholar 

  • Bryan, J., Moore-Thomas, C., Day-Vines, N., Holcomb-McCoy, C., & Mitchell, N. M. (2009). Characteristics of students who receive school counseling services: Implications for practice and research. Journal of School Counseling, 7(21), 1–29. Retrieved from http://jsc.montana.edu/articles/v7n21.pdf.

  • Bryan, J., Moore-Thomas, C., Gaenzle, S., Kim, J., Lin, C., & Na, G. (2012). The effects of school bonding on high school seniors’ academic achievement. Journal of Counseling and Development, 90, 467–480.

    Google Scholar 

  • Bryan, J., Young, A., Griffin, D., & Henry, L. (2016). Preparing students for higher education: How school counselors can foster college readiness and access. In J. L. DeVitis & P. Sasso (Eds.), Higher education and society (pp. 149–172). New York: Peter Lang.

    Google Scholar 

  • Carey, J. C., & Martin, I. (2015). A review of the major school counseling policy studies in the United States: 2000–2014. Amherst, MA: Center for School Counseling Outcome Research and Evaluation. Retrieved from http://www.counseling.org/docs/default-source/resources---school-counselors/carey-and-martin-2015-policy-research-monograph.pdf?sfvrsn=8.

  • Cheslock, J. J., & Rios-Aguilar, C. (2011). Multilevel analysis in higher education research: A multidisciplinary approach. In J. Smart & M. Paulsen (Eds.), Higher education: Handbook of theory and research (Vol. 26, pp. 85–123). The Netherlands: Springer.

    Google Scholar 

  • Cholewa, B., Burkhardt, C. K., & Hull, M. F. (2015). Are school counselors impacting underrepresented students’ thinking about postsecondary education? A nationally representative study. Professional School Counseling, 19(1), 144–154.

    Article  Google Scholar 

  • Coker, J. K., & Borders, L. D. (2001). An analysis of environmental and social factors affecting adolescent problem drinking. Journal of Counseling & Development, 79, 200–208.

    Article  Google Scholar 

  • Collins, L. M., & Lanza, S. T. (2013). Latent class and latent transition analysis: With applications in the social, behavioral, and health sciences (2nd ed.). New York: John Wiley & Sons.

    Google Scholar 

  • Croninger, R. G., & Lee, V. E. (2001). Social capital and dropping out of high school: Benefits to at-risk students of teachers’ support and guidance. Teachers College Record, 103, 548–581.

    Article  Google Scholar 

  • Dumais, S. A. (2009). The academic attitudes of American teenagers, 1990–2002: Cohort and gender effects on math achievement. Social Science Research, 38(4), 767–780.

    Google Scholar 

  • Dumais, S. A. (2008). Cohort and gender differences in extracurricular participation: The relationship between activities, math achievement, and college expectations. Sociological Spectrum, 29(1), 72–100.

    Article  Google Scholar 

  • Engberg, M. E., & Gilbert, A. J. (2014). The counseling opportunity structure: Examining correlates of four-year college going rates. Research in Higher Education, 55(3), 219–244.

    Article  Google Scholar 

  • Espelage, D. (2015). Data needs for emerging research issues in bully and violence prevention: Strengths and limitations of the National Center for Educational Statistics data sets. AERA Open, 1(3), doi: http://dx.doi.org/10.1177/2332858415604147.

  • Espelage, D. L. (2014). Using NCES surveys to understand school violence and bullying. Paper Prepared for the National Academy of Education’s Workshop to Examine Current and Potential Uses of NCES Longitudinal Surveys by the Education Research Community, Washington, DC. Retrieved from http://www.naeducation.org/cs/groups/naedsite/documents/webpage/naed_160696.pdf.

  • Farrington, C. A., Roderick, M., Allensworth, E., Nagaoka, J., Keyes, T. S., Johnson, D. W., & Beechum, N. O. (2012). Teaching adolescents to become learners. The role of noncognitive factors in shaping school performance: A critical literature review. Chicago: University of Chicago Consortium on Chicago School Research. Retrieved from https://consortium.uchicago.edu/sites/default/files/publications/Noncognitive Report.pdf.

    Google Scholar 

  • Foote, M. Q., & Bartell, T. G. (2011). Pathways to equity in mathematics education: How life experiences impact researcher positionality. Educational Studies in Mathematics, 78(1), 45–68.

    Article  Google Scholar 

  • Glover, D. (2002). What makes a good “policy paper”? Ten examples (no. sp200205t1). Economy and environment program for Southeast Asia (EEPSEA). Retrieved from https://idl-bnc.idrc.ca/dspace/bitstream/10625/27168/1/118102.pdf.

  • Grammer, J. K., Coffman, J. L., Ornstein, P. A., & Morrison, F. J. (2013). Change over time: Conducting longitudinal studies of children’s cognitive development. Journal of Cognition and Development, 14(4), 515–528. Retrieved from http://curran.web.unc.edu/files/2015/03/BainterCurran2015.pdf.

    Article  PubMed  PubMed Central  Google Scholar 

  • Griffith, D. M., Neighbors, H. W., & Johnson, J. (2009). Using national data sets to improve the health and mental health of Black Americans: Challenges and opportunities. Cultural Diversity and Ethnic Minority Psychology, 15(1), 86.

    Article  PubMed  Google Scholar 

  • Hahs-Vaughn, D. L. (2017). Applied multivariate statistical concepts. Abingdon, UK/Oxon/New York: Routledge.

    Google Scholar 

  • Hahs-Vaughn, D. L. (2007). Using NCES national datasets for evaluation of postsecondary issues. Assessment & Evaluation in Higher Education, 32(3), 239–254. http://education.ufl.edu/educational-research/files/2011/01/Hahs-Vaughn_2007_Using-NCES-datasets.pdf.

    Article  Google Scholar 

  • Hahs-Vaughn, D. L. (2006). Analysis of data from complex samples. International Journal of Research & Method in Education, 29(2), 165–183.

    Article  Google Scholar 

  • Hahs-Vaughn, D. L. (2005). A primer for using and understanding weights with national datasets. Journal of Experimental Education, 73(3), 221–248. Retrieved from http://education.ufl.edu/educational-research/files/2011/01/Hahs-Vaughn_2005_Using-weights-with-national-datasets.pdf.

    Article  Google Scholar 

  • Hahs-Vaughn, D. L., McWayne, C. M., Bulotsky-Shearer, R. J., Wen, X., & Faria, A. M. (2011b). Complex sample data recommendations and troubleshooting. Evaluation Review, 0193841X11412070. Retrieved from https://www.researchgate.net/profile/Rebecca_Bulotsky-Shearer/publication/51245439_Complex_sample_data_recommendations_and_troubleshooting/links/53da4e0b0cf2e38c633676b6.pdf.

  • Hahs-Vaughn, D. L., McWayne, C. M., Bulotsky-Shearer, R. J., Wen, X., & Faria, A. M. (2011a). Methodological considerations in using complex survey data: An applied example with the head start family and child experiences survey. Evaluation Review, 35(3), 269–303. Retrieved from https://www.researchgate.net/profile/Rebecca_Bulotsky-Shearer/publication/51245439_Complex_sample_data_recommendations_and_troubleshooting/links/53da4e0b0cf2e38c633676b6.pdf.

    Article  PubMed  Google Scholar 

  • Herrold, K., & O’Donnell, K. (2008). Parent and Family Involvement in Education, 2006–07 school year, from the National Household Education Surveys Program of 2007 (NCES 2008–050). Washington, DC: National Center for Education Statistics, Institute of Education Sciences, U.S. Department of Education.

    Google Scholar 

  • Hofferth, S. L. (2005). Secondary data analysis in family research. Journal of Marriage and Family, 67(4), 891–907.

    Article  Google Scholar 

  • Kim, J., & Bryan, J. (2017). A first step to a conceptual framework of parent empowerment: Exploring relationships between parent empowerment and academic performance in a national sample. Journal of Counseling and Development, 95(2), 168–179.

    Article  Google Scholar 

  • Kluwin, T. N., & Morris, C. S. (2006). Lost in a giant database: The potentials and pitfalls of secondary analysis for deaf education. American Annals of the Deaf, 151(2), 121–128.

    Article  Google Scholar 

  • Lanza, S. T., & Cooper, B. R. (2016). Latent class analysis for developmental research. Child Development Perspectives, 10(1), 59–64. doi:10.1111/cdep.12163.

    Article  Google Scholar 

  • Lanza, S. T., & Rhoades, B. L. (2013). Latent class analysis: An alternative perspective on subgroup analysis in prevention and treatment. Prevention Science, 14(2), 157–168. http://doi.org/10.1007/s11121-011-0201-1.

    Article  PubMed  PubMed Central  Google Scholar 

  • Lapan, R. T., Wells, R., Petersen, J., & McCann, L. A. (2014). Stand tall to protect students: School counselors strengthening school connectedness. Journal of Counseling & Development, 92(3), 304–315.

    Article  Google Scholar 

  • Lauritsen, J. L. (2015). The devil is in the details: Crime and victimization research with the National Crime Victimization Survey. In M. D. Maltz & S. K. Rice (Eds.), Envisioning criminology: Researchers on research as a process of discovery (pp. 191–197). Cham, Switzerland: Springer International Publishing.

    Chapter  Google Scholar 

  • Lee, S., & Smith-Adcock, S. (2005). A model of girls’ school delinquency: School bonding and reputation. Professional School Counseling, 9(1), 78–87.

    Article  Google Scholar 

  • Lynch, M. F. (2012). Using multilevel modeling in counseling research. Measurement and Evaluation in Counseling and Development, 45(3), 211–224.

    Article  Google Scholar 

  • Makel, M. C., & Plucker, J. A. (2014). Facts are more important than novelty: Replication in the education sciences. Educational Researcher, 43, 304–316. 0013189X14545513.

    Article  Google Scholar 

  • Maxwell, J. A. (2012). Qualitative research design: An interactive approach (3rd ed.). Thousand Oaks, CA: Sage.

    Google Scholar 

  • McMahon, H. G., Mason, E., Daluga-Guenther, N., & Ruiz, A. (2014). An ecological model of professional school counseling. Journal of Counseling & Development, 92(4), 459–471.

    Article  Google Scholar 

  • Milner, H. R. (2007). Race, culture, and researcher positionality: Working through dangers seen, unseen, and unforeseen. Educational Researcher, 36(7), 388–400.

    Article  Google Scholar 

  • Mueller, C. E., & Hart, C. O. (2011). Effective use of secondary data analysis in gifted education research: Opportunities and challenges. Gifted Children, 4(2), 3. Retrieved from http://docs.lib.purdue.edu/cgi/viewcontent.cgi?article=1048&context=giftedchildren.

  • Nagaoka, J., Farrington, C. A., Roderick, M., Allensworth, E., Keyes, T. S., Johnson, D. W., & Beechum, N. O. (2013). Readiness for college: The role of Noncognitive factors and context. Voices in Urban Education, 38, 45–52.

    Google Scholar 

  • Nathans, L. L., Nimon, K., & Walker, D. A. (2013). Use of the multiple lens approach to multiple regression findings with a national dataset. Multiple Linear Regression Viewpoints, 39(1), 25–33. Retrieved from http://mlrv.ua.edu/2013/vol39_1/Nathans%20et%20al..pdf.

    Google Scholar 

  • O’Connor, C., Lewis, A., & Mueller, J. (2007). Researching “Black” educational experiences and outcomes: Theoretical and methodological considerations. Educational Researcher, 36, 541–552.

    Article  Google Scholar 

  • Orletsky, D., Middleton, J. A., & Sloane, F. (2015). A review of three large-scale datasets critiquing item design, data collection, and the usefulness of claims. In J. A. Middleton, J. Cai, & S. Hwang (Eds), Large-Scale Studies in Mathematics Education (pp. 311–334). Research in Mathematics Education Series. Springer International Publishing. Springer.

    Google Scholar 

  • Osborne, J. (2011). Best practices in using large, complex samples: The importance of using appropriate weights and design effect compensation. Practical Assessment Research and Evaluation, 16, 1–7. Retrieved from http://pareonline.net/pdf/v16n12.pdf.

    Google Scholar 

  • O’Connell, A. A., & McCoach, D. B. (2008). Multilevel modeling of educational data. Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Peugh, J. L. (2010). A practical guide to multilevel modeling. Journal of School Psychology, 48(1), 85–112.

    Article  PubMed  Google Scholar 

  • Peugh, J. L., & Enders, C. K. (2004). Missing data in educational research: A review of reporting practices and suggestions for improvement. Review of Educational Research, 74(4), 525–556.

    Article  Google Scholar 

  • Perna, L. W., & Titus, M. A. (2005). The relationship between parental involvement as social capital and college enrollment: An examination of racial/ethnic group differences. Journal of Higher Education, 76, 485–518.

    Article  Google Scholar 

  • Schneider, B., Carnoy, M., Kilpatrick, J., Schmidt, W. H., & Shavelson, R. J. (2007). Estimating causal effects using experimental and observational designs. Washington, DC: American Educational Research Association. Retrieved from http://documents.library.nsf.gov/edocs/LB1028.E77-2007-PDF-Estimating-Causal-effects-using-experimental-and-observational-designs.pdf.

    Google Scholar 

  • Schlomer, G. L., Bauman, S., & Card, N. A. (2010). Best practices for missing data management in counseling psychology. Journal of Counseling Psychology, 57, 1–10.

    Article  PubMed  Google Scholar 

  • Snijders, T. A., & Bosker, T. A. (2012). Multilevel analysis: An introduction to basic and advanced multilevel modeling. Los Angeles: Thousand Oaks: Sage.

    Google Scholar 

  • Stapleton, L. M., & Thomas, S. L. (2008). The use of national datasets for teaching and research: Source and issues. In A. O’Connell & B. McCoach (Eds.), Multilevel modeling of educational (pp. 11–59). Charlotte, NC: Information Age Publishing.

    Google Scholar 

  • Strayhorn, T. L. (2009). Accessing and analyzing national databases. In T. J. Kowalski & T. J. Lasley II (Eds.), Handbook of data-based decision making in education (pp. 105–122). New York: Routledge.

    Google Scholar 

  • St. John, E. P. (2004). Public policy and research on college access: Lessons learned from NCES research and state evaluation studies. In E. P. S. John (Ed.), Public policy and college access: Investigating the federal and state roles in equalizing postsecondary opportunity, readings on equal education (Vol. 19, pp. 181–196). New York: AMS Press.

    Google Scholar 

  • Suh, S., Suh, J., & Houston, I. (2007). Predictors of categorical at-risk high school dropouts. Journal of Counseling and Development, 85(2), 196.

    Article  Google Scholar 

  • Swadener, E. B. (1990). Children and families “at risk:” etiology, critique, and alternative paradigms. The Journal of Educational Foundations, 4(4), 17.

    Google Scholar 

  • Trusty, J. (2002). African Americans’ educational expectations: Longitudinal causal models for women and men. Journal of Counseling & Development, 80, 332–345.

    Article  Google Scholar 

  • Trusty, J., & Niles, S. G. (2003). High-school math courses and completion of the bachelor’s degree. Professional School Counseling, 7, 99–107.

    Google Scholar 

  • Trusty, J., & Niles, S. G. (2004). Realized potential or lost talent: High school variables and bachelor’s degree completion. The Career Development Quarterly, 53, 2–15.

    Article  Google Scholar 

  • United States Department of Education. (2010). Anti-bullying policies: Examples of provision in state laws. Key policy letter from the Education Secretary and Deputy Secretary. Retrieved from http://www2.ed.gov/policy/gen/guid/secletter/101215/html.

  • Warren, J. R. (2015). The Future of NCES’s Longitudinal Student Surveys. AERA Open, 1(2), 2332858415587910. Retrieved from http://ero.sagepub.com/content/1/2/2332858415587910.full OR http://ero.sagepub.com/content/spero/1/2/2332858415587910.full.pdf.

  • Wells, R. (2016). Large national datasets. In F. K. Stage & K. Manning (Eds.), Research in the college context: Approaches and methods (2nd ed., p. 106-?). New York: Routledge.

    Google Scholar 

  • Wells, R. S., Lynch, C. M., & Seifert, T. A. (2011). Methodological options and their implications: An example using secondary data to analyze Latino educational expectations. Research in Higher Education, 52(7), 693–716. Retrieved from https://www.researchgate.net/profile/Ryan_Wells2/publication/225768412_Methodological_Options_and_their_Implications_An_Example_Using_Secondary_Data_to_Analyze_Latino_Educational_Expectations/links/0f317535c5ac351646000000.pdf.

    Article  Google Scholar 

  • Wennberg, K. (2005). Entrepreneurship research through databases: Measurement and design issues. New England Journal of Entrepreneurship, 8(2), 3. Retrieved from http://digitalcommons.sacredheart.edu/cgi/viewcontent.cgi?article=1148&context=neje.

  • Whiston, S. C. (2002). Response to the past, present, and future of school counseling: Raising some issues. Professional School Counseling, 5, 148–155.

    Google Scholar 

  • Wilcox, A., & Hirschfield, A. (2007). A framework for deriving policy implications from research. University of Huddersfield: Applied Criminology Centre. Retrieved from http://www.scopic.ac.uk/documents/Huddersfield_1.pdf

  • Willms, J. D. (2011). Managing and using secondary data sets with multidisciplinary research teams. In K. H. Trzesniewski, M. Brent Donnellan, & R. E. Lucas (Eds.), Secondary data analysis: An introduction for psychologists (pp. 27–38). Washington, DC: American Psychological Association. x, 245 pp.http://dx.doi.org/10.1037/12350-002.

  • Zhang, L. (2010). The use of panel data models in higher education policy studies. In J. Smart (Ed.), Higher education: Handbook of theory and research (Vol. 25, pp. 307–349). Dordrecht, The Netherlands: Springer.

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Julia Bryan .

Editor information

Editors and Affiliations

Appendix

Appendix

Table 11.3 A summary of national datasets suitable for counseling research

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer International Publishing AG

About this chapter

Cite this chapter

Bryan, J., Kim, J., Shi, Q. (2017). Identifying and Using Secondary Datasets to Answer Policy Questions Related to School-Based Counseling: A Step-by-Step Guide. In: Carey, J., Harris, B., Lee, S., Aluede, O. (eds) International Handbook for Policy Research on School-Based Counseling. Springer, Cham. https://doi.org/10.1007/978-3-319-58179-8_11

Download citation

Publish with us

Policies and ethics