Skip to main content
SpringerLink
Log in

Student Survey Response Rates across Institutions: Why Do they Vary?

  • Published:
Research in Higher Education Aims and scope Submit manuscript

While many studies have examined nonresponse in student surveys, little research investigates why some schools achieve higher student survey response rates than other schools. Using hierarchical linear modeling, we analyze survey data from 321 institutions that participated in the 2003 National Survey of Student Engagement to understand how characteristics of colleges and universities relate to student survey response rates. We find that the makeup of the student body, as well as institutional characteristics such public/private status and urban location affects response rates, and that the number of computers per undergraduate has a strong positive effect for web survey response rates.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • P. M. Blau (1964) Exchange and Power in Social Life Wiley New York

    Google Scholar 

  • M. Brennan J. Hoek (1992) ArticleTitleThe behavior of respondents, nonrespondents, and refusers across mail surveys Public Opinion Quarterly 56 IssueID4 530–535 Occurrence Handle10.1086/269343

    Article  Google Scholar 

  • R. M. Carini J. C. Hayek G. D. Kuh J. M. Kennedy J. A. Ouimet (2003) ArticleTitleCollege student responses to web and paper surveys: Does mode matter? Research in Higher Education 44 IssueID1 1–19 Occurrence Handle10.1023/A:1021363527731

    Article  Google Scholar 

  • C. Cobanoglu B. Warde P. J. Moreo (2001) ArticleTitleA comparison of mail, fax and web-based survey methods International Journal of Market Research 43 IssueID4 441–452

    Google Scholar 

  • M. P. Couper R. M. Groves (1996) ArticleTitleSocial environmental impacts on survey cooperation Quality and Quantity 30 IssueID2 173–188 Occurrence Handle10.1007/BF00153986

    Article  Google Scholar 

  • R. Curtin S. Presser E. Singer (2000) ArticleTitleThe effects of response rate changes on the index of consumer sentiment Public Opinion Quarterly 64 IssueID4 413–428 Occurrence Handle10.1086/318638

    Article  Google Scholar 

  • E. Dey (1997) ArticleTitleWorking with low survey response rates: The efficacy of weighting adjustments Research in Higher Education 38 IssueID2 215–227 Occurrence Handle10.1023/A:1024985704202

    Article  Google Scholar 

  • D. A. Dillman (2000) Mail and Internet Surveys: The Tailored Design Method John Wiley & Sons New York

    Google Scholar 

  • R. J. Fox M. R. Crask J. Kim (1988) ArticleTitleMail survey response rate: A meta-analysis of selected techniques for inducing response Public Opinion Quarterly 52 IssueID4 467–491 Occurrence Handle10.1086/269125

    Article  Google Scholar 

  • J. Goyder (1986) ArticleTitleSurveys on surveys: Limitations and potentialities Public Opinion Quarterly 50 IssueID1 27–41 Occurrence Handle10.1086/268957

    Article  Google Scholar 

  • J. Goyder (1987) The Silent Minority: Nonrespondents in Sample Surveys Westview Press Boulder

    Google Scholar 

  • J. Goyder K. Warriner S. Miller (2002) ArticleTitleEvaluating socio-economic status (ses) bias in survey nonresponse Journal of Official Statistics 18 IssueID1 1–11

    Google Scholar 

  • R. M. Groves R. B. Cialdini M. P. Couper (1992) ArticleTitleUnderstanding the decision to participate in a survey Public Opinion Quarterly 56 IssueID4 475–495 Occurrence Handle10.1086/269338

    Article  Google Scholar 

  • R. M. Groves M. P. Couper (1995) ArticleTitleTheoretical motivation for post-survey nonresponse adjustment in household surveys Journal of Official Statistics 11 IssueID1 93–106

    Google Scholar 

  • R. M. Groves M. P. Couper (1996) ArticleTitleContact-level influences on cooperation in face- to-face surveys Journal of Official Statistics 12 IssueID1 63–83

    Google Scholar 

  • R. M. Groves M. P. Couper (1998) Nonresponse in Household Surveys Wiley New York

    Google Scholar 

  • R. M. Groves D. A. Dillman J. L. Eltinge R. J. A. Little (2002) Survey Nonresponse John Wiley & Sons New York

    Google Scholar 

  • R. M. Groves F. J. J. Fowler J. M. Couper M. P. Lepkowski E. Singer R. Tourangeau (2004a) Survey Methodology Wiley-Interscience Hoboken, NJ

    Google Scholar 

  • R. M. Groves S. Presser S. Dipko (2004b) ArticleTitleThe role of topic interest in survey participation decisions Public Opinion Quarterly 68 IssueID1 2–31 Occurrence Handle10.1093/poq/nfh002

    Article  Google Scholar 

  • R. M. Groves E. Singer A. Corning (2000) ArticleTitleLeverage-saliency theory of survey participation Public Opinion Quarterly 64 IssueID3 299–308 Occurrence Handle10.1086/317990

    Article  Google Scholar 

  • T. A. Heberlein R. Baumgartner (1978) ArticleTitleFactors affecting response rates to mailed questionnaires: A quantitative analysis of the published literature American Sociological Review 43 IssueID4 447–462

    Google Scholar 

  • R. H. Heck S. L. Thomas (2000) An Introduction to Multilevel Modeling Techniques Lawrence Erlbaum Associates Mahwah, NJ

    Google Scholar 

  • J. Hutchinson N. Tollefson H. Wigington (1987) ArticleTitleResponse bias in college freshman’s response to mail surveys Research in Higher Education 26 IssueID1 99–106

    Google Scholar 

  • Kojetin, B. A., Borgida, E., and Snyder, M. (1993). Survey topic involvement and nonresponse bias. Paper presented at the Proceeding of the Section on Survey Research Method, Vol. II. American Statistical Association

  • J. A. Krosnick (1999) ArticleTitleSurvey research Annual Review of Psychology 50 537–567 Occurrence Handle10.1146/annurev.psych.50.1.537

    Article  Google Scholar 

  • Kuh G. D. (2001). Assessing what really matters to student learning: Inside the national survey of student engagement. Change 33(3): 10--17, 66

    Google Scholar 

  • G. D. Kuh S. Hu (2001) ArticleTitleThe effects of student-faculty interaction in the 1990s Review of Higher Education 24 IssueID3 309–332

    Google Scholar 

  • J. S. Long (1997) Regression Models for Categorical and Limited Dependent Variables Sage Publications Thousand Oaks, CA

    Google Scholar 

  • C. A. Lundberg L. A. Schreiner (2004) ArticleTitleQuality and frequency of faculty-student interaction as predictors of learning: An analysis by student race/ethnicity Journal of College Student Development 45 IssueID5 549–565

    Google Scholar 

  • Moore D. L., and Tarnai J. (2002). Evaluating nonresponse error in mail surveys. In: Groves, R. M., Dillman D. A., Eltinge J. L., and Little R. J. A. (eds.), Survey nonresponse, pp. 197--211

  • National Survey of Student Engagement (2003). The college student report: 2003 overview

  • Pascarella, E. T., Cruce, T. M., Umbach, P. D., Wolniak, G. C., Kuh, G. D., Carini, R. M., et al. (in press). Institutional selectivity and good practices in undergraduate education: How strong is the link? Journal of Higher Education

  • E. T. Pascarella P. T. Terenzini (2005) How College Affects Students: A Third Decade of Research Jossey-Bass San Francisco

    Google Scholar 

  • E. T. Pascarella G. C. Wolniak T. M. Cruce C. F. Blaich (2004) ArticleTitleDo liberal arts colleges really foster good practices in undergraduate education? Journal of College Student Development 45 IssueID1 57–74

    Google Scholar 

  • Porter, S. R. (in press). Institutional structures and student engagement, Research in Higher Education.

  • S. R. Porter M. E. Whitcomb (2003) ArticleTitleThe impact of lottery incentives on student survey response rates Research in Higher Education 44 IssueID4 389–407 Occurrence Handle10.1023/A:1024263031800

    Article  Google Scholar 

  • S. R. Porter M. E. Whitcomb (2005) ArticleTitleNonresponse in student surveys: The role of demographics, engagement and personality Research in Higher Education 46 IssueID2 127–152 Occurrence Handle10.1007/s11162-004-1597-2

    Article  Google Scholar 

  • S. R. Porter M. E. Whitcomb W. H. Weitzer (2004) Multiple Surveys of Students and Survey Fatigue S. R. Porter (Eds) Overcoming Survey Research Problems Jossey-Bass San Francisco

    Google Scholar 

  • S. W. Raudenbush A. S. Bryk (2002) Hiearchical Linear Models: Applications and Data Analysis Methods Sage Publications Thousand Oaks, CA

    Google Scholar 

  • L. J. Sax S. K. Gilmartin A. N. Bryant (2003) ArticleTitleAssessing response rates and nonresponse bias in web and paper surveys Research in Higher Education 44 IssueID4 409–432 Occurrence Handle10.1023/A:1024232915870

    Article  Google Scholar 

  • D. M. Shannon C. C. Bradshaw (2002) ArticleTitleA comparison of response rate, response time, and costs of mail and electronic surveys Journal of Experimental Education 70 IssueID2 179–192

    Google Scholar 

  • J. Sharp L. M. Frankel (1983) ArticleTitleRespondent burden: A test of some common assumptions Public Opinion Quarterly 47 IssueID1 36–53 Occurrence Handle10.1086/268765

    Article  Google Scholar 

  • E. Singer R. M. Groves A. D. Corning (1999) ArticleTitleDifferential incentives: Beliefs about practices, perceptions of equity, and effects on survey participation Public Opinion Quarterly 63 IssueID2 251–260 Occurrence Handle10.1086/297714

    Article  Google Scholar 

  • E. Singer J. Hoewyk Particlevan M. P. Maher (2000) ArticleTitleExperiments with incentives in telephone surveys Public Opinion Quarterly 64 IssueID2 171–188 Occurrence Handle10.1086/317761

    Article  Google Scholar 

  • A. L. Stinchcombe C. Jones P. Sheatsley (1981) ArticleTitleNonresponse bias for attitude questions Public Opinion Quarterly 45 IssueID3 359–375 Occurrence Handle10.1086/268670

    Article  Google Scholar 

  • Umbach, P. D., and Kuh, G. D. (in press). Student experiences with diversity at liberal arts colleges: Another claim for distinctiveness. The Journal of Higher Education

  • P. D. Umbach S. R. Porter (2002) ArticleTitleHow do academic departments impact student satisfaction? Understanding the contextual effects of departments Research in Higher Education 23 IssueID2 209–233

    Google Scholar 

  • P. Kenhove ParticleVan K. Wijnen K. Wulf ParticleDe (2002) ArticleTitleThe influence of topic involvement on mail-survey response behavior Psychology and Marketing 19 IssueID3 293–301

    Google Scholar 

  • L. F. Voigt T. D. Koepsell J. R. Daling (2003) ArticleTitleCharacteristics of telephone survey respondents according to willingness to participate American Journal of Epidemiology 157 IssueID1 66–73 Occurrence Handle10.1093/aje/kwf185

    Article  Google Scholar 

  • F. J. Yammarino S. J. Skinner T. L. Childers (1991) ArticleTitleUnderstanding mail survey response behavior: A meta-analysis Public Opinion Quarterly 55 IssueID4 613–639 Occurrence Handle10.1086/269284

    Article  Google Scholar 

  • J. Yu H. Cooper (1983) ArticleTitleA quantitative review of research design effects on response rates to questionnaires Journal of Marketing Research 20 IssueID1 36–44

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Educational Leadership and Policy Studies, Iowa State University, Lagomarcino Hall, Ames, IA , 50011, USA

    Stephen R. Porter

  2. Department of Educational Policy and Leadership Studies, University of Iowa, Iowa City, USA

    Paul D. Umbach

  3. Department of Educational Policy and Leadership Studies, University of Iowa, N491 Lindquist Center, Iowa City, IA, 52242-1529, USA

    Paul D. Umbach

Authors
  1. Stephen R. Porter
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Paul D. Umbach
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Paul D. Umbach.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Porter, S.R., Umbach, P.D. Student Survey Response Rates across Institutions: Why Do they Vary?. Res High Educ 47, 229–247 (2006). https://doi.org/10.1007/s11162-005-8887-1

Download citation

  • Received:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11162-005-8887-1

Keywords

Search

Navigation