Abstract
We examined the responses of 58,288 college students to 8 scales involving 53 items from the National Survey of Student Engagement (NSSE) to gauge whether individuals respond differently to surveys administered via the Web and paper. Multivariate regression analyses indicated that mode effects were generally small. However, students who completed the Web-based survey responded more favorably than paper on all 8 scales. These patterns generally held for both women and men, and younger and older students. Interestingly, the largest effect was found for a scale of items involving computing and information technology.
Similar content being viewed by others
REFERENCES
Kuh, G.D. (2001). Assessing what really matters to student learning: Inside the National Survey of Student Engagement. Change 33(3): 10–17, 66.
Kuh, G. D., Hayek, J. C., Carini, R. M., Ouimet, J. A., Gonyea, R. M., and Kennedy, J. (2001). NSSE Technical and Norms Report, Indiana University Center for Postsecondary Research and Planning, Bloomington, IN.
Kuh, G. D., and Hu, S. (2001). The relationships between computer and information technology use, student learning, and other college experiences. J. Coll. Stud. Dev. 42: 217–232.
Kuh, G. D., and Vesper, N. (2001). Do computers enhance or detract from student learning? Res. Higher Educ. 42: 87–102.
Laing, J., Swayer, R., and Noble, J. (1989). Accuracy of self-reported activities and accomplishments of college-bound seniors. J. Coll. Stud. Dev. 29: 362–368.
Layne, B. H., DeCristoforo, J. R., and McGinty, D. (1999). Electronic versus traditional student ratings of instruction. Res. Higher Educ. 40: 221–232.
Light, R., and Pillemer, D. (1982). Numbers and narrative: Combining their strengths in research reviews. Harv. Educ. Rev. 52: 1–26.
Malveaux, J. (2000). Technology, learning, and the future of education. Black Issues Higher Educ. 17:38.
National Survey of Student Engagement (2000). NSSE 2000 Overview, Indiana University Center for Postsecondary Research and Planning, Bloomington, IN.
National Telecommunications and Information Administration (2000). Falling Through the Net: Toward Digital Inclusion, U.S. Department of Commerce, Washington, DC.
Olsen, D. R., Wygant, S. A., and Brown, B. L. (1999). Entering the next millennium with Web-based assessment: Considerations of efficiency and reliability. Paper presented at the Conference of the Rocky Mountain Association for Institutional Research, Las Vegas, NV.
Pace, C. R. (1985). The Credibility of Student Self-Reports, University of California, Center for the Study of Evaluation, Graduate Institution of Education, Los Angeles.
Pascarella, E. T., and Terenzini, P. T. (1991). How College Affects Students: Findings and Insights from Twenty Years of Research, Jossey-Bass, San Francisco.
Pascarella, E. T., Flowers, L., and Whitt, E. J. (2001). Cognitive effects of Greek affiliation in college: Additional evidence. NASPA J. 38: 280–301.
Pew Internet and American Life (2000). Tracking Online Life: How Women use the Internet to Cultivate Relationships with Family and Friends, The Pew Internet and American Life Project, Washington, DC.
Schwarz, N., Hippler, H. J., and Noelle-Neumann, E. (1992). A cognitive model of response-order effects in survey measurement. In: Schwarz, N., and Sudman, S. (eds.), Context Effects in Social and Psychological Research, New York, Springer-Verlag, pp. 187–201.
Tomsic, M. L., Hendel, D. D., and Matross, R. P. (2000). A World Wide Web response to student satisfaction surveys: Comparisons using paper and Internet formats. Paper presented at the Annual Meeting of the Association for Institutional Research, Cincinnati, OH.
Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., and Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, & violence: Increased reporting with computer survey technology. Science 280: 867–873.
Yahoo Internet Life (2001). America's Most Wired Colleges 2000. Available: http:// www.zdnet.com/yil/content/college/college2000/wired_ivy.html.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Carini, R.M., Hayek, J.C., Kuh, G.D. et al. College Student Responses to Web and Paper Surveys: Does Mode Matter?. Research in Higher Education 44, 1–19 (2003). https://doi.org/10.1023/A:1021363527731
Issue Date:
DOI: https://doi.org/10.1023/A:1021363527731