Skip to main content
Log in

College Student Responses to Web and Paper Surveys: Does Mode Matter?

  • Published:
Research in Higher Education Aims and scope Submit manuscript

Abstract

We examined the responses of 58,288 college students to 8 scales involving 53 items from the National Survey of Student Engagement (NSSE) to gauge whether individuals respond differently to surveys administered via the Web and paper. Multivariate regression analyses indicated that mode effects were generally small. However, students who completed the Web-based survey responded more favorably than paper on all 8 scales. These patterns generally held for both women and men, and younger and older students. Interestingly, the largest effect was found for a scale of items involving computing and information technology.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

REFERENCES

  • Kuh, G.D. (2001). Assessing what really matters to student learning: Inside the National Survey of Student Engagement. Change 33(3): 10–17, 66.

    Google Scholar 

  • Kuh, G. D., Hayek, J. C., Carini, R. M., Ouimet, J. A., Gonyea, R. M., and Kennedy, J. (2001). NSSE Technical and Norms Report, Indiana University Center for Postsecondary Research and Planning, Bloomington, IN.

    Google Scholar 

  • Kuh, G. D., and Hu, S. (2001). The relationships between computer and information technology use, student learning, and other college experiences. J. Coll. Stud. Dev. 42: 217–232.

    Google Scholar 

  • Kuh, G. D., and Vesper, N. (2001). Do computers enhance or detract from student learning? Res. Higher Educ. 42: 87–102.

    Google Scholar 

  • Laing, J., Swayer, R., and Noble, J. (1989). Accuracy of self-reported activities and accomplishments of college-bound seniors. J. Coll. Stud. Dev. 29: 362–368.

    Google Scholar 

  • Layne, B. H., DeCristoforo, J. R., and McGinty, D. (1999). Electronic versus traditional student ratings of instruction. Res. Higher Educ. 40: 221–232.

    Google Scholar 

  • Light, R., and Pillemer, D. (1982). Numbers and narrative: Combining their strengths in research reviews. Harv. Educ. Rev. 52: 1–26.

    Google Scholar 

  • Malveaux, J. (2000). Technology, learning, and the future of education. Black Issues Higher Educ. 17:38.

    Google Scholar 

  • National Survey of Student Engagement (2000). NSSE 2000 Overview, Indiana University Center for Postsecondary Research and Planning, Bloomington, IN.

    Google Scholar 

  • National Telecommunications and Information Administration (2000). Falling Through the Net: Toward Digital Inclusion, U.S. Department of Commerce, Washington, DC.

    Google Scholar 

  • Olsen, D. R., Wygant, S. A., and Brown, B. L. (1999). Entering the next millennium with Web-based assessment: Considerations of efficiency and reliability. Paper presented at the Conference of the Rocky Mountain Association for Institutional Research, Las Vegas, NV.

  • Pace, C. R. (1985). The Credibility of Student Self-Reports, University of California, Center for the Study of Evaluation, Graduate Institution of Education, Los Angeles.

    Google Scholar 

  • Pascarella, E. T., and Terenzini, P. T. (1991). How College Affects Students: Findings and Insights from Twenty Years of Research, Jossey-Bass, San Francisco.

    Google Scholar 

  • Pascarella, E. T., Flowers, L., and Whitt, E. J. (2001). Cognitive effects of Greek affiliation in college: Additional evidence. NASPA J. 38: 280–301.

    Google Scholar 

  • Pew Internet and American Life (2000). Tracking Online Life: How Women use the Internet to Cultivate Relationships with Family and Friends, The Pew Internet and American Life Project, Washington, DC.

    Google Scholar 

  • Schwarz, N., Hippler, H. J., and Noelle-Neumann, E. (1992). A cognitive model of response-order effects in survey measurement. In: Schwarz, N., and Sudman, S. (eds.), Context Effects in Social and Psychological Research, New York, Springer-Verlag, pp. 187–201.

    Google Scholar 

  • Tomsic, M. L., Hendel, D. D., and Matross, R. P. (2000). A World Wide Web response to student satisfaction surveys: Comparisons using paper and Internet formats. Paper presented at the Annual Meeting of the Association for Institutional Research, Cincinnati, OH.

  • Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., and Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, & violence: Increased reporting with computer survey technology. Science 280: 867–873.

    Google Scholar 

  • Yahoo Internet Life (2001). America's Most Wired Colleges 2000. Available: http:// www.zdnet.com/yil/content/college/college2000/wired_ivy.html.

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Robert M. Carini.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Carini, R.M., Hayek, J.C., Kuh, G.D. et al. College Student Responses to Web and Paper Surveys: Does Mode Matter?. Research in Higher Education 44, 1–19 (2003). https://doi.org/10.1023/A:1021363527731

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1021363527731

Navigation