Abstract
To compare the generalizability of online and mail surveys in a cross-national service quality study, the authors use G-theory and find a comparable level of generalizability, though online surveys benefited from considerably lower costs. This article contributes to the current comparison of the response quality between online and mail surveys. Furthermore, the authors illustrate how G-theory can be used to compare online and mail surveys and take data collection costs into account. Important implications include the process and results of comparing two survey modes and the effects for service research.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Brennan, R.L. (2001). Generalizability theory. New York: Springer-Verlag.
Cobanoglu, C., Warde, B., &Moreo, P.J. (2001). A Comparison of Mail, Fax and Web-based Survey Methods. International Journal of Market Research 43(4), 441–452.
Cronbach, L.J.,Gleser, G.C., Nanda, H., &Rajaratnam, N. (1972). The Dependability of Behavioral Measurements. Theory of generalizability for scores and profiles, New York: Wiley.
Deutskens, E.C., de Ruyter, K., Wetzels, M.G.M., &Oosterveld, P. (2004). Response Rate and Response Quality of Internet-based Surveys: An Experimental Study. Marketing Letters, 15(1), 21–36.
Dillman, D.A. (2000). Mail and Internet Surveys. The tailored design method, New York: Wiley.
Efron, B., &Tibshirani, R. (1986). Bootstrap Methods for Standard Errors, Confidence Intervals, and Other Measures of Statistical Accuracy. Statistical Science, 1(1), 54–77.
ESOMAR. Marketing and Opinion Research Industry in the USA is the Largest Market Worldwide, retrieved October 14, 2004 from http://www.esomar.org/esomar/show/id107403
Finn, A., &Kayandé, U. (1997). Reliability Assessment and Optimization of Marketing Measurement. Journal of Marketing Research, 34(2), 262–275.
Hartley, H.O., Rao, J.N.K., &LaMotte, L.R. (1978). A Simple Synthesis-Based Method of Variance Component Estimation. Biometrics, 34, 233–242.
Hogg, A. Conducting Online Research. Retrieved June 18, 2003 from http://www.burke.com/whitepapers/PDF/B.WhitePaperVol3-2002-Iss2.pdf
Illieva, J., Baron, S., &Healey, N.M. (2002). Online Surveys in Marketing Research: Pros and cons. International Journal of Market Research, 44(3), 361–382.
Kane, M.T., Gillmore, G.M., &Crooks, T.J. (1976). Student Evaluations of Teaching: The Generalizability of Class Means. Journal of Educational Measurement, 13(3), 171–184.
Knapp, H., &Kirk, S.A. (2003). Using Pencil and Paper, Internet and Touch-Tone Phones for Self-Administered Surveys: Does methodology matter? Computers in Human Behavior, 19(1), 117–134.
Malhotra, N.K. (1999). Marketing research. An applied orientation. New Jersey: Prentice Hall.
Mandel, N., &Johnson, E.J. (2002). When Web Pages Influence Choice: Effects of Visual Primes on Experts and Novices. Journal of Consumer Research, 29(2), 235–245.
McDonald, H., &Adam, S. (2003). A Comparison of Online and Postal Data Collection Methods in Marketing Research. Marketing Intelligence &Planning, 21(2), 85–95.
Meuter, M.L., Ostrom, A.L., Roundtree, R.I., &Bitner, M.J. (2000). Self-service technologies: Understanding Customer Satisfaction with Technology-Based Service Encounters. Journal of Marketing, 64(3), 50–64.
Nunnally, J.C., &Bernstein, I.H. (1994). Psychometric theory, New York: McGraw-Hill.
OnlineSurveyServices. Cost Comparison of Paper Survey vs. Online Survey. Retrieved December 8, 2003 from http://www.onlinesurveyservices.com/olss/cost.htm
Parasuraman, A., Zeithaml, V.A., &Berry, L.L. (1988). SERVQUAL: A Multiple-Item Scale for Measuring Consumer Perceptions of Service Quality. Journal of Retailing, 64(1), 12–40.
Peter, J.P. (1979). Reliability: A Review of Psychometric basic and Recent Marketing Practices. Journal of Marketing Research, 16(1), 6–17.
Rentz, J.O. (1987). Generalizability theory: A Comprehensive Method for Assessing and Improving the Dependability of Marketing Measures. Journal of Marketing Research, 24(1), 19–28.
Rentz, J.O. (1988). An Exploratory Study of the Generalizability of Selected Marketing Measures. Academy of Marketing Science, 16(1), 141–150.
Roster, C.A., Rogers, R.D., Albaum, G., &Klein, D. (2004). A Comparison of Response Characteristic from Web and Telephone Surveys. International Journal of Market Research, 46(3), 359–373.
Salkin, H.M. (1975). Integer programming. Massachusetts: Addison-Wesley.
Sanders, P.F., Theunissen, T.J.J.M., &Baas, S.M. (1989). Minimizing the number of observations: A Generalization of the Spearman-Brown Formula. Psychometrika, 54, 587–598.
Searle, S.R., Casella, G., &McCulloch, C.E. (1992). Variance Components. New York: Wiley.
Sharma, S., &Weathers, D. (2003). Assessing Generalizability of Scales Used in Cross-National Research. International Journal of Research in Marketing, 20(3), 287–295.
Shermis, M.D., &Lombard D. (1999). A Comparison of Survey Data Collected by Regular Mail and Electronic Mail Questionnaires. Journal of Business &Psychology, 14(2), 341–354.
Stanton, J.M. (1998). An Empirical Assessment of Data Collection Using the Internet. Personnel Psychology, 51(3), 709–725.
Vehovar, V., Manfreda, K.L., &Batagelj, Z. (1999). Web surveys: Can The Weighting Solve The Problem? Proceedings of the Survey Research Methods Section, American Statistical Association.
Author information
Authors and Affiliations
Corresponding author
Additional information
Martin Wetzels now also works at Maastricht University
Rights and permissions
About this article
Cite this article
Deutskens, E., de Jong, A., de Ruyter, K. et al. Comparing the generalizability of online and mail surveys in cross-national service quality research. Market Lett 17, 119–136 (2006). https://doi.org/10.1007/s11002-006-4950-8
Issue Date:
DOI: https://doi.org/10.1007/s11002-006-4950-8