Skip to main content
SpringerLink
Log in

Mixed strategies for improving data quality: the contribution of qualitative procedures to survey research

  • Published:
Quality & Quantity Aims and scope Submit manuscript

Abstract

This article aims to illustrate how qualitative research strategies contribute to the implementation of the standard survey model by monitoring and improving the quality of collected data and thus the quality of survey findings as well. The methodological cycle for survey data-quality construction using qualitative strategies comprises three sequential stages that alternate with standard procedures: the pilot study, pretesting, and deviant case analysis. If the first two of these stages have enjoyed a certain recognition in the literature, the same cannot be said for deviant case analysis. Deviant case analysis is a research strategy originally proposed by Lazarsfeld and promoted within the Colombia School from the 1940s to the 1960s, unfortunately without subsequently receiving the attention it deserved within the area of survey research in general. It refers to searching outside the collected empirical base for clues concerning anomalous responses revealed by statistical analysis that either deviate from research hypotheses or produce contradictory classificatory results.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

Notes

  1. Now the Department of Communication and Social Research.

  2. The main difference between the cognitive interview and the meta-interview is that in the latter procedure the verbal probing takes place in the field rather than in the laboratory.

  3. The questionnaire consulted is from the fourth IARD report (Buzzi et al. 1997).

References

  • Agnoli, M.S. (ed.): Lo straniero in immagine. Rappresentazione degli immigrati e pregiudizio etnico tra gli studenti del Lazio. Angeli, Milano (2004)

  • Agnoli, M.S. (ed.): Spazi, identità, relazioni. Indagine sulla convivenza multiculturale nelle residenze universitarie. Angeli, Milano (2010)

    Google Scholar 

  • Beatty, P.C.: Paradigms of cognitive interviewing practice, and their implications for developing standards of best practice. In: Proceedings of the 4th Conference on Questionnaire Evaluation Standards, Zentrum fur Umfragen Methoden un Analysen (ZUMA), pp. 8–25 (2004)

  • Beatty, P.C., Willis, B.G.: Research synthesis: the practice of cognitive interviewing. Public Opin. Q. 2, 287–311 (2007)

    Article  Google Scholar 

  • Boudon, R., Lazarsfeld, P.F. (eds.): Méthodes de la sociologie: II. L’analyse empirique de la causalité. Mouton & Co, Paris (1966)

  • Buzzi, C., Cavalli, A., de Lillo, A.: Giovani verso il Duemila. Quarto Rapporto lard sulla condizione giovanile, il mulino, Bologna (1997)

  • Cantril, H., Gaudet, H., Herzog, H.: The Invasion from Mars. Harper & Row, New York (1966)

    Google Scholar 

  • Capecchi, V.: Tre Castelli, una Casa e la Città inquieta. In: Cipolla, C., de Lillo, A. (eds.) Il sociologo e le sirene. La sfida dei metodi qualitativi, pp. 37–99. Angeli, Milano (1996)

    Google Scholar 

  • Capecchi, V.: Il contributo di Lazarsfeld alla metodologia sociologica. In: Campelli, E., Fasanella, A., Lombardo, C. (eds.) Paul Felix Lazarsfeld: Un Classico Marginale, pp. 35–82. Angeli, Milano (1999)

    Google Scholar 

  • Dewey, J.: Logic, The Theory of Inquiry. Henry Holt and Co., New York (1938)

    Google Scholar 

  • Esposito, J.L., Campanelli, P.C., Rothgeb, J.M., Polivka, A.E.: Determining which questions are best: methodologies for evaluating survey questions. In: Proceedings of the Section on Survey Research Methods, , pp. 46–55. American Statistical Association, Alexandria (1991)

  • Esposito, J.L., Rothgeb, J.M.: Evaluating survey data: Making the transition from pretesting to quality assessment. In: Lyberg, L., Biemer, P., Collins, M., de Leeuw, E., Dippo, C., et al. (eds.) Survey Measurement and Process Quality, pp. 541–571. Wiley, New York (1997)

  • Foddy, W.: An empirical evaluation of in-depth probes used to pretest survey questions. Sociol. Methods Res. 27, 103–133 (1998)

    Article  Google Scholar 

  • Glaser, B., Strauss, A.: The Discovery of Grounded Theory: Strategies for Qualitative Research. Aldine, Chicago (1967)

    Google Scholar 

  • Gobo, G., Mauceri, S.: Constructing Survey Data. A Pragmatist Approach. Sage Publications, London (2013)

  • Green, J., Caplovitz, D.: Cases déviantes dans la relation entre deux indicateurs (1966). In: Boudon R., Lazarsfeld P.F. (eds.) Méthodes de la sociologie: II. L’analyse empirique de la causalité, (Italian tr.), pp. 183–186. Mouton & Co, Paris (1966)

  • Jahoda, M., Lazarsfeld, P.F., Zeisel, H.: Die Arbeitslosen von Marienthal. Leipzig, Hitzel (1933); Eng. tr. Marienthal. The Sociography of an Unemployed Community. Tavistock, London (1971)

  • Kendall, P.L., Wolf, K.M.: The analysis of deviant cases in communication research. In: Lazarsfeld, P.F., Stanton, F.M. (eds.) Communication Research 1948–1949, pp. 152–157. Harper and Bros, New York (1949); republished in Lazarsfeld, P.F., Rosenberg, M., The Language of Social Research. A Reader in Methodology of Social Research, pp. 167–169. The Free Press, New York (1955)

  • Lazarsfeld, P.F.: The controversy over detailed interviews. Public Opin. Q. 1, 38–60 (1944); republished. In: Berelson, B., Janowitz, M. (eds.) Reader in Public Opinion and Communication. The Free Press, New York (1966)

  • Lazarsfeld, P.F.: Evidence and inference in social research. Daedalus 4, 99–130 (1958)

    Google Scholar 

  • Lazarsfeld, P.F.: Problems in methodology. In: Merton, R.K., Broom, L., Cottrell Jr, L.S. (eds.) Sociology Today, pp. 39–78. Basic Books, New York (1959)

    Google Scholar 

  • Lazarsfeld, P.F.: The sociology of empirical social research. Am. Sociol. Rev. 6, 757–767 (1962)

    Article  Google Scholar 

  • Lazarsfeld, P.F., Rosenberg, M. (eds.): The Language of Social Research. A Reader in Methodology of Social Research. Free Press, New York (1955)

    Google Scholar 

  • Lazarsfeld, P.F., Stanton, F.M. (eds.): Communication Research 1948–1949. Harper and Bros, New York (1949)

  • Lazarsfeld, P.F., Thielens Jr, W.: The Academic Mind: Social Scientists in a Time of Crisis. The Free Press, Glencoe (1958)

    Google Scholar 

  • Lazarsfeld, P.F., Berelson, B., Mc Phee, W.N.: Voting: A Study in a Presidential Campaign. Columbia University Press, New York (1954)

  • Lazarsfeld, P.F., Berelson, B., Gaudet, H.: The People’s Choice. How, the Voter Makes Up his Mind in a Presidential Campaign. Columbia University Press, New York (1944)

  • Leech, N.L., Onwuegbuzie, A.J.: A typology of mixed methods research. Qual. Quant. 43, 265–275 (2009)

    Article  Google Scholar 

  • Lutynski, J.: Un centro di ricerca sulle tecniche di raccolta dei dati. In: Marradi, A. (ed.) Costruire il dato. Angeli, Milano (1988)

    Google Scholar 

  • Marradi, A.: Fedeltà di un dato, affidabilità di una definizione operativa. Rassegna Italiana di Sociologia 1, 55–96 (1990)

    Google Scholar 

  • Martin, E.: Vignettes and respondent debriefing for questionnaire design and evaluatin. In: Presser, S., Rothgeb, J., Cooper, M., Lessler, J., Martin, E., Martin, J., et al. (eds.) Methods for Testing and Evaluating Survey Questionnaires. Wiley, New York (2004)

  • Mauceri, S.: La qualità del dato costruito nella ricerca sociale: il caso dell’intervista con questionario. Sociologia e ricerca sociale 65, 59–100 (2001)

    Google Scholar 

  • Mauceri, S.: Per la qualità del dato nella ricerca sociale. Strategie di progettazione e conduzione dell’intervista con questionario. Angeli, Milano (2003)

    Google Scholar 

  • Mauceri, S. (ed.): Nello stesso luogo. Percorsi di ricerca sulle pratiche e le dinamiche della convivenza multiculturale. Bonanno, Acireale-Roma (2009)

    Google Scholar 

  • Mauceri, S. (ed.): Arcipelago call center. Indagine sulla vita lavorativa degli operatori telefonici, Nova Logos, Aprilia (Lt) (2013)

  • Merton, R.K.: Definitions of a situation. In: Lazarsfeld, P.F., Rosenberg, M. (eds.) The Language of Social Research. A Reader in Methodology of Social Research, pp. 170–172. The Free Press, New York (1955)

    Google Scholar 

  • Merton, R.K.: Social Theory and Social Structure. The Free Press, Glencloe (1957)

    Google Scholar 

  • Merton, R.K., Kendall, P.L.: The focused interview. Am. J. Sociol. 51, 541–557 (1946)

    Article  Google Scholar 

  • Merton, R.K., Fiske, M., Curtis, A.: Mass Persuasion. The Social Psychology of a War Bond Drive. Harper & Brothers, New York (1946)

    Google Scholar 

  • Morgan, D.L.: Combining qualitative and quantitative methods paradigms lost and pragmatism regained: methodological implications of combining qualitative and quantitative methods. J. Mixed Methods Res. 1, 48–76 (2007)

    Article  Google Scholar 

  • Oksenberg, L., Cannell, C., Kalton, G.: New strategies for pretesting survey questions. J. Off. Stat. 7, 349–365 (1991)

    Google Scholar 

  • Royston, P., Bercini, D., Sirken, M., Mingay, D.: Questionnaire design research laboratory. In: Proceedings American Statistics Association, pp. 703–707 (1986)

  • Sale, J.M., Lohfeld, L.H., Brazil, K.: Revisiting the quantitative–qualitative debate: implications for mixed-methods research. Qual. Quant. 36, 43–53 (2002)

    Article  Google Scholar 

  • Sieber, S.D.: The integration of fieldwork and survey methods. Am. J. Sociol. 6, 1335–1359 (1973)

    Article  Google Scholar 

  • Viswanathan, M.: Mesaurement Error and Research Design. Sage, London (2005)

    Google Scholar 

  • Willis, G.P.: Cognitive Interviewing. A Tool for Improving Questionnaire Design. Sage, London (2005)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Communication and Social Research, Sapienza University of Rome, C.so d’Italia 38/a, 00193 , Rome, Italy

    Sergio Mauceri

Authors
  1. Sergio Mauceri
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sergio Mauceri.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mauceri, S. Mixed strategies for improving data quality: the contribution of qualitative procedures to survey research. Qual Quant 48, 2773–2790 (2014). https://doi.org/10.1007/s11135-013-9923-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-013-9923-4

Keywords

Search

Navigation