Skip to main content

Treatment of “don’t know” responses in the consumers’ perceptions about sustainability in the agri-food sector

Quality & Quantity volume 51, pages 765–778 (2017)Cite this article

Abstract

In several studies the analysis of consumers’ perceptions has become of paramount strategic value in order to understand consumption behaviour. The aim of this paper is to determine the effectiveness of two alternative strategies for analyzing the “don’t know” responses in questionnaires with items having ordered response categories. Both strategies rest on a statistical model, denoted as cub (Combination of Uniform and shifted Binomial random variables), designed to measure the agreement of consumers with the latent trait measured by the questionnaire together with the level of uncertainty in choosing the ordinal response category. In the first strategy, the fraction of don’t know responses is considered as a measure of the item difficulty and used, together with some personal characteristics, as covariate in the cub model. The second strategy is a recent extension of the standard cub, consisting in adjusting the uncertainty measure to take account of the fraction of don’t know responses, considered as a source of further uncertainty. We applied the two proposed strategies on real data from a survey about the consumers’ perceptions on the importance of sustainability issues in the agri-food sector.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

USD 39.95

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3

References

  • Beatty, P., Herrmann, D.: A framework for evaluating “don’t know” responses in surveys. Proc of the section on Survey Research Methods, pp. 1005–1010. Am Stat Assoc, Washington DC (1995)

    Google Scholar 

  • Bishop, G., Tuchfarber, A., Oldendick, R.: Opinions on fictitious issues: the pressure to answer survey questions. Public Opin. Q. 50, 240–250 (1986)

    Article  Google Scholar 

  • Bradbum, N.M., Sudman, S., Blair, E.: Improving Interview Method and Questionnaire Design. Jossey-Bass Publishers, San Francisco (1979)

    Google Scholar 

  • Brown, K., McIlveen, H., Strugnell, C.: Nutritional awareness and food preferences of young consumers. Nutr. Food Sci. 30, 230–235 (2000)

    Article  Google Scholar 

  • Cannell, C., Miller, P., Oksenberg, L.: Research on interviewing techniques. Sociol. Methodol. 1, 50–79 (1981)

    Google Scholar 

  • Cannell, C.F., Henson, R.: Incentives, motives, and responses bias. Ann. Econ. Soc. Measurement 3, 307–317 (1974)

    Google Scholar 

  • Capecchi, S., Endrizzi, E., Gasperi, F., Piccolo, D.: A multi-product approach for detecting subjects’ and objects’ covariates in consumer preferences. Br. Food J. 118, 515–526 (2016)

    Article  Google Scholar 

  • Commission, European: Flash Eurobarometer 256 (Europeans’ attitudes towards the issue of sustainable consumption and production). Technical Report. The GALLUP Organisation, Brussels (2009)

  • Converse, P., 1964. The nature of belief systems in mass publics, in: Apter, D. (Ed.), Idealogy and Discontent. Free Press, pp. 206–261

  • Corduas, M., Cinquanta, L., Ievoli, C.: The importance of wine attributes for purchase decisions: a study of italian consumer perception. Food Qual. Preference 28, 407–418 (2013)

    Article  Google Scholar 

  • Cugnata, F., Salini, S.: Comparison of alternative imputation methods for ordinal data. Theory and Methods, Communications in Statistics (2014). doi:10.1080/03610918.2014.963611

  • de Boer, J., Hoogland, C., Boersema, J.: Towards more sustainable food choices: value priorities and motivational orientations. Food Qual. Preference 18, 985–996 (2007)

    Article  Google Scholar 

  • de Mooij, M.: Consumer behavior and culture. SAGE Publications Inc, Thousand Oaks (2010)

    Google Scholar 

  • D’Elia, A., Piccolo, D.: A mixture model for preferences data analysis. Computational Stat. Data Anal. 49, 917–934 (2005)

    Article  Google Scholar 

  • Feagan, R., Morris, D., Krug, K.: Niagara region farmers’ markets: local food systems and sustainability considerations. Local Environ. 9, 235–254 (2004)

    Article  Google Scholar 

  • Feick, L.F.: Latent class analysis of survey questions that include don’t know responses. Public Opin. Quart. 53, 525–547 (2005)

    Article  Google Scholar 

  • Food, Slow: Towards a new Common Agricultural Policy. Technical Report, Slow Food Policy Paper on CAP (2011)

  • Honkanen, P., Olsen, S.: Environmental and animal welfare issues in food choice: the case of farmed fish. Br. Food J. 111, 293–309 (2009)

    Article  Google Scholar 

  • Hume, M.: Compassion without action: examining the young consumers consumption and attitude to sustainable consumption. J. World Bus. 45, 385–394 (2010)

    Article  Google Scholar 

  • Iannario, M., Piccolo, D.: A generalized framework for modelling ordinal data. Stat. Methods Appl. 25, 163–189 (2016)

    Article  Google Scholar 

  • Iannario, M., Manisera, M., Piccolo, D., Zuccolotto, P.: Ordinal data models for no-opinion responses in attitude surveys. Submitted (2016a)

  • Iannario, M., Piccolo, D., Simone, R.: CUB: a class of mixture models for ordinal data. R package version 0.1 (2016b). http://CRAN.R-project.org/package=CUB

  • Jonung, L.: Uncertainty about inflationary perceptions and expectations. J. Econ. Psychol. 7, 315–325 (1986)

    Article  Google Scholar 

  • Kemp, S.: Rating the values of government and market supplied goods. J. Econ. Psychol. 19, 447–461 (1998)

    Article  Google Scholar 

  • Kemp, S., Lea, S., Fussell, S.: Experiments on rating the utility of consumer goods: evidence supporting microeconomic theory. J. Econ. Psychol. 16, 543–561 (1995)

    Article  Google Scholar 

  • Kemp, S., Willetts, K.: Rating the value of government-funded services: comparison of methods. J. Econ. Psychol. 16, 1–21 (1995)

    Article  Google Scholar 

  • Kilbourne, W.: Green marketing: a theoretical perspective. J. Mark. Manag. 14, 641–655 (1998)

    Article  Google Scholar 

  • Kilbourne, W., McDonagh, P., Prothero, A.: Sustainable consumption and the quality of life: a macromarketing challenge to the dominant social paradigm. J. Macromark. 17, 14–24 (1997)

    Article  Google Scholar 

  • Kroh, M.: Taking don’t knows as valid responses: a complete random imputation of missing data. Qual. Quant. 40, 225–244 (2006)

    Article  Google Scholar 

  • Krosnick, J.: The causes of no-opinion responses to attitude measures in surveys: they are rarely what they appear to be. In: Groves, R., Dillman, D., Eltinge, J., Little, J. (eds.) Survey nonresponse, pp. 1005–1010. Wiley, New York (2002)

    Google Scholar 

  • Lewis, A.: Public expenditure: perceptions and preferences. J. Econ. Psychol. 3, 159–167 (1983)

    Article  Google Scholar 

  • Lietz, P.: Research into questionnaire design—a summary of the literature. Int. J. Mark. Res. 52, 249–272 (2010)

    Article  Google Scholar 

  • Lozza, E., Carrera, S., Bosio, A.: Perceptions and outcomes of a fiscal bonus: framing effects on evaluations and usage intentions. J. Econ. Psychol. 31, 400–404 (2010)

    Article  Google Scholar 

  • Maddala, G.S.: Limited dependant and qualitative variables in econometrics. Cambridge University Press, New York (1983)

    Book  Google Scholar 

  • Manisera, M., Zuccolotto, P.: Modeling rating data with Nonlinear CUB models. Comput. Stat. Data An. 78, 100–118 (2014a)

    Article  Google Scholar 

  • Manisera, M., Zuccolotto, P.: Modelling “don’t know” responses in rating scales. Pattern. Recognit. Lett. 45, 226–234 (2014b)

    Article  Google Scholar 

  • Manisera, M., Zuccolotto, P.: Treatment of “don’t know” responses in a mixture model for rating data. Metron 74, 99–115 (2015)

    Article  Google Scholar 

  • von Meyer-Hofer, M., Spiller, A.: Sustainability a semi-globalisable concept for international food marketing: Consumer expectations regarding sustainable food. Paper prepared for presentation at the EAAE-AAEA Joint Seminar ‘Consumer Behavior in a Changing World: Food, Culture, Society’, Naples, Italy (2015)

  • Ottman, J., 2011. The New Rules of Green Marketing: Strategies, Tools, and Inspiration for Sustainable Branding. Berrett-Koehler Publishers, Inc

  • Piccolo, D.: On the moments of a mixture of uniform and shifted binomial random variables. Quaderni di Statistica 5, 85–104 (2003)

    Google Scholar 

  • Piccolo, D., D’Elia, A.: A new approach for modelling consumers’ preferences. Food Qual. Preference 19, 247–259 (2008)

    Article  Google Scholar 

  • Pierson, T., Allen, J.: Directions in food marketing: responding to consumers of tomorrow, in: Outlook-Proceedings, Agricultural Outlook Conference, US Department of Agriculture (USA) (1989)

  • Poe, G., Seeman, I., McLaughlin, J., Mehl, E., Dietz, M.: Don’t know boxes in factual questions in a mail questionnaire. Public Opin. Q. 19, 212–222 (1988)

    Article  Google Scholar 

  • Rossi, M., 2015. Soddisfazione e attenzione dei consumatori nei confronti delle etichette dei prodotti alimentari: analisi statistica di percezioni e comportamenti di consumo. Technical Report. Master’s Degree Thesis (supervisor: Prof. P. Zuccolotto) - University of Brescia, Italy

  • Rubin, D.B., Stern, H.S., Vehovarc, V.: Handling “don’t know” survey responses: the case of the slovenian plebiscite. J. Am. Stat. Assoc. 90, 822–828 (1995)

    Google Scholar 

  • Sautron, V., Peneau, S., Camilleri, G.M., Muller, L., Ruffieux, B., Hercberg, S., Méjean, C.: Validity of a questionnaire measuring motives for choosing foods including sustainable concerns. Appetite 87, 90–97 (2015)

    Article  Google Scholar 

  • Schafer, J.L., Graham, J.W.: Missing data: our view of the state of the art. Psychol. Methods 7, 147–177 (2002)

    Article  Google Scholar 

  • Siegrist, M., Visschers, V., Hartmann, C.: Factors influencing changes in sustainability perception of various food behaviors: results of a longitudinal study. Food Qual. Preference 46, 33–39 (2015)

    Article  Google Scholar 

  • Simon, H.: Models of Man. Wiley, New York (1957)

    Google Scholar 

  • Steptoe, A., Pollard, T., Wardle, J.: Development of the motives underlying the selection of food: the food choice questionnaire. Appetite 25, 267–284 (1995)

    Article  Google Scholar 

  • Stobbelaar, D., Casimir, G., Borghuis, J., Marks, I., Meijer, L., Zebeda, S.: Adolescents attitudes towards organic food: a survey of 15-to 16-year old school children. Int. J. Consum. Stud. 31, 349–356 (2007)

    Article  Google Scholar 

  • Tourangeau, R., Rips, L., Rasinski, K.: The psychology of survey response. Cambridge University Press, Cambridge (2000)

    Book  Google Scholar 

  • Vanhonacker, F., Van Loo, E., Gellynck, X., Verbeke, W.: Flemish consumer attitudes towards more sustainable food choices. Appetite 62, 7–16 (2013)

    Article  Google Scholar 

  • Verain, M.C., Sijtsema, S.J., Antonides, G.: Consumer segmentation based on food-category attribute importance: the relation with healthiness and sustainability perceptions. Food Qual. Preference 48, 99–106 (2016)

    Article  Google Scholar 

  • Willis, G.: Cognitive aspects of survey methodology (\({\text{ CASM }}\)). In: Lavrakas, P. (ed.) Encyclopedia of survey research methods, pp. 104–107. SAGE Publications, Thousand Oaks (2008)

    Google Scholar 

  • Zander, K., Hamm, U.: Consumer preferences for additional ethical attributes of organic food. Food Qual. Preference 21, 495–503 (2010)

    Article  Google Scholar 

Download references

Acknowledgments

We thank the Referees for their useful comments and suggestions. A special thank to Michela Rossi, who developed the questionnaire and prepared the dataset, as part of her Master’s degree thesis.

Author information

Authors and Affiliations

  1. University of Naples Federico II, via L. Rodinò 22, 80138, Naples, Italy

    Maria Iannario

  2. University of Brescia, C.da S. Chiara, 50, 25122, Brescia, Italy

    Marica Manisera & Paola Zuccolotto

Authors
  1. Maria Iannario
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Marica Manisera
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Paola Zuccolotto
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Marica Manisera.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Iannario, M., Manisera, M. & Zuccolotto, P. Treatment of “don’t know” responses in the consumers’ perceptions about sustainability in the agri-food sector. Qual Quant 51, 765–778 (2017). https://doi.org/10.1007/s11135-016-0438-7

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11135-016-0438-7

Keywords

  • Agri-food
  • Sustainability
  • “Don’t know” responses
  • Missing data
  • Ordinal data
  • cub models