Open narrative questions in PC and smartphones: is the device playing a role?
- 409 Downloads
Most survey questions are closed questions, where respondents have to select an answer from a proposed set of alternatives. However, a lot of surveys also include, at least occasionally, some open questions. Open questions that call for elaborated and developed answers, called “open narrative questions”, are used when the researchers want to go deeper into what the respondents think. This paper compares the answers to open narrative questions when the respondent is participating in a PC survey, in a smartphone-not-optimised survey or in a smartphone-optimised survey. The experiment was carried out in Spain using data collected by the Netquest online access panel. Respondents were assigned randomly to each type of device and survey format, in two successive waves. Because respondents have to type in their answer, we expect differences between devices, linked with the size and the kind of keyboards (i.e. physical versus digital, touch-screen or not). Differences are observed between answers that come from PCs and smartphones for the response time per written character, for the number of total characters and for the use of abbreviations, but not for the non-answer and non-substantive responses. No differences are observed between optimised and not optimised versions for smartphones, except for the response time per character written.
KeywordsWeb surveys Smartphones Mobile optimised questionnaires Open narrative questions Response time
We are very grateful to the Netquest team for the support in planning and collecting the necessary data. We would also like to thank Daniele Toninelli for his help in designing the experiment and his very useful comments on a previous draft of this paper, and the anonymous reviewers who gave us many valuable suggestions.
- Buskirk, T.D., Andrus C.H.: Smart Surveys for Smartphone: Exploring Various Approaches for Conducting Online Mobile Surveys Via Smartphones. Survey Practice. http://surveypractice.wordpress.com/2012/02/21/smart-surveys-for-smart-phones/ (2012)
- Couper, M.P., Kennedy, C., Conrad, F.G., Tourangeau, R.: Designing input fields for non-narrative open-ended responses in web surveys. J. Off. Stat. 27(1), 65–85 (2011)Google Scholar
- Couper, M, Peterson G. : Exploring Why Mobile Web Surveys Take Longer. Presented at the General Online Research conference, 18 to 20 March 2015 in Cologne. https://conftool.gor.de/conftool15/index.php?page=browseSessions&form_session=26&presentations=show (2015)
- de Bruijne, M, Wijnant A.: Can mobile web surveys be taken on computers? a discussion on a multi-device survey design. Surv. Pract. 6(4) (2013)Google Scholar
- Emde, M., Fuchs M.: Using adaptive questionnaire design in open-ended questions: a field experiment. In: JSM Proceedings, Statistical Computing Section. American Statistical Association, Alexandria (2012)Google Scholar
- Emde, M., Fuchs, M.: Using interactive feedback to enhance response quality in Web surveys: The case of open-ended questions. Presentación GOR conferencia 2013 (Mannheim): http://conftool.gor.de/conftool13/index.php?page=browseSessions&presentations=show&form_session=14 (2013)
- Israel, G.D.: Effects of answer space size on responses to open-ended questions in mail surveys. J. Off. Stat. 26(2), 271–285 (2010)Google Scholar
- Mavletova, A., Couper M.P.: Sensitive topics in pc web and mobile web surveys: is there a difference? Surv. Res. Methods 7(3):191–205. https://ojs.ub.uni-konstanz.de/srm/article/view/5751 (2013)
- Occhipinti, S.: Mixed modelling using stata. Workshop for GSBRC. http://www.griffith.edu.au/__data/assets/pdf_file/0011/439346/Stata_mixed_intro-1.pdf (2012)
- Peterson, G.: Unintended mobile respondents. Paper presented at CASRO technology conference, New York. http://c.ymcdn.com/sites/www.casro.org/resource/collection/D0686718-163A-4AF4-A0BB-8F599F573714/Gregg_Peterson_-_Market_Strategies.pdf (2012)
- Revilla, M., Toninelli, D., Ochoa, C., Loewe, G.: Do online access panels really need to allow and adapt surveys to mobile devices? Internet Res. (fothcoming)Google Scholar
- Wells, T., Bailey, J.T., Link, M.W.: Filling the void: Gaining a better understanding of tablet-based surveys. Surv. Pract. 6 (2013)Google Scholar
- Zahariev, M., Ferneyhough, C., Ryan, C.: Best practices in mobile research. Paper presented at ESOMAR Online Research, Chicago, Oct 26–28 (2009)Google Scholar