Abstract
Web-based surveys are a salient tool in the repertoire of social and behavioral scientists. The increase in web-based surveys is understandable considering the distinct advantages offered, including: (a) lower costs and reduced labor time, (b) ability to directly transfer data into statistical packages (reducing coding errors), (c) customization options enabling more attractive presentation, (d) ability to reduce respondent burden by embedding skip patterns, and (e) access to larger sample sizes in different geographic regions. It is important to note, however, that administering web-based surveys also introduces distinct sources of error (e.g., coverage, sampling and non-response). Regardless of format (e.g., paper-and-pencil or web-based), specific, prescribed steps must be followed when constructing an instrument in order to reduce survey error and lend credence to the data collected before subsequent analysis is performed. One of those crucial stages integral to the pretesting process is cognitive interviewing. Cognitive interviewing is a qualitative process, encompassing two main techniques: think aloud interviewing and verbal probing. Collectively, these two methods seek to (a) produce information on what the respondent is thinking while answering the questions, (b) the cognitive processes used to answer the questions, and (c) how the respondent answers the questions. The purpose of this article is to provide a practical guide outlining how Camtasia, a screen video capture software, can aide and inform the cognitive interview process.
Article PDF
Similar content being viewed by others
Avoid common mistakes on your manuscript.
References
Alvarez R.M., VanBeselaere C.: Web-based surveys. In: Kempf-Leonard, K. (eds) Encyclopedia of Social Measurement, pp. 955–962. Academic, London (2005)
Anderson R.P., Wilson S.P., Livingston M.B., LoCicero A.D.: Characteristics and content of library tutorials: a review. J. Med. Libr. Assoc. 96, 61–63 (2008)
Barmby P., Harries T., Higgins S., Suggate J.: The array representation and primary children’s understanding and reasoning in multiplication. Educ. Stud. Math. 70, 217–241 (2009)
Barry A.E., Chaney B.H., Stellefson M.L., Chaney J.D.: So you want to develop a survey: practical recommendations for scale development. Am. J. Health Stud. 26, 97–105 (2011)
Best S.J., Krueger B., Hubbard C., Smith A.: An assessment of the generalizability of internet surveys. Soc. Sci. Comput. Rev. 19, 131–145 (2001)
Birru, M.S., Monaco, V.M., Charles, L., Drew, H., Nijie, V., Bierria, T, Detlefson, E., Steinman, R.A.: Internet usage by low-literacy adults seeking health information: an observational analysis. J. Med. Internet Res. 6, e25 (2004)
Black, G.: Questioning market leaders for long term investors. Wall Str. J. http://www.twst.com/ceos/hpol.html (2000). Accessed 15 June 2000
Boyer K.K., Olson J.R., Calantone R.J., Jackson E.C.: Print versus electronic surveys: a comparison of two data collection methodologies. J. Oper. Manag. 20, 357–373 (2002)
Buhi E.R., Daley E.M., Fuhrmann H.J., Smith S.A.: An observational study of how young people search for online sexual health information. J. Am. Coll. Health 58, 101–111 (2009)
Chen L., Goodson P.: Web-based survey of US health educators: challenges and lessons. Am. J. Health Behav. 34, 3–11 (2010)
Collins D.: Pretesting survey instruments: an overview of cognitive methods. Qual. Life Res. 12, 229–238 (2003)
Couper M.P.: Web surveys: a review of issues and approaches. Public Opin. Q 64, 464–494 (2000)
Couper M.P.: Technology trends in survey data collection. Soc. Sci. Comput. Rev. 23, 486–501 (2005)
Couper M.P., Kapteyn A., Schonlau M., Winter J.: Noncoverage and nonresponse in an internet survey. Soc. Sci. Res. 36, 131–148 (2007)
Denscombe M.: Web-based questionnaires and the mode effect: an evaluation based on the completion rates and data contents of near-identical questionnaires delivered in difference modes. Soc. Sci. Comput. Rev. 24, 246–254 (2006)
DeMaio T.J., Rothgeb J.M.: Cognitive interviewing techniques: in the lab and the field. In: Schwarz, N., Sudman, S. (eds) Answering Questions: Methodology for Determining Cognitive and Communicative Processes in Survey Research, pp. 175–195. Jossey-Bass, San Francisco (1996)
Dillman, D.A.: Mail and Internet Surveys: The Tailored Design Method. Wiley, New Jersey (2000)
Dillman D.A.: Mail and Internet Surveys: The Tailored Design Method. Wiley, New Jersey (2007)
Hansen L.D., Derry A.H., Resnick J.P., Richardson R.C.: Adolescents searching for health information on the internet: an observational study. J. Med. Internet Res. 5, e25 (2003)
Jobe J.B., Herrmann D.J.: Implications of models of survey cognition for memory theory. In: Herrmann, D.J., McEvoy, C., Herzog, C., Hertel, P., Johnson, M.K. (eds) Basic and Applied Memory Research: Practical Applications, Vol. 2., pp. 193–205. Erlbaum, New Jersey (1996)
Kaplovitz M.D., Hadlock T.D., Levine R.: A comparison of web and mail survey response rates. Public Opin. Q. 68, 94–101 (2004)
Kerwin J., Willis G.: Cognitive interview pretesting of a health information survey. In: Finney Rutten, L., Hesse, B., Moser, R., Kreps, G. (eds) Building the Evidence Base in Cancer Communication: Health Information National Trends Survey (HINTS), pp. 47–60. Hampton Press, New Jersey (2011)
Kiernan, N.E., Kiernan, M., Oyler, M.A., Gilles, C.: Is a web survey as effective a a mail survey? A field experiment among computer users. Am. J. Eval. 26, 245–252 (2005)
Kuiper E., Volman M., Terwel J.: Students’ use of web literacy skills and strategies: searching, reading, and evaluating web information. Inf. Res. 13, 1–18 (2008)
Kypri K., Gallagher S.J., Cashell-Smith M.L.: An internet-based survey method for college student drinking research. Drug Alcohol Depend. 76, 45–53 (2004)
Lim S.: The self-confrontation interview: towards an enhanced understanding of human factors in web-based interaction form improved website usability. J. Electron. Commer. Res. 3, 162–173 (2002)
McCabe S.E., Boyd C.J., Couper M.P., Crawford S.D., D’Arcy H.: Mode effects for collecting alcohol and other drug use data: web and US mail. J. Stud. Alcohol 63, 755–762 (2002)
McCabe S.E., Couper M.P., Cranfrod J.A., Boyd C.J.: Comparison of web and mail surveys for studing secondary consequences associated with substance use: evidence for minimal mode effects. Addict. Behav. 31, 162–168 (2006a)
McCabe S.E., Diez A., Boyd C.J., Nelson T.F., Weitzman E.R.: Comparing web and mail responses in a mixed mode survey in college alcohol research. Addict. Behav. 31, 1619–1627 (2006b)
McGrann R.T.: Enhancing engineering computer-aided design education using lectures recorded on the PC. J. Educ. Technol. Syst. 34, 165–175 (2005)
Miller E.T., Neal D.J., Roberts L.J., Baer J.S., Cressler S.O., Metrik J., Marlatt G.A.: Test-retest reliability of alcohol measures: is there a difference between internet-based assessment and traditional methods?. Psychol. Addict. Behav. 16, 56–63 (2002)
Parks K.A., Pardi A.M., Bradizza C.M.: Collecting data on alcohol use and alcohol-related victimization: a comparison of telephone and web-based survey methods. J. Stud. Alcohol Drug 67, 318–323 (2006)
Power J.L.: Training 2.0—library assistants in the age of information. J. Access. Serv. 8, 69–79 (2011)
Qiu, Y., Yu, P., Hyland, P.: A multi-method approach to assessing health information systems end users’ training needs. Medinfo 2007: Proceedings of the 12th World Congress on Health (Medical) Informatics; Building Sustainable Health Systems, 1352–1356 (2007). http://search.informit.com.au/browsePublication;isbn=9781586037741;res=E-LIBRARY (2007). Accessed 16 August 2011
Sills S.J., Song C.: Innovations in survey research: an application of web-based surveys. Soc. Sci. Comput. Rev. 20, 22–30 (2002)
Smidt E., Hegelheimer V.: Effects of online academic lectures on ESL listening comprehension, incidental vocabulary acquisition, and strategy use. Comput. Assist. Lang. Learn. 17, 517–556 (2004)
TechSmith Coporation.: Camtasia Studio 7.1. www.techsmith.com/Camtasia (2011). Accessed 16 August 2011
Truell A.D., Bartlett J.E., Alexander M.W.: Response rate, speed and completeness: a comparison of internet-based and mail surveys. Behav. Res. Methods Instrum. Comput. 34, 46–49 (2002)
Warwick C., Rimmer J., Blandford A., Gow J., Buchanan G.: Cognitive economy and satisficing in information seeking: a longitudinal study of undergraduate information behavior. J. Am. Soc. Inf. Sci. Technol. 60, 2402–2415 (2009)
Willson R., Given L.M.: The effect of spelling and retrieval system familiarity on search behavior in online public access catalogs: a mixed methods study. J. Am. Soc. Inf. Sci. Technol. 61, 2461–2476 (2010)
Yun, G.W., Trumbo, C.W.: Comparative response to a survey executed by post, email, and web form. J. Comput.-Mediat. Commun. 6 (1) (2000). http://icmc.indiana.edu/vol6/issue1/yun.html. Accessed 18 April 2005
Open Access
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License (https://creativecommons.org/licenses/by-nc/2.0), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Chaney, B.H., Barry, A.E., Chaney, J.D. et al. Using screen video capture software to aide and inform cognitive interviewing. Qual Quant 47, 2529–2537 (2013). https://doi.org/10.1007/s11135-012-9669-4
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11135-012-9669-4