Using cognitive interviews to pilot an international survey of principal preparation: A Western Australian perspective
- 175 Downloads
This paper provides an example of the application of the cognitive interview, a qualitative tool for pre-testing a survey instrument to check its cognitive validity, that is, whether the items mean to respondents what they mean to the item designers. The instrument is the survey used in the final phase of the International Study of Principal Preparation (ISPP http://www.ucalgary.ca/~cwebber/ISPP/index.htm). This study involving researchers in 13 countries investigates those aspects of principals’ work perceived by them to be most challenging in their early years in the position and the extent to which principals believe they were prepared for these challenges. Both probing and think aloud approaches to the cognitive interview were used and revealed a small number of items requiring amendment.
KeywordsCognitive interviews Qualitative research Survey development Principal preparation
- Ackermann, A.C., & Blair, J. (2006). Efficient respondent selection for cognitive interviewing. In Proceedings of the Survey Research Methods Section, American Statistical Association. http://www.amstat.org/sections/srms/Proceedings/y2006f.html. Accessed 21 August 2008.
- Andrich, D. (1988). Rasch models for measurement. Sage University Series on Quantitative Approaches to the Social Sciences, pp. 07–068. Beverley Hills & London: Sage.Google Scholar
- Andrich, D., Sheridan, B. S., & Luo, G. (2005). RUMM2020: Rasch Unidimensional Models for Measurement. Perth, Western Australia: RUMM Laboratory.Google Scholar
- Blair, J., Conrad, F., Ackermann, A.C., & Claxton, G. (2006). The effect of sample size on cognitive interview findings. In Proceedings of the Survey Research Methods Section, American Statistical Association. http://www.amstat.org/sections/srms/Proceedings/y2006f.html. Accessed 21 August 2008.
- Clarke, S., Wildy, H., & Pepper, C. (2007). Connecting preparation with reality: Primary principals’ experiences of their first year out in Western Australia. Leading & Managing, 13(1), 81–90.Google Scholar
- Ericsson, K. A., & Simon, H. (1984). Protocol analysis, verbal reports as data. Cambridge, MA: MIT.Google Scholar
- Karabenick, S., Woolley, M., Friedel, J., Ammon, B., Blazevski, J., Bonney, C., et al. (2007). Cognitive processing of self-report items in educational research: Do they think what we mean? Educational Psychologist, 42(3), 139–151.Google Scholar
- Rasch, G. (1960). Probablistic models for some intelligence and attainment tests. (Copenhagen, Danish Institute for Educational Research)). Expanded edition (1980) with foreword and afterword by B.D. Wright. Chicago: The University of Chicago Press.Google Scholar
- Rasch, G. (1980). Probablistic models for some intelligence and attainment tests. (Copenhagen, Danish Institute for Educational Research)). Expanded edition (1980) with foreword and afterword by B.D. Wright. Chicago: The University of Chicago Press.Google Scholar
- Slater, C. L., Boone, M., Nelson, S., De La Colina, M., Garcia, E., Grimaldo, L., et al. (2007). El Escalafón y el Doble Turno: An international perspective on school director preparation. Journal for Educational Research and Policy Studies, 6(2), 60–90.Google Scholar
- Wildy, H., Clarke, S., & Slater, C. (2007). International perspectives of principal preparation: How does Australia fare? Leading & Managing Special Edition, 13(2), 1–14.Google Scholar
- Willis, G. B. (2005). Cognitive interviewing: A tool for improving questionnaire design. Thousand Oaks, CA: Sage.Google Scholar
- Wright, B. D. (1999). Fundamental measurement for psychology. In S. E. Embretson & S. C. Herschberger (Eds.), The new rules of measurement, pp. 65–104. New York: Lawrence Erlbaum.Google Scholar