Skip to main content
SpringerLink
Log in

Development and psychometric evaluation of a multidimensional scale of willingness to communicate in a foreign language

  • Published:
European Journal of Psychology of Education Aims and scope Submit manuscript

Abstract

This study aims to develop and validate a multidimensional scale of willingness to communicate in a foreign language. Multidimensional random coefficient multinomial logit model was employed to analyze the scale. Likelihood deviance test and information criteria showed that a three-dimensional model fits significantly better than a two-dimensional model and the two-dimensional model fits significantly better than a unidimensional model. A four-dimensional model, however, did not improve model fit. Low and moderate correlations among the three dimensions supported the multidimensionality of the scale. Further evidence for the validity of the scale was derived from correlation with an English proficiency test used as an external criterion.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1

Similar content being viewed by others

References

  • Adams, R. J., Wilson, M. R., & Wang, W.-C. (1997). The multidimensional random coefficients multinomial logit model. Applied Psychological Measurement, 21, 1–23.

    Article  Google Scholar 

  • Andrich, D. (1978). A rating formulation for ordered response categories. Psychometrika, 43, 561–573.

    Article  Google Scholar 

  • Baghaei, P. (2011). C-Test construct validation: a Rasch modeling approach. Saarbrücken: VDM Verlag Dr. Müller.

  • Baghaei, P. (2012). The application of multidimensional Rasch models in large scale assessment and evaluation: an empirical example. Electronic Journal of Research in Educational Psychology, 10(1), 233–252.

    Google Scholar 

  • Baghaei, P., & Grotjahn, R. (in press) Establishing the construct validity of conversational C-Tests using a multidimensional item response model. In R. Grotjahn (Ed.). Der C-Test: Aktuelle Tendenzen/The C-Test: Current trends. Frankfurt/M.: Lang.

  • Baker, S. C., & MacIntyre, P. D. (2000). The role of gender and immersion in communication and second language orientations. Language Learning, 50, 311–341.

    Article  Google Scholar 

  • Briggs, D. C., & Wilson, M. (2003). An introduction to multidimensional measurement using Rasch models. Journal of Applied Measurement, 4, 87–100.

    Google Scholar 

  • Brown, H. D. (2007). Principles of language learning and teaching. New York: Pearson.

    Google Scholar 

  • Burgoon, J. K. (1976). The unwillingness-to-communicate scale: development and validation. Communication Monographs, 43, 60–69.

    Google Scholar 

  • Clément, R., Baker, S. C., & MacIntyre, P. D. (2003). Willingness to communicate in a second language: the effects of context, norms, and vitality. Journal of Language and Social Psychology, 22, 190–209.

    Article  Google Scholar 

  • Dörnyei, Z. (2005). The psychology of the language learner. New York: Erlbaum.

    Google Scholar 

  • Eckes, T., & Grotjahn, T. (2006). A closer look at the construct validity of C-tests. Language Testing, 23, 290–325.

    Article  Google Scholar 

  • Embretson Whitely, S. E. (1985). Introduction to the problem of test design. In S. E. Embretson (Ed.), Test design: developments in psychology and psychometrics. New York: Academic.

    Google Scholar 

  • Grotjahn, R. (Ed.). (2002). Der C-test. Theoretische Grundlagen und praktische Anwendungen, vol. 4. Bochum: AKS-Verlag.

    Google Scholar 

  • Grotjahn, R. (Ed.). (2006). Der C-test: theorie, empirrie, anwendungen/the C-test: theory, empirical research, applications. Frankfurt/M: Peter Lang.

    Google Scholar 

  • Grotjahn, R. (Ed.). (2010). Der C-test: beiträge aus der aktuellen forschung/The c-test: contributions from current research. Frankfurt am Main: Peter Lang.

    Google Scholar 

  • Grotjahn, R., Klein-Braley, C., & Raatz, U. (2002). C-Tests: An overview. In J. Coleman, R. Grotjahn, & U. Raatz (Eds.), University language testing and the C-test (pp. 93–114). Bochum: AKS.

    Google Scholar 

  • Hashimoto, Y. (2002). Motivation and willingness to communicate as predictors of reported L2 use: the Japanese ESL context. Second Language Studies, 20(2), 29–70.

    Google Scholar 

  • Hopp, H. (2006). Syntactic features and reanalysis in near-native processing. Second Language Research, 22, 369–397.

    Article  Google Scholar 

  • Janssen, R., & De Boeck, P. (1999). Confirmatory analyses of componential test structure using multidimensional item response theory. Multivariate Behavioral Research, 34, 245–268.

    Article  Google Scholar 

  • Kassing, J. W. (1997). Development of the intercultural willingness to communicate scale. Communication Research Reports, 14(4), 399–407.

    Article  Google Scholar 

  • Krekeler, C. (2006). Language for special academic purposes (LSAP) testing: the effect of background knowledge revisited. Language Testing, 23, 99–130.

    Article  Google Scholar 

  • Lee-Ellis, S. (2009). The development and validation of a Korean C-test using Rasch analysis. Language Testing, 26, 245–274.

    Article  Google Scholar 

  • Lightbown, P., & Spada, N. (2006). How languages are learned. Oxford: Oxford University Press.

    Google Scholar 

  • Linacre, J. M. (2011). WINSTEPS [Computer Programme]. Chicago, IL: winsteps.com.

  • MacIntyre, P., & Charos, C. (1996). Personality, attitudes, and affect as predictors of second language communication. Journal of Language and Social Psychology, 15, 3–26.

    Article  Google Scholar 

  • MacIntyre, P. D., Clément, R., Dörnyei, Z., & Noels, K. A. (1998). Conceptualizing willingness to communicate in a L2: a situational model of L2 confidence and affiliation. Modern Language Journal, 82, 545–562.

    Article  Google Scholar 

  • MacIntyre, P., Baker, S. C., Clément, R., & Conrad, S. (2001). Willingness to communicate, social support, and language-learning orientations of immersion students. Studies in Second Language Acquisition, 23, 369–388.

    Article  Google Scholar 

  • MacIntyre, P., Baker, S. C., Clément, R., & Donovan, L. A. (2002). Sex and age effects on willingness to communicate, anxiety, perceived competence, and L2 motivation among junior high school French immersion students. Language Learning, 52, 537–564.

    Article  Google Scholar 

  • MacIntyre, P., Baker, S. C., Clément, R., & Donovan, L. A. (2003). Talking in order to learn: willingness to communicate and intensive language programs. The Canadian Modem Language Review, 59, 589–607.

    Article  Google Scholar 

  • McCroskey, J. C. (1992). Reliability and validity of the willingness to communicate scale. Communication Quarterly, 40, 16–25.

    Article  Google Scholar 

  • McCroskey, J. C, & Richmond, V. P. (1982). Communication apprehension and shyness: conceptual and operational distinctions. Central States Speech Journal, 33, 458–468.

    Google Scholar 

  • McCroskey, J. C., & Baer, J. E. (1985). Willingness to communicate: the construct and its measurement. Paper presented at the annual convention of the Speech Communication Association, Denver, Colorado.

  • McCroskey, J. C., & Richmond, V. P. (1987). Willingness to communicate. In J. C. McCroskey & J. A. Daly (Eds.), Personality and interpersonal communication (pp. 129–156). Newbury Park: SAGE.

    Google Scholar 

  • Mortensen, C. D., Arntson, P. H., & Lustig, M. (1977). The measurement of verbal predispositions: scale development and application. Human Communication Research, 3, 146–158.

    Google Scholar 

  • Raatz, U., & Klein-Braley, C. (1982). The C-test – a modification of the cloze procedure. In T. Culhane, C. Klein-Braley, & D. K. Stevenson (Eds.), Practice and problems in language testing IV (pp. 113–138). Colchester: University of Essex, Dept. of Language and Linguistics.

  • Rasch, G. (1960/1980). Probabilistic models for some intelligence and attainment tests. Copenhagen: Danish Institute for Educational Research, 1960. (Expanded edition, Chi-cago: The university of Chicago Press, 1980).

  • Santelices, M. V., & Caspary, K. (2009). Development of a multidimensional measure of academic engagement. Journal of Applied Measurement, 10(4), 371–393.

    Google Scholar 

  • Schmid, M. S., & Dusseldorp, E. (2010). Quantitative analyses in a multivariate study of language attrition: the impact of extralinguistic factors. Second Language Research, 26, 125–160.

    Article  Google Scholar 

  • Sigott, G. (2004). Towards identifying the C-test construct. Frankfurt: Peter Lang.

    Google Scholar 

  • Skehan, P. (1989). Individual differences in second language learning. London: Edward Arnold.

    Google Scholar 

  • Smith, E. V., Jr. (2002). Detecting and evaluating the impact of multidimensionality using item fit statistics and principal component analysis of residuals. Journal of Applied Measurement, 3(2), 205–231.

    Google Scholar 

  • Wang, W.-C., Chen, P.-H., & Cheng, Y.-Y. (2004). Improving measurement precision of test batteries using multidimensional item response models. Psychological Methods, 9, 116–136.

    Article  Google Scholar 

  • Wang, W.-C., Cheng, Y.-Y., & Wilson, M. (2005). Local item dependence for items across tests connected by common stimuli. Educational and Psychological Measurement, 65(1), 5–27.

    Article  Google Scholar 

  • Wright, B. D., & Stone, M. H. (1979). Best test design. Chicago: MESA Press.

    Google Scholar 

  • Wu, M. L., Adams, R. J., & Haldane, S. A. (2007). ACER ConQuest. Australian Council for Educational Research.

  • Yashima, T. (2002). Willingness to communicate in a second language: the Japanese EFL context. The Modern Language Journal, 86(1), 54–66.

    Article  Google Scholar 

Download references

Acknowledgments

The Alexander von Humboldt Foundation in Germany is greatly acknowledged for funding the research reported here.

Author information

Authors and Affiliations

  1. English Department, Islamic Azad University, Mashhad Branch, Ostad Yusofi St., 91871, Mashhad, Iran

    Purya Baghaei

Authors
  1. Purya Baghaei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Purya Baghaei.

Additional information

Purya Baghaei is assistant professor in the English Department of Islamic Azad University, Mashhad Branch in Iran. His major research interests are the applications of Rasch models in educational and psychological testing. His publications include extensive work on foreign language proficiency testing and scale development.

Selected publications:

Baghaei, P., & Amrahi, N. (2011) The effects of the number of options on the psychometric characteristics of multiple choice items. Psychological Test and Assessment Modeling, 53(2), 192–211.

Baghaei, P., & Roshanzamir, M. (2011). Investigating the divisibility of foreign language comprehension construct: A multidimensional item response modeling approach. The Journal of Language and Translation Studies, 42(3), 1–19.

Baghaei, P. (2012). The application of multidimensional Rasch models in large scale assessment and validation: An empirical example. Electronic Journal of Research in Educational Psychology, 10(1), 233–252.

Baghaei, P., Pishghadam, R., Ghaviandam, S., & Bazri, E. (2012). Determining the underlying constructs of the English Language Teacher Prejudice Scale. Journal of American Science, 8(2), 703–708.

Pishghadam, R., Baghaei, P., & Shayesteh, S. (2012). Construction and validation of an English language teacher creativity scale (ELT-CS). Journal of American Science, 8(3), 497–508.

Appendix

Appendix

Table 6 Willingness to communicate in a foreign-language scale (WTC-FLS)
Full size table

Rights and permissions

Reprints and permissions

About this article

Cite this article

Baghaei, P. Development and psychometric evaluation of a multidimensional scale of willingness to communicate in a foreign language. Eur J Psychol Educ 28, 1087–1103 (2013). https://doi.org/10.1007/s10212-012-0157-y

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10212-012-0157-y

Keywords

Search

Navigation