Assessing Learner Autonomy: Development and Validation of a Localized Scale

  • Lilan Lin
  • Hayo Reinders
Chapter
First Online:
Part of the New Language Learning and Teaching Environments book series (NLLTE)

Abstract

With the inclusion of learner autonomy as an educational objective in many educational programs around the world, it is becoming increasingly important to be able to measure to what extent different interventions are successful. Although some general tests exist, we argue in this chapter for the need to develop localized instruments that are culturally appropriate, educationally relevant, and that are based on pedagogical principles shared by the staff and students in the particular context. Specifically, we describe the creation of a scale for measuring learner autonomy at a university in China. We detail the process of its development, from initial conception through to rigorous psychometric validation. In doing so, we will share some of the lessons learned and discuss some of the implications for scale developers and educational practitioners in other contexts.

Keywords

Learner autonomy Scale development Validity Reliability 
This is a preview of subscription content, log in to check access.

References

  1. Benson, P. (2005). Teaching and researching autonomy in language learning. Beijing: Foreign Language Teaching and Research Press.Google Scholar
  2. Benson, P. (2007). Autonomy in language teaching and learning. State of the Art Article Language Teaching, 40(1), 21–40.CrossRefGoogle Scholar
  3. Broady, E., & Kenning, M. (1996). Learner autonomy: An introduction to the issues. In E. Broady & M. Kenning (Eds.), Promoting learner autonomy in university language teaching (pp. 9–21). London: CILT.Google Scholar
  4. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105.CrossRefGoogle Scholar
  5. Candy, P. C. (1991). Self-direction for lifelong learning. San Francisco: Jossey-Bass.Google Scholar
  6. Chan, V. (2001). Readiness for learner autonomy: What do our learners tell us? Teaching in Higher Education, 6(4), 505–518.CrossRefGoogle Scholar
  7. Comrey, A. L., & Lee, H. (1992). A first course in factor analysis. New York: Academic Press.Google Scholar
  8. Confessore, G. J., & Park, E. (2004). Factor validation of the learner autonomy profile, version 3 and extraction of the short form. International Journal of Self-directed Learning, 1(1), 39–58.Google Scholar
  9. Cooker, L. (2012). Formative (self-) assessment as autonomous language learning, (PhD). University of Nottingham.Google Scholar
  10. Cotterall, S. (1995). Readiness for autonomy: Investigating learner beliefs. System, 23(2), 195–205.CrossRefGoogle Scholar
  11. Deci, E. L., & Ryan, R. M. (1985). The general causality orientations scale: Self-determination in personality. Journal of Research in Personality, 19, 109–134.CrossRefGoogle Scholar
  12. Dixon, D. (2011). Measuring language learner autonomy in tertiary-level learner of English, (PhD), University of Warwick.Google Scholar
  13. Fabrigar, L. R., MacCallum, R. C., Wegener, D. T., & Strahan, E. J. (1999). Evaluating the use of exploratory factor analysis in psychological research. Psychological Methods, 4(3), 272–299.CrossRefGoogle Scholar
  14. Fornell, C., & Larcker, D. F. (1981). Evaluating structural equation models with unobservable variables and measurement error. Journal of Marketing Research, 18(1), 39–50.CrossRefGoogle Scholar
  15. Fu, L. F., & Yang, J. D. (2007). Research of students’ autonomous English learning abilities in multimedia and web-based learning environment. Foreign Languages and their Teaching, 223(10), 36–38.Google Scholar
  16. Guglielmino, L. M. (1977). Development of the self-directed learning readiness scale, (PhD). University of Georgia.Google Scholar
  17. Hedge, T. (2000). Teaching and learning in the language classroom. Oxford: Oxford University Press.Google Scholar
  18. Ho, J., & Crookall, D. (1995). Breaking with Chinese cultural traditions: Learner autonomy in English language teaching. System, 32(2), 235–244.CrossRefGoogle Scholar
  19. Holec, H. (1981). Autonomy in foreign language learning. Oxford: Pergamon.Google Scholar
  20. Hu, J. H. (2011). Assessment of autonomous foreign language learning capacities: Designing a two-dimensional questionnaire. Foreign Language World, 145(4), 12–17.Google Scholar
  21. Lin, L. L. (2013). Development and validation of the autonomous learning scale. Foreign Language World, 157(4), 73–80.Google Scholar
  22. Lin, L. L., & Chen, Y. E. (2009). An investigation into psychology, learning behaviors and outcomes of tertiary students in resourced-based learning environment. Journal of PLA University of Foreign Languages, 32(2), 45–50.Google Scholar
  23. Linstone, H. A., & Turoff, M. (1975). The Delphi method: Techniques and applications. Boston, MA: Addison-Wesley.Google Scholar
  24. Little, D. (1991). Learner autonomy. 1: Definition, issues and problems. Dublin: Authentik.Google Scholar
  25. Little, D. (2000). Strategies, counseling and cultural difference: Why we need an anthropological understanding of learner autonomy. In R. Ribé (Ed.), Developing learner autonomy in foreign language learning (pp. 17–33). Barcelona: University of Barcelona.Google Scholar
  26. Lv, T. T. (2016). A study on the flipped classroom based college English autonomous learning mode. Foreign Languages in China, 69(1), 77–83.Google Scholar
  27. Matuga, J. M. (2006). The role of assessment and evaluation in context: Pedagogic alignment, constraints and affordances in online courses. In D. D. Williams, S. Howell, & M. Hricko (Eds.), Online assessment, measurement and evaluation: Emerging practices (pp. 316–330). London: Information Science Publishing.CrossRefGoogle Scholar
  28. Ministry of Education of the People’s Republic of China. (2004). College English curriculum requirements (for trial implementation). Beijing: Qinghua University Press.Google Scholar
  29. Murase, F. (2015). Measuring language learner autonomy: Problems and possibilities. In C. J. Everrhard & L. Murphy (Eds.), Assessment and autonomy in language learning (pp. 35–63). New York: Palgrave.CrossRefGoogle Scholar
  30. Oddi, L. (1986). Development and validation of an instrument to identify self-directed continuing learners. Adult Education Quarterly, 36(2), 97–107.CrossRefGoogle Scholar
  31. Ouyang, J. P., & Xie, J. (2009). Constructing a model of autonomous English learning: An empirical study. Journal of PLA University of Foreign Languages, 32(3), 46–51.Google Scholar
  32. Oxford, R. L. (2003). Toward a more systematic model of L2 learner autonomy. In D. Palfreyman & R. C. Smith (Eds.), Learner autonomy across cultures: Language education perspectives (pp. 75–91). Basingstoke: Palgrave Macmillan.Google Scholar
  33. Reinders, H. (2011). Towards an operationalisation of autonomy. In A. Ahmed, G. Cane, & M. Hanzala (Eds.), Teaching English in multilingual contexts: Current challenges, future directions (pp. 37–52). Cambridge: Cambridge Scholars Publishing.Google Scholar
  34. Ren, H. H., & Gao, P. (2012). Development of English autonomous learning skill rating scale for college students. Journal of University of Science and Technology Liaoning, 35(2), 210–214.Google Scholar
  35. Shao, S. Y., & Zhao, R. (2011). Metacognitive strategy and autonomous learning: An investigation into self-access extensive reading. Computer-assisted Foreign Language Education, 141(5), 60–64.Google Scholar
  36. Shi, J. F. (2010). Fostering science-and-technology students autonomy in web-based learning environment: An empirical study based on metacognitive-strategy training. Foreign Languages in China, 34(3), 63–67.Google Scholar
  37. Tan, X., & Zhang, Z. H. (2015). Relationship among English learning strategies, learner autonomy and CET-4 scores. Foreign Language Learning Theory and Practice, 149(2), 59–65.Google Scholar
  38. Wenden, A. (1991). Learner strategies for learner autonomy. London: Prentice Hall International.Google Scholar
  39. Worthington, R. L., & Whittaker, T. A. (2006). Scale development research: A content analysis and recommendations for best practices. The Counseling Psychologist, 34(6), 806–838.CrossRefGoogle Scholar
  40. Xiao, W. Y., Wang, X. P., & Cao, Q. Y. (2011). An empirical study on metacognitive strategy training used in improving learner autonomy and learning achievement. Foreign Language Research, 159(2), 109–113.Google Scholar
  41. Xu, J. F., Peng, R. Z., & Wu, W. P. (2004). Study of non-English majors’ autonomous learning ability. Foreign Language Teaching and Research, 36(1), 64–68.Google Scholar
  42. Xu, J. F., Tang, F., & Liu, Z. H. (2010). A three-in-one teaching model to promote freshmen’s autonomous learning. Foreign Language Education, 31(6), 60–64.Google Scholar
  43. Xu, J. F., & Wu, W. P. (2004). Fuzz comprehensive measurement of students’ autonomous learning ability. Research in Higher Education of Engineering, 3, 84–86.Google Scholar
  44. Zhang, L. (2009). Metacognitive strategy training: A prerequisite to fostering autonomous learning ability. Foreign Language World, 133(4), 56–60.Google Scholar

Copyright information

© The Author(s) 2017

Authors and Affiliations

  • Lilan Lin
    • 1
  • Hayo Reinders
    • 2
  1. 1.Anhui Jianzhu UniversityHefei ShiChina
  2. 2.UnitecAucklandNew Zealand

Personalised recommendations