Abstract
This study provided validity evidence of the Questionnaire of English Writing Self-Efficacy (QEWSE) based on the five sources of validity evidence described in the Standards for Educational and Psychological Testing (AERA, APA, & NCME, 2014). Items of this measure demonstrated close alignment with the linguistic domain and the writing self-efficacy and self-regulation theories, providing validity evidence based on test content. Confirmatory factor analysis revealed a satisfactory global fit of the four-factor (ideation, skills, use, and self-regulation) model to the data, providing internal structure-based evidence. Significant correlations between self-efficacy ratings, writing proficiency, and writing self-regulated learning strategies supported the validity evidence based on relations to other variables. The reliability evidence was evaluated with consistencies of participants’ responses to items and further supported using Item Response Theory (IRT). IRT analyses suggested that measurement precision was greatest at the lower range of the latent trait scale, which provided justification for the primary use of the instrument to identify students with low writing self-efficacy.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
American Educational Research Association, American Psychological Association, & National Council on Measurement in Education (2014). Standards for educational and psychological testing. American Educational Research Association
Baker, F. B. (1998). An investigation of the item parameter recovery characteristics of a gibbs sampling approach. Applied Psychological Measurement, 22, 153–169. https://doi.org/10.1177/01466216980222005
Bandura A. (1997). Self-Efficacy: The Exercise of Control. Freeman.
Bandura, A, (2006). Guidelines for constructing self-efficacy scales. In F, Pajares & T, Urdan (Eds.), Adolescence and education: Self-efficacy beliefs of adolescents. 5, 307–337. Information Age Publishing
Bruning, R., Dempsey, M., Kauffman, D. F., McKim, C., & Zumbruun, S. (2013). Examining dimensions of self-efficacy for writing. Journal of Educational Psychology, 105(1), 25–38. https://doi.org/10.1037/a0029692
Cai, L. (2018). flexMIRT (Version 1.88). [Computer Program]. Vector Psychological Group, LLC
Chae, S. E. (2013). Effects of self-efficacy and interest on college students’ L2 writing strategy use and performance. English Teaching. https://doi.org/10.15858/engtea.68.4.201312.43
Chen, J., & Zhang, L. J. (2019). Assessing student-writers’ self-efficacy beliefs about text revision in EFL writing. Assessing Writing, 40, 27–41. https://doi.org/10.1016/j.asw.2019.03.002
Ching, L. C. (2002). Strategy and self-regulation instruction as contributors to improving students’ cognitive model in an ESL program. English for Specific Purposes, 21, 261–289. https://doi.org/10.1016/S0889-4906(01)00008-4
College English Curriculum Requirements. (2017). Ministry of Education of the People’s Republic of China
Cuenca-Sanchez, Y., Mastropieri, M. A., Scruggs, T. E., & Kidd, J. K. (2012). Teaching students with emotional and behavioral disorders to self-advocate through persuasive writing. Exceptionality, 20(2), 71–93. https://doi.org/10.1080/09362835.2012.669291
Ekholm, E., Zumbrunn, S., & Conklin, S. (2015). The relation of college student self-efficacy toward writing and writing self-regulation aptitude: writing feedback perceptions as a mediating variable. Teaching in Higher Education, 20(2), 197–207. https://doi.org/10.1080/13562517.2014.974026
Graham, S., Kiuhara, S. A., Harris, K. R., & Fishman, E. J. (2017). The relationship among strategic writing behavior, writing motivation, and writing performance with young, developing writers. The Elementary School Journal, 118(1), 82–104. https://doi.org/10.1086/693009
Graham, S., Wijekumar, K., Harris, K. R., Lei, P., Fishman, E., & Ray, A. B. (2019). Writing skills, knowledge, motivation, and strategic behavior predict students’ persuasive writing performance in the context of robust writing instruction. The Elementary School Journal, 119, 447–510. https://doi.org/10.1086/701720
Gray-Little, B., Williams, V. S., & Hancock, T. D. (1997). An item response theory analysis of the rosenberg self-esteem scale. Personality and Social Psychology Bulletin, 23, 443–451. https://doi.org/10.1177/0146167297235001
Hair, J., Black, W., Babin, B., & Anderson, R. (2010). Multivariate data analysis (7th ed.). Pearson
Housen A., Kuiken F., & Vedder I. (Eds.). (2012). Dimensions of L2 performance and proficiency: Complexity, accuracy and fluency in SLA. John Benjamins Pub. Co.
Jones, E. (2008). Predicting performance in first-semester college basic writers: Revisiting the role of self-beliefs. Contemporary Educational Psychology, 33, 109–238. https://doi.org/10.1016/j.cedpsych.2006.11.001
Kane, M. (2013). Validating the interpretations and uses of test scores. Journal of Educational Measurement, 50(1), 1–73. https://doi.org/10.1111/jedm.12000
Lavelle, E., & Guarino, A. J. (2003). A multidimensional approach to understanding college writing processes. Educational Psychology, 23, 295–305. https://doi.org/10.1080/0144341032000060138
Lord, F. M. (1980). Applications of item response theory to practical testing problems. Erlbaum.
McNeish, D. (2017). Thanks coefficient alpha, we’ll take it from here. Psychological Methods, 23(3), 412–433. https://doi.org/10.1037/met0000144
Messick, S. (1995). Validity of psychological assessment: validation of inferences from persons’ responses and performances as scientific inquiry into score meaning. American Psychologist, 50, 741–749. https://doi.org/10.1037/0003-066X.50.9.741
Mueller, R. O., & Hancock, G. R. (2008). Best practices in structural equation modeling. In J. W. Osborne (Ed.), Best practices in quantitative methods (pp. 488–508). Sage.
Multon, K., Brown, S. D., & Lent, R. W. (1991). Relation of self-efficacy beliefs to academic outcomes: a meta-analytic investigation. Journal of Counseling Psychology, 38(1), 30–38. https://doi.org/10.1037/0022-0167.38.1.30
National College English Testing Committee. (2006). Syllabus of National College English Test Band 4 and Band 6 (Revised Version). Retrieved from http://cet.neea.edu.cn/res/Home/1704/55b02330ac17274664f06d9d3db8249d.pdf
Pajares, F., Johnson, M. J., & Usher, E. L. (2007). Sources of writing self-efficacy beliefs of elementary, middle, and high school students. Research in the Teaching of English, 42(1), 104–120.
Pajares, F., & Valiante, G. (1999). Grade level and gender differences in the writing self-beliefs of middle school students. Contemporary Educational Psychology, 24, 390–405. https://doi.org/10.1006/ceps.1998.0995
Pajares, F., & Valiante, G. (2001). Gender differences in writing motivation and achievement of middle school students: a function of gender orientation? Contemporary Educational Psychology, 26, 366–381. https://doi.org/10.1006/ceps.2000.1069
Pajares, F., Valiante, G., & Cheong, Y. F. (2007). Writing self-efficacy and its relation to gender, writing motivation, and writing competence: A developmental perspective. In G. Rijlaarsdam (Series Ed.) and P. Boscolo & S. Hidi (Volume Eds.), Studies in Writing, Vol. 19: Writing and Motivation. 141–159. Elsevier
Plake, B. S., & Kane, M. T. (1991). Comparison of methods for combining the minimum passing levels for individual items into a passing score for a test. Journal of Educational Measurement, 28, 249–256. https://doi.org/10.1111/j.1745-3984.1991.tb00357.x
Plake, B. S., & Wise, L. L. (2014). What is the role and importance of the revised AERA, APA, NCME Standards for educational and psychological testing? Educational Measurement: Issues and Practice, 33(4), 4–12. https://doi.org/10.1111/emip.12045
Prat-Sala, M., & Redford, P. (2010). The interplay between motivation, self-efficacy, and approaches to studying. British Journal of Educational Psychology, 80, 283–305. https://doi.org/10.1348/000709909X480563
Prat-Sala, M., & Redford, P. (2012). Writing essays: does self- efficacy matter? the relationship between self-efficacy in reading and in writing and undergraduate students’ performance in essay writing. Educational Psychology, 32(1), 9–20. https://doi.org/10.1080/01443410.2011.621411
Samejima, F. (1969). Estimation of latent ability using a response pattern of graded scores. Psychometrics Monograph. https://doi.org/10.1007/BF03372160
Sanders-Reio, J., Alexander, P. A., Reio, T. G., Jr., & Newman, I. (2014). Do students’ beliefs about writing relate to their writing self-efficacy, apprehension, and performance. Leaning and Instruction, 33, 1–11. https://doi.org/10.1016/j.learninstruc.2014.02.001
Schunk, D. H., & Zimmerman, B. J. (1997). Developing self-efficacious readers and writers: The role of social and self-regulatory processes. In J. T. Guthrie and A. Wigfield (Eds.), Promoting literacy engagement: Motivational strategic reading through integrated instruction. International Reading Association
Schunk, D. H., & Zimmerman, B. J. (2007). Influencing children’s self-efficacy and self-regulation of reading and writing through modeling. Reading & Writing Quarterly, 23(1), 7–25. https://doi.org/10.1080/10573560600837578
Shell, D. F., Murphy, C. C., & Bruning, R. H. (1989). Self-efficacy and outcome expectancy mechanisms in reading and writing achievement. Journal of Educational Psychology, 81(1), 91–100. https://doi.org/10.1037/0022-0663.81.1.91
Silva, T. (1993). Toward an understanding of the distinct nature of L2 writing: The ESL research and its implications. TESOL Quarterly, 27(4), 657–677. https://doi.org/10.2307/3587400
Sireci, S., & Faulkner-Bond, M. (2014). Validity evidence based on test content. Psicothema. https://doi.org/10.7334/psicothema2013.256
Sun, T., & Wang, C. (2020). College students’ writing self-efficacy and writing self-regulated learning strategies in learning English as a foreign language. System, 90, https://doi.org/10.1016/j.system.2020.102221.
Sun, T., Wang, C., Lambert, R. G., & Liu, L. (2021). Relationship between second language English writing self-efficacy and achievement: A meta-regression analysis. Journal of Second Language Writing, 53, 100817. https://doi.org/10.1016/j.jslw.2021.100817.
Teng, L. S., Sun, P. P., & Xu, L. (2018). Conceptualizing writing self-efficacy in English as a foreign language context: scale validation through structural equation modeling. TESOL Quarterly, 52, 911–942. https://doi.org/10.1002/tesq.432
Tsutakawa, R. K., & Johnson, J. C. (1990). The effect of uncertainty of item parameter estimation on ability estimates. Psychometrika, 55, 371–390. https://doi.org/10.1007/BF02295293
Unrau, N. J., Rueda, R., Son, E., Polanin, J. R., & LundeenMuraszewski, R. J. (2018). Can reading self-efficacy be modified? a meta-analysis of the impact of interventions on reading self-efficacy. Review of Educational Research, 88, 167–204. https://doi.org/10.3102/0034654317743199
Wang, C., & Bai, B. (2017). Validating the instruments to measure ESL/EFL learners' self-efficacy beliefs and self-regulated learning strategies. TESOL Quarterly, 51(4), 931–947. https://doi.org/10.1002/tesq.355.
Woodrow, L. (2011). College English writing affect: Self-efficacy and anxiety. System, 39, 510–522. https://doi.org/10.1016/j.system.2011.10.017
Wright, K. L., Hodges, T. S., & McTigue, E. M. (2019). A validation program for the self-beliefs, writing-beliefs, and attitude survey: A measure of adolescents’ motivation toward writing. Assessing Writing, 39, 64–78. https://doi.org/10.1016/j.asw.2018.12.004
Yang, H., & Weir, C. (1999). 大学英语四六级考试效度研究 [Validation study of the national College English Test]. Shanghai Foreign Language Education Press.
Yang, W. (2014). Mapping the relationship among the cognitive complexity of independent writing tasks, L2 writing quality, and complexity, accuracy and fluency of L2 writing [Doctoral dissertation, Georgia State University]. https://scholarworks.gsu.edu/alesl_diss/29
Zabihi, R. (2018). The role of cognitive and affective factors in measures of L2 writing. Written Communication, 35(1), 32–57. https://doi.org/10.1177/0741088317735836
Zhang, Y., & Guo, H. (2012). A study of English writing and domain-specific motivation and self-efficacy of Chines EFL learners. Pan-Pacific Association of Applied Linguistics, 16(2), 101–121. Retrieved from https://web.a.ebscohost.com
Zimmerman, B., & Risemberg, R. (1997). Becoming a self-regulated writer: a social cognitive perspective. Contemporary Educational Psychology. https://doi.org/10.1006/ceps.1997.0919
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
We have no known conflict of interest to disclose.
Ethical approval
We are not allowed to share the data to protect the identity of the participants and to follow the requirement of the Research Committee – Panel on Research Ethics.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Appendices
Appendix A
Questionnaire of English Writing Self-Efficacy (QEWSE)
Notes: Please read the following questions carefully and make an accurate evaluation of your current command of English no matter whether you are doing it or not. These questions are designed to measure your judgment of your capabilities, so there are no right or wrong answers.
Please use the following scales to answer these questions accordingly. Please choose the number accurately representing your capabilities | ||||||
|---|---|---|---|---|---|---|
1 | 2 | 3 | 4 | 5 | 6 | 7 |
I cannot do it at all | I cannot do it | Maybe I cannot do it | Maybe I can do it | I basically can do it | I can do it | I can do it well |
1. I can think of many ideas for my writing | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
2. I can organize sentences into a paragraph to express an idea | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
3. I can correctly spell all the words in the compositions I write | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
4. I can compose messages in English on social media (e.g., WeChat and blogs)? | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
5. I can focus on my writing for at least one hour | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
6. I can put my ideas into writing | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
7. I can organize different paragraphs into a composition | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
8. I can correctly use verb tenses in English writing | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
9. I can make new sentences with given words | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
10. I can write an expository paragraph in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
11. I can think of appropriate words to describe my ideas | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
12. I can focus on the main ideas when writing | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
13. I can write an argumentative paragraph in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
14. I can write email messages in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
15. I can finish writing assignments on time | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
16. I can write a descriptive paragraph in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
17. I can write diaries in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
18. I can plan what I want to say before I start writing | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
19. I can avoid distractions while I write | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
20. I can write a paragraph in a cohesive way | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
21. I can write a sentence with proper grammatical structures | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
22. I can write a narrative paragraph in English | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
23. I can revise my writing to make it better | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
24. I can control my frustration when I write | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
25. I can keep writing even when it’s difficult | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
26. I can fix my grammar errors | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
27. I can write a paragraph in a coherent way | 1 | 2 | 3 | 4 | 5 | 6 | 7 |
Rights and permissions
About this article
Cite this article
Sun, T., Wang, C. & Kim, S.Y. Psychometric properties of an English Writing Self-Efficacy scale: aspects of construct validity. Read Writ 35, 743–766 (2022). https://doi.org/10.1007/s11145-021-10206-w
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11145-021-10206-w