Abstract
Studies have shown that course participation and academic performance are key factors in defining the success of online education, but much remains unknown regarding how best to define the success of online K-12 after-school education that are popular in Asian countries. To address this issue, we used a longitudinal clustering approach to analyze the course records of a large online education company in China. In total, we analyzed data on 166 online English courses offered by a Chinese K12 after-school education company for the entire fall semester, and after excluding data on 10 classes where there were consecutive missing courses, the remaining 156 classes covered more than 200,000 primary school students enrolled in grades 1–6 in public schools. The results showed that there were two different patterns: classes with poor learning outcomes generally had high participation rates, while classes with good learning outcomes generally had low participation rates. Further analysis revealed that teacher's teaching experience, the difficulty of the course, and students' grade level helped explain the dichotomy. This finding shows that there can be dissociation between participation and achievement at the class level in online K-12 after-school education, which likely resulted from misalignment between requirements set by the course and the expectations from teachers and parents. This study provides important insight for future research and practice in online K-12 after-school education.
Similar content being viewed by others
Data availability
The datasets generated during and/or analysed during the current study are available from the corresponding author on reasonable request.
References
Adamovic, S., Sarac, M., Stamenkovic, D., & Radovanovic, D. (2018). The Importance of the Using Software Tools for Learning Modern Cryptography. International Journal of Engineering Education, 34(1), 256–262.
Aldowah, H., Al-Samarraie, H., Alzahrani, A. I., & Alalwan, N. (2020). Factors affecting student dropout in MOOCs: A cause and effect decision-making model. Journal of Computing in Higher Education, 32(2), 429–454. https://doi.org/10.1007/s12528-019-09241-y
Alzahrani, L., & Seth, K. P. (2021). Factors influencing students’ satisfaction with continuous use of learning management systems during the COVID-19 pandemic: An empirical study. Education and Information Technologies, 26(6), 6787–6805. https://doi.org/10.1007/s10639-021-10492-5
Barbera, E., Gros, B., & Kirschner, P. (2012). Temporal issues in e-learning research: A literature review. British Journal of Educational Technology, 43(2), E53–E55. https://doi.org/10.1111/j.1467-8535.2011.01255.x
Barbera, E., Gros, B., & Kirschner, P. A. (2015). Paradox of time in research on educational technology. Time & Society, 24(1), 96–108. https://doi.org/10.1177/0961463x14522178
Beluce, A. C., & Oliveira, K. L. D. (2015). Students’ motivation for learning in virtual learning environments. Paidéia (Ribeirão Preto), 25(60), 105–113. https://doi.org/10.1590/1982-43272560201513
Bergner, Y., Kerr, D., & Pritchard, D. E. (2015). Methodological Challenges in the Analysis of MOOC Data for Exploring the Relationship between Discussion Forum Views and Learning Outcomes. International educational data mining society, Madrid, Spain.
Bingol, I., Kursun, E., & Kayaduman, H. (2020). Factors for success and course completion in massive open online courses through the lens of participant types. Open Praxis, 12(2), 223–239. https://doi.org/10.5944/openpraxis.12.2.1067
Black, A. E., & Deci, E. L. (2000). The effects of instructors’ autonomy support and students’ autonomous motivation on learning organic chemistry: A self-determination theory perspective. Science Education, 84(6), 740–756. https://doi.org/10.1002/1098-237X(200011)84:6
Bravo-Agapito, J., Romero, S. J., & Pamplona, S. (2021). Early prediction of undergraduate Student’s academic performance in completely online learning: A five-year study. Computers in Human Behavior, 115, Article 106595. https://doi.org/10.1016/j.chb.2020.106595
Bullen, M. (1998). Participation and critical thinking in online university distance education. Journal of Distance Education, 13, 1–32.
Calinski, T., & Harabasz, J. (1974). A Dendrite method for cluster analysis. Communications in Statistics - Theory and Methods, 3(1), 1–27.
Celeux, G., & Govaert, G. (1992). A classification EM algorithm for clustering and two stochastic versions. Computational statistics & Data analysis, 14(3), 315–332.
Chan, S.-J. (2012). Shifting Patterns of Student Mobility in Asia. Higher Education Policy, 25(2), 207–224. https://doi.org/10.1057/hep.2012.3
Cheng, G., & Chau, J. (2016). Exploring the relationships between learning styles, online participation, learning achievement and course satisfaction: An empirical study of a blended learning course. British Journal of Educational Technology, 47(2), 257–278. https://doi.org/10.1111/bjet.12243
Chiu, T. K. F. (2021). Student engagement in K-12 online learning amid COVID-19: A qualitative approach from a self-determination theory perspective. Interactive Learning Environments. https://doi.org/10.1080/10494820.2021.1926289
Chung, I. F. (2013). Crammed to learn English: What are learners’ motivation and approach. The Asia-Pacific Education Researcher, 22(4), 585–592. https://doi.org/10.1007/s40299-013-0061-5
Cinar, M., Ekici, M., & Demir, O. (2021). Medication or band-aid? Revisiting university students’ readiness forr online wducation. Turkish Online Journal of Distance Education, 22(2), 176–191. https://doi.org/10.17718/tojde.906848
De Ribaupierre, A. (2015). Piaget’s Theory of Cognitive Development. International Encyclopedia of the Social & Behavioral Sciences, 120–124. https://doi.org/10.1016/b978-0-08-097086-8.23093-6
Deci, E. L., & Ryan, R. M. (1985). The general causality orientations scale: Self-determination in personality. Journal of Research in Personality, 19(2), 109–134.
Dhingra, P. (2018). What Asian Americans Really Care about When They Care about Education. Sociological Quarterly, 59(2), 301–319. https://doi.org/10.1080/00380253.2018.1436944
Diver, P., & Martinez, I. (2015). MOOCs as a massive research laboratory: Opportunities and challenges. Distance Education, 36(1), 5–25. https://doi.org/10.1080/01587919.2015.1019968
Du, Z., Wang, F., Wang, S., & Xiao, X. (2022). Enhancing learner participation in online discussion forums in massive open online courses: the role of mandatory participation. Frontiers in Psychology, 13, Article 819640. https://doi.org/10.3389/fpsyg.2022.819640
Dullo, T. T., Kalyanapu, A. J., & Teegavarapu, R. S. (2017). Evaluation of changing characteristics of temporal rainfall distribution within 24-hour duration storms and their influences on peak discharges: Case study of Asheville, North Carolina. Journal of Hydrologic Engineering, 22(11), 05017022.
England, B. J., Brigati, J. R., Schussler, E. E., & Chen, M. M. (2019). Student Anxiety and Perception of Difficulty Impact Performance and Persistence in Introductory Biology Courses. Cbe-Life Sciences Education, 18(2), 21. https://doi.org/10.1187/cbe.17-12-0284. Article ar21.
Freeman, S., Eddy, S. L., McDonough, M., Smith, M. K., Okoroafor, N., Jordt, H., & Wenderoth, M. P. (2014). Active learning increases student performance in science, engineering, and mathematics. Proceedings of the National Academy of Sciences, 111(23), 8410–8415.
Genolini, C., & Falissard, B. (2010). KmL: k-means for longitudinal data. Computational Statistics, 25(2), 317–328. https://doi.org/10.1007/s00180-009-0178-4
Genolini, C., et al. (2013). KmL3D: A non-parametric algorithm for clustering joint trajectories. Computer Methods and Programs in Biomedicine, 109(1), 104–111.
Gim, S. N., Joung, Y. J., & Sol, Y. (2021). An analysis of the demands for online support system for teaching practicum: Focused on the demands of kindergarten and elementary pre-service teachers, in-service teachers, and teacher educators. The Journal of Learner-Centered Curriculum and Instruction, 21(10), 81–95.
Glusac, D., Karuovic, D., & Milanov, D. (2015). Massive open online courses - pedagogical overview. 16th International Carpathian Control Conference (ICCC), Miskolc, Hungary.
Goli, A., Chintagunta, P. K., & Sriram, S. (2022). Effects of payment on user engagement in online courses. Journal of Marketing Research, 59(1), 11–34.
Hamid, M. M., Alam, T., Rabbi, M. F., Hasan, K., Kuzminykh, A., & Amin, M. R. (2021). Emergence of Polarization and Marginalization in Online Education System of Bangladesh Due to COVID-19: Challenges and Policies to Ensure Inclusive Education.Lecture Notes in Computer Science 10th International Conference on Design, User Experience, and Usability held as Part of the 23rd International Conference on Human-Computer Interaction (HCII), Electr Network.
Ho, Y.-J., Hong, J.-C., Ye, J.-H., Chen, P.-H., Ma, L.-P., & Chang Lee, Y.-J. (2022). Effects of Helicopter Parenting on Tutoring Engagement and Continued Attendance at Cram Schools. Frontiers in Psychology, 13, Article 880894. https://doi.org/10.3389/fpsyg.2022.880894
Hrastinski, S. (2009). A theory of online learning as online participation. Computers & Education, 52(1), 78–82. https://doi.org/10.1016/j.compedu.2008.06.009
Huang, H., Jew, L., & Qi, D. (2023). Take a MOOC and then drop: A systematic review of MOOC engagement pattern and dropout factor. Heliyon, 9(4). https://doi.org/10.1016/j.heliyon.2023.e15220
Idrizi, E., Filiposka, S., & Trajkovik, V. (2021). Analysis of Success Indicators in Online Learning. International Review of Research in Open and Distributed Learning, 22(2), 205–223. https://doi.org/10.19173/irrodl.v22i2.5243
Inda-Caro, M., Fernandez-Garcia, C.-M., Maulana, R., & Vinuela-Hernandez, M.-P. (2021). The effect of contextual, personal and curricular factors on students’ engagement. Revista De Educacion (391), 173–198. https://doi.org/10.4438/1988-582x-re-2021-391-474
Itani, A., Brisson, L., Garlatti, S. (2018). Understanding learner’s drop-out in MOOCs. International conference on intelligent data engineering and automated learning, Madrid, Spain.
Jeong, H. (2020). Exploring variables that influence the continuous user’s intention of online classes recognized by college students who participated in online alternative lectures due to COVID-19. Global Creative Leader: Education & Learning, 10(4), 109–134. https://doi.org/10.34226/gcl.2020.10.4.109
Jin, K.-A., & Kwan, J. C. (2020). Exploring Korean elementary school students’ prior learning of English before 3rd grade. Primary English Education, 26(1), 83–107.
Justus, M. (2017). The role of pedagogical beliefs in emerging technology integration: an exploratory case study of faculty perspectives. The Qualitative Report, 22(2), 499–526. https://doi.org/10.46743/2160-3715/2017.2478
Kaya, S. (2021). The Factors Predicting Students’ Participation in Online English Courses. Eurasian Journal of Educational Research, 91, 301–320.
Kiran, D., Sungur, S., & Yerdelen, S. (2019). Predicting Science Engagement with Motivation and Teacher Characteristics: A Multilevel Investigation. International Journal of Science and Mathematics Education, 17(1), 67–88. https://doi.org/10.1007/s10763-018-9882-2
Koestner, R., & Zuckerman, M. (1994). Causality orientations, failure, and achievement. Journal of Personality, 62(3), 321–346.
Komatsu, H., & Rappleye, J. (2018). Is exam hell the cause of high academic achievement in East Asia? The case of Japan and the case for transcending stereotypes. British Educational Research Journal, 44(5), 802–826. https://doi.org/10.1002/berj.3468
Kornpitack, P., & Sawmong, S. (2022). Empirical analysis of factors influencing student satisfaction with online learning systems during the COVID-19 pandemic in Thailand. Heliyon, 8(3), Article e09183. https://doi.org/10.1016/j.heliyon.2022.e09183
Kumar, P., Garg, R. K., Kumar, P., & Panwar, M. (2022). Teachers’ perceptions of student barriers to sustainable engagement in online education. International Journal of Knowledge and Learning, 15(4), 373–408. https://doi.org/10.1504/ijkl.2022.10047469
Kurt, G., Atay, D., & Ozturk, H. A. (2022). Student engagement in K12 online education during the pandemic: The case of Turkey. Journal of Research on Technology in Education, 54, S31–S47. https://doi.org/10.1080/15391523.2021.1920518
Lee, J., Song, H.-D., & Hong, A. J. (2019). Exploring Factors, and Indicators for Measuring Students’ Sustainable Engagement in e-Learning. Sustainability, 11(4), Article 985. https://doi.org/10.3390/su11040985
Li, F., Jin, T., Edirisingha, P., & Zhang, X. (2021). School-Aged Students’ Sustainable Online Learning Engagement during COVID-19: Community of Inquiry in a Chinese Secondary Education Context. Sustainability, 13(18), Article 10147. https://doi.org/10.3390/su131810147
Lyngstad, I., Bjerke, O., & Lagestad, P. (2019). “The teacher sees my absence, not my participation”. Pupils’ experiences of being seen by their teacher in physical education class. Sport Education and Society, 24(2), 147–157. https://doi.org/10.1080/13573322.2017.1343713
Means, B., & Neisler, J. (2021). Teaching and learning in the time of COVID: The student perspective. Online Learning, 25(1). https://doi.org/10.24059/olj.v25i1.2496
Metallidou, P., Malegiannaki, A. C., Konstantinopoulou, E., & Kiosseoglou, G. (2016). Effects of different functions of attention on school grades in primary school children. Journal of Education and Human Development, 5,68-79.
Mladenovic, S., Zanko, Z., & Mladenovic, M. (2014). Elementary students' motivation towards informatics course. 5th International Conference on New Horizons in Education (INTE), Paris, France.
Muir, T., Milthorpe, N., Stone, C., Dyment, J., Freeman, E., & Hopwood, B. (2019). Chronicling engagement: Students’ experience of online learning over time. Distance Education, 40(2), 262–277.
Nieuwoudt, J. E. (2020). Investigating synchronous and asynchronous class attendance as predictors of academic success in online education. Australasian Journal of Educational Technology, 36(3), 15–25. https://doi.org/10.14742/ajet.5137
Ning, H. K., & Downing, K. (2010). Connections between learning experience, study behaviour and academic performance: A longitudinal study. Educational Research, 52(4), 457–468. https://doi.org/10.1080/00131881.2010.524754
Nkrumah, M. A. (2018). The relevance of teacher factors in understanding tertiary students’ performances. Quality Assurance in Education, 26(4), 476–488. https://doi.org/10.1108/qae-02-2018-0017
O’neill, D. K., & Sai, T. H. (2014). Why not? Examining college students’ reasons for avoiding an online course. Higher Education, 68, 1–14. https://doi.org/10.1007/s10734-013-9663-3
Palvia, S., Aeron, P., Gupta, P., Mahapatra, D., Parida, R., Rosner, R., & Sindhi, S. (2018). Online Education: Worldwide Status, Challenges, Trends, and Implications. Journal of Global Information Technology Management, 21(4), 233–241. https://doi.org/10.1080/1097198x.2018.1542262
Papousek, J., Stanislav, V., & Pelanek, R. (2016). Impact of Question Difficulty on Engagement and Learning. [Intelligent tutoring systems, its 2016]. 13th International Conference on Intelligent Tutoring Systems (ITS), Zagreb, Croatia.
Papouskova, K., & Telecky, M. (2019). Factors influencing the planning of teaching.EDULEARN Proceedings 11th International Conference on Education and New Learning Technologies (EDULEARN), Palma, Spain.
Qian, Y., Li, C. C., Zou, X. G., Feng, X. B., Xiao, M. H., & Ding, Y. Q. (2022). Research on predicting learning achievement in a flipped classroom based on MOOCs by big data analysis. Computer Applications in Engineering Education, 30(1), 222–234. https://doi.org/10.1002/cae.22452
Reimann, P. (2009). Time is precious: Variable- and event-centred approaches to process analysis in CSCL research. International Journal of Computer-Supported Collaborative Learning, 4(3), 239–257. https://doi.org/10.1007/s11412-009-9070-z
Robinson, C. C., & Hullinger, H. (2008). New benchmarks in higher education: Student engagement in online learning. Journal of Education for Business, 84(2), 101–108. https://doi.org/10.3200/JOEB.84.2.101-109
Saqr, M., & López-Pernas, S. (2021). The longitudinal trajectories of online engagement over a full program. Computers & Education, 175, 104325. https://doi.org/10.1016/j.compedu.2021.104325
Sasic, S. S., & Soric, I. (2010). Do Personal Characteristics of Teachers Contribute to the Type of Interaction They Have with Their Students? Drustvena Istrazivanja, 19(6), 973–994. https://doi.org/10.1007/s12564-021-09671-3
Sergio, M. R. S. (2012). K-12 education reform: Problems and prospects. Ateneo De Naga University Gibon, 9, 70–80.
Shrestha, S., Haque, S., Dawadi, S., & Giri, R. A. (2022). Preparations for and practices of online education during the Covid-19 pandemic: A study of Bangladesh and Nepal. Education and Information Technologies, 27(1), 243–265. https://doi.org/10.1007/s10639-021-10659-0
Stone, C., & Springer, M. (2019). Interactivity, connectedness and “teacher-presence”: Engaging and retaining students online. Australian Journal of Adult Learning, 59(2), 146–169.
Su, R. H., & Zhang, H. (2021). The design and application of leading online learning mode for public English courses under the perspective of distance and open education–taking Sichuan Open University as an example. Journal of Jilin College of Education, 07, 92–99. https://doi.org/10.16083/j.cnki.1671-1580.2021.07.024
Sun, H.-L., Sun, T., Sha, F.-Y., Gu, X.-Y., Hou, X.-R., Zhu, F.-Y., & Fang, P.-T. (2022). The influence of teacher-student interaction on the effects of online learning: Based on a serial mediating model. Frontiers in Psychology, 13, Article 779217. https://doi.org/10.3389/fpsyg.2022.779217
Szafran, R. F. (2001). The effect of academic load on success for new college students: Is lighter better? Research in Higher Education, 42(1), 27–50. https://doi.org/10.1023/a:1018712527023
Tang, H., Xing, W., & Pei, B. (2019). Time really matters: understanding the temporal dimension of online learning using educational data mining. Journal of Educational Computing Research, 57(5), 1326–1347. https://doi.org/10.1177/0735633118784705
Tong, L., & Zhang, S. (2008). A research concerning the achievement motivation of regular young college teachers. Psychological Science, 31(4), 861–865. https://doi.org/10.3969/j.issn.1671-6981.2008.04.021
Vallerand, R. J., Pelletier, L. G., & Koestner, R. (2008). Reflections on self-determination theory. Canadian Psychology / Psychologie Canadienne, 49(3), 257–262. https://doi.org/10.1037/a0012804
Wang, S., Tlili, A., Zhu, L., & Yang, J. (2021). Do Playfulness and University Support Facilitate the Adoption of Online Education in a Crisis? COVID-19 as a Case Study Based on the Technology Acceptance Model. Sustainability, 13(16), Article 9104. https://doi.org/10.3390/su13169104
Wang, J., Tigelaar, D. E. H., Luo, J., & Admiraal, W. (2022). Teacher beliefs, classroom process quality, and student engagement in the smart classroom learning environment: A multilevel analysis. Computers & Education, 183, Article 104501. https://doi.org/10.1016/j.compedu.2022.104501
Wong, M.M.-H. (2000). The relations among causality orientations, academic experience, academic performance, and academic commitment. Personality and Social Psychology Bulletin, 26(3), 315–326. https://doi.org/10.1177/0146167200265005
Woodrow, L. (2006). Anxiety and speaking English as a second language. RELC Journal, 37(3), 308–328.
Xie, S.-T., Chen, Q., Liu, K.-H., Kong, Q.-Z., Cao, X.-J. (2021). Learning Behavior Analysis Using Clustering and Evolutionary Error Correcting Output Code Algorithms in Small Private Online Courses. Scientific Programming, 2021, 1–11, Article 9977977. https://doi.org/10.1155/2021/9977977
Xing, W. L. (2022). Does the early bird catch the worm? A large-scale examination of the effects of early participation in online learning. Distance Education, 43(3), 466–481. https://doi.org/10.1080/01587919.2022.2088476
Xue, N. (2019). The Design and Implementation of English Curriculum for Children in Internet plus Times. International Conference on Arts, Management, Education and Innovation (ICAMEI), Seoul, South Korea
Yan, L., Whitelock-Wainwright, A., Guan, Q., Wen, G., Gasevic, D., & Chen, G. (2021). Students’ experience of online learning during the COVID-19 pandemic: A province-wide survey study. British Journal of Educational Technology, 52(5), 2038–2057. https://doi.org/10.1111/bjet.13102
Yung, K.W.-H. (2020). Comparing the effectiveness of cram school tutors and schoolteachers: A critical analysis of students’ perceptions. International Journal of Educational Development, 72, Article 102141. https://doi.org/10.1016/j.ijedudev.2019.102141
Zeidner, M., & Schleyer, E. J. (1999). The big-fish-little-pond effect for academic self-concept, test anxiety, and school grades in gifted children. Contemporary Educational Psychology, 24(4), 305–329. https://doi.org/10.1006/ceps.1998.0985
Zhang, Q.-M., & Kim, T.-Y. (2013). Cross-grade analysis of Chinese students’ English learning motivation: A mixed-methods study. Asia Pacific Education Review, 14(4), 615–627. https://doi.org/10.1007/s12564-013-9288-3
Zhang, Y., Dang, Y., He, Y., Ma, X., & Wang, L. (2021a). Is private supplementary tutoring effective? A longitudinally detailed analysis of private tutoring quality in China. Asia Pacific Education Review, 22(2), 239–259. https://doi.org/10.1007/s12564-021-09671-3
Zhang, Y., Zhao, G., & Zhou, B. (2021b). Does learning longer improve student achievement? Evidence from online education of graduating students in a high school during COVID-19 period. China Economic Review, 70, Article 101691. https://doi.org/10.1016/j.chieco.2021.101691
Zuo, M., Liu, H., Hu, Y., Zhang, Y., & Luo, H. (2021). Differences in learning engagement, academic workload, and technology use during online learning: a comparison among primary, middle, and high school students. 2021 IEEE International Conference on Engineering, Technology & Education (TALE), Wuhan, China.
Funding
This study was supported by the National Natural Science Foundation of China (U2133209 and 52072406), and the key project of Chongqing Technology Innovation and Application Development (grant no. cstc2021jscx-dxwtBX0020).
Author information
Authors and Affiliations
Contributions
Fei Wang: Conceptualization, Methodology, Data curation, Writing- Original draft preparation, Writing- Reviewing and Editing, Data analysis, Xiaopeng Zhu: Data curation, Writing- Original draft preparation, Writing- Reviewing and Editing, Linli Pi: Conceptualization, Writing- Original draft preparation, Data analysis, Xingyao Xiao: Validation, Visualization, Data curation, Writing-review & editing, Jingyu Zhang: Conceptualization, Methodology, Resources, Writing-Review & Editing, Supervision, Project administration, Funding acquisition.
Corresponding author
Ethics declarations
Competing interests
The authors listed below certify that they have no affiliation with any organization or entity, are not involved in any financial interest, or have a non-financial interest in the subject matter or material discussed in this manuscript.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Wang, F., Zhu, X., Pi, L. et al. Patterns of participation and performance at the class level in English online education: A longitudinal cluster analysis of online K-12 after-school education in China. Educ Inf Technol (2024). https://doi.org/10.1007/s10639-024-12451-2
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s10639-024-12451-2