Abstract
Understanding the reasons for Massive Open Online Course (MOOC) learners’ complaints is essential for MOOC providers to facilitate service quality and promote learner satisfaction. The current research uses structural topic modeling to analyze 21,692 programming MOOC course reviews in Class Central, leading to enhanced inference on learner (dis)satisfaction. Four topics appear more commonly in negative reviews as compared to positive ones. Additionally, variations in learner complaints across MOOC course grades are explored, indicating that learners’ main complaints about high-graded MOOCs include problemsolving, practices, and programming textbooks, whereas learners of low-graded courses are frequently annoyed by grading and course quality problems. Our study contributes to the MOOC literature by facilitating a better understanding of MOOC learner (dis)satisfaction using rigorous statistical techniques. Although this study uses programming MOOCs as a case study, the analytical methodologies are independent and adapt to MOOC reviews of varied subjects.
Article PDF
Avoid common mistakes on your manuscript.
References
K.F. Hew, X. Hu, C. Qiao, Y. Tang, What predicts student satisfaction with MOOCs: a gradient boosting trees supervised machine learning and sentiment analysis approach, Comput. Educ. 145 (2020), 103724.
S. Molinillo, A. Fernández-Morales, J.L. Ximénez-de-Sandoval, A. Coca-Stefaniak, Hotel assessment through social media–TripAdvisor as a case study, Tour. Manag. Stud. 12 (2016), 15–24.
X. Chen, D. Zou, G. Cheng, H. Xie, Detecting latent topics and trends in educational technologies over four decades using structural topic modeling: a retrospective of all volumes of Computers & Education, Comput. Educ. 151 (2020), 103855.
F.F. Lubis, Y. Rosmansyah, S.H. Supangkat, Topic discovery of online course reviews using LDA with leveraging reviews helpfulness, Int. J. Electr. Comput. Eng. 9 (2019), 426–438.
S. Liu, X. Peng, H.N.H. Cheng, Z. Liu, J. Sun, C. Yang, Unfolding sentimental and behavioral tendencies of learners’ concerned topics from course reviews in a MOOC, J. Educ. Comput. Res. 57 (2019), 670–696.
M.E. Roberts, B.M. Stewart, D. Tingley, STM: R package for structural topic models, J. Stat. Softw. 10 (2014), 1–40.
N. Hu, T. Zhang, B. Gao, I. Bose, What do hotel customers complain about? Text analysis using structural topic model, Tour. Manag. 72 (2019), 417–426.
K.F. Hew, Promoting engagement in online courses: what strategies can we learn from three highly rated MOOCS, Br. J. Educ. Technol. 47 (2016), 320–341.
X. Chen, J. Chen, G. Cheng, T. Gong, Topics and trends in artificial intelligence assisted human brain research, PLoS One 15 (2020), e0231192.
B.G. Gameel, Learner satisfaction with massive open online courses, Am. J. Distance Educ. 31 (2017), 98–111.
K. Popper, The logic of scientific discovery, Routledge, London and New York, 2005.
S. Ackroyd, J.A. Hughes, Data collection in context, Longman Group UK Ltd., London, UK, 1992.
X. Peng, Q. Xu, Investigating learners’ behaviors and discourse content in MOOC course reviews, Comput. Educ. 143 (2020), 103673.
A. Ezen-Can, K.E. Boyer, S. Kellogg, S. Booth, Unsupervised modeling for understanding MOOC discussion forums: a learning analytics approach, Proceedings of the Fifth International Conference on Learning Analytics and Knowledge, Associtation for Computing Machinery, New York, USA, 2015, pp. 146–150.
X. Peng, S. Liu, Z. Liu, W. Gan, J. Sun, Mining learners’ topic interests in course reviews based on like-LDA model, Int. J. Innov. Comput. Inf. Control. 12 (2016), 2099–2110.
D.M. Blei, Probabilistic topic models, Commun. ACM 55 (2012), 77–84.
D.M. Blei, A.Y. Ng, M.I. Jordan, Latent dirichlet allocation, J. Mach. Learn. Res. 3 (2003), 993–1022.
M.E. Roberts, B.M. Stewart, D. Tingley, C. Lucas, J. Leder-Luis, S.K. Gadarian, et al., Structural topic models for open-ended survey responses, Am. J. Pol. Sci. 58 (2014), 1064–1082.
A. Garcia-Rudolph, S. Laxe, J. Saurí, M.B. Guitart, Stroke survivors on twitter: sentiment and topic analysis from a gender perspective, J. Med. Internet Res. 21 (2019), e14077.
R.I. Chang, Y.H. Hung, C.F. Lin, Survey of learning experiences and influence of learning style preferences on user intentions regarding MOOCs, Br. J. Educ. Technol. 46 (2015), 528–541.
A. Ramesh, S.H. Kumar, J. Foulds, L. Getoor, Weakly supervised models of aspect-sentiment for online course discussion forums, Proceedings of the 53rd Annual Meeting of the Association for Computational Linguistics and the 7th International Joint Conference on Natural Language Processing, vol. 1: Long Papers, Association for Computational Linguistics, Beijing, China, 2015, pp. 74–83.
X. Chen, D. Zou, H. Xie, G. Cheng, What Are MOOCs Learners’ Concerns? Text Analysis of Reviews for Computer Science Courses, in: Y. Nah, C. Kim, S.Y. Kim, Y.S. Moon, S.E. Whang (Eds.), Database Systems for Advanced Applications, DASFAA 2020 International Workshops, DASFAA 2020, Springer, Cham, 2020, pp. 73–79.
K.F. Hew, Unpacking the strategies of ten highly rated MOOCs: implications for engaging students in large online courses, Teach. Coll. Rec. 120 (2018), 1–40.
N.A. Albelbisi, Development and validation of the MOOC success scale (MOOC-SS), Educ. Inf. Technol. 25 (2020), 4535–4555.
M. Yang, Z. Shao, Q. Liu, C. Liu, Understanding the quality factors that influence the continuance intention of students toward participation in MOOCs, Education. Tech. Research Dev. 65 (2017), 1195–1214.
J.M. Kevan, M.P. Menchaca, E.S. Hoffman, Designing MOOCs for success: a student motivation-oriented framework, Proceedings of the Sixth International Conference on Learning Analytics & Knowledge, Association for Computing Machinery, Edinburgh, UK, 2016, pp. 274–278.
C. Zhang, S. Yi, B. Rao, An empirical study on the satisfaction of new form textbook based on ACSI, Proceedings of the 5th International Conference on Distance Education and Learning, Association for Computing Machinery, Beijing, China, 2020, pp. 128–132.
W.H. DeLone, E.R. McLean, The DeLone and McLean model of information systems success: a ten-year update, J. Manag. Inf. Syst. 19 (2003), 9–30.
P. Adamopoulos, What makes a great MOOC? An interdisciplinary analysis of student retention in online courses, Proceedings of the 34th International Conference on Information Systems, ICIS 2013, AIS, Milano, Italy, 2013.
A.D. Edgcomb, F. Vahid, R. Lysecky, A. Knoesen, R. Amirtharajah, M.L. Dorf, Student performance improvement using interactive textbooks: a three-university cross-semester analysis, 2015 ASEE Annual Conference & Exposition, Seattle, Washington, 2015, pp. 26.1423.1–26.1423.17.
Author information
Authors and Affiliations
Corresponding author
Additional information
Peer review under responsibility of KEO (Henan) Education Technology Co. Ltd
Rights and permissions
This is an open access article distributed under the CC BY-NC 4.0 license (https://doi.org/creativecommons.org/licenses/by-nc/4.0/).
About this article
Cite this article
Chen, X., Cheng, G., Xie, H. et al. Understanding MOOC Reviews: Text Mining using Structural Topic Model. Hum-Cent Intell Syst 1, 55–65 (2021). https://doi.org/10.2991/hcis.k.211118.001
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.2991/hcis.k.211118.001