Abstract
Blended learning is generally defined as the combination of traditional face-to-face learning and online learning. This learning mode has been widely used in advanced education across the globe due to the COVID-19 pandemic’s social distance restriction as well as the development of technology. Online learning plays an important role in blended learning, and as it requires more student autonomy, the quality of blended learning in advanced education has been a persistent concern. Existing literature offers several elements and frameworks regarding evaluating the quality of blended learning. However, most of them either have different favours for evaluation perspectives or simply offer general guidance for evaluation, reducing the completeness, objectivity and practicalness of related works. In order to carry out a more intuitive and comprehensive evaluation framework, this paper proposes a hierarchy-based analysis approach. Applying gradient boosting model and feature importance evaluation method, this approach mainly analyses student engagement and its three identified dimensions (behavioral engagement, emotional engagement, cognitive engagement) to eliminate some existing stubborn problems when it comes to blended learning evaluation. The results show that cognitive engagement and emotional engagement play a more important role in blended learning evaluation, implying that these two should be considered to improve for better learning as well as teaching quality.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Allen, I.E., Seaman, J., Garrett, R.: Blending in: the extent and promise of blended education in the united states. Sloan Consortium (2007)
Asoodar, M., Vaezi, S., Izanloo, B.: Framework to improve e-learner satisfaction and further strengthen e-learning implementation. Comput. Hum. Behav. 63, 704–716 (2016)
Bliuc, A.M., Goodyear, P., Ellis, R.A.: Research focus and methodological choices in studies into students’ experiences of blended learning in higher education. Internet High. Educ. 10(4), 231–244 (2007)
Boelens, R., Van Laer, S., De Wever, B., Elen, J.: Blended learning in adult education: towards a definition of blended learning (2015)
Boyle, T., Bradley, C., Chalk, P., Jones, R., Pickard, P.: Using blended learning to improve student success rates in learning to program. J. Educ. Media 28(2–3), 165–178 (2003)
Castro, R.: Blended learning in higher education: trends and capabilities. Educ. Inf. Technol. 24(4), 2523–2546 (2019)
Chang, V.: Evaluating the effectiveness of online learning using a new web based learning instrument. In: Proceedings Western Australian Institute for Educational Research Forum (1999)
Chen, W.S., Yao, A.Y.T.: An empirical evaluation of critical factors influencing learner satisfaction in blended learning: a pilot study. Univers. J. Educ. Res. 4(7), 1667–1671 (2016)
Chen, X., DeBoer, J.: Checkable answers: understanding student behaviors with instant feedback in a blended learning class. In: 2015 IEEE Frontiers in Education Conference (FIE), pp. 1–5. IEEE (2015)
Deakin Crick, R., Huang, S., Ahmed Shafi, A., Goldspink, C.: Developing resilient agency in learning: the internal structure of learning power. Br. J. Educ. Stud. 63(2), 121–160 (2015)
Deegan, D., Wims, P., Pettit, T.: The potential of blended learning in agricultural education of Ireland (2015)
Delialioğlu, Ö.: Student engagement in blended learning environments with lecture-based and problem-based instructional approaches. J. Educ. Technol. Soc. 15(3), 310–322 (2012)
Dringus, L.P., Seagull, A.B.: A five-year study of sustaining blended learning initiatives to enhance academic engagement in computer and information sciences campus courses. Blended Learn. 122–140 (2013)
Fredricks, J.A., Blumenfeld, P.C., Paris, A.H.: School engagement: potential of the concept, state of the evidence. Rev. Educ. Res. 74(1), 59–109 (2004)
Friedman, J.H.: Stochastic gradient boosting. Comput. Stat. Data Analy. 38(4), 367–378 (2002)
Garrison, D.R., Kanuka, H.: Blended learning: uncovering its transformative potential in higher education. Internet High. Educ. 7(2), 95–105 (2004)
Gibson, A.M., Slate, J.R.: Student engagement at two-year institutions: age and generational status differences. Community Coll. J. Res. Pract. 34(5), 371–385 (2010)
Gomes, T., Panchoo, S.: Teaching climate change through blended learning: a case study in a private secondary school in Mauritius. In: 2015 International Conference on Computing, Communication and Security (ICCCS), pp. 1–5. IEEE (2015)
Holley, D., Oliver, M.: Student engagement and blended learning: portraits of risk. Comput. Educ. 54(3), 693–700 (2010)
Kinzie, J., Gonyea, R., Kuh, G.D., Umbach, P., Blaich, C., Korkmaz, A.: The relationship between gender and student engagement in college. In: Association for the Study of Higher Education Annual Conference (2007)
Kiviniemi, M.T.: Effects of a blended learning approach on student outcomes in a graduate-level public health course. BMC Med. Educ. 14(1), 1–7 (2014)
Krause, K.L., Coates, H.: Students’ engagement in first-year university. Assess. Eval. High. Educ. 33(5), 493–505 (2008)
Kuh, G.D.: The national survey of student engagement: conceptual framework and overview of psychometric properties (2001)
Kuh, G.D., Kinzie, J., Buckley, J.A., Bridges, B.K., Hayek, J.C.: Piecing together the student success puzzle: research, propositions, and recommendations: ASHE higher education report, vol. 116. Wiley (2011)
Li, X., Wang, Y., Basu, S., Kumbier, K., Yu, B.: A debiased MDI feature importance measure for random forests. In: Advances in Neural Information Processing Systems, vol. 32 (2019)
Lietaert, S., Roorda, D., Laevers, F., Verschueren, K., De Fraine, B.: The gender gap in student engagement: the role of teachers’ autonomy support, structure, and involvement. Br. J. Educ. Psychol. 85(4), 498–518 (2015)
Lipovetsky, S.: The synthetic hierarchy method: An optimizing approach to obtaining priorities in the AHP. Eur. J. Oper. Res. 93(3), 550–564 (1996)
Liu, O.L., Bridgeman, B., Adler, R.M.: Measuring learning outcomes in higher education: motivation matters. Educ. Res. 41(9), 352–362 (2012)
López-Pérez, M.V., Pérez-López, M.C., Rodríguez-Ariza, L.: Blended learning in higher education: students’ perceptions and their relation to outcomes. Comput. Educa. 56(3), 818–826 (2011)
Mahaye, N.E.: The impact of COVID-19 pandemic on education: navigating forward the pedagogy of blended learning. Res. Online 5, 4–9 (2020)
Moskal, P., Dziuban, C., Hartman, J.: Blended learning: a dangerous idea? Internet High. Educ. 18, 15–23 (2013)
Ozkan, S., Koseler, R.: Multi-dimensional students’ evaluation of e-learning systems in the higher education context: an empirical investigation. Comput. Educ. 53(4), 1285–1296 (2009)
Pombo, L., Moreira, A.: Evaluation framework for blended learning courses: a puzzle piece for the evaluation process. Contemp. Educ. Technol. 3(3), 201–211 (2012)
Prifti, R.: Self-efficacy and student satisfaction in the context of blended learning courses. Open Learn. J. Open Distance e-Learn. 37(2), 111–125 (2022)
Reed, P.: Staff experience and attitudes towards technology enhanced learning initiatives in one faculty of health & life sciences. Res. Learn. Technol. 22 (2014)
Saaty, R.W.: The analytic hierarchy process-what it is and how it is used. Math. Model. 9(3–5), 161–176 (1987)
Sahni, J.: Does blended learning enhance student engagement? Evidence from higher education. J. E-Learn. High. Educ. 2019(2019), 1–14 (2019)
Sari, R., Karsen, M.: An empirical study on blended learning to improve quality of learning in higher education. In: 2016 International Conference on Information Management and Technology (ICIMTech), pp. 235–240. IEEE (2016)
Sarıtepeci, M., Çakır, H.: The effect of blended learning environments on student motivation and student engagement: a study on social studies course. Educ. Sci./Egitim ve Bilim 40(177) (2015)
Smythe, M.: Blended learning: a transformative process. 12, 2011 (2011). Retrieved on December
Sun, A., Zhang, X., Ling, T., Wang, J., Cheng, N., Xiao, J.: Pre-avatar: an automatic presentation generation framework leveraging talking avatar. In: 2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 1002–1006 (2022). https://doi.org/10.1109/ICTAI56018.2022.00153
Tobin, K.: Qualitative perceptions of learning environments on the world wide web. Learn. Environ. Res. 1(2), 139–62 (1998)
Vaughan, N.: Student engagement and blended learning: making the assessment connection. Educ. Sci. 4(4), 247–264 (2014)
Wivell, J., Day, S.: Blended learning and teaching: synergy in action. Adv. Soc. Work Welfare Educ. 17(2), 86–99 (2015)
Zhang, C., Ma, Y.: Ensemble Machine Learning: Methods and Applications. Springer, New York (2012). https://doi.org/10.1007/978-1-4419-9326-7
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Ye, Y. et al. (2024). A Hierarchy-Based Analysis Approach for Blended Learning: A Case Study with Chinese Students. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14332. Springer, Singapore. https://doi.org/10.1007/978-981-97-2390-4_7
Download citation
DOI: https://doi.org/10.1007/978-981-97-2390-4_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-97-2389-8
Online ISBN: 978-981-97-2390-4
eBook Packages: Computer ScienceComputer Science (R0)