Skip to main content

A Hierarchy-Based Analysis Approach for Blended Learning: A Case Study with Chinese Students

  • Conference paper
  • First Online:
Web and Big Data (APWeb-WAIM 2023)

Abstract

Blended learning is generally defined as the combination of traditional face-to-face learning and online learning. This learning mode has been widely used in advanced education across the globe due to the COVID-19 pandemic’s social distance restriction as well as the development of technology. Online learning plays an important role in blended learning, and as it requires more student autonomy, the quality of blended learning in advanced education has been a persistent concern. Existing literature offers several elements and frameworks regarding evaluating the quality of blended learning. However, most of them either have different favours for evaluation perspectives or simply offer general guidance for evaluation, reducing the completeness, objectivity and practicalness of related works. In order to carry out a more intuitive and comprehensive evaluation framework, this paper proposes a hierarchy-based analysis approach. Applying gradient boosting model and feature importance evaluation method, this approach mainly analyses student engagement and its three identified dimensions (behavioral engagement, emotional engagement, cognitive engagement) to eliminate some existing stubborn problems when it comes to blended learning evaluation. The results show that cognitive engagement and emotional engagement play a more important role in blended learning evaluation, implying that these two should be considered to improve for better learning as well as teaching quality.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 149.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Allen, I.E., Seaman, J., Garrett, R.: Blending in: the extent and promise of blended education in the united states. Sloan Consortium (2007)

    Google Scholar 

  2. Asoodar, M., Vaezi, S., Izanloo, B.: Framework to improve e-learner satisfaction and further strengthen e-learning implementation. Comput. Hum. Behav. 63, 704–716 (2016)

    Article  Google Scholar 

  3. Bliuc, A.M., Goodyear, P., Ellis, R.A.: Research focus and methodological choices in studies into students’ experiences of blended learning in higher education. Internet High. Educ. 10(4), 231–244 (2007)

    Article  Google Scholar 

  4. Boelens, R., Van Laer, S., De Wever, B., Elen, J.: Blended learning in adult education: towards a definition of blended learning (2015)

    Google Scholar 

  5. Boyle, T., Bradley, C., Chalk, P., Jones, R., Pickard, P.: Using blended learning to improve student success rates in learning to program. J. Educ. Media 28(2–3), 165–178 (2003)

    Article  Google Scholar 

  6. Castro, R.: Blended learning in higher education: trends and capabilities. Educ. Inf. Technol. 24(4), 2523–2546 (2019)

    Article  Google Scholar 

  7. Chang, V.: Evaluating the effectiveness of online learning using a new web based learning instrument. In: Proceedings Western Australian Institute for Educational Research Forum (1999)

    Google Scholar 

  8. Chen, W.S., Yao, A.Y.T.: An empirical evaluation of critical factors influencing learner satisfaction in blended learning: a pilot study. Univers. J. Educ. Res. 4(7), 1667–1671 (2016)

    Article  Google Scholar 

  9. Chen, X., DeBoer, J.: Checkable answers: understanding student behaviors with instant feedback in a blended learning class. In: 2015 IEEE Frontiers in Education Conference (FIE), pp. 1–5. IEEE (2015)

    Google Scholar 

  10. Deakin Crick, R., Huang, S., Ahmed Shafi, A., Goldspink, C.: Developing resilient agency in learning: the internal structure of learning power. Br. J. Educ. Stud. 63(2), 121–160 (2015)

    Article  Google Scholar 

  11. Deegan, D., Wims, P., Pettit, T.: The potential of blended learning in agricultural education of Ireland (2015)

    Google Scholar 

  12. Delialioğlu, Ö.: Student engagement in blended learning environments with lecture-based and problem-based instructional approaches. J. Educ. Technol. Soc. 15(3), 310–322 (2012)

    Google Scholar 

  13. Dringus, L.P., Seagull, A.B.: A five-year study of sustaining blended learning initiatives to enhance academic engagement in computer and information sciences campus courses. Blended Learn. 122–140 (2013)

    Google Scholar 

  14. Fredricks, J.A., Blumenfeld, P.C., Paris, A.H.: School engagement: potential of the concept, state of the evidence. Rev. Educ. Res. 74(1), 59–109 (2004)

    Article  Google Scholar 

  15. Friedman, J.H.: Stochastic gradient boosting. Comput. Stat. Data Analy. 38(4), 367–378 (2002)

    Article  MathSciNet  Google Scholar 

  16. Garrison, D.R., Kanuka, H.: Blended learning: uncovering its transformative potential in higher education. Internet High. Educ. 7(2), 95–105 (2004)

    Article  Google Scholar 

  17. Gibson, A.M., Slate, J.R.: Student engagement at two-year institutions: age and generational status differences. Community Coll. J. Res. Pract. 34(5), 371–385 (2010)

    Article  Google Scholar 

  18. Gomes, T., Panchoo, S.: Teaching climate change through blended learning: a case study in a private secondary school in Mauritius. In: 2015 International Conference on Computing, Communication and Security (ICCCS), pp. 1–5. IEEE (2015)

    Google Scholar 

  19. Holley, D., Oliver, M.: Student engagement and blended learning: portraits of risk. Comput. Educ. 54(3), 693–700 (2010)

    Article  Google Scholar 

  20. Kinzie, J., Gonyea, R., Kuh, G.D., Umbach, P., Blaich, C., Korkmaz, A.: The relationship between gender and student engagement in college. In: Association for the Study of Higher Education Annual Conference (2007)

    Google Scholar 

  21. Kiviniemi, M.T.: Effects of a blended learning approach on student outcomes in a graduate-level public health course. BMC Med. Educ. 14(1), 1–7 (2014)

    Article  Google Scholar 

  22. Krause, K.L., Coates, H.: Students’ engagement in first-year university. Assess. Eval. High. Educ. 33(5), 493–505 (2008)

    Article  Google Scholar 

  23. Kuh, G.D.: The national survey of student engagement: conceptual framework and overview of psychometric properties (2001)

    Google Scholar 

  24. Kuh, G.D., Kinzie, J., Buckley, J.A., Bridges, B.K., Hayek, J.C.: Piecing together the student success puzzle: research, propositions, and recommendations: ASHE higher education report, vol. 116. Wiley (2011)

    Google Scholar 

  25. Li, X., Wang, Y., Basu, S., Kumbier, K., Yu, B.: A debiased MDI feature importance measure for random forests. In: Advances in Neural Information Processing Systems, vol. 32 (2019)

    Google Scholar 

  26. Lietaert, S., Roorda, D., Laevers, F., Verschueren, K., De Fraine, B.: The gender gap in student engagement: the role of teachers’ autonomy support, structure, and involvement. Br. J. Educ. Psychol. 85(4), 498–518 (2015)

    Article  Google Scholar 

  27. Lipovetsky, S.: The synthetic hierarchy method: An optimizing approach to obtaining priorities in the AHP. Eur. J. Oper. Res. 93(3), 550–564 (1996)

    Article  Google Scholar 

  28. Liu, O.L., Bridgeman, B., Adler, R.M.: Measuring learning outcomes in higher education: motivation matters. Educ. Res. 41(9), 352–362 (2012)

    Article  Google Scholar 

  29. López-Pérez, M.V., Pérez-López, M.C., Rodríguez-Ariza, L.: Blended learning in higher education: students’ perceptions and their relation to outcomes. Comput. Educa. 56(3), 818–826 (2011)

    Article  Google Scholar 

  30. Mahaye, N.E.: The impact of COVID-19 pandemic on education: navigating forward the pedagogy of blended learning. Res. Online 5, 4–9 (2020)

    Google Scholar 

  31. Moskal, P., Dziuban, C., Hartman, J.: Blended learning: a dangerous idea? Internet High. Educ. 18, 15–23 (2013)

    Article  Google Scholar 

  32. Ozkan, S., Koseler, R.: Multi-dimensional students’ evaluation of e-learning systems in the higher education context: an empirical investigation. Comput. Educ. 53(4), 1285–1296 (2009)

    Article  Google Scholar 

  33. Pombo, L., Moreira, A.: Evaluation framework for blended learning courses: a puzzle piece for the evaluation process. Contemp. Educ. Technol. 3(3), 201–211 (2012)

    Article  Google Scholar 

  34. Prifti, R.: Self-efficacy and student satisfaction in the context of blended learning courses. Open Learn. J. Open Distance e-Learn. 37(2), 111–125 (2022)

    Article  Google Scholar 

  35. Reed, P.: Staff experience and attitudes towards technology enhanced learning initiatives in one faculty of health & life sciences. Res. Learn. Technol. 22 (2014)

    Google Scholar 

  36. Saaty, R.W.: The analytic hierarchy process-what it is and how it is used. Math. Model. 9(3–5), 161–176 (1987)

    Article  MathSciNet  Google Scholar 

  37. Sahni, J.: Does blended learning enhance student engagement? Evidence from higher education. J. E-Learn. High. Educ. 2019(2019), 1–14 (2019)

    Google Scholar 

  38. Sari, R., Karsen, M.: An empirical study on blended learning to improve quality of learning in higher education. In: 2016 International Conference on Information Management and Technology (ICIMTech), pp. 235–240. IEEE (2016)

    Google Scholar 

  39. Sarıtepeci, M., Çakır, H.: The effect of blended learning environments on student motivation and student engagement: a study on social studies course. Educ. Sci./Egitim ve Bilim 40(177) (2015)

    Google Scholar 

  40. Smythe, M.: Blended learning: a transformative process. 12, 2011 (2011). Retrieved on December

    Google Scholar 

  41. Sun, A., Zhang, X., Ling, T., Wang, J., Cheng, N., Xiao, J.: Pre-avatar: an automatic presentation generation framework leveraging talking avatar. In: 2022 IEEE 34th International Conference on Tools with Artificial Intelligence (ICTAI), pp. 1002–1006 (2022). https://doi.org/10.1109/ICTAI56018.2022.00153

  42. Tobin, K.: Qualitative perceptions of learning environments on the world wide web. Learn. Environ. Res. 1(2), 139–62 (1998)

    Article  Google Scholar 

  43. Vaughan, N.: Student engagement and blended learning: making the assessment connection. Educ. Sci. 4(4), 247–264 (2014)

    Article  Google Scholar 

  44. Wivell, J., Day, S.: Blended learning and teaching: synergy in action. Adv. Soc. Work Welfare Educ. 17(2), 86–99 (2015)

    Google Scholar 

  45. Zhang, C., Ma, Y.: Ensemble Machine Learning: Methods and Applications. Springer, New York (2012). https://doi.org/10.1007/978-1-4419-9326-7

    Book  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Liang Xu .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Ye, Y. et al. (2024). A Hierarchy-Based Analysis Approach for Blended Learning: A Case Study with Chinese Students. In: Song, X., Feng, R., Chen, Y., Li, J., Min, G. (eds) Web and Big Data. APWeb-WAIM 2023. Lecture Notes in Computer Science, vol 14332. Springer, Singapore. https://doi.org/10.1007/978-981-97-2390-4_7

Download citation

  • DOI: https://doi.org/10.1007/978-981-97-2390-4_7

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-97-2389-8

  • Online ISBN: 978-981-97-2390-4

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics