Skip to main content
SpringerLink
Log in

Examining Learning Experience in Two Online Courses Using Web Logs and Experience Sampling Method (ESM)

  • Chapter
The Design of Learning Experience

Abstract

Web mining and visualization techniques are used to discover the underlying patterns of online learning experience. Yet, the analytics are often limited to merely behavioral data lacking other critical dimensions that form an important part of the learning experience such as learners’ cognitive involvement and emotional experience. Therefore, it is critical to find a method that can capture a holistic online learning experience while a learner progresses in an online course. This chapter introduces the Experience Sampling Method (ESM) that can be used to supplement Web Log Analysis (WLA) by collecting data on learners’ cognitive involvement and emotion in each learning task. Then this chapter reports a case study of utilizing the ESM and WLA to examine online learning experiences in a discussion-focused online course and a design-/development-focused online course. Lastly, a visualized learning experience dashboard is presented to show an individual learner's learning experience based upon the three dimensions of learning experience.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
eBook
USD 16.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  • Allen, I. E., & Seaman, J. (2014). Grade change: Tracking online education in the United States. Babson Park, MA: Babson Survey Research Group and Quahog Research Group. Retrieved from http://www.onlinelearningsurvey.com/reports/gradechange.pdf.

    Google Scholar 

  • Bassi, M., Ferrario, N., Ba, G., Fave, A. D., & Viganò, C. (2012). Quality of experience during psychosocial rehabilitation: A real-time investigation with experience sampling method. Psychiatric Rehabilitation Journal, 35(6), 447–453.

    Article  Google Scholar 

  • Borokhovski, E., Tamim, R., Bernard, R. M., Abrami, P. C., & Sokolovskaya, A. (2012). Are contextual and designed student–student interaction treatments equally effective in distance education? Distance Education, 33, 311–329. doi:10.1080/01587919.2012.723162.

    Article  Google Scholar 

  • Brady, K. P., Holcomb, L. B., & Smith, B. V. (2010). The use of alternative social networking sites in higher educational settings: A case study of the e-learning benefits of ning in education. Journal of Interactive Online Learning, 9(2), 151–170.

    Google Scholar 

  • Clow, D. (2012). The learning analytics cycle: Closing the loop effectively. In S. Buckingham Shum, D. Gašević, & R. Ferguson (Eds.), Proceedings of the 2nd conference on learning analytics and knowledge (pp. 134–138). Vancouver, BC: ACM.

    Chapter  Google Scholar 

  • Cole, J. (2005). Using moodle: Teaching with the popular open source course management system. Sebastopol, CA: O’Reilly Media.

    Google Scholar 

  • Cowan, P., & Butler, R. (2013). Using activity theory to problematize the role of the teacher during mobile learning. SAGE Open, 3(4). doi: 10.1177/2158244013516155.

  • Ebner-Priemer, U. W., & Trull, T. J. (2009). Ecological momentary assessment of mood disorders and mood dysregulation. Psychological Assessment, 21, 463–475. doi:10.1037/a0017075.

    Article  Google Scholar 

  • Feldman Barrett, L. (1998). Discrete emotions or dimensions? The role of valence focus and arousal focus. Cognition and Emotion, 12(4), 579–599.

    Article  Google Scholar 

  • Ferguson, R. (2012). The state of learning analytics in 2012: A review and future challenges (technical report No. KMI-12-01). Milton Keynes, England: Knowledge Media Institute, The Open University.

    Google Scholar 

  • Field, A. P. (2013). Discovering statistics using IBM SPSS statistics (4th ed.). London: Sage.

    Google Scholar 

  • Forlizzi, J., & Ford, S. (2000). The building blocks of experience: An early framework for interaction designers. Proceedings of Designing Interactive Systems 2000 Conference, New York, 419–423.

    Google Scholar 

  • Grace, L. J., Maheswari, V., & Nagamalai, D. (2011). Web log data analysis and mining. Proceedings of Advanced Computing First International Conference on Computer Science and Information Technology, Bangalore, India.

    Google Scholar 

  • Harasim, L. (2012). Learning theory and online technologies. New York/London: Routledge.

    Google Scholar 

  • Hektner, J., Schmidt, J., & Csikszentmihalyi, M. (2007). Experience sampling method: Measuring the quality of everyday life. Thousand Oaks, CA: Sage.

    Google Scholar 

  • Hellwege, J., Gleadow, A., & McNaught, C. (1996). Paperless lectures on the web: An evaluation of the educational outcomes of teaching geology using the Web. Proceedings of 13th Annual Conference of the Australian Society for Computers in Learning in Tertiary Education (ASCILITE), Adelaide: The University of South Australia.

    Google Scholar 

  • Hurlburt, R. T. (1979). Random sampling of cognitions and behavior. Journal of Research in Personality, 13, 103–111.

    Article  Google Scholar 

  • Mahajan, R., Sodhi, J. S., & Mahajan, V. (2014). Usage patterns discovery from a web log in an Indian e-learning site: A case study. Educational Information Technology. doi: 10.1007/s10639-014-9312-1

  • McLoughlin, C., & Lee, M. J. W. (2010). Personalised and self-regulated learning in the web 2.0 era: International exemplars of innovative pedagogy using social software. Australasian Journal of Educational Technology, 26, 28–43.

    Google Scholar 

  • Meyer, K. A. (2003). Face-to-face versus threaded discussions: The role of time and higher-order thinking. Journal of Asynchronous Learning networks, 7, 55–65. Retrieved from http://sloanconsortium.org/publications/jaln_main.

    Google Scholar 

  • Moller, L., Foshay, W., & Huett, J. (2008). The evolution of distance education: Implications for instructional design on the potential of the web (part 2: Higher education). TechTrends, 52(4), 66–70.

    Article  Google Scholar 

  • Moodle (2014). http://moodle.org/

  • Mostow, J., Beck, J., Cen, H., Cuneo, A., Gouvea, E., & Heiner, C. (2005). An educational data mining tool to browse tutor–student interactions: Time will tell! Proceedings of the Workshop on Educational Data Mining. Pittsburgh, PA, 15–22.

    Google Scholar 

  • Nachar, M. N. (2008). The Mann-Whitney U: A test for assessing whether two independent samples come from the same distribution. Tutorials in Quantitative Methods for Psychology, 4(1), 13–20.

    Google Scholar 

  • Paas, F., Tuovinen, J. E., MerriĂ«nboer, J. G., & Darabi, A. A. (2005). A motivational perspective on the relation between mental effort and performance: Optimizing learner involvement in instruction. Educational Technology Research & Development, 53(3), 25–34.

    Article  Google Scholar 

  • Paas, F., & van MerriĂ«nboer, J. J. G. (1994). Variability of worked examples and transfer of geometrical problem solving skills: A cognitive-load approach. Journal of Educational Psychology, 86, 122–133.

    Article  Google Scholar 

  • Paskey, J. A. (2001, April 26). Survey compares 2 Canadian MBA programs, one online and one traditional. The Chronicle of Higher Education. Retrieved from http://chronicle.com/ article/A-Survey-Compares-2-Canadian/108330/

  • Peled, A., & Rashty, D. (1999). Logging for success: Advancing the use of WWW logs to improve computer mediated distance learning. Journal of Educational Computing Research, 21(3).

    Google Scholar 

  • Dringus, L. P., & Ellis, T. (2005). Using data mining as a strategy for assessing asynchronous discussion forums. Computers & Education, 45, 141–160.

    Article  Google Scholar 

  • Romero, C., Ventura, S., & GarcĂ­a, E. (2008). Data mining in course management systems: Moodle case study and tutorial. Computers & Education, 51(1), 368–384.

    Article  Google Scholar 

  • Shea, P., & Bidjerano, T. (2014). Does online learning impede degree completion? a national study of community college students. Computers & Education, 75(2), 103–111.

    Article  Google Scholar 

  • Sheard, J., Albrecht, D., & Butbul, E. (2005). VISION: Visualization student interactions online. Proceedings of the Eleventh Australasian World Wide Web Conference, 48–58.

    Google Scholar 

  • Siemens, G., Gašević, D., Haythornthwaite, C., Dawson, S., Buckingham Shum, S., Ferguson, R., Duval, E. et al. (2011). Open learning analytics: An integrated & modularized platform [Concept paper]. Society for Learning Analytics Research.

    Google Scholar 

  • Tedesco, D., & Tullis, T. (2006). A comparison of methods for eliciting post-task subjective ratings in usability testing. Usability Professionals Association (UPA), 1–9.

    Google Scholar 

  • Turner, J. C., Cox, K. E., DiCintio, M., Meyer, D. K., Logan, C., & Thomas, C. T. (1998). Creating contexts for involvement in mathematics. Journal of Educational Psychology, 90, 730–745.

    Article  Google Scholar 

  • Uekawa, K., Borman, K., & Lee, R. (2005). Student engagement in America’s urban high school mathematics and science classrooms: Findings on social organization, race, and ethnicity. Unpublished manuscript.

    Google Scholar 

  • Valsamidis, S., & Democritus, S. K. (2011). E-learning platform usage analysis. Interdisciplinary Journal of E-Learning and Learning Objects, 7, 185–204.

    Google Scholar 

  • Vanijja, V., & Supattathum, M. (2006). Statistical analysis of eLearning usage in a university. Third International Conference on eLearning for Knowledge-Based Society.

    Google Scholar 

  • Velestianos, G., & Navarrete, C. C. (2012). Online social networks as formal learning environments: Learner experiences and activities. The International Review of Research in Open and Distance Learning, 13(1), 144–166.

    Google Scholar 

  • Veletsianos, G., & Doering, A. (2010). Long-term student experiences in a hybrid, open-ended and problem based adventure learning program. Australasian Journal of Educational Technology, 26(2), 280–296.

    Google Scholar 

  • White, C. (1994). Language learning strategy research in distance education: The yoked subject technique. In T. Evans & D. Murphy (Eds.), Research in distance education 3 (pp. 10–20). Geelong, Victoria: Deakin University.

    Google Scholar 

  • Wise, A. F., Zhao, Y., & Hausknecht, S. N. (2014). Learning analytics for online discussions: Embedded and extracted approaches. Journal of Learning Analytics, 1(2), 48–71.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University of South Florida, Tampa, FL, 33620, USA

    Sanghoon Park

Authors
  1. Sanghoon Park
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Sanghoon Park .

Editor information

Editors and Affiliations

  1. College of Design, University of Minnesota, St. Paul, Minnesota, USA

    Brad Hokanson

  2. Athens, Georgia, USA

    Gregory Clinton

  3. Wayne State University, Detroit, Michigan, USA

    Monica W. Tracey

Rights and permissions

Reprints and permissions

Copyright information

© 2015 Springer International Publishing Switzerland

About this chapter

Cite this chapter

Park, S. (2015). Examining Learning Experience in Two Online Courses Using Web Logs and Experience Sampling Method (ESM). In: Hokanson, B., Clinton, G., Tracey, M. (eds) The Design of Learning Experience. Educational Communications and Technology: Issues and Innovations. Springer, Cham. https://doi.org/10.1007/978-3-319-16504-2_18

Download citation

Publish with us

Policies and ethics

Search

Navigation