Skip to main content

Investigating Adaptive Activity Effectiveness Across Domains: Insights into Design Best Practices

  • 773 Accesses

Part of the Lecture Notes in Computer Science book series (LNISA,volume 12792)

Abstract

Courseware as an adaptive instructional system is a complex environment to develop. The student will encounter lessons of content with integrated formative practice, adaptive activities, and assessments in their learning path. The alignment of all course features, including the scaffolding structure of the adaptive activities, may vary between courses and the teams who created them. In a previous analysis of adaptive activities [1], these activities had net positive effects on student learning estimates and summative assessment scores. In this paper, we will analyze three additional non-STEM courses that had less effective adaptive activities using the same methods as the original study, and further investigate course features that could be influencing their effectiveness, such as alignment, difficulty, and amount of practice. The results of this analysis can provide guidance on how to best create content for adaptive courseware and provide an example of the critical role data analysis has in the evaluation and iterative improvement of student learning environments.

Keywords

  • Adaptive activities
  • Adaptive courseware
  • Formative practice
  • Learning by doing
  • Learning outcomes

This is a preview of subscription content, access via your institution.

Buying options

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-030-77857-6_22
  • Chapter length: 13 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   109.00
Price excludes VAT (USA)
  • ISBN: 978-3-030-77857-6
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   139.99
Price excludes VAT (USA)
Fig. 1.

References

  1. Van Campenhout, R., Jerome, B., Johnson, B.G.: The impact of adaptive activities in Acrobatiq courseware - investigating the efficacy of formative adaptive activities on learning estimates and summative assessment scores. In: Sottilare, R.A., Schwarz, J. (eds.) HCII 2020. LNCS, vol. 12214, pp. 543–554. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50788-6_40

    CrossRef  Google Scholar 

  2. Black, P., William, D.: Inside the black box: raising standards through classroom assessment. Phi Delta Kappan 92(1), 81–90 (2010). https://doi.org/10.1177/003172171009200119

    MathSciNet  CrossRef  Google Scholar 

  3. Dunlosky, J., Rawson, k., Marsh, E., Nathan, M., Willingham, D.: Improving students’ learning with effective learning techniques: promising directions from cognitive and educational psychology. Psychol. Sci. Public Interest 14(1), 4–58 (2013). https://doi.org/10.1177/1529100612453266

  4. Koedinger, K., Kim, J., Jia, J., McLaughlin, E., Bier, N.: Learning is not a spectator sport: doing is better than watching for learning from a MOOC. Learning at Scale, Vancouver, Canada, pp. 111–120 (2015). https://doi.org/10.1145/2724660.2724681

  5. Koedinger, K., McLaughlin, E., Jia, J., Bier, N.: Is the doer effect a causal relationship? how can we tell and why it’s important. Learning Analytics and Knowledge. Edinburgh, United Kingdom (2016). https://doi.org/10.1145/2883851.2883957

  6. Koedinger, K.R., Scheines, R., Schaldenbrand, P.: Is the doer effect robust across multiple data sets? In: Proceedings of the 11th International Conference on Educational Data Mining, EDM 2018, pp. 369–375 (2018)

    Google Scholar 

  7. Olsen, J., Johnson, B.G.: Deeper collaborations: a finding that may have gone unnoticed. Paper presented at the IMS Global Learning Impact Leadership Institute, San Diego, CA (2019)

    Google Scholar 

  8. Baker, F. The basics of item response theory. ERIC Clearinghouse on Assessment and Evaluation. College Park, MD (2001). http://echo.edres.org:8080/irt/baker/

  9. Embretson, S., Reise, S.: Item Response Theory for Psychologists. Erl-baum, Mahwah (2000)

    Google Scholar 

  10. Fox, J.: Bayesian Item Response Modeling: Theory and Applications. Springer, New York (2010). https://doi.org/10.1007/978-1-4419-0742-4

  11. Sanders, D., Welk, D.: Strategies to scaffold student learning: applying Vygotsky’s zone of proximal development. Nurse Educ. 30(5), 203–204 (2005)

    CrossRef  Google Scholar 

  12. Sweller, J.: The worked example effect and human cognition. Learn. Instr. 16(2), 165–169 (2006). https://doi.org/10.1016/j.learninstruc.2006.02.005

    CrossRef  Google Scholar 

  13. Goodell, J., Thai, K.-P.: A learning engineering model for learner-centered adaptive systems. In: Stephanidis, C., Harris, D., Li, W.-C., Schmorrow, D.D., Fidopiastis, C.M., Zaphiris, P., Ioannou, A., Fang, X., Sottilare, R.A., Schwarz, J. (eds.) HCII 2020. LNCS, vol. 12425, pp. 557–573. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-60128-7_41

    CrossRef  Google Scholar 

Download references

Acknowledgements

The authors sincerely thank Leandro Ucha for his assistance in preparing the data for the analysis of the adaptive activities.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Rachel Van Campenhout .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Van Campenhout, R., Jerome, B., Dittel, J.S., Johnson, B.G. (2021). Investigating Adaptive Activity Effectiveness Across Domains: Insights into Design Best Practices. In: Sottilare, R.A., Schwarz, J. (eds) Adaptive Instructional Systems. Design and Evaluation. HCII 2021. Lecture Notes in Computer Science(), vol 12792. Springer, Cham. https://doi.org/10.1007/978-3-030-77857-6_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77857-6_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77856-9

  • Online ISBN: 978-3-030-77857-6

  • eBook Packages: Computer ScienceComputer Science (R0)