Skip to main content
Log in

Expertise amiss: interactivity fosters learning but expert tutors are less interactive than novice tutors

  • Published:
Instructional Science Aims and scope Submit manuscript

Abstract

The extent to which tutors are interactive and engage in dialogue with a student tends to depend on their pedagogical expertise. Normally, tutors with pedagogical expertise are more interactive than tutors without pedagogical expertise. This finding, however, has largely been obtained when examining tutoring in procedural domains such as mathematics. Hence, less is known about the extent to which tutors engage in interactivity as a function of their pedagogical expertise when they tutor a conceptual domain such as biology. Therefore, we conducted a study with N = 46 tutors who differed in their pedagogical expertise and examined their interactive style of tutoring in a conceptual domain (Herppich et al. 2013, 2014). This article presents results of a content-based analysis showing that a tutor’s interactivity resulting from combining more scaffolding with less explaining particularly promoted a student’s deep learning. Contrary to prior research, however, tutors with more pedagogical expertise were less interactive and, consequently, fostered learning to a lesser degree than tutors with less pedagogical expertise. Our findings suggest that a more complete understanding of interactivity in tutoring requires a differentiated approach considering interactivity as a multifaceted phenomenon.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1

Similar content being viewed by others

Notes

  1. Figure 1a, c also displays the total effect of a tutor’s expertise on a student’s concept learning that was reported in Herppich et al. (2014). Coefficients deviate marginally from those reported earlier. This is because in Herppich et al. (2014), one tutor–student dyad did not yield codes for the analyses performed there and, thus, had to be excluded from the analysis. For the analyses presented in this article, all dyads yielded codes and, accordingly, could be included. The total effect of the type of tutor on a student’s concept learning was significant, R 2 = .09, F(1,44) = 4.26, p = .04, 95 % CIB [.01, .28], f = .31 (medium effect). The total effect of the type of tutor on a student’ mental model learning (Fig. 1b, d), yet, was not significant, R 2 < .01, F(1,44) < .01, p = .96, CIB [−.16, .18], f = .01 (small effect).

References

  • Azevedo, R., Cromley, J. G., & Seibert, D. (2004). Does adaptive scaffolding facilitate students’ ability to regulate their learning with hypermedia? Contemporary Educational Psychology, 29(3), 344–370. doi:10.1016/j.cedpsych.2003.09.002.

    Article  Google Scholar 

  • Cade, W. L. (2009). How domain differences impact the mode structure of expert tutoring dialogue. Honors paper. Rhodes College, Memphis, TN. Retrieved from http://www.researchgate.net.

  • Chae, H. M., Kim, J. H., & Glass, M. (2005). Effective behaviors in a comparison between novice and expert algebra tutors. In S. Hettiarachchi & R. Finkbine (Eds.), Proceedings of the Sixteenth Midwest Artificial Intelligence and Cognitive Science Conference. Retrieved from http://www.mglass.org/papers/papers.html.

  • Chi, M. T. H., Roy, M., & Hausmann, R. G. M. (2008). Observing tutorial dialogues collaboratively: Insights about human tutoring effectiveness from vicarious learning. Cognitive Science, 32(2), 301–341. doi:10.1080/03640210701863396.

    Article  Google Scholar 

  • Chi, M. T. H., Siler, S. A., & Jeong, H. (2004). Can tutors monitor students' understanding accurately? Cognition and Instruction, 22(3), 363–387. doi:10.1207/s1532690xci2203_4.

    Article  Google Scholar 

  • Chi, M. T. H., Siler, S. A., Jeong, H., Yamauchi, T., & Hausmann, R. G. M. (2001). Learning from human tutoring. Cognitive Science, 25(4), 471–533. doi:10.1207/s15516709cog2504_1.

    Article  Google Scholar 

  • Chi, M. T. H., & Wylie, R. (2014). The ICAP framework: Linking cognitive engagement to active learning outcomes. Educational Psychologist, 49(4), 219–243. doi:10.1080/00461520.2014.965823.

    Article  Google Scholar 

  • Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20(1), 37–46. doi:10.1177/001316446002000104.

    Article  Google Scholar 

  • Cohen, J. (1988). Statistical power analysis for the behavioral sciencies (2nd ed.). Hillsdale, NJ: Lawrence Erlbaum.

    Google Scholar 

  • Core, M. G., Moore, J. D., & Zinn, C. (2003). The role of initiative in tutorial dialogue. In A. Copestake & J. Hajic (Eds.), Proceedings of the 10th Conference of the European Chapter of the Association for Computational Linguistics (pp. 67–74). Retrieved from http://www.aclweb.org.

  • Cromley, J. G., & Azevedo, R. (2005). What do reading tutors do? A naturalistic study of more and less experienced tutors in reading. Discourse Processes, 40(2), 83–113. doi:10.1207/s15326950dp4002_1.

    Article  Google Scholar 

  • D’Mello, S., Lehman, B. A., & Person, N. K. (2010). Expert tutors feedback is immediate, direct, and discriminating. In H. W. Guesgen & C. Murray (Eds.), Proceedings of the Twenty-Third International Florida Artificial Intelligence Research Society Conference (pp. 504–509). Menlo Park, CA: AAAI Press. Retrieved from http://www.aaai.org.

  • Di Eugenio, B., Kershaw, T. C., Lu, X., Corrigan-Halpern, A., & Ohlsson, S. (2006). Toward a computational model of expert tutoring: a first report. In G. Sutcliffe, & R. Goebel (Eds.), Proceedings of 19th International conference of Florida Artificial Intelligence Research Society (pp. 503–508). Menlo Park, CA: AAAI Press. Retrieved from http://www.aaai.org.

  • DiCiccio, T. J., & Efron, B. (1996). Bootstrap confidence intervals. Statistical Science, 11(3), 189–212. doi:10.1214/ss/1032280214.

    Article  Google Scholar 

  • Fleiss, J. L., & Cohen, J. (1973). The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educational and Psychological Measurement, 33(3), 613–619. doi:10.1177/001316447303300309.

    Article  Google Scholar 

  • Fossati, D. (2008, June). The role of positive feedback in Intelligent Tutoring Systems. Paper presented at the 46th Annual Meeting of the Association for Computational Linguistics, Student Research Workshop, Columbus, OH. Retrieved from http://www.aclweb.org/anthology/P08-3006.

  • Glass, M., Kim, J. H., Evens, M. W., Michael, J. A., & Rovick, A. A. (1999). Novice vs. expert tutors: A comparison of style. In U. Priss (Ed.), Midwest artificial intelligence and cognitive science conference (pp. 43–49). Bloomington, IN: AAAI Press.

    Google Scholar 

  • Graesser, A. C., D’Mello, S., & Cade, W. L. (2011). Instruction based on tutoring. In R. E. Mayer & P. A. Alexander (Eds.), Handbook of research on learning and instruction (2nd ed., pp. 408–426). London, UK: Routledge.

    Google Scholar 

  • Graesser, A. C., Person, N. K., & Magliano, J. P. (1995). Collaborative dialogue patterns in naturalistic one-to-one tutoring. Applied Cognitive Psychology, 9(6), 495–522. doi:10.1002/acp.2350090604.

    Article  Google Scholar 

  • Hattie, J. (2012). Visible learning for teachers. Maximizing impact on learning. London: Routledge.

    Google Scholar 

  • Hayes, A. F. (2012). PROCESS: A versatile computational tool for observed variable mediation, moderation, and conditional process modeling [White paper]. Retrieved from http://www.afhayes.com/public/process2012.pdf.

  • Herppich, S., Wittwer, J., Nückles, M., & Renkl, A. (2013). Does it make a difference? Investigating the assessment accuracy of teacher tutors and student tutors. The Journal of Experimental Education, 81(2), 242–260. doi:10.1080/00220973.2012.699900.

    Article  Google Scholar 

  • Herppich, S., Wittwer, J., Nückles, M., & Renkl, A. (2014). Addressing knowledge deficits in tutoring and the role of teaching experience: Benefits for learning and summative assessment. Journal of Educational Psychology, 106(4), 934–945. doi:10.1037/a0036076.

    Article  Google Scholar 

  • Jackson, G., Person, N., Graesser, A. (2004). Adaptive tutorial dialogue in AutoTutor. In J. C. Lester, R. M. Vicari & F. Paraguaçu (Eds.), Proceedings of the Workshop on Dialog-Based Intelligent Tutoring Systems at the 7th International Conference on Intelligent Tutoring Systems (Vol. 3220, pp. 368–372). Heidelberg, Germany: Springer. Retrieved fromhttp://www.ibrarian.net.

  • Litman, D. J., Rosé, C. P., Forbes-Riley, K., VanLehn, K., Bhembe, D., & Silliman, S. (2006). Spoken versus typed human and computer dialogue tutoring. International Journal of Artificial Intelligence in Education, 16(2), 145–170. Retrieved from http://ijaied.org/.

  • Lu, X., Di Eugenio, B., Kershaw, T., Ohlsson, S., & Corrigan-Halpern, A. (2007). Expert vs. non-expert tutoring: Dialogue moves, interaction patterns and multi-utterance turns. In A. Gelbukh (Ed.), Computational linguistics and intelligent text processing (Vol. 4394, pp. 456–467). Heidelberg, Germany: Springer.

  • Muldner, K., Lam, R., & Chi, M. T. H. (2014). Comparing learning from observing and from human tutoring. Journal of Educational Psychology, 106(1), 69–85. doi:10.1037/a0034448.

    Article  Google Scholar 

  • Pelaez, N. J., Boyd, D. D., Rojas, J. B., & Hoover, M. A. (2005). Prevalence of blood circulation misconceptions among prospective elementary teachers. Advances in Physiology Education, 29(3), 172–181. doi:10.1152/advan.00022.2004.

    Article  Google Scholar 

  • Preacher, K. J., & Hayes, A. F. (2008). Asymptotic and resampling strategies for assessing and comparing indirect effects in multiple mediator models. Behavior Research Methods, 40(3), 879–891. doi:10.3758/brm.40.3.879.

    Article  Google Scholar 

  • Preacher, K. J., & Kelley, K. (2011). Effect size measures for mediation models: Quantitative strategies for communicating indirect effects. Psychological Methods, 16(2), 93–115. doi:10.1037/a002265810.1037/a0022658.supp.

    Article  Google Scholar 

  • Seidel, T., & Shavelson, R. J. (2007). Teaching effectiveness research in the past decade: The role of theory and research design in disentangling meta-analysis results. Review of Educational Research, 77(4), 454–499. doi:10.3102/0034654307310317.

    Article  Google Scholar 

  • Towle, A. (1989). Modern biology. New York, NY: Holt, Rinehart and Winston.

    Google Scholar 

  • VanLehn, K. (2011). The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educational Psychologist, 46(4), 197–221. doi:10.1080/00461520.2011.611369.

    Article  Google Scholar 

  • VanLehn, K., Graesser, A. C., Jackson, G. T., Jordan, P., Olney, A., & Rosé, C. P. (2007). When are tutorial dialogues more effective than reading? Cognitive Science, 31(1), 1–60. doi:10.1080/03640210709336984.

    Article  Google Scholar 

  • VanLehn, K., Siler, S. A., Murray, C., Yamauchi, T., & Baggett, W. B. (2003). Why do only some events cause learning during human tutoring? Cognition and Instruction, 21(3), 209–249. doi:10.1207/s1532690xci2103_01.

    Article  Google Scholar 

  • Wittwer, J., Nückles, M., Landmann, N., & Renkl, A. (2010). Can tutors be supported in giving effective explanations? Journal of Educational Psychology, 102(1), 74–89. doi:10.1037/a0016727.

    Article  Google Scholar 

  • Wittwer, J., & Renkl, A. (2008). Why instructional explanations often do not work: A framework for understanding the effectiveness of instructional explanations. Educational Psychologist, 43(1), 49–64. doi:10.1080/00461520701756420.

    Article  Google Scholar 

Download references

Acknowledgments

Analyses in this article are based on data collected but not reported in Herppich et al. (2013, 2014). This research was supported by grants from the German Research Foundation (WI 3348/2-1).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Stephanie Herppich.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Herppich, S., Wittwer, J., Nückles, M. et al. Expertise amiss: interactivity fosters learning but expert tutors are less interactive than novice tutors. Instr Sci 44, 205–219 (2016). https://doi.org/10.1007/s11251-015-9363-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11251-015-9363-8

Keywords

Navigation