Educational Technology Research and Development

, Volume 65, Issue 4, pp 1067–1103 | Cite as

Teacher professional development through digital content evaluation

  • Kui Xie
  • Min Kyu Kim
  • Sheng-Lun Cheng
  • Nicole C. Luthy
Development Article

Abstract

In this study, researchers designed and implemented a 1-year professional development (PD) program that focused on supporting teachers in evaluating and selecting digital learning contents. Participants in this investigation included 109 teachers who consented to the study amongst a total of 171 teachers from five school districts across central Ohio. In addition to their participation in the PD program, they completed surveys, interviews, and self-reflections in this mixed-method study. The results revealed that teachers’ perceived TPACK increased over time throughout the PD program, suggesting that training teachers to evaluate digital contents can be an effective PD model to improve teachers’ capacity in learning technology integration. The PD program was especially effective for teachers with less prior experience in technology integration or related training. Mathematics teachers, in comparison to teachers from other disciplines, began with low TPACK; however, these initial differences gradually diminished over the course of the PD program. In terms of their motivation in digital content evaluation, teachers’ expectancy for success increased significantly while their task values remained medium high. The qualitative analyses provided additional insights and revealed design suggestions for success in future PDs.

Keywords

Digital content evaluation Technology integration TPACK Standard alignment Professional development Teacher training 

References

  1. Abbitt, J. T. (2011). Measuring technological pedagogical content knowledge in preservice teacher education: A review of current methods and instruments. Journal of Research on Technology in Education, 43(4), 281–300.CrossRefGoogle Scholar
  2. Adelman, N., Donnelly, M. B., Dove, T., Tiffany-Morales, J., Wayne, A., & Zucker, A. (2002). The integrated studies of educational technology: Professional development and teachers’ use of technology. Arlington, VA: SRI International.Google Scholar
  3. Anderson, L. W., & Krathwohl, D. R. (Eds.). (2001). A taxonomy for learning, teaching, and assessing: A revision of Bloom’s taxonomy of educational objectives. New York: Longman.Google Scholar
  4. Angeli, C., & Valanides, N. (2013). Using educational data mining methods to assess field-dependent and field-independent learners’ complex problem solving. Educational Technology Research and Development, 61(3), 521–548.CrossRefGoogle Scholar
  5. Bandura, A. (1977). Self-efficacy: toward a unifying theory of behavioral change. Psychological Review, 84(2), 191–215.CrossRefGoogle Scholar
  6. Bloom, B. S., Engelhart, M. D., Furst, E. J., Hill, W. H., & Krathwohl, D. R. (1956). Taxonomy of educational objectives, handbook I: Cognitive domain. New York: Longman Publishers.Google Scholar
  7. Bonk, C., & Graham, C. (Eds.). (2005). The handbook of blended learning: Global perspectives, local designs. New York: Pfeiffer.Google Scholar
  8. Brinkerhoff, J. (2006). Effects of a long-duration, professional development academy on technology skills, computer self-efficacy, and technology integration beliefs and practices. Journal of Research on Technology in Education, 39(1), 22–43. doi:10.1080/15391523.2006.10782471.CrossRefGoogle Scholar
  9. Brophy, J. (2008). Developing students’ appreciation for what is taught in school. Educational Psychologist, 43(3), 132–141.CrossRefGoogle Scholar
  10. Buchanan, B. (1974). Building organizational commitment: The socialization of managers in work organizations. Administrative science quarterly, 19(4), 533–546.CrossRefGoogle Scholar
  11. Chai, C. S., Koh, J. H. L., & Tsai, C. C. (2010). Facilitating preservice teachers’ development of technological, pedagogical, and content knowledge (TPACK). Journal of Educational Technology & Society, 13(4), 63–73.Google Scholar
  12. Chow, A., Eccles, J. S., & Salmela-Aro, K. (2012). Task value profiles across subjects and aspirations to physical and IT-related sciences in the United States and Finland. Developmental Psychology, 48(6), 1612–1628.CrossRefGoogle Scholar
  13. Cohen, J. (1988). Statistical power analysis for the behavioral sciences. Hillsdale: LEA.Google Scholar
  14. Cosmah, M., & Saine, P. (2013). Targeting digital technologies in common core standards: A framework for professional development. New England Reading Association Journal, 48(2), 81–86.Google Scholar
  15. Creswell, J. W., & Clark, V. L. P. (2007). Designing and conducting mixed methods research. Thousand Oaks, CA: Sage.Google Scholar
  16. Creswell, J. W., Plano Clark, V. L., Guttmann, M. L., & Hanson, E. E. (2003). Advanced mixed methods research design. In A. Tashakkori & C. Teddlie (Eds.), Handbook of mixed methods in social and behavioral research (pp. 209–240). Thousand Oaks, CA: Sage.Google Scholar
  17. Dean, D., & Kuhn, D. (2003). Metacognition and critical thinking. Retrieved from http://eric.ed.gov/?id=ED477930.
  18. Deanna, K. (1999). A developmental model of critical thinking. Educational Researcher, 28(2), 16–46.CrossRefGoogle Scholar
  19. DeBacker, T.K., Miller, R.B., Walker, C.O., & Man Sell, R., (2004, September). Perceptions of classroom climate, student motivation, and achievement: Changes and interrelationships across an academic year. Paper presented at the Ninth International conference on Motivation. Lisbon, Portugal.Google Scholar
  20. DeSantis, J. (2013). Exploring the effects of professional development for the interactive whiteboard on teachers’ technology self-efficacy. Journal of Information Technology Education: Research, 12, 343–362.Google Scholar
  21. Dewey, J. (1933). How we think: A restatement of the relation of reflective thinking to the educative process. Lexington, MA: Heath.Google Scholar
  22. Doering, A., Veletsianos, G., Scharber, C., & Miller, C. (2009). Using the technological, pedagogical, and content knowledge framework to design online learning environments and professional development. Journal of Educational Computing Research, 41(3), 319–346.CrossRefGoogle Scholar
  23. Doherty, I. (2011). Evaluating the impact of educational technology professional development upon adoption of Web 2.0 tools in teaching. Australasian Journal of Educational Technology, 27(3), 381–396.CrossRefGoogle Scholar
  24. Duran, M., Brunvand, S., Ellsworth, J., & Şendağ, S. (2011). Impact of research-based professional development: Investigation of inservice teacher learning and practice in Wiki integration. Journal of Research on Technology in Education, 44(4), 313–334.CrossRefGoogle Scholar
  25. Eccles, J. (1983). Expectancies, values and academic behaviors. In J. T. Spence (Ed.), Achievement and achievement motives (pp. 75–146). San Francisco: Freeman.Google Scholar
  26. Eccles, J. S., O’Neill, S. A., & Wigfield, A. (2005). Ability self-perceptions and subjective task values in adolescents and children. In K. A. Moore & L. H. Lippman (Eds.), What do children need to flourish? Conceptualizing and measuring indicators of positive development (pp. 237–249). New York: Springer.CrossRefGoogle Scholar
  27. Eccles, J. S., & Wigfield, A. (1995). In the mind of the achiever: The structure of adolescents’ academic achievement related-beliefs and self-perceptions. Personality and Social Psychology Bulletin, 21, 215–225.CrossRefGoogle Scholar
  28. Eccles, J. S., & Wigfield, A. (2002). Motivational beliefs, values, and goals. Annual Review of Psychology, 53(1), 109–132.CrossRefGoogle Scholar
  29. Ennis, R. H. (1987). A taxonomy of critical thinking dispositions and abilities. In J. B. Baron & R. J. Sternberg (Eds.), Teaching thinking skills (pp. 9–26). New York: Freeman.Google Scholar
  30. Ertmer, P. A. (2005). Teacher pedagogical beliefs: The final frontier in our quest for technology integration? Educational Technology Research and Development, 53(4), 25–39.CrossRefGoogle Scholar
  31. Ertmer, P. A., & Ottenbreit-Leftwich, A. T. (2010). Teacher technology change: How knowledge, confidence, beliefs, and culture intersect. Journal of research on Technology in Education, 42(3), 255–284.CrossRefGoogle Scholar
  32. Ertmer, P. A., Ottenbreit-Leftwich, A. T., Sadik, O., Sendurur, E., & Sendurur, P. (2012). Teacher beliefs and technology integration practices: A critical relationship. Computers & Education, 59(2), 423–435.CrossRefGoogle Scholar
  33. Ertmer, P. A., Paul, A., Molly, L., Eva, R., & Denise, W. (1999). Examining teachers’ beliefs about the role of technology in the elementary classroom. Journal of Research on Computing in Education, 32(1), 54–72.CrossRefGoogle Scholar
  34. Facione, N. E. (1990). The Delphi report. Committee on pre-college philosophy. American Philosophical Association.Google Scholar
  35. Fiorella, L., Vogel-Walcutt, J. J., & Schatz, S. (2012). Applying the modality principle to real-time feedback and the acquisition of higher-order cognitive skills. Educational Technology Research and Development, 60(2), 223–238.CrossRefGoogle Scholar
  36. Fleck, J. (2012). Blended learning and learning communities: opportunities and challenges. Journal of Management Development, 31(4), 398–411.CrossRefGoogle Scholar
  37. Fraenkel, J., Wallen, N., & Hyun, H. H. (2012). How to design and evaluate research in education (8th ed.). Boston: McGraw Hill.Google Scholar
  38. Gallant, D.J., Hill, E., Luthy, N., & Shiverdecker, T. (2015). Using a modified Delphi survey and focus group interviews to determine K-12 teachers’ and principals’ information needs to select digital content. Paper presented at the annual conference of American Evaluation Association, Chicago, IL.Google Scholar
  39. Garet, M. S., Porter, A. C., Desimone, L., Birman, B. F., & Yoon, K. S. (2001). What makes professional development effective? Results from a national sample of teachers. American Educational Research Journal, 38(4), 915–945.CrossRefGoogle Scholar
  40. Goodson, I. F., & Mangan, J. M. (1995). Subject cultures and the introduction of classroom computers. British Educational Research Journal, 21(5), 613–628.CrossRefGoogle Scholar
  41. Greene, J. C. (2007). Mixed methods in social inquiry. San Francisco, CA: Jossey-Bass.Google Scholar
  42. Hartsell, T., Herron, S., Fang, H., & Rathod, A. (2009). Effectiveness of professional development in teaching mathematics and technology applications. Journal of Educational Technology Development and Exchange, 2(1), 53–64.CrossRefGoogle Scholar
  43. Hew, K. F., & Brush, T. (2007). Integrating technology into K-12 teaching and learning: Current knowledge gaps and recommendations for future research. Educational Technology Research and Development, 55(3), 223–252.CrossRefGoogle Scholar
  44. Higgins, T. E., & Spitulnik, M. W. (2008). Supporting teachers’ use of technology in science instruction through professional development: a literature review. Journal of Science Education and Technology, 17(5), 511–521.CrossRefGoogle Scholar
  45. Holbein, M. F., & Jackson, K. (1999). Study groups and electronic portfolios: A professional development school inservice project. Journal of Technology and teacher Education, 7(3), 205–218.Google Scholar
  46. Holland, P. E. (2001). Professional development in technology: Catalyst for school reform. Journal of Technology in Teacher Education, 9(2), 245–267.Google Scholar
  47. Howard, S. K., Chan, A., Mozejko, A., & Caputi, P. (2015). Technology practices: Confirmatory factor analysis and exploration of teachers’ technology integration in subject areas. Computers & Education, 90, 24–35.CrossRefGoogle Scholar
  48. Howard, S. K., & Maton, K. (2011). Theorising knowledge practices: A missing piece of the educational technology puzzle. Research in Learning Technology, 19(3), 191–206.CrossRefGoogle Scholar
  49. Inan, F. A., & Lowther, D. L. (2010). Factors affecting technology integration in K-12 classrooms: A path model. Educational Technology Research and Development, 58(2), 137–154.CrossRefGoogle Scholar
  50. Jimoyiannis, A. (2010). Designing and implementing an integrated technological pedagogical science knowledge framework for science teachers professional development. Computers & Education, 55(3), 1259–1269.CrossRefGoogle Scholar
  51. John, P. D., & La Velle, L. B. (2004). Devices and desires: Subject subcultures, pedagogical identity and the challenge of information and communications technology. Technology, Pedagogy and Education, 13(3), 307–326.CrossRefGoogle Scholar
  52. Keller, J. B., Bonk, C. J., & Hew, K. (2005). The TICKIT to teacher learning: Designing professional development according to situative principles. Journal of Educational Computing Research, 32(4), 329–340.CrossRefGoogle Scholar
  53. Kereluik, K., Casperson, G., & Akcaoglu, M. (2010). Coding pre-service teacher lesson plans for TPACK. In D. Gibson & B. Dodge (Eds.), Proceedings of Society for Information Technology and Teacher Education International Conference 2010 (pp. 3889–3891). Chesapeake, VA: AACE.Google Scholar
  54. Kleickmann, T., Tröbst, S., Jonen, A., Vehmeyer, J., & Möller, K. (2016). The effects of expert scaffolding in elementary science professional development on teachers’ beliefs and motivations, instructional practices, and student achievement. Journal of Educational Psychology, 108(1), 21–42. doi:10.1037/edu0000041.CrossRefGoogle Scholar
  55. Koehler, M., & Mishra, P. (2009). What is technological pedagogical content knowledge (TPACK)? Contemporary Issues in Technology and Teacher Education, 9(1), 60–70.Google Scholar
  56. Koehler, M. J., Mishra, P., Kereluik, K., Shin, T. S., & Graham, C. R. (2014). The technological pedagogical content knowledge framework. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (pp. 101–111). New York, NY: Springer.CrossRefGoogle Scholar
  57. Koehler, M. J., Mishra, P., & Yahya, K. (2007). Tracing the development of teacher knowledge in a design seminar: Integrating content, pedagogy and technology. Computers & Education, 49(3), 740–762.CrossRefGoogle Scholar
  58. Kopcha, T. J. (2012). Teachers’ perceptions of the barriers to technology integration and practices with technology under situated professional development. Computers & Education, 59(4), 1109–1121.CrossRefGoogle Scholar
  59. Labin, S. N., Duffy, J. L., Meyers, D. C., Wandersman, A., & Lesesne, C. A. (2012). A research synthesis of the evaluation capacity building literature. American Journal of Evaluation, 33, 307–338.CrossRefGoogle Scholar
  60. Lawless, K. A., & Pellegrino, J. W. (2007). Professional development in integrating technology into teaching and learning: Knowns, unknowns, and ways to pursue better questions and answers. Review of Educational Research, 77(4), 575–614.CrossRefGoogle Scholar
  61. Martin, W., Strother, S., Beglau, M., Bates, L., Reitzes, T., & McMillan Culp, K. (2010). Connecting instructional technology professional development to teacher and student outcomes. Journal of Research on Technology in Education, 43(1), 53–74.CrossRefGoogle Scholar
  62. Matzen, N. J., & Edmunds, J. A. (2007). Technology as a catalyst for change: The role of professional development. Journal of Research on Technology in Education, 39(4), 417–430.CrossRefGoogle Scholar
  63. Mayer, R. E. (2002). Rote versus meaningful learning. Theory Into Practice, 41, 226–232.CrossRefGoogle Scholar
  64. Meece, J. L., Wigfield, A., & Eccles, J. S. (1990). Predictors of math anxiety and its influence on young adolescents’ course enrollment intentions and performance in mathematics. Journal of Educational Psychology, 82(1), 60–70.CrossRefGoogle Scholar
  65. Midgley, C., & Urdan, T. (2001). Academic self-handicapping and achievement goals: A further examination. Contemporary Educational Psychology, 26(1), 61–75.CrossRefGoogle Scholar
  66. Milbrath, Y. C. L., & Kinzie, M. B. (2000). Computer technology training for prospective teachers: Computer attitudes and perceived self-efficacy. Journal of Technology and Teacher Education, 8(4), 373–396.Google Scholar
  67. Mishra, P., & Koehler, M. (2006). Technological pedagogical content knowledge: A framework for teacher knowledge. The Teachers College Record, 108(6), 1017–1054.CrossRefGoogle Scholar
  68. Mouza, C. (2006). Linking professional development to teacher learning and practice: A multi-case study analysis of urban teachers. Journal of Educational Computing Research, 34(4), 405–440.CrossRefGoogle Scholar
  69. Mouza, C. (2009). Does research-based professional development make a difference? A longitudinal investigation of teacher learning in technology integration. The Teachers College Record, 111(5), 1195–1241.Google Scholar
  70. Mouza, C. (2011). Promoting urban teachers’ understanding of technology, content, and pedagogy in the context of case development. Journal of Research on Technology in Education, 44(1), 1–29.CrossRefGoogle Scholar
  71. Mouza, C., Karchmer-Klein, R., Nandakumar, R., Ozden, S. Y., & Hu, L. (2014). Investigating the impact of an integrated approach to the development of preservice teachers’ technological pedagogical content knowledge (TPACK). Computers & Education, 71, 206–221.CrossRefGoogle Scholar
  72. Mumford, M. D., Mobley, M. I., Reiter-Palmon, R., Uhlman, C. E., & Doares, L. M. (1991). Process analytic models of creative capacities. Creativity Research Journal, 4(2), 91–122.CrossRefGoogle Scholar
  73. Niess, M. L., van Zee, E. H., & Gillow-Wiles, H. (2010). Knowledge growth in teaching mathematics/science with spreadsheets: Moving PCK to TPACK through online professional development. Journal of Digital Learning in Teacher Education, 27(2), 42–52.CrossRefGoogle Scholar
  74. Owston, R., Wideman, H., Murphy, J., & Lupshenyuk, D. (2008). Blended teacher professional development: A synthesis of three program evaluations. The Internet and Higher Education, 11(3), 201–210.CrossRefGoogle Scholar
  75. Piaget, J. (1985). The equilibration of cognitive structures. Chicago: University of Chicago Press.Google Scholar
  76. Pintrich, P. R. (2000). Multiple goals, multiple pathways: The role of goal orientation in learning and achievement. Journal of Educational Psychology, 92(3), 544–555.CrossRefGoogle Scholar
  77. Polly, D. (2011). Examining teachers’ enactment of technological pedagogical and content knowledge (TPACK) in their mathematics teaching after technology integration professional development. Journal of Computers in Mathematics and Science Teaching, 30(1), 37–59.Google Scholar
  78. Rienties, B., Brouwer, N., & Lygo-Baker, S. (2013). The effects of online professional development on higher education teachers’ beliefs and intentions towards learning facilitation and technology. Teaching and Teacher Education, 29, 122–131.CrossRefGoogle Scholar
  79. Schieb, L. J., & Karabenick, S. A. (2011). Teacher Motivation and Professional Development: A Guide to Resources. Math and Science Partnership—Motivation Assessment Program, University of Michigan, Ann Arbor, MI.Google Scholar
  80. Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological pedagogical content knowledge (TPACK) the development and validation of an assessment instrument for preservice teachers. Journal of Research on Technology in Education, 42(2), 123–149.CrossRefGoogle Scholar
  81. Scott, P., & Mouza, C. (2007). The impact of professional development on teacher learning, practice and leadership skills: A study on the integration of technology in the teaching of writing. Journal of Educational Computing Research, 37(3), 229–266.CrossRefGoogle Scholar
  82. Simpkins, S. D., Fredricks, J. A., & Eccles, J. S. (2012). Charting the Eccles’ expectancy-value model from mothers’ beliefs in childhood to youth’s activities in adolescence. Developmental Psychology, 48, 1019–1032.CrossRefGoogle Scholar
  83. Sinnott, J. D. (1989). A model for solution of ill-structured problems: Implications for everyday and abstract problem solving. In J. D. Sinnott (Ed.), Everyday problem solving: Theory and applications (pp. 72–99). New York: Praeger.Google Scholar
  84. Skoretz, Y., & Childress, R. (2013). An evaluation of a school-based professional development program on teachers’ efficacy for technology integration: Findings from an initial study. Journal of Technology and Teacher Education, 21(4), 461–484.Google Scholar
  85. Smith, S. M. (2001). The four sources of influence on computer self-efficacy. Delta Pi Epsilon Journal, 43(1), 27–39.Google Scholar
  86. Sparks, (2002). Designing powerful professional development for teachers and principals. Oxford, OH: National Staff Development Council.Google Scholar
  87. Staker, H., Chan, E., Clayton, M., Hernandez, A., Horn, M.B., & Mackey, K. (2011). The rise of K12 blended learning: Profiles of emerging models. Innosight Institute report. Retrieved from http://www.innosightinstitute.org/innosight/wp-content/uploads/2011/01/The-Rise-of-K-12-Blended-Learning.pdf.
  88. Stipek, D. J., & Ryan, R. H. (1997). Economically disadvantaged preschoolers: Ready to learn but further to go. Developmental Psychology, 33(4), 711–723.CrossRefGoogle Scholar
  89. Suharwoto, G. (2006). Developing and implementing a technology pedagogical content knowledge (TPCK) for teaching mathematics with technology. In C. Crawford, D. Willis, R. Carlsen, I. Gibson, K. McFerrin, J. Price, & R. Weber (Eds.), Proceedings of society for information technology and teacher education international conference 2006 (pp. 3824–3828). Chesapeake, VA: AACE.Google Scholar
  90. Tabachnick, B. G., & Fidell, L. S. (2013). Using multivariate statistics (6th ed.). Boston, MA: Pearson.Google Scholar
  91. Tamim, R. M., Bernard, R. M., Borokhovski, E., Abrami, P. C., & Schmid, R. F. (2011). What forty years of research says about the impact of technology on learning a second-order meta-analysis and validation study. Review of Educational Research, 81(1), 4–28.CrossRefGoogle Scholar
  92. Trautmann, N. M., & MaKinster, J. G. (2010). Flexibly adaptive professional development in support of teaching science with geospatial technology. Journal of Science Teacher Education, 21(3), 351–370.CrossRefGoogle Scholar
  93. Uslu, O., & Bümen, N. T. (2012). Effects of the professional development program on Turkish teachers: Technology integration along with attitude towards ICT in education. The Turkish Online Journal of Educational Technology, 11(3), 115–127.Google Scholar
  94. Van Braak, J., Tondeur, J., & Valcke, M. (2004). Explaining different types of computer use among primary school teachers. European Journal of Psychology of Education, 19(4), 407–422.CrossRefGoogle Scholar
  95. Wachira, P., & Keengwe, J. (2011). Technology integration barriers: Urban school mathematics teachers perspectives. Journal of Science Education and Technology, 20(1), 17–25.CrossRefGoogle Scholar
  96. Watson, D. M. (2001). Pedagogy before technology: Re-thinking the relationship between ICT and teaching. Education and Information Technologies, 6(4), 251–266.CrossRefGoogle Scholar
  97. Wells, J. (2007). Key design factors in durable instructional technology professional development. Journal of Technology and Teacher Education, 15(1), 101–122.Google Scholar
  98. Wigfield, A. (1994). Expectancy-value theory of achievement motivation: A developmental perspective. Educational Psychology Review, 6(1), 49–78.CrossRefGoogle Scholar
  99. Wigfield, A., & Eccles, J. S. (1992). The development of achievement task values: A theoretical analysis. Developmental Review, 12(3), 265–310.CrossRefGoogle Scholar
  100. Wigfield, A., & Eccles, J. S. (2000). Expectancy—Value theory of achievement motivation. Contemporary Educational Psychology, 25(1), 68–81.CrossRefGoogle Scholar
  101. Wiley, D., Bliss, T. J., & McEwen, M. (2014). Open educational resources: A review of the literature. In J. M. Spector, M. D. Merrill, J. Elen, & M. J. Bishop (Eds.), Handbook of research on educational communications and technology (pp. 781–789). New York: Springer.CrossRefGoogle Scholar
  102. Xie, K., DeBacker, T. K., & Ferguson, C. (2006). Extending the traditional classroom through online discussion: The role of student motivation. Journal of Educational Computing Research, 34(1), 67–89.CrossRefGoogle Scholar
  103. Xie, K., Durrington, V. A., & Yen, L. L. (2011). Relationship between students’ motivation and their participation in asynchronous online discussions. Journal of Online Learning and Teaching, 7(1), 17–29.Google Scholar

Copyright information

© Association for Educational Communications and Technology 2017

Authors and Affiliations

  • Kui Xie
    • 1
  • Min Kyu Kim
    • 2
  • Sheng-Lun Cheng
    • 1
  • Nicole C. Luthy
    • 1
  1. 1.Department of Educational Studies, College of Education and Human EcologyThe Ohio State UniversityColumbusUSA
  2. 2.Georgia State UniversityAtlantaUSA

Personalised recommendations