Journal of Computing in Higher Education

, Volume 30, Issue 1, pp 3–33 | Cite as

Development and validation of the educational technologist competencies survey (ETCS): knowledge, skills, and abilities

  • Albert D. Ritzhaupt
  • Florence Martin
  • Raymond Pastore
  • Youngju Kang
Article

Abstract

The purpose of this research was to identify the competencies of educational technologists by surveying the professionals within the field. The Educational Technology Competency Survey (ETCS) developed in this research was based on a conceptual framework that emphases the definition of educational technology and associated knowledge, skill, and ability statements (KSAs). Using the conceptual framework, the study was executed in four phases: (1) an extant review of relevant literature related to competencies of educational technology professionals, (2) job announcement analysis of 400 postings from five relevant databases, (3) extraction and merging of the KSA statements from the job announcements and relevant literature, (4) administration of the survey on a wide-variety of educational technology professionals (N = 219). One hundred seventy-six KSA competencies were derived from the process and organized into KSA statements. The data was analyzed using descriptive statistics, exploratory factor analysis, internal consistency reliability, and multivariate analysis of variance. The findings demonstrate key competencies such as instructional design, project management, learning theories, working in teams with diverse stakeholders, and twenty-first-century proficiencies. Discussion and recommendations for future research and practice are provided. The ETCS was found to be a valid and reliable measurement system for these data.

Keywords

Educational technology KSA Instrument Validation Competencies Professionals 

Notes

Compliance with ethical standards

Conflict of interest

The authors declare that they have no conflict of interest.

References

  1. Arrindell, W. A., & Van der Ende, J. (1985). Cross-sample invariance of the structure of self-reported distress and difficulty in assertiveness. Advances in Behavior Research and Therapy, 7, 205–243.CrossRefGoogle Scholar
  2. ATD (2017). Association for Talent Development. Available at: https://www.td.org/.
  3. Brill, J. M., Bishop, M. J., & Walker, A. E. (2006). The competencies and characteristics required of an effective project manager: A web-based Delphi study. Educational Technology Research and Development, 54(2), 115–140.CrossRefGoogle Scholar
  4. Daniels, L., Sugar, W., Brown, A. & Hoard, B. (2012). Educational technology professionals in higher education: Multimedia production competencies identified from a Delphi study. In P. Resta (Ed.), Proceedings of Society for Information Technology & Teacher Education International Conference 2012 (pp. 1711–1714).Google Scholar
  5. Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.CrossRefGoogle Scholar
  6. Hartley, R., Kinshuk, Koper, R., Okamoto, T., & Spector, J. M. (2010). The education and training of learning technologists: A competences approach. Educational Technology & Society, 13(2), 206–216.Google Scholar
  7. Huggins, A. C., Ritzhaupt, A. D., & Dawson, K. (2014). Measuring information and communication technology literacy using a performance assessment: Validation of the student tool for technology literacy (ST2L). Computers & Education, 77, 1–12.CrossRefGoogle Scholar
  8. IBSTPI (2017). International board of standards for training performance and instruction. Available at: http://ibstpi.org/.
  9. ISTE (2017). ISTE standards. Retrieved from https://www.iste.org/standards/standards.
  10. İzmirli, Ö. Ş., & Kurt, A. A. (2009). Basic competencies of instructional technologists. Procedia-Social and Behavioral Sciences, 1(1), 998–1002.CrossRefGoogle Scholar
  11. Januszewski, A., & Molenda, M. (2007). Educational technology: A definition with commentary. New York: Taylor & Francis Group.Google Scholar
  12. Kaiser, H. F. (1974). An index of factorial simplicity. Pschometrika, 39, 31–36.CrossRefGoogle Scholar
  13. Kang, Y., & Ritzhaupt, A. D. (2015). A job announcement analysis of educational technology professional positions: Knowledge, skills, and abilities. Journal of Educational Technology Systems, 43(3), 231–256.CrossRefGoogle Scholar
  14. Kenny, R. F., Zhang, Z., Schwier, R. A., & Campbell, K. (2008). A review of what instructional designers do: Questions answered and questions not asked. Canadian Journal of Learning and Technology, 31(1), 9–16.Google Scholar
  15. Kerlinger, F. (1974). Foundations of behavioral research. New York: Holt, Rienhart and Winston.Google Scholar
  16. Klein, J. D., & Richey, R. C. (2005). The case for international standards. Performance Improvement, 44(10), 9–14.Google Scholar
  17. Koszalka, T. A., Russ-Eft, D. F., & Reiser, R. (2013). Instructional designer competencies: The standards. Charlotte: IAP.Google Scholar
  18. Liu, M., Gibby, S., Quiros, O., & Demps, E. (2002). Challenges of being an instructional designer for new media development: A view from the practitioners. Journal of Educational Multimedia and Hypermedia, 11(3), 195–219.Google Scholar
  19. Lowenthal P., Wilson B. G., Dunlap J. C. (2010). An analysis of what instructional designers need to know and be able to do to get a job. Presented at the annual meeting of the Association for Educational Communications and Technology, Anaheim, CA, October 2010.Google Scholar
  20. Moallem, M. (1995). Analysis of job announcements and the required competencies for instructional technology professionals. ERIC document: ED405355.Google Scholar
  21. Nunnaly, J. (1978). Psychometric theory. New York: McGraw-Hill.Google Scholar
  22. Reiser, R. A., & Dempsey, J. V. (Eds.). (2012). Trends and issues in instructional design and technology. Boston: Pearson.Google Scholar
  23. Richey, R. C., Fields, D. C., Foxon, M. (with Roberts, R. C., Spannaus, T., & Spector, J. M.) (2001). Instructional design competencies: The standards (3rd ed.). Syracuse, NY: ERIC Clearinghouse on Information & Technology.Google Scholar
  24. Ritzhaupt, A. D., & Kumar, S. (2015). Knowledge and skills needed by instructional designers in higher education. Performance Improvement Quarterly, 28(3), 51–69.CrossRefGoogle Scholar
  25. Ritzhaupt, A. D., & Martin, F. (2014). Development and validation of the educational technologist multimedia competency survey. Educational Technology Research and Development, 62(1), 13–33.CrossRefGoogle Scholar
  26. Ritzhaupt, A., Martin, F., & Daniels, K. (2010). Multimedia competencies for an educational technologist: A survey of professionals and job announcement analysis. Journal of Educational Multimedia and Hypermedia, 19(4), 421–449.Google Scholar
  27. Sampson, D., & Fytros, D. (2008). Competence models in technology-enhanced competence-based learning. In Handbook on information technologies for education and training (pp. 155–177). Berlin: Springer.Google Scholar
  28. Sinnott, G. C., Madison, G. H., & Pataki, G. E. (2002). Competencies: Report of the competencies workgroup, workforce and succession planning work groups. New York: New York State Governor’s Office of Employee Relations and the Department of Civil Service.Google Scholar
  29. Spector, J. M., & de la Teja, I. (2001). Competencies for online teaching. ERIC Digest. ERIC Clearinghouse on Information and Technology. Syracuse: NY. Retrieved online from http://www.eric.ed.gov/PDFS/ED456841.pdf.
  30. Spector, J. M., Klein, J. D., Reiser, R. A., Sims, R. C., Grabowski, B. L., & Teja, I. D. L. (2006). Competencies and Standards for Instructional Design and Educational Technology. Discussion paper for ITFORUM.Google Scholar
  31. Sugar, W. (2005). Instructional technologist as a coach: Impact of a situated professional development program on teachers' technology use. Journal of Technology and Teacher Education, 13(4), 547.Google Scholar
  32. Sugar, W., Brown, A., & Daniels, L. (2009). Identifying entry-level multimedia production competencies and skills of instructional design and technology professionals: Results from the 2009–2010 biennial survey. Presented at the annual conference of the Association for Educational Communications and Technology (AECT), Louisville, KY.Google Scholar
  33. Sugar, W., Hoard, B., Brown, A., & Daniels, L. (2012). Identifying multimedia production competencies and skills of instructional design and technology professionals: An analysis of recent job postings. Journal of Educational Technology Systems, 40(3), 227–249.CrossRefGoogle Scholar
  34. Sumuer, E., Kursun, E. & Cagiltay, K. (2006). Current major competencies for instructional design and technology professionals. In E. Pearson, & P. Bohman (Eds.), Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2006 (pp. 1617–1622).Google Scholar
  35. Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks: Sage.Google Scholar
  36. Tennyson, R. D. (2001). Defining core competencies of an instructional technologist. Computers in Human Behavior, 17, 355–361.CrossRefGoogle Scholar
  37. Wakefield, J., Warren, S. & Mills, L. (2012). Traits, skills, & competencies aligned with workplace demands: What today’s instructional designers need to master. In P. Resta (Ed.), Proceedings of Society for Information Technology & Teacher Education International Conference 2012 (pp. 3126–3132).Google Scholar
  38. Wang, N., Schnipke, D., & Witt, E. A. (2005). Use of knowledge, skill, and ability statements in developing licensure and certification examinations. Educational Measurement: Issues and Practice, 24(1), 15–22.CrossRefGoogle Scholar
  39. Williams Van Rooij, S. (2010). Project management in instructional design: ADDIE is not enough. British Journal of Educational Technology, 41(5), 852–864.CrossRefGoogle Scholar
  40. Williams Van Rooij, S. (2011). Instructional design and project management: complementary or divergent? Educational Technology Research and Development, 59(1), 139–158.CrossRefGoogle Scholar
  41. Williams van Rooij, S. (2013). The career path to instructional design project management: An expert perspective from the US professional services sector. International Journal of Training and Development, 17(1), 33–53.CrossRefGoogle Scholar
  42. Zepeda, S. J. (2014). Job-embedded professional development: Support, collaboration, and learning in schools. New York: Routledge.Google Scholar

Copyright information

© Springer Science+Business Media, LLC, part of Springer Nature 2018

Authors and Affiliations

  • Albert D. Ritzhaupt
    • 1
  • Florence Martin
    • 2
  • Raymond Pastore
    • 3
  • Youngju Kang
    • 4
  1. 1.School of Teaching and Learning, College of EducationUniversity of FloridaGainesvilleUSA
  2. 2.University of North Carolina at CharlotteCharlotteUSA
  3. 3.University of North Carolina WilmingtonWilmingtonUSA
  4. 4.University of FloridaGainesvilleUSA

Personalised recommendations