Development and validation of the educational technologist competencies survey (ETCS): knowledge, skills, and abilities
Abstract
The purpose of this research was to identify the competencies of educational technologists by surveying the professionals within the field. The Educational Technology Competency Survey (ETCS) developed in this research was based on a conceptual framework that emphases the definition of educational technology and associated knowledge, skill, and ability statements (KSAs). Using the conceptual framework, the study was executed in four phases: (1) an extant review of relevant literature related to competencies of educational technology professionals, (2) job announcement analysis of 400 postings from five relevant databases, (3) extraction and merging of the KSA statements from the job announcements and relevant literature, (4) administration of the survey on a wide-variety of educational technology professionals (N = 219). One hundred seventy-six KSA competencies were derived from the process and organized into KSA statements. The data was analyzed using descriptive statistics, exploratory factor analysis, internal consistency reliability, and multivariate analysis of variance. The findings demonstrate key competencies such as instructional design, project management, learning theories, working in teams with diverse stakeholders, and twenty-first-century proficiencies. Discussion and recommendations for future research and practice are provided. The ETCS was found to be a valid and reliable measurement system for these data.
Keywords
Educational technology KSA Instrument Validation Competencies ProfessionalsNotes
Compliance with ethical standards
Conflict of interest
The authors declare that they have no conflict of interest.
References
- Arrindell, W. A., & Van der Ende, J. (1985). Cross-sample invariance of the structure of self-reported distress and difficulty in assertiveness. Advances in Behavior Research and Therapy, 7, 205–243.CrossRefGoogle Scholar
- ATD (2017). Association for Talent Development. Available at: https://www.td.org/.
- Brill, J. M., Bishop, M. J., & Walker, A. E. (2006). The competencies and characteristics required of an effective project manager: A web-based Delphi study. Educational Technology Research and Development, 54(2), 115–140.CrossRefGoogle Scholar
- Daniels, L., Sugar, W., Brown, A. & Hoard, B. (2012). Educational technology professionals in higher education: Multimedia production competencies identified from a Delphi study. In P. Resta (Ed.), Proceedings of Society for Information Technology & Teacher Education International Conference 2012 (pp. 1711–1714).Google Scholar
- Guadagnoli, E., & Velicer, W. F. (1988). Relation of sample size to the stability of component patterns. Psychological Bulletin, 103, 265–275.CrossRefGoogle Scholar
- Hartley, R., Kinshuk, Koper, R., Okamoto, T., & Spector, J. M. (2010). The education and training of learning technologists: A competences approach. Educational Technology & Society, 13(2), 206–216.Google Scholar
- Huggins, A. C., Ritzhaupt, A. D., & Dawson, K. (2014). Measuring information and communication technology literacy using a performance assessment: Validation of the student tool for technology literacy (ST2L). Computers & Education, 77, 1–12.CrossRefGoogle Scholar
- IBSTPI (2017). International board of standards for training performance and instruction. Available at: http://ibstpi.org/.
- ISTE (2017). ISTE standards. Retrieved from https://www.iste.org/standards/standards.
- İzmirli, Ö. Ş., & Kurt, A. A. (2009). Basic competencies of instructional technologists. Procedia-Social and Behavioral Sciences, 1(1), 998–1002.CrossRefGoogle Scholar
- Januszewski, A., & Molenda, M. (2007). Educational technology: A definition with commentary. New York: Taylor & Francis Group.Google Scholar
- Kaiser, H. F. (1974). An index of factorial simplicity. Pschometrika, 39, 31–36.CrossRefGoogle Scholar
- Kang, Y., & Ritzhaupt, A. D. (2015). A job announcement analysis of educational technology professional positions: Knowledge, skills, and abilities. Journal of Educational Technology Systems, 43(3), 231–256.CrossRefGoogle Scholar
- Kenny, R. F., Zhang, Z., Schwier, R. A., & Campbell, K. (2008). A review of what instructional designers do: Questions answered and questions not asked. Canadian Journal of Learning and Technology, 31(1), 9–16.Google Scholar
- Kerlinger, F. (1974). Foundations of behavioral research. New York: Holt, Rienhart and Winston.Google Scholar
- Klein, J. D., & Richey, R. C. (2005). The case for international standards. Performance Improvement, 44(10), 9–14.Google Scholar
- Koszalka, T. A., Russ-Eft, D. F., & Reiser, R. (2013). Instructional designer competencies: The standards. Charlotte: IAP.Google Scholar
- Liu, M., Gibby, S., Quiros, O., & Demps, E. (2002). Challenges of being an instructional designer for new media development: A view from the practitioners. Journal of Educational Multimedia and Hypermedia, 11(3), 195–219.Google Scholar
- Lowenthal P., Wilson B. G., Dunlap J. C. (2010). An analysis of what instructional designers need to know and be able to do to get a job. Presented at the annual meeting of the Association for Educational Communications and Technology, Anaheim, CA, October 2010.Google Scholar
- Moallem, M. (1995). Analysis of job announcements and the required competencies for instructional technology professionals. ERIC document: ED405355.Google Scholar
- Nunnaly, J. (1978). Psychometric theory. New York: McGraw-Hill.Google Scholar
- Reiser, R. A., & Dempsey, J. V. (Eds.). (2012). Trends and issues in instructional design and technology. Boston: Pearson.Google Scholar
- Richey, R. C., Fields, D. C., Foxon, M. (with Roberts, R. C., Spannaus, T., & Spector, J. M.) (2001). Instructional design competencies: The standards (3rd ed.). Syracuse, NY: ERIC Clearinghouse on Information & Technology.Google Scholar
- Ritzhaupt, A. D., & Kumar, S. (2015). Knowledge and skills needed by instructional designers in higher education. Performance Improvement Quarterly, 28(3), 51–69.CrossRefGoogle Scholar
- Ritzhaupt, A. D., & Martin, F. (2014). Development and validation of the educational technologist multimedia competency survey. Educational Technology Research and Development, 62(1), 13–33.CrossRefGoogle Scholar
- Ritzhaupt, A., Martin, F., & Daniels, K. (2010). Multimedia competencies for an educational technologist: A survey of professionals and job announcement analysis. Journal of Educational Multimedia and Hypermedia, 19(4), 421–449.Google Scholar
- Sampson, D., & Fytros, D. (2008). Competence models in technology-enhanced competence-based learning. In Handbook on information technologies for education and training (pp. 155–177). Berlin: Springer.Google Scholar
- Sinnott, G. C., Madison, G. H., & Pataki, G. E. (2002). Competencies: Report of the competencies workgroup, workforce and succession planning work groups. New York: New York State Governor’s Office of Employee Relations and the Department of Civil Service.Google Scholar
- Spector, J. M., & de la Teja, I. (2001). Competencies for online teaching. ERIC Digest. ERIC Clearinghouse on Information and Technology. Syracuse: NY. Retrieved online from http://www.eric.ed.gov/PDFS/ED456841.pdf.
- Spector, J. M., Klein, J. D., Reiser, R. A., Sims, R. C., Grabowski, B. L., & Teja, I. D. L. (2006). Competencies and Standards for Instructional Design and Educational Technology. Discussion paper for ITFORUM.Google Scholar
- Sugar, W. (2005). Instructional technologist as a coach: Impact of a situated professional development program on teachers' technology use. Journal of Technology and Teacher Education, 13(4), 547.Google Scholar
- Sugar, W., Brown, A., & Daniels, L. (2009). Identifying entry-level multimedia production competencies and skills of instructional design and technology professionals: Results from the 2009–2010 biennial survey. Presented at the annual conference of the Association for Educational Communications and Technology (AECT), Louisville, KY.Google Scholar
- Sugar, W., Hoard, B., Brown, A., & Daniels, L. (2012). Identifying multimedia production competencies and skills of instructional design and technology professionals: An analysis of recent job postings. Journal of Educational Technology Systems, 40(3), 227–249.CrossRefGoogle Scholar
- Sumuer, E., Kursun, E. & Cagiltay, K. (2006). Current major competencies for instructional design and technology professionals. In E. Pearson, & P. Bohman (Eds.), Proceedings of World Conference on Educational Multimedia, Hypermedia and Telecommunications 2006 (pp. 1617–1622).Google Scholar
- Tashakkori, A., & Teddlie, C. (1998). Mixed methodology: Combining qualitative and quantitative approaches. Thousand Oaks: Sage.Google Scholar
- Tennyson, R. D. (2001). Defining core competencies of an instructional technologist. Computers in Human Behavior, 17, 355–361.CrossRefGoogle Scholar
- Wakefield, J., Warren, S. & Mills, L. (2012). Traits, skills, & competencies aligned with workplace demands: What today’s instructional designers need to master. In P. Resta (Ed.), Proceedings of Society for Information Technology & Teacher Education International Conference 2012 (pp. 3126–3132).Google Scholar
- Wang, N., Schnipke, D., & Witt, E. A. (2005). Use of knowledge, skill, and ability statements in developing licensure and certification examinations. Educational Measurement: Issues and Practice, 24(1), 15–22.CrossRefGoogle Scholar
- Williams Van Rooij, S. (2010). Project management in instructional design: ADDIE is not enough. British Journal of Educational Technology, 41(5), 852–864.CrossRefGoogle Scholar
- Williams Van Rooij, S. (2011). Instructional design and project management: complementary or divergent? Educational Technology Research and Development, 59(1), 139–158.CrossRefGoogle Scholar
- Williams van Rooij, S. (2013). The career path to instructional design project management: An expert perspective from the US professional services sector. International Journal of Training and Development, 17(1), 33–53.CrossRefGoogle Scholar
- Zepeda, S. J. (2014). Job-embedded professional development: Support, collaboration, and learning in schools. New York: Routledge.Google Scholar