Abstract
University students have to master new competences to be able to completely form part of Knowledge Society, which are known as 21st-century competences. These include high-skill competences (higher-order thinking capacities and teamwork competences) and information and communication technologies (ICT) competences (technological, pedagogical and ethical). Moreover, using technological resources is vital for student learning. This study aims to determine the influence of ICT use (personal use, academic use at home and academic use in the classroom) on the relational asymmetric structure of ICT competences on high-skill competences. For this purpose, an explanatory, cross-sectional and correlational design has been made that collected information through a questionnaire from a sample that comprised 983 students from the University of Valencia (Spain), selected by incidental non-probability sampling. The data analysis was a structural equation model that asymmetrically related three sets: ICT use, ICT competences and high-skill competences. The results indicated that ICT competences, mostly the pedagogical competences, impacted on high-skill competences: higher-order thinking capacities and teamwork competences. Academic use at home directly influenced the three ICT competences subsets and teamwork competences. This work stresses the negative relation of academic ICT use in the classroom with ICT competences, higher-order thinking capacities and teamwork competences. This research makes it possible to delimit the complex influence of ICT use on twenty-first-century competences, being necessary to promote the academic ICT use at home and rethink the academic ICT use in the classroom. This implies that university institutions should consider training plans that include the ICT integration into classrooms.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
Availability of data and materials
According to the oral and written agreement submitted and agreed with the research participants, the data cannot be made available to third parties.
References
Alderete, M. V., Di Meglio, G., & Formichella, M. M. (2017). ICT access and educational performance:¿a relationship enhanced by ICT use? An analysis for Spain. Revista de Educación, 377, 54–81. https://doi.org/10.4438/1988-592X-RE-2017-377-353.
Alexander, B., Adams Becker, S., & Cummins, M. (2016). Digital Literacy: An NMC Horizon Project Strategic Brief. Volume 3.3, October 2016. Austin, Texas: The New Media Consortium.
Alexander, B., Ashford-Rowe, K., Barajas-Murphy, N., Dobbin, G., Knott, J., McCormack, M., et al. (2019). EDUCAUSE horizon report: 2019 higher education edition. Louisville: EDUCAUSE.
Almerich, G., Orellana, N., Suárez-Rodríguez, J., & Díaz-García, I. (2016). Teachers’ information and communication technology competences: A structural approach. Computers & Education, 100, 110–125. https://doi.org/10.1016/j.compedu.2016.05.002.
Almerich, G., Díaz-García, I., Cebrián-Cifuentes, S., & Suárez-Rodríguez, J. M. (2018). Dimensional structure of 21st century competences in university students of education. RELIEVE, 24(1), art. 5. https://doi.org/10.7203/relieve.24.1.12548.
Almerich, G., Suárez-Rodríguez, J., Díaz-García, I., & Orellana, N. (2020a). Estructura de las competencias del siglo XXI en alumnado del ámbito educativo. Factores personales influyentes. Educación XX1, 23(1), 45–74. https://doi.org/10.5944/educXX1.23853.
Almerich, G., Suárez-Rodríguez, J., Díaz-García, I., & Cebrián-Cifuentes, S. (2020b). 21st-century competences: The relation of ICT competences with higher-order thinking capacities and teamwork competences in university students. Journal of Computer Assisted Learning, 36(4), 468–479. https://doi.org/10.1111/jcal.12413.
Ananiadou, K., & Claro, M. (2009). 21st century skills and competences for new millennium learners in OECD countries. Organisation for economic cooperation and development. EDU working paper no. 41. Retrieved from http://www.olis.oecd.org/olis/2009doc.nsf/linkto/edu-wkp(2009)20.
Arras, A. M. D. G., Torres, C. A., & García-Valcárcel, A. (2011). Competencias en Tecnologías de Información y Comunicación (TIC) de los estudiantes universitarios. Revista Latina de Comunicación Social, 66, 130–152 Retrieved from http://www.revistalatinacs.org/11/art/927_Mexico/06_Arras.html.
Association of American Colleges & Universities (2016). Trends in learning outcomes assessment. Key Findings from a Survey among Administrators at AAC&U Member Institutions. Washington D.C.: Retrieved from https://eric.ed.gov/?q=source%3a%22Association+of+American+Colleges+and+Universities%22&ff1=subDeans&id=ED582021Association of American Colleges & Universities.
Bandalos, D. L., & Finney, S. J. (2018). Factor analysis: Exploratory and confirmatory. In G. R. Hancock, L. M. Stapleton, & R. O. Mueller (Eds.), The reviewer’s guide to quantitative methods in the social sciences (Second edition, pp. 98–122). Nueva York: Routledge.
Binkley, M., Erstad, O., Hermna, J., Raizen, S., Ripley, M., Miller-Ricci, M., & Rumble, M. (2012). Defining 21st century skills. In P. E. Griffin, B. McGaw, & E. Care (Eds.), Assessment and teaching of 21st century skills (pp. 17–66). Dordrecht: Springer.
Bundsgaard, J., & Gerick, J. (2017). Patterns of students’ computer use and relations to their computer and information literacy: Results of a latent class analysis and implications for teaching and learning. Large-scale Assessments in Education, 5, 16. https://doi.org/10.1186/s40536-017-0052-8.
Cebrián-Cifuentes, S., Almerich, G., Suárez-Rodríguez, J., & Pedró, F. (2021). Incidencia de factores personales y contextuales sobre el uso de los recursos tecnológicos por el alumnado en América Latina. Archivos Analíticos de Políticas Educativas, 29(6). https://doi.org/10.14507/epaa.29.5127.
Cohen, J., Cohen, P., West, S. G., & Aiken, L. S. (2003). Applied multiple regression/correlation analysis for the behavioral sciences. London: Routledge.
Corrin, L., Lockyer, L., & Bennett, S. (2010). Technological diversity: An investigation of students’ technology use in everyday life and academic study. Learning, Media and Technology, 35(4), 387–401. https://doi.org/10.1080/17439884.2010.531024.
Díaz-García, I., Cebrián-Cifuentes, S., & Fuster-Palacios, I. (2016). ICT competences of university students in the education field and their relation with learning strategies. RELIEVE, 22(1). art., 5 http://doi.org/0.7203/relieve.22.1.8159.
Díaz-García, I., Almerich, G., Suárez-Rodríguez, J., & Orellana, N. (2020). La relación entre las competencias TIC, el uso de las TIC y los enfoques de aprendizaje en alumnado universitario de educación. Revista de Investigación Educativa, 38(2), 549–566. https://doi.org/10.6018/rie.409371.
Erstad, O., & Voogt, J. (2018). The twenty-first century curriculum: Issues and challenges. In J. Voogt, G. Knezek, R. Christensen, & K. W. Lai (Eds.), Second handbook of information Technology in Primary and Secondary Education (pp. 19–36). Cham: Springer.
European Commission. (2017). Communication from the commission to the European Parliament, the council, the European economic and social committee and the Committee of the Regions on a renewed EU agenda for higher education. Brussels: European Commission Retrieved from https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=CELEX:52017DC0247&from=EN.
European Commission. (2019). 2nd survey of schools: ICT in education. In Objective 1: Benchmark progress in ICT in schools. Luxembourg: Publications Office of the European Union Retrieved from https://ec.europa.eu/newsroom/dae/document.cfm?doc_id=57894.
Fraillon, J., Ainley, J., Schulz, W., Duckworth, D., & Friedman, T. (2019). International computer and information literacy study 2018: Assessment framework. Amsterdam: IEA-Springer.
Fraillon, J., Ainley, J., Schulz, W., Friedman, T., & Duckworth, D. (2020). Preparing for life in a digital world: IEA international computer and information literacy study 2018 international report. Amsterdam: IEA-Springer.
Fullan, M., Quinn, J., & McEachen, J. (2018). Deep learning. Engage the world change the world. Thousand Oaks, CA: Corwin.
Gargallo, B., Suárez-Rodríguez, J. M., Almerich, G., Verde, I., & i Iranzo, M. À. C. (2018). The dimensional validation of the Student Engagement Questionnaire (SEQ) with a Spanish university population. Students’ capabilities and the teaching-learning environment. Anales de Psicologia, 34(3), 519–530. https://doi.org/10.6018/analesps.34.3.299041.
González-González, I., & Jiménez-Zarco, A. I. (2015). Using learning methodologies and resources in the development of critical thinking competency: An exploratory study in a virtual learning environment. Computers in Human Behavior, 51, 1359–1366. https://doi.org/10.1016/j.chb.2014.11.002.
Hair, J. F., Black, W. C., Babin, B. J., & Anderson, R. E. (2010). Multivariate Data Analysis (Seventh edition). Prentice Hall: Upper Saddle River.
Hatlevik, O. E., Ottestad, G., & Throndsen, I. (2015). Predictors of digital competence in 7th grade: A multilevel analysis. Journal of Computer Assisted Learning, 31(3), 220–231. https://doi.org/10.1111/jcal.12065.
Hinostroza, J. E. (2017). ICT, education and social development in Latin America and the Caribbean. Montevideo: UNESCO Retrieved from https://unesdoc.unesco.org/ark:/48223/pf0000262862_eng.
International Society for Technology in Education (ISTE) (2016). ISTE Standards for Students. Retrieved from http://www.iste.org/standards/standards
Karakoyun, F., & Lindberg, O. J. (2020). Preservice teachers’ views about the twenty-first century skills: A qualitative survey study in Turkey and Sweden. Education and Information Technologies, 25(4), 2353–2369. https://doi.org/10.1007/s10639-020-10148-w.
Karamti, C. (2016). Measuring the impact of ICTs on academic performance: Evidence from higher education in Tunisia. Journal of Research on Technology in Education, 48(4), 322–337. https://doi.org/10.1080/15391523.2016.1215176.
Kember, D., & Leung, D. (2005). The influence of the teaching and learning environment on the development of generic capabilities needed for a knowledge-based society. Learning Environments Research, 8, 245–266. https://doi.org/10.1007/s10984-005-1566-5.
Kember, D., & Leung, D. (2009). Development of a questionnaire for assessing students’ perceptions of the teaching and learning environment and its use in quality assurance. Learning Environments Research, 12, 15–29. https://doi.org/10.1007/s10984-008-9050-7.
Kember, D., Leung, D. & Ma, R. (2007). Characterizing learning environments capable of nurturing generic capabilities in higher education. Research in Higher Education, 2, 48(5), 609-632. Doi: https://doi.org/10.1007/s11162-006-9037-0.
Kim, H. J., Yi, P., & Hong, J. I. (2020). Students’ academic use of Mobile technology and higher-order thinking skills: The role of active engagement. Education Sciences, 10(3), 47. https://doi.org/10.3390/educsci10030047.
Kline, R. B. (2015). Principles and practice of structural equation modeling (Fourth ed.). NY: Guilford Press.
Kuh, G. D., & Vesper, N. (2001). Do computers enhance or detract from student learning? Research in Higher Education, 42(1), 87–102. https://doi.org/10.1023/A:1018768612002.
Liu, Q., Geertshuis, S., & Grainger, R. (2020). Understanding academics' adoption of learning technologies: A systematic review. Computers & Education, 151, 103857. https://doi.org/10.1016/j.compedu.2020.103857.
Matamala, C., & Hinostroza, J. E. (2020). Factores relacionados con el uso académico de Internet en educación superior. Pensamiento Educativo, 57(1), 1–19. https://doi.org/10.7764/PEL.57.1.2020.7.
Maurer, M., Schemer, C., Zlatkin-Troitschanskaia, O., & Jitomirski, J. (2019). Positive and negative media effects on university students’ learning: Preliminary findings and a research program. In O. Zlatkin-Troitschanskaia (Ed.), Frontiers and Advances in Positive Learning in the Age of InformaTiOn (PLATO) (pp. 109–119). Cham: Springer.
McMahon, G. (2009). Critical thinking and ICT integration in a Western Australian secondary school. Journal of Educational Technology y Society, 12(4), 269–281.
McMillan, J. H., & Schumacher, S. (2010). Research in education: Evidence-based inquiry 7th ed. Boston: Pearson.
National Research Council. (2012). Education for life and work: Developing transferable knowledge and skills in the 21st century. Washington, DC: The National Academies Press.
OECD. (2015). Students, computers and learning: Making the connection. Paris: OECD.
OECD. (2019). OECD Future of Education and Skills 2030. OECD learning compass 2030. Paris: OECD Retrieved from https://www.oecd.org/education/2030-project/contact/OECD_Learning_Compass_2030_Concept_Note_Series.pdf.
Olszewski, B., & Crompton, H. (2020). Educational technology conditions to support the development of digital age skills. Computers & Education, 150, article 103849. https://doi.org/10.1016/j.compedu.2020.103849.
P21 (2019). Framework for 21st century learning definitions. Partnership for 21st Century Skills. Retrieved from http://static.battelleforkids.org/documents/p21/P21_Framework_DefinitionsBFK.pdf.
Perera, U., & Gardner, L. (2018). Analysing the relationships between digital literacy and self-regulated learning of undergraduates -a preliminary investigation. In N. Paspallis, M. Raspopoulos, C. Barry, M. Lang, H. Linger, & C. Schneider (Eds.), Advances in information systems development: methods, tools and management, (pp. 1-16). Charm: Springer.
Rohatgi, A., Scherer, R., & Hatlevik, O. E. (2016). The role of ICT self-efficacy for students' ICT use and their achievement in a computer and information literacy test. Computers & Education, 102, 103–116. https://doi.org/10.1016/j.compedu.2016.08.001.
Sang, G., Liang, J. C., Chai, C. S., Dong, Y., & Tsai, C. C. (2018). Teachers’ actual and preferred perceptions of twenty-first century learning competencies: A Chinese perspective. Asia Pacific Education Review, 19(3), 307–317. https://doi.org/10.1007/s12564-018-9522-0.
Schmidt, S., Zlatkin-Troitschanskaia, O., Roeper, J., Klose, V., Weber, M., Bültmann, A. K., & Brückner, S. (2020). Undergraduate students’ critical online reasoning—Process mining analysis. Frontiers in Psychology, 11, 3301. https://doi.org/10.3389/fpsyg.2020.576273.
Shavelson, R. J., Zlatkin-Troitschanskaia, O., Beck, K., Schmidt, S., & Marino, J. P. (2019). Assessment of university students’ critical thinking: Next generation performance assessment. International Journal of Testing, 19(4), 337–362. https://doi.org/10.1080/15305058.2018.1543309.
Strayhorn, T. L. (2006). College in the information age: Gains associated with students’ use of technology. Journal of Interactive Online Learning, 5(2), 143–155.
Strømsø, H. I., & Bråten, I. (2010). The role of personal epistemology in the self-regulation of internet-based learning. Metacognition and Learning, 5(1), 91–111. https://doi.org/10.1007/s11409-009-9043-7.
Suárez-Rodríguez, J. M., Almerich, G., Orellana, N., & Díaz-García, I. (2016). Innovatic protocol. Unpublished document.
Suárez-Rodríguez, J., Almerich, G., Orellana, N., & Díaz-García, I. (2018). A basic model of integration of ICT by teachers: competence and use. Educational Technology Research and Development, 66(5), 1165–1187. https://doi.org/10.1007/s11423-018-9591-0.
Tan, J. P. L., Choo, S. S., Kang, T., & Liem, G. A. D. (2017). Educating for twenty-first century competencies and future-ready learners: Research perspectives from Singapore. Asia Pacific Journal of Education, 37(4), 425–436. https://doi.org/10.1080/02188791.2017.1405475.
Tien, F. F., & Fu, T. T. (2008). The correlates of the digital divide and their impact on college student learning. Computers & Education, 50(1), 421–436. https://doi.org/10.1016/j.compedu.2006.07.005.
Torres-Gastelú, C. A., & Kiss, G. (2016). Perceptions of students towards ICT competencies at the university. Informatics in Education, 15(2), 319–338. https://doi.org/10.15388/infedu.2016.16.
U.S. Department of Education, Office of Educational Technology. (2017). Reimagining the role of Technology in Higher Education: A supplement to the National Education Technology Plan. Washington, D.C.: Office of Educational Technology Retrieved from https://tech.ed.gov/files/2017/01/Higher-Ed-NETP.pdf.
UNESCO. (2015). Rethinking education. In Towards a global common good? Paris: UNESCO.
University Libraries Network (REBIUN) (2016). Marco de competencia digital para estudiantes de grado. CRUE- REBIUN. Retrieved from http://www.rebiun.org/competenciadigital/Documents/Propuesta_adaptacion_competenciadigital_estudiante_grado_0916.pdf.
Valtonen, T., Sointu, E. T., Kukkonen, J., Häkkinen, P., Järvelä, S., Ahonen, A., Näykki, P., Pöysä-Tarhonen, J., & Mäkitalo-Siegl, K. (2017). Insights into Finnish first-year pre-service teachers’ twenty-first century skills. Education and Information Technologies, 22(5), 2055–2069. https://doi.org/10.1007/s10639-016-9529-2.
Van Braak, J. P. (2004). Domains and determinants of university students’ self-perceived computer competence. Computers & Education, 43(3), 299–312. https://doi.org/10.1016/j.compedu.2003.09.006.
van Laar, E., van Deursen, A. J., van Dijk, J. A., & de Haan, J. (2020). Determinants of 21st-century skills and 21st-century digital skills for workers: A systematic literature review. SAGE Open, 10(1), 1–14. https://doi.org/10.1177/2158244019900176.
Vega-Hernández, M. C., Patino-Alonso, M. C., & Galindo-Villardón, M. P. (2018). Multivariate characterization of university students using the ICT for learning. Computers & Education, 121, 124–130. https://doi.org/10.1016/j.compedu.2018.03.004.
Venkatesh, V., Rabah, J., Fusaro, M., Couture, A., Varela, W., & Alexander, K. (2016). Factors impacting university instructors and students’ perceptions of course effectiveness and technology integration in the age of web 2.0. McGill Journal of Education, 51(1), 533–561. https://doi.org/10.7202/1037358ar.
Verhoeven, J. C., Heerwegh, D., & De Wit, K. (2016). ICT learning experience and research orientation as predictors of ICT skills and the ICT use of university students. Education and Information Technologies, 21(1), 71–103. https://doi.org/10.1007/s10639-014-9310-3.
Voogt, J., & Erstad, O. (2018). Section introduction: Curricular challenges of the twenty-first century. In J. Voogt, G. Knezek, R. Christensen, & K. W. Lai (Eds.), Second handbook of information Technology in Primary and Secondary Education (pp. 15–18). Cham: Springer.
Voogt, J., & Pareja-Roblin, N. (2012). A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. Journal of Curriculum Studies, 44(3), 299–321. https://doi.org/10.1080/00220272.2012.668938.
World Economic Forum. (2015). New vision for education: Unlocking the potential of technology. Ginebra: World Economic Forum Retrieved from http://www3.weforum.org/docs/WEFUSA_NewVisionforEducation_Report2015.pdf.
Author information
Authors and Affiliations
Contributions
The authors confirm that names appear on the submission have contributed sufficiently to the scientific work (conception, design of the work, analysis and interpretation of data) and therefore share collective responsibility and accountability for the results. The authors confirm that the manuscript has been read and approved by all named authors.
Corresponding author
Ethics declarations
Conflicts of interest/competing interests
The authors declare that they have no conflict of interest.
Additional information
Publisher’s note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
About this article
Cite this article
Almerich, G., Suárez-Rodríguez, J., Díaz-García, I. et al. The influence of using ICT in high-skills competences and ICT competences. A structural model. Educ Inf Technol 26, 3845–3869 (2021). https://doi.org/10.1007/s10639-021-10437-y
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10639-021-10437-y