Skip to main content
Springer Nature Link
Log in

DigComp-Based Digital competence Assessment Tools: Literature Review and Instrument Analysis

  • Published:
Education and Information Technologies Aims and scope Submit manuscript

Abstract

The purpose of this article is to compare digital competence assessment instruments based on DigComp related frameworks. The study aims to answer four questions: (a) What types of instruments based on these frameworks are available? (b) How were these instruments created from these frameworks? (c) What procedures were used to guarantee the validity and reliability of these instruments? (d) In what ways are the data collected by these instruments analyzed and used? The theoretical background is the discussion on digital competences developed by the European Union in the last decade, including several frameworks. A scoping literature review was conducted in Capes Journal Portal, DOAJ, EBSCO, Scopus, Web of Science, and Google Scholar. The initial search returned 327 texts, to which selection criteria were applied, resulting in ten articles that explore six instruments. All the instruments have a section to characterize the respondents’ profiles. Some have other sections to evaluate access, frequency, contributions, and pedagogical practices related to digital technologies. The instruments are questionnaires with different designs and items, mainly self-assessment statements and closed-ended questions. The questionnaires are based on the areas and competences described by DigComp and DigCompEdu frameworks. Few procedures to guarantee the validity and reliability of the questionnaires were identified. The instruments are adopted to profile the use of technologies by students and teachers and assess their digital and professional competences. One of the main contributions of this article is the proposal of a typology for the design and items that can be used in questionnaires to assess digital competences.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Subscribe and save

Springer+ Basic
€32.70 /Month
  • Get 10 units per month
  • Download Article/Chapter or eBook
  • 1 Unit = 1 Article or 1 Chapter
  • Cancel anytime
Subscribe now

Buy Now

Price includes VAT (Finland)

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

Explore related subjects

Discover the latest articles, news and stories from top researchers in related subjects.

References

  • Bacigalupo, M., Kampylis, P., Punie, Y., & Van den Brande, G. (2016). EntreComp: The entrepreneurship competence framework. Publication Office of the European Union. https://doi.org/10.2791/593884. EUR 27939 EN

  • Bartolomé, J., de Soria, I. M., Jakobsone, M., Fernández, A., Ruseva, G., Koutoudis, P. … Vaquero, M. (2018). Developing a digital competence assessment and accreditation platform for digital profiles. In L. Gómez Chova, A. López Martínez, & I. Candel Torres (Eds.), Proceedings of the 12th International Technology, Education and Development Conference (INTED) (pp. 4552–4559). International Academy of Technology, Education and Development (IATED). https://doi.org/10.21125/inted.2018

  • Brečko, B., & Ferrari, A. (2016). The Digital Competence Framework for Consumers. Publications Office of the European Union. Edited by R. Vuorikari & Y. Punie. Joint Research Centre (JRC) Science for Policy Report. EUR 28133 EN. doi:https://doi.org/10.2791/838886

  • Cabero-Almenara, J., Barroso-Osuna, J., Rodríguez, A. P., & Llorente-Cejudo, C. (2020). Marcos de Competencias Digitales para docentes universitarios: su evaluación a través del coeficiente competencia experta. Revista Electrónica Interuniversitaria de Formación del Profesorado, 23(2), 1–18. https://doi.org/10.6018/reifop.413601

    Article  Google Scholar 

  • Caena, F., & Redecker, C. (2019). Aligning teacher competence frameworks to 21st century challenges: The case for the European Digital Competence Framework for Educators (Digcompedu). European Journal of Education, 54(3), 356–369. https://doi.org/10.1111/ejed.12345

    Article  Google Scholar 

  • Carretero, S., Vuorikari, R., & Punie, Y. (2017). DigComp 2.1: The Digital Competence Framework for Citizens with eight proficiency levels and examples of use. Publications Office of the European Union. EUR 28558 EN. https://doi.org/10.2760/38842

  • Calatayud, V. G., García, M. R., & Espinosa, M. P. P. (2018). Formación en competencias digitales para estudiantes universitarios basada en el modelo DigComp. Edutec. Revista Electrónica de Tecnología Educativa, 65, 1–15. https://doi.org/10.21556/edutec.2018.65.1119

    Article  Google Scholar 

  • Creswell, J. W., & Clark, V. L. P. (2018). Designing and conducting mixed methods research (3rd ed.). Sage Publications, Inc.

  • Creswell, J. W., & Creswell, J. D. (2018). Research design: qualitative, quantitative, and mixed methods approaches (5th ed.). Sage Publications, Inc.

  • European Commission (2021a). CheckIn tool. https://ec.europa.eu/jrc/en/digcompedu/self-reflection/checkIn

  • European Commission (2021b). SELFIE. https://ec.europa.eu/education/schools-go-digital_en

  • European Commission (n.d.). DigCompEduSAT. https://ec.europa.eu/eusurvey/runner/DigCompEdu_SAT_EN (this survey has been unpublished)

  • Evangelinos, G. (2018). Appendix 14 - TOOL_02 Questionnaire DigCompv1 Student. In G. Evangelinos, Digital competence in health education (DCiHE): A transferrable framework for curriculum development (Doctoral dissertation, Anglia Ruskin University). https://arro.anglia.ac.uk/id/eprint/704513/1/Evangelinos_2018.pdf

  • Evangelinos, G., & Holley, D. (Eds.). (2016a). Investigating the Digital Literacy Needs of Healthcare Students: Using Mobile Tablet Devices for the Assessment of Student-Nurse Competency in Clinical Practice. In G. Vincenti, A. Bucciero, & C. Vaz de Carvalho (Eds), Lecture Notes of the Institute for Computer Sciences, Social Informatics and Telecommunications Engineering: Vol. 160. Second International Conference on E-Learning, E-Education, and Online Training, eLEOT 2015 (pp. 60–67). Springer. https://doi.org/10.1007/978-3-319-28883-3_8

  • Evangelinos, G., & Holley, D. (2016b). Investigating the Digital Literacy Needs of Healthcare Students when using Mobile Tablet Devices. EAI Endorsed Transactions on e-Learning, 3(10), 1–8. https://doi.org/10.4108/eai.11-4-2016.151155

    Article  Google Scholar 

  • Ferrari, A. (2013). DIGCOMP: A framework for developing and understanding digital competence in Europe. European Commission. Joint Research Centre, Institute for Prospective Technological Studies. Editors: Yves Punie and Barbara N. Brečko. Report EUR 26035 EN. https://doi.org/10.2788/52966

  • Ferrari, A. (2012). Digital Competence in practice: An analysis of frameworks. Luxembourg: Publications Office of the European Union

    Google Scholar 

  • Ferrari, A., Punie, Y., & Redecker, C. (2012). Understanding digital competence in the 21st century: An analysis of current frameworks. In European Conference on Technology Enhanced Learning (pp. 79–92). Springer

  • Herring, M. C., Koehler, M. J., & Mishra, P. (Eds.). (2016). Handbook of technological pedagogical content knowledge (TPACK) for educators. Routledge

  • International Society for Technology in Education (ISTE) (n.d.). The ISTE Standards. https://www.iste.org/standards

  • Kampylis, P., Punie, Y., & Devine, J. (2015). Promoting effective digital-age learning – A European framework for digitally-competent educational organizations. European Union. Joint Research Centre. EUR 27599 EN. https://doi.org/10.2791/54070

  • Kluzer, S., & Priego, L. P. (2018). DigComp into action: get inspired, make it happen. Publications Office of the European Union. JRC Science for Policy Report, EUR 29115 EN. Editors: S. Carretero, Y. Punie, R. Vuorikari, M. Cabrera, & W. O’Keefe. https://doi.org/10.2760/112945

  • Koehler, M. J., Shin, T. S., & Mishra, P. (2012). How do we measure TPACK? Let me count the ways. In M. J. Koehler, T. S. Shin, & P. Mishra (Eds.), Educational technology, teacher knowledge, and classroom impact: A research handbook on frameworks and approaches (pp. 16–31). IGI Global

  • Kuzminska, O., Mazorchuk, M., Morze, N., Pavlenko, V., & Prokhorov, A. (2018). Digital Competency of the Students and Teachers in Ukraine: Measurement, Analysis, Development Prospects. In V. Ermolayev et al. (Eds.), Proceedings of the 14th International Conference on ICT in Education, Research and Industrial Applications. Integration, Harmonization and Knowledge Transfer (ICTERI 2018) (pp. 366–379)

  • Kuzminska, O., Mazorchuk, M., Morze, N., Pavlenko, V., & Prokhorov, A. (2019). Study of Digital Competence of the Students and Teachers in Ukraine. In V. Ermolayev et al. (Eds.), Communications in Computer and Information Science: vol. 1007. Information and Communication Technologies in Education, Research, and Industrial Applications, ICTERI 2018 (pp. 148–169). Springer. https://doi.org/10.1007/978-3-030-13929-2_8

  • Laanpere, M. (2019). Recommendations on Assessment Tools for Monitoring Digital Literacy within UNESCO’s Digital Literacy Global Framework. Unesco Institute for Statistics. Information Paper No. 56. UIS/2019/LO/IP/56. http://uis.unesco.org/sites/default/files/documents/ip56-recommendations-assessment-tools-digital-literacy-2019-en.pdf

  • Law, N., Woo, D., de la Torre, J., & Wong, G. (2018). A global framework of reference on digital literacy skills for indicator 4.4.2. Unesco Institute for Statistics. http://uis.unesco.org/sites/default/files/documents/ip51-global-framework-reference-digital-literacy-skills-2018-en.pdf

  • Lucas, M. (2019). Facilitating Students’ Digital Competence: Did They Do It? In M. Scheffel, J. Broisin, V. Pammer-Schindler, A. Ioannou & J. Schneider (Eds.), Lecture Notes in Computer Science: Vol 11722. Transforming Learning with Meaningful Technologies: EC-TEL 2019 (pp. 3–14). Springer. https://doi.org/10.1007/978-3-030-29736-7_1

  • Lucas, M., Bem-Haja, P., Moreira, A., & Costa, N. (2019a). Is It All About Frequency?. In Á. Rocha, H. Adeli, L. Reis, & S. Costanzo (Eds.), Advances in Intelligent Systems and Computing: vol 932. New Knowledge in Information Systems and Technologies, WorldCist’19 (pp. 234–243). Springer. https://doi.org/10.1007/978-3-030-16187-3_23

  • Lucas, M., Bem-Haja, P., Moreira, A., & Costa, N. (2019b). Utilização de tablets e desenvolvimento de competências digitais: que impacto? Observatorio, 13(3), 34–51. doi: https://doi.org/10.15847/obsOBS13320191453

    Article  Google Scholar 

  • Paré, G., Trudel, M. C., Jaana, M., & Kitsiou, S. (2015). Synthesizing information systems knowledge: A typology of literature reviews. Information & Management, 52(2), 183–199. https://doi.org/10.1016/j.im.2014.08.008

    Article  Google Scholar 

  • Redecker, C. (2017). European framework for the digital competence of educators: DigCompEdu (No. JRC107466). Edited by Y. Punie. Publications Office of the European Union. Joint Research Centre. EUR 28775 EN. JRC107466. https://doi.org/10.2760/159770

  • Santos, A. I., dos, Punie, Y., & Castaño-Muñoz, J. (2016). Opening up Education: A Support Framework for Higher Education Institutions. European Union. JRC Science for Policy Report, EUR 27938 EN. doi:https://doi.org/10.2791/293408

  • Schmidt, D. A., Baran, E., Thompson, A. D., Mishra, P., Koehler, M. J., & Shin, T. S. (2009). Technological pedagogical content knowledge (TPACK) the development and validation of an assessment instrument for preservice teachers. Journal of research on Technology in Education, 42(2), 123–149. https://doi.org/10.1080/15391523.2009.10782544

    Article  Google Scholar 

  • Silva, E., Loureiro, M. J., & Pischetola, M. (2019). Competências digitais de professores do estado do Paraná (Brasil). Eduser: Revista de Educação, 11(1), 61–75. https://doi.org/10.34620/eduser.v11i1.125

    Article  Google Scholar 

  • The Council of the European Union (2018). Council Recommendation of 22 May 2018 on key competences for lifelong learning (Text with EEA relevance). Official Journal of the European Union, 61, C189, 1–13. https://eur-lex.europa.eu/legal-content/EN/TXT/PDF/?uri=OJ:C:2018:189:FULL&from=EN

  • United Nations Educational, Scientific and Cultural Organization (2018). UNESCO ICT Competency Framework for Teachers. Version 3.0. https://unesdoc.unesco.org/ark:/48223/pf0000265721

  • Vuorikari, R., Punie, Y., Gomez, S. C., & Van Den Brande, G. (2016). DigComp 2.0: The digital competence framework for citizens. Update phase 1: The conceptual reference model. Office of the European Union. Joint Research Centre. https://doi.org/10.2791/11517

  • Wang, W., Schmidt-Crawford, D., & Jin, Y. (2018). Preservice teachers’ TPACK development: A review of literature. Journal of Digital Learning in Teacher Education, 34(4), 234–258

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Pontifícia Universidade Católica de São Paulo (PUC–SP), São Paulo, Brazil

    João Mattar

  2. Universidade Santo Amaro (Unisa), São Paulo, Brazil

    João Mattar

  3. Universidade Federal de Santa Catarina, Florianópolis, Brazil

    Daniela Karine Ramos

  4. Universidade de Aveiro, Aveiro, Portugal

    Margarida Rocha Lucas

Authors
  1. João Mattar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Daniela Karine Ramos
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Margarida Rocha Lucas
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to João Mattar.

Ethics declarations

Funding: This research is supported by The National Council for Scientific and Technological Development - CNPq Conflict of interest

None.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mattar, J., Ramos, D.K. & Lucas, M.R. DigComp-Based Digital competence Assessment Tools: Literature Review and Instrument Analysis. Educ Inf Technol 27, 10843–10867 (2022). https://doi.org/10.1007/s10639-022-11034-3

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10639-022-11034-3

Keywords

Search

Navigation