Skip to main content

Quality in Learning Objects: Evaluating Compliance with Metadata Standards

  • Conference paper
Metadata and Semantic Research (MTSR 2010)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 108))

Included in the following conference series:

Abstract

Ensuring a certain level of quality of learning objects used in e-learning is crucial to increase the chances of success of automated systems in recommending or finding these resources. This paper aims to present a proposal for implementation of a quality model for learning objects based on ISO 9126 international standard for the evaluation of software quality. Features indicators associated with the conformance sub-characteristic are defined. Some instruments for feature evaluation are advised, which allow collecting expert opinion on evaluation items. Other quality model features are evaluated using only the information from its metadata using semantic web technologies. Finally, we propose an ontology-based application that allows automatic evaluation of a quality feature. IEEE LOM metadata standard was used in experimentation, and the results shown that most of learning objects analyzed do not complain the standard.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Al-Khalifa, H.S., Davis, H.C.: The evolution of metadata from standards to semantics in E-learning applications. In: Proceedings of the Seventeenth Conference on Hypertext and Hypermedia. ACM, Odense (2006)

    Google Scholar 

  2. Soto, J., García, E., Sánchez Alonso, S.: Repositorios semánticos para objetos de aprendizaje. In: V encuentro de universidades & e-learning, en actas de Virtual C@mpus, Barcelona (2006)

    Google Scholar 

  3. Morales, E., Gil, A., García, F.: Arquitectura para la Recuperación de Objetos de Aprendizaje de calidad en Repositorios Distribuidos. In: XII Jornadas de Ingeniería del Software y Bases de Datos, Zaragoza, España (2007)

    Google Scholar 

  4. Sarasa Cabezuelo, A., Dodero Beardo, J.M.: Towards a Model of Quality for Learning Objects. In: Fourth IEEE International Conference on Advanced Learning Technologies (ICALT 2004), pp. 822–824 (2004)

    Google Scholar 

  5. Vidal, C.L., Segura, A.A., Prieto, M.E.: Calidad de Objetos de Aprendizaje. In: V Simposio Pluridisciplinar sobre Diseño y Evaluación de Contenidos Educativos Reutilizables (SPDECE 2008), Salamanca (2008)

    Google Scholar 

  6. Segura, A., Vidal, C., Prieto, M.: Evaluación de la Calidad del Software para el Aprendizaje. In: X Simposio Internacional de Informática Educativa SIIE 2008, pp. 59–64. Ediciones Universidad de Salamanca, Salamanca (2008)

    Google Scholar 

  7. Pérez, M., Díaz-Antón, G., Grimán, A., Mendoza, L.: Calidad Sistemática del software Educativo. In: Congreso Internacional EDUTEC 2003, Gestión de las Tecnologías de la Información y la Comunicación en los Diferentes Ámbitos Educativos, Caracas (2003)

    Google Scholar 

  8. Marqués, P.: Evaluación y selección de software educativo. Comunicación y Pedagogía 185, 31–37 (2000)

    Google Scholar 

  9. Bednarik, R.: Evaluation of Educational Environments. The TUP Model. MSc. Thesis. Department of Computer Science, University of Joensuu, Joensuu (2002)

    Google Scholar 

  10. Shaughnessy, M.R.: Educational Software Evaluation: A Contextual Approach. Unpublished doctoral dissertation, University of Cincinnati (2002)

    Google Scholar 

  11. Leighton, H., García, J.: Calidad en los Sitios WEB Educativos. Reporte Técnico. Departamento de Informática y Automática, Universidad de Salamanca, Salamanca (2003)

    Google Scholar 

  12. Pérez, M., Pérez, N., Mendez, S., García, A., Galvez, M.P., Quincoses, V., Liberatori, H., Fiorito, B., Lassere, C.: Construcción y Validación del cuestionario: Métrica de Calidad de Credibilidad e Interacción de Cursos de Teleformación. TE&ET Revista Iberoamericana de Tecnología en Educación y Educación en Tecnología 2, 30–38 (2007)

    Google Scholar 

  13. Plaza, I., Marcuello, J., Arcega, F.: Evaluación de la calidad del software educativo: revisión normativa. In: Simposio Nacional de Tecnologías de la Información y las Comunicaciones en la Educación CEDI, Zaragoza, España (2007)

    Google Scholar 

  14. Abud, M.A.: MECSE: Conjunto de Métricas para Evaluar Software Educativo. UPIICSA Tecnología Ciencia Cultura, 39 (2005)

    Google Scholar 

  15. Sanz, J., Dodero, J.M., Sánchez-Alonso, S.: A Preliminary Analysis of Software Engineering Metrics-based Criteria for the Evaluation of Learning Objects Reusability. International Journal of Emerging Technologies in Learning (iJET) 4 (2009)

    Google Scholar 

  16. Khoo, C.S.G., Chaudhry, A.S., Butdisuwan, S., Chen, J.C.-c.: Factors affecting re-usability of learning objects across national boundaries: an exploratory study of information organization and knowledge Management. In: World Library and Information Congress: 76th IFLA General Conference and Assembly, Gothenburg, Sweden (2010)

    Google Scholar 

  17. Currier, S., Campbell, L.M.: Evaluating 5/99 content for reusability as learning objects. VINE: The Journal of Information and Knowledge Management Systems 35, 85–96 (2005)

    Article  Google Scholar 

  18. Cuadrado, J.-j., Sicilia, M.-a.: Learning Object Reusability Metrics: Some Ideas from Software Engineering. In: International Conference on Internet Technologies and Applications ITA, Wrexham, North Wales, UK (2005)

    Google Scholar 

  19. Hiddink, G.: Solving reusability problems of online learning materials. Campus-Wide Information Systems 18, 146–152 (2001)

    Article  Google Scholar 

  20. Nesbit, J., Belfer, K., Vargo, J.: A Convergent Participation Model for Evaluation of Learning Objects. Canadian Journal of Learning and Technology 28, 105–120 (2002)

    Google Scholar 

  21. Morales, E., Garcia, F., Rego, H., Moreira, T.: Learning objects quality management for e-learning systems. International Journal of Technology Enhanced Learning 1, 193–204 (2009)

    Article  Google Scholar 

  22. Ochoa, X., Duval, E.: Quality Metrics for Learning Object Metadata. In: Pearson, E., Bohman, P. (eds.) World Conference on Educational Multimedia, Hypermedia and Telecommunications 2006, pp. 1004–1011. AACE, Chesapeake (2006)

    Google Scholar 

  23. Franch, X., Carvello, J.P.: Using quality models in software package selection. IEEE Software 20(1), 34–41 (2003)

    Article  Google Scholar 

  24. Uebersax, J.: Likert scales: dispelling the confusion. Statistical Methods for Rater Agreement website, http://ourworld.compuserve.com/homepages/jsuebersax/likert.htm

  25. IEEE-LOM: Draft Standard for Learning Object Metadata. IEEE P1484.12.1 (2002)

    Google Scholar 

  26. Horrocks, I., Patel-Schneider, P., McGuinness, D., Welty, C.: OWL: a Description Logic Based Ontology Language for the Semantic Web. In: Baader, F., Calvanese, D., McGuinness, D., Nardi, D., Patel-Schneider, P.F. (eds.) The Description Logic Handbook: Theory, Implementation, and Applications, 2nd edn. Cambridge University Press, Cambridge (2007)

    Google Scholar 

  27. Sicilia, M.A., Garcia-Barriocanal, E., Sanchez-Alonso, S., Soto, J.: A Semantic Lifecycle Approach to Learning Object Repositories. In: Proceedings of the Advanced Industrial Conference on Telecommunications/Service Assurance with Partial and Intermittent Resources Conference/E-Learning on Telecommunications Workshop (AICT/SAPIR/ELETE 2005), Lisbon (2005)

    Google Scholar 

  28. McGreal, R.: A Typology of Learning Object Repositories. Athabasca University Library. Athabasca University, Athabasca (2007) (pre-print accepted for publication)

    Google Scholar 

  29. Vidal, C., Prieto, M.: Una Ontología de apoyo a actividades de Diseño Instruccional. In: Prieto, M., Sanchez-Alonso, S., et al. (eds.) Recursos Digitales para el Aprendizaje. Editorial Universidad Autónoma de Yucatán, Mérida (2009)

    Google Scholar 

  30. Fermoso, A.M., Sánchez-Alonso, S., Sicilia, M.A.: Una ontología en OWL para la representación semántica de objetos de aprendizaje. In: V Simposio Pluridisciplinar sobre Diseño y Evaluación de Contenidos Educativos Reutilizables, SPDECE 2008, Salamanca (2008)

    Google Scholar 

  31. O’Connor, M.J., Shankar, R.D., Tu, S.W., Nyulas, C.I., Das, A.K.: Developing a Web-Based Application using OWL and SWRL. In: AAAI Spring Symposium, Stanford, CA, USA (2008)

    Google Scholar 

  32. Morales, R., Ochoa, X., Sánchez, V.G., Ordoñez, V.: LA FLOR - Repositorio Latinoamericano de Objetos de Aprendizaje. In: Prieto, M., Sánchez-Alonso, S., Pech-Campos, S.J. (eds.) Recursos Digitales para el Aprendizaje. Ediciones de la Universidad Autónoma de Yucatán, Mérida (2009)

    Google Scholar 

  33. Prieto, M., Menéndez, V., Segura, A., Vidal, C.: A Recommender System Architecture for Instructional Engineering. In: Lytras, M.D., Carroll, J.M., Damiani, E., Tennyson, R.D. (eds.) WSKS 2008. LNCS (LNAI), vol. 5288, pp. 314–321. Springer, Heidelberg (2008)

    Chapter  Google Scholar 

  34. Duval, E., Forte, E., Cardinaels, K., Verhoeven, B., Durm, R.V., Hendrikx, K., Forte, M.W., Ebel, N., Macowicz, M., Warkentyne, K., Haenni, F.: The Ariadne knowledge pool system. Communications of the ACM 44, 72–78 (2001)

    Article  Google Scholar 

  35. Stefaner, M., Vecchia, E.D., Condotta, M., Wolpers, M., Specht, M., Apelt, S., Duval, E.: MACE – Enriching Architectural Learning Objects for Experience Multiplication. In: Duval, E., Klamma, R., Wolpers, M. (eds.) EC-TEL 2007. LNCS, vol. 4753, pp. 322–336. Springer, Heidelberg (2007)

    Chapter  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2010 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Vidal, C.C., Segura, N.A., Campos, S.P., Sánchez-Alonso, S. (2010). Quality in Learning Objects: Evaluating Compliance with Metadata Standards. In: Sánchez-Alonso, S., Athanasiadis, I.N. (eds) Metadata and Semantic Research. MTSR 2010. Communications in Computer and Information Science, vol 108. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-16552-8_31

Download citation

  • DOI: https://doi.org/10.1007/978-3-642-16552-8_31

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-642-16551-1

  • Online ISBN: 978-3-642-16552-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics