Metrics for Metadata Quality Assurance and Their Implications for Digital Libraries

  • Ya-Ning Chen
  • Chun-Ya Wen
  • Hui-Pin Chen
  • Yen-Hung Lin
  • Hon-Chung Sum
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7008)


This study aims at developing a set of common metrics for metadata quality at data element level. The proposed metrics are used to assure the quality for metadata that converted from heterogeneous metadata formats and sources into a Dublin Core based centralized digital repository. This study adopted the metrics provided by Bruce and Hillmann [2] as a basis to develop the proposed metrics as follows: conformance to expectations, provenance, accuracy, completeness and accessibility. A hybrid approach of automatic and manual had developed for assessing metadata quality in practice. Target subjects were two individual projects selected from the Taiwan E-Learning and Digital Archives Program as use case to illustrate the details and examine the feasibility of the proposed metrics. Finally, this study discussed the implications of proposed metadata quality metrics for digital libraries in the following perspectives: project management, metadata management, hidden quality problems and accessibility.


metadata quality assurance evaluation digital libraries 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Barton, J., Currier, S., Hey, J.M.N.: Building Quality Assurance into Metadata Creation: An Analysis Based on the Learning Objects and e-Prints Communities of Practices. In: Proceedings of 2003 Dublin Core Conference: Supporting Communities of Discourse and Practice - Metadata Research and Applications, pp. 39–48 (2003),
  2. 2.
    Bruce, T.R., Hillmann, D.I.: The Continuum of Metadata Quality: Defining, Expressing, Exploiting. In: Hillmann, D.I., Wesbrooks, E.L. (eds.) Metadata in Practice, pp. 238–256. ALA, Chicago (2004)Google Scholar
  3. 3.
    Currier, S., Barton, J., O’Beirne, R., Ryan, B.: Quality Assurance for Digital Learning Object Repositories: Issues for the Metadata Creation Process. Research in Learning Technology 12(1), 5–20 (2004), CrossRefGoogle Scholar
  4. 4.
    Guy, M., Powell, A., Day, M.: Improving the Quality of Metadata in Eprint Archives. Ariadne 38 (2004),
  5. 5.
    Hughes, B.: Metadata Quality Evaluation: Experience from the Open Language Archives Community. In: Chen, Z., Chen, H., Miao, Q., Fu, Y., Fox, E., Lim, E.-p. (eds.) ICADL 2004. LNCS, vol. 3334, pp. 320–329. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  6. 6.
    Kelly, B., Closier, A., Hiom, D.: Gateway Standardization: A Quality Assurance Framework for Metadata. Library Trends 53(4), 637–650 (2005)Google Scholar
  7. 7.
    Ma, S., Lu, C., Lin, X., Galloway, M.: Evaluating the Metadata Quality for the IPL. Proceedings of the American Society for Information Science and Technology 46(1), 1–17 (2009)Google Scholar
  8. 8.
    Moen, W.E., Stewart, E.L., McClure, C.R.: The Role of Content Analysis in Evaluating Metadata for the U.S. Government Information Locator Service: Results from an Exploratory Study (1997),
  9. 9.
    Moen, W.E., Stewart, E.L., McClure, C.R.: Assessing Metadata Quality: Findings and Methodological Considerations from an Evaluation of the U.S. Government Information Locator Service. In: Proceedings of Proceeding ADL 1998 Proceedings of the Advances in Digital Libraries Conference. IEEE Computer Society, Washington, DC (1998), Google Scholar
  10. 10.
    Ochoa, X., Duval, E.: Towards Automatic Evaluation of Learning Object Metadata Quality. In: Roddick, J., Benjamins, V.R., Si-said Cherfi, S., Chiang, R., Claramunt, C., Elmasri, R.A., Grandi, F., Han, H., Hepp, M., Lytras, M.D., Mišić, V.B., Poels, G., Song, I.-Y., Trujillo, J., Vangenot, C. (eds.) ER Workshops 2006. LNCS, vol. 4231, pp. 372–381. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  11. 11.
    Ochoa, X., Duval, E.: Towards Automatic Evaluation of Metadata Quality in Digital Repositories (2009),
  12. 12.
    Stvilia, B., Gasser, L.: Value-based Metadata Quality Assessment. Library & Information Science Research 30(1), 67–74 (2008)CrossRefGoogle Scholar
  13. 13.
    Stvilia, B., Gasser, L., Twidale, M.B., Shreeves, S.L., Cole, T.W.: Metadata Quality for Federated Collections. In: Proceedings of the 9th Conference on Information Quality, pp. 111–125. M.E. Sharpe, New York (2004)Google Scholar
  14. 14.
    Stvilia, B., Gasser, L., Twidale, M.B., Smith, L.C.: A Framework for Information Quality Assessment. Journal of the American Society for Information Science and Technology 58(12), 1720–1733 (2007)CrossRefGoogle Scholar
  15. 15.
    Shreeves, S.L., Knutson, E.M., Stvilia, B., Palmer, C.L., Twidale, M.B., Cole, T.W.: Is Quality Metadata Sharable Metadata: The Implications of Local Metadata Practices for Federated Collections. In: Proceedings of ACRL 20th National Conference, pp. 223–237 (2005)Google Scholar
  16. 16.
    Ward, J.: A Quantitative Analysis of Unqualified Dublin Core Metadata Element Set Usage within Data Providers Registered with the Open Archives Initiative. In: Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, pp. 315–317. IEEE Computer Society, Washington, DC (2003)Google Scholar
  17. 17.
    Wilson, A.J.: Toward Releasing the Metadata Bottleneck: A Baseline Evaluation of Contributor-supplied Metadata. Library Resources & Technical Service 51(1), 16–28 (2007)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Ya-Ning Chen
    • 1
    • 2
  • Chun-Ya Wen
    • 3
  • Hui-Pin Chen
    • 2
  • Yen-Hung Lin
    • 4
  • Hon-Chung Sum
    • 3
  1. 1.Graduate Institute of Library and Information StudiesNational Taiwan Normal UniversityTaipeiTaiwan
  2. 2.Computing CenterAcademia SinicaTaipeiTaiwan
  3. 3.Research Center for Information Technology InnovationAcademia SinicaTaipeiTaiwan
  4. 4.Institute of History and PhilologyAcademia SinicaTaipeiTaiwan

Personalised recommendations