Abstract
Content profiling in digital preservation is a crucial step that enables controlled management of content over time. However, large-scale profiling is facing a set of challenges. As data grows and gets more diverse, the only option to control it is to combine outputs of multiple characterization tools to cover the varieties of formats and extract features of interest. This cooperation of tools introduces conflicting measures and poses challenges on data quality. Sparsity and labeling conflicts make it difficult or impossible to partition, sample and analyze large metadata sets of a content profile. Without this, however, it is virtually impossible to manage heterogeneous collections reliably over time.
In this paper, we present the content profiling tool C3PO, which includes rule-based techniques and heuristics designed for conflict reduction. We conduct a set of experiments in which we assess the effect of creating such a mechanisms and rule set on the quality and effectiveness of content profiling. The results show the potential of simple conflict reduction rules to strongly improve data quality of content profiling for analysis and decision support.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Abrams, S., Morrissey, S., Cramer, T.: What? So What.: The next-generation JHOVE2 architecture for format-aware characterization. IJDC 4(3) (2009)
Becker, C., Duretec, K.: Free benchmark corpora for preservation experiments: using model-driven engineering to generate data sets. In: Proc. JCDL. ACM (2013)
Becker, C., Rauber, A.: Preservation decisions: Terms and conditions apply. In: Proc. JCDL. ACM (2011)
Brody, T., Carr, L., Hey, J., Brown, A., Hitchcock, S.: PRONOM-ROAR: Adding format profiles to a repository registry to inform preservation services. IJDC 2(2) (2008)
Dappert, A.: Deal with conflict, capture the relationship: The case of digital object properties. In: Proc. IPRES, pp. 21–29 (2010)
Dappert, A., Farquhar, A.: Significance is in the eye of the stakeholder. In: Agosti, M., Borbinha, J., Kapidakis, S., Papatheodorou, C., Tsakonas, G. (eds.) ECDL 2009. LNCS, vol. 5714, pp. 297–308. Springer, Heidelberg (2009)
Faria, L., Petrov, P., Duretec, K., Becker, C., Ferreira, M., Ramalho, J.: Design and architecture of a novel preservation watch system. In: Chen, H.-H., Chowdhury, G. (eds.) ICADL 2012. LNCS, vol. 7634, pp. 168–178. Springer, Heidelberg (2012)
Forgy, C.L.: Rete: A fast algorithm for the many pattern/many object pattern match problem. Artificial Intelligence 19(1), 17–37 (1982)
Hedstrom, M., Lee, C.A.: Significant properties of digital objects: definitions, applications, implications. In: DLM-Forum, vol. 200, pp. 218–27 (2002)
Hutchins, M.: Testing software tools of potential interest for digital preservation activities at the national library of australia. NLA Australia Staff Papers (2012)
Kulovits, H., Kraxner, M., Plangg, M., Becker, C., Bechhofer, S.: Open preservation data: Controlled vocabularies and ontologies for preservation ecosystems. In: Proc. IPRES, pp. 63–72
Petrov, P., Becker, C.: Large-scale content profiling for preservation analysis. In: 9th International Conference on Preservation of Digital Objects (IPRES 2012) (2012)
van der Knijff, J., Wilson, C.: Evaluation of characterisation tools. part 1: Identification. Technical report, National Library of the Netherlands (2011)
Wheatley, P.: The practitioners have spoken: “we need better characterisation!”. Blog post (2012), http://www.openplanetsfoundation.org/blogs/2012-10-19-practitioners-have-spoken-we-need-better-characterisation (accessed June 2014)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this paper
Cite this paper
Kulmukhametov, A., Becker, C. (2014). Content Profiling for Preservation: Improving Scale, Depth and Quality. In: Tuamsuk, K., Jatowt, A., Rasmussen, E. (eds) The Emergence of Digital Libraries – Research and Practices. ICADL 2014. Lecture Notes in Computer Science, vol 8839. Springer, Cham. https://doi.org/10.1007/978-3-319-12823-8_1
Download citation
DOI: https://doi.org/10.1007/978-3-319-12823-8_1
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-12822-1
Online ISBN: 978-3-319-12823-8
eBook Packages: Computer ScienceComputer Science (R0)