An Approach for Processing Large and Non-uniform Media Objects on MapReduce-Based Clusters

  • Rainer Schmidt
  • Matthias Rella
Conference paper

DOI: 10.1007/978-3-642-24826-9_23

Volume 7008 of the book series Lecture Notes in Computer Science (LNCS)
Cite this paper as:
Schmidt R., Rella M. (2011) An Approach for Processing Large and Non-uniform Media Objects on MapReduce-Based Clusters. In: Xing C., Crestani F., Rauber A. (eds) Digital Libraries: For Cultural Heritage, Knowledge Dissemination, and Future Creation. ICADL 2011. Lecture Notes in Computer Science, vol 7008. Springer, Berlin, Heidelberg

Abstract

Cloud computing enables us to create applications that take advantage of large computer infrastructures on demand. Data intensive computing frameworks leverage these technologies in order to generate and process large data sets on clusters of virtualized computers. MapReduce provides an highly scalable programming model in this context that has proven to be widely applicable for processing structured data. In this paper, we present an approach and implementation that utilizes this model for the processing of audiovisual content. The application is capable of analyzing and modifying large audiovisual files using multiple computer nodes in parallel and thereby able to dramatically reduce processing times. The paper discusses the programming model and its application to binary data. Moreover, we summarize key concepts of the implementation and provide a brief evaluation.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Rainer Schmidt
    • 1
  • Matthias Rella
    • 1
  1. 1.Austrian Institute of TechnologyViennaAustria