Multimedia Tools and Applications

, Volume 70, Issue 1, pp 573–598

Requirements for multimedia metadata schemes in surveillance applications for security

  • J. van Rest
  • F. A. Grootjen
  • M. Grootjen
  • R. Wijn
  • O. Aarts
  • M. L. Roelofs
  • G. J. Burghouts
  • H. Bouma
  • L. Alic
  • W. Kraaij
Article

DOI: 10.1007/s11042-013-1575-9

Cite this article as:
van Rest, J., Grootjen, F.A., Grootjen, M. et al. Multimed Tools Appl (2014) 70: 573. doi:10.1007/s11042-013-1575-9

Abstract

Surveillance for security requires communication between systems and humans, involves behavioural and multimedia research, and demands an objective benchmarking for the performance of system components. Metadata representation schemes are extremely important to facilitate (system) interoperability and to define ground truth annotations for surveillance research and benchmarks. Surveillance places specific requirements on these metadata representation schemes. This paper offers a clear and coherent terminology, and uses this to present these requirements and to evaluate them in three ways: their fitness in breadth for surveillance design patterns, their fitness in depth for a specific surveillance scenario, and their realism on the basis of existing schemes. It is also validated that no existing metadata representation scheme fulfils all requirements. Guidelines are offered to those who wish to select or create a metadata scheme for surveillance for security.

Keywords

SurveillanceHuman behaviourAnnotationMetadata representation schemeEventActionMultimodalMulti-sensorONVIFMPEG-7PETS

Supplementary material

View video
ESM 1

(MPG 7337 kb)

Copyright information

© Springer Science+Business Media New York 2013

Authors and Affiliations

  • J. van Rest
    • 1
  • F. A. Grootjen
    • 2
  • M. Grootjen
    • 1
  • R. Wijn
    • 1
  • O. Aarts
    • 1
  • M. L. Roelofs
    • 1
  • G. J. Burghouts
    • 1
  • H. Bouma
    • 1
  • L. Alic
    • 1
  • W. Kraaij
    • 1
  1. 1.TNOThe HagueThe Netherlands
  2. 2.Radboud UniversityNijmegenThe Netherlands