Audio-Visual Surveillance System for Application in Bank Operating Room

  • Józef Kotus
  • Kuba Lopatka
  • Andrzej Czyżewski
  • Georgis Bogdanis
Part of the Communications in Computer and Information Science book series (CCIS, volume 368)


An audio-visual surveillance system able to detect, classify and to localize acoustic events in a bank operating room is presented. Algorithms for detection and classification of abnormal acoustic events, such as screams or gunshots are introduced. Two types of detectors are employed to detect impulsive sounds and vocal activity. A Support Vector Machine (SVM) classifier is used to discern between the different classes of acoustic events. The methods for calculating the direction of coming sound employing an acoustic vector sensor are presented. The localization is achieved by calculating the DOA (Direction of Arrival) histogram. The evaluation of the system based on experiments conducted in a real bank operating room is given. Results of sound event detection, classification and localization are given and discussed. The system proves efficient for the task of automatic surveillance of the bank operating room.


sound detection sound source localization audio surveillance 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Łopatka, K., Kotus, J., Czyżewski, A.: Application of vector sensors to acoustic surveillance of a public interior space. Archives of Acoustics 36(4), 851–860 (2011)Google Scholar
  2. 2.
    Kotus, J., Łopatka, K., Czyżewski, A.: Detection and localization of selected acoustic events in 3d acoustic field for smart surveillance applications. Multimedia Tools and Applications (2012) (published online)Google Scholar
  3. 3.
    Cowling, M., Sitte, R.: Comparison of techniques for environmental sound recognition. Pattern Recognition Letters 24, 2895–2907 (2003)CrossRefGoogle Scholar
  4. 4.
    Valenzise, G., Gerosa, L., Tagliasacchi, M., Antonacci, F., Sarti, A.: Scream and gunshot detection and localization for audio-surveillance systems. In: IEEE Conference on Advanced Video and Signal Based Surveillance, London, August 5–7, pp. 21–26 (2007)Google Scholar
  5. 5.
    Temko, A., Nadeu, C.: Acoustic event detection in meeting room environments. Pattern Recognition Letters 30, 1281–1288 (2009)CrossRefGoogle Scholar
  6. 6.
    Yoo, I.-C., Yook, D.: Robust voice activity detection using the spectral peaks of vowel sounds. ETRI Journal 31(4), 451–453 (2009)CrossRefGoogle Scholar
  7. 7.
    Zhuang, X., Zhou, X., Hasegawa-Johnson, M., Huang, T.: Real-world acoustic event detection. Pattern Recognition Letters 31, 1543–1551 (2010)CrossRefGoogle Scholar
  8. 8.
    Rabaoui, A., et al.: Using robust features with multi-class SVMs to classify noisy sounds. In: International Symposium on Communications, Control and Signal Processing, Malta, March 12–14 (2008)Google Scholar
  9. 9.
    Łopatka, K., Zwan, P., Czyżewski, A.: Dangerous sound event recognition using support vector machine classifiers. In: Nguyen, N.T., Zgrzywa, A., Czyżewski, A. (eds.) Adv. in Multimed. and Netw. Inf. Syst. Technol. AISC, vol. 80, pp. 49–57. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  10. 10.
    Zwan, P., Czyzewski, A.: Verification of the parameterization methods in the context of automatic recognition of sounds related to danger. Journal of Digital Forensic Practice 3(1), 33–45 (2010)CrossRefGoogle Scholar
  11. 11.
    Peeters, G.: A large set of audio features for sound description (similarity and classification) in the cuidado project. CUIDADO IST Project Report 54 (version 1.0), 1-25 (2004)Google Scholar
  12. 12.
    Raangs, R., Druyvesteyn, W.F.: Sound source localization using sound intensity measured by a three dimensional PU probe. In: AES Munich (2002)Google Scholar
  13. 13.
    Basten, T., de Bree, H.-E., Druyvesteyn, E.: Multiple incoherent sound source localization using a single vector sensor ICSV16, Krakow, Poland (2009)Google Scholar
  14. 14.
    Wind, J.W., Tijs, E., de Bree, H.-E.: Source localization using acoustic vector sensors, a MUSIC approach, NOVEM, Oxford (2009)Google Scholar
  15. 15.
    Wind, J.W.: Acoustic Source Localization, Exploring Theory and Practice. PhD Thesis, University of Twente, Enschede, The Netherlands (2009)Google Scholar
  16. 16.
    Kotus, J.: Application of passive acoustic radar to automatic localization, tracking and classification of sound sources. Information Technologies 18, 111–116 (2010)Google Scholar
  17. 17.
    Kotus, J.: Multiple sound sources localization in real time using acoustic vector sensor. In: Dziech, A., Czyżewski, A. (eds.) MCSS 2012. Communications in Computer and InfSCCISormation Science, vol. 287, pp. 168–179. Springer, Heidelberg (2012)CrossRefGoogle Scholar
  18. 18.
    Weyna, S.: Identification of Reflection and Scattering Effects in Real Acoustic Flow Field. Archives of Acoustics 28(3), 191–203 (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Józef Kotus
    • 1
  • Kuba Lopatka
    • 1
  • Andrzej Czyżewski
    • 1
  • Georgis Bogdanis
    • 2
  1. 1.Faculty of Electronics, Telecommunications and Informatics, Multimedia Systems DepartmentGdańsk University of TechnologyGdańskPoland
  2. 2.Informatic Systems Designing and Applications Agency MicrosystemSopotPoland

Personalised recommendations