Sound learning–based event detection for acoustic surveillance sensors
- 45 Downloads
This study proposes an event detection technique for acoustic surveillance that detects emergency situations by using acoustic sensors. Most surveillance systems have widely depended on visual data recorded by closed-circuit television (CCTV) cameras, but more intelligent systems are now beginning to use audio information for more reliable detection of emergency situations. Most of the conventional studies on acoustic event detection adopt limited types of acoustic data and are based on simple algorithms, such as energy-based determination. Thus, these approaches are easily realized, but may induce serious detection errors in real-world applications. In this study, we propose an event detection technique based on a sound-learning algorithm to be adopted by real-time acoustic surveillance systems. One main process of this technique is to construct acoustic models via learning algorithms from sound data collected according to types of acoustic events. The models are used to determine whether audio streams entering an acoustic sensor refer to the events or not. In event detection experiments performed in an outdoor environment, the proposed approach outperformed conventional approaches in the real-time detection of acoustic events.
KeywordsAcoustic surveillance sensor Surveillance system Sound learning Acoustic event detection
This research was supported by Hankuk University of Foreign Studies Research Fund, Basic Science Research Program through the National Research Foundation of Korea (NRF) funded by the Ministry of Education (NRF-2017R1D1A1A09000903), the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2019-2016-0-00313) supervised by the IITP (Institute for Information & communications Technology Planning & Evaluation), and the research grant of Pai Chai University in 2019.
- 1.Bilmes J (1997) A gentle tutorial of the EM algorithm and its application to parameter estimation for Gaussian mixture and hidden Markov models. University of Berkeley, International Computer Science Institute, Tech. Rep., ICSI-TR-97-021Google Scholar
- 3.Clavel C, Ehrette T, Richard G (2005) Events detection for an audio-based surveillance system. In: IEEE international conference on multimedia and expoGoogle Scholar
- 5.Didrikas T, Kubilius R, Spegys M (2011) Surveillance of marine resources using multi-frequency hydroacoustics. Klaipeda Univ Tech Rep, NOR-LT0047Google Scholar
- 7.Huang PS, Zhuang X, Hasegawa-Johnson M (2011) Improving acoustic event detection using generalizable visual features and multi-modality modeling. In: IEEE international conference on acoustics, speech, and signal processingGoogle Scholar
- 8.Kang K, Ouyang W, Li H, Wang X (2016) Object detection from video tubelets with convolutional neural networks. In: IEEE conference on computer vision and pattern recognitionGoogle Scholar
- 9.Lurton X (2002) An introduction to underwater acoustics: principles and applications. Springer Science & Business MediaGoogle Scholar
- 10.Lyon D (2007) Surveillance studies: an overview. Polity Press, CambridgeGoogle Scholar
- 11.Mesaros A, Heittola T, Eronen A, Virtanen T (2010) Acoustic event detection in real life recordings. In: European signal processing conferenceGoogle Scholar
- 12.Ntalampiras S, Potamitis I, Fakotakis N (2009) On acoustic surveillance of hazardous situations. In: IEEE international conference on acoustics, speech, and signal processingGoogle Scholar
- 20.Zhu Z, Huang TS (2009) Multimodal surveillance: sensors, algorithms and systems. Artech. HouseGoogle Scholar