Skip to main content
SpringerLink
Log in

Automated real-time video surveillance summarization framework

  • Special Issue
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Reviewing video surveillance contents for security monitoring is a time-consuming and time-limiting task. This paper presents a real-time video surveillance summarization framework intended for minimizing the time requirement for time critical tasks, based on compact moving objects in time–space. A tunnel is proposed as an individual time-dimension object. In order to summarize an endless video into a shorter duration without loss of selected targets so as to extend the understanding of any given individual object, this research utilizes three real-time algorithms. Direct shift collision detection (DSCD) is implemented for the extremely fast shifting of tunnels together in time–space. The DSCD summarized video can then be customized by technique from many different approaches. Here, early trajectory searching is applied with the same DSCD technique, and then direct distance transform is used to instantly give the trajectory similarity between tunnels and the user’s query. The most important step for identifying each individual object is background subtraction. To this end, dynamic region adaptation (DRA) was used as the background subtraction algorithm to select the best foreground for each object before making a tunnel. DRA also helps DSCD to summarize the video more accurately. The proposed framework is able to provide the results by real-time performance approach without losing the major events of the original video stream.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16
Fig. 17
Fig. 18
Fig. 19
Fig. 20
Fig. 21
Fig. 22
Fig. 23
Fig. 24
Fig. 25
Fig. 26
Fig. 27
Fig. 28
Fig. 29
Fig. 30
Fig. 31

Similar content being viewed by others

Notes

  1. We encourage readers to view more video examples in ftp://tppwan1.dyndns.org/VideoSummarization.

References

  1. Avidan, S., Shamir, A.: Seam carving for content-aware image resizing. ACM Trans. Graphics 26 (2007)

  2. Berndt, D.J., Clifford, J.: Advances in knowledge discovery and data mining chap. Finding Patterns in Time Series: A Dynamic Programming Approach, pp. 229–248. American Association for Artificial Intelligence (1996)

  3. Chen, L., O¨ zsu, M.T., Oria, V.: Robust and fast similarity search for moving object trajectories. In: Proceedings of the 2005 ACM SIGMOD International Conference on Management of Data, SIGMOD’05, pp. 491–502. ACM (2005)

  4. Cooharojananone, N., Kasamwattanarote, S., Satoh, S., Lipikorn, R.: Real time trajectory search in video summarization using direct distance transform. In: IEEE 10th International Conference on Signal Processing, ICSP’10, pp. 932–935. IEEE Computer Society (2010)

  5. Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of the 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR’05, vol. 1, pp. 886–893. IEEE Computer Society (2005)

  6. Ferman, A.M., Tekalp, A.M.: Multiscale content extraction and representation for video indexing. In: Proceedings of Multimedia Storage and Archiving Systems, vol. 2, pp. 23–31. SPIE (1997)

  7. Kang, H.W., Chen, X.Q., Matsushita, Y., Tang, X.: Space-time video montage. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR’06, vol. 2, pp. 1331–1338. IEEE Computer Society (2006)

  8. Kasamwattanarote, S., Cooharojananone, N., Satoh, S., Lipikorn, R.: Real time tunnel based video summarization using direct shift collision detection. In: Proceedings of the 11th Pacific Rim Conference on Advances in Multimedia Information Processing: Part I, PCM’10, pp. 136–147. Springer (2010)

  9. Kim, C., Hwang, J.N.: An integrated scheme for object-based video abstraction. In: Proceedings of the Eighth ACM International Conference on Multimedia, MULTIMEDIA’00, pp. 303–311. ACM (2000)

  10. van Kreveld, M., Luo, J.: Trajectory similarityof moving objects. In: Young Researcher Forum, pp. 229–232 (2007)

  11. Li, Z., Ishwar, P., Konrad, J.: Video condensation by ribbon carving. IEEE Trans. Image Process. 18, 2572–2583 (2009)

    Article  MathSciNet  Google Scholar 

  12. Peker, K.A., Divakaran, A.: Adaptive fast playback-based video skimming using a compressed-domain visual complexity measure. In: International Conference on Multimedia and Expo, ICME’04, vol. 3, pp. 2055–2058. IEEE Computer Society (2004)

  13. Pelekis, N., Kopanakis, I., Marketos, G., Ntoutsi, I., Andrienko,G., Theodoridis, Y.: Similarity search in trajectory databases. In: Proceedings of the 14th International Symposium on Temporal Representation and Reasoning, pp. 129–140. IEEE Computer Society (2007)

  14. Petrovic, N., Jojic, N., Huang, T.S.: Adaptive video fast forward. Multimedia Tools Appl. 26, 327–344 (2005)

    Google Scholar 

  15. Pritch, Y., Ratovitch, S., Hendel, A., Peleg, S.: Clustered synopsis of surveillance video. In: Proceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based Surveillance, AVSS’09, pp. 195–200. IEEE Computer Society (2009)

  16. Pritch, Y., Rav-Acha, A., Gutman, A., Peleg, S.: Webcam synopsis: Peeking around the world. In: IEEE 11th International Conference on Computer Vision, ICCV’07, pp. 1–8. IEEE Computer Society (2007)

  17. Pritch, Y., Rav-Acha, A., Peleg, S.: Nonchronological video synopsis and indexing. IEEE Trans. Pattern Anal. Mach. Intell. 30, 1971–1984 (2008)

    Article  Google Scholar 

  18. Rav-Acha, A., Pritch, Y., Peleg, S.: Making a long video short: dynamic video synopsis. In: Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 1, pp. 435–441. IEEE Computer Society (2006)

  19. Smith, M.A.: Video skimming and characterization through the combination of image and language understanding techniques. In: Proceedings of the 1997 Conference on Computer Vision and Pattern Recognition, CVPR’97, pp. 775–781. IEEE Computer Society (1997)

  20. Vlachos, M., Gunopoulos, D., Kollios, G.: Discovering similar multidimensional trajectories. In: Proceedings of the 18th International Conference on Data Engineering, ICDE’02, pp. 673–684. IEEE Computer Society (2002)

  21. Vlachos, M., Gunopulos, D., Kollios, G.: Robust similarity measures for mobile object trajectories. In: Proceedings of the 13th International Workshop on Database and Expert Systems Applications, DEXA’02, pp. 721–728. IEEE Computer Society (2002)

Download references

Acknowledgments

This research was supported by Thailand Research Fund (TRF) and Commission on Higher Education (CHE). The London Gatwick surveillance video files are copyrighted and are provided for research purposes through the TREC Information Retrieval Research Collection, with thanks.

Author information

Authors and Affiliations

  1. Department of Mathematics and Computer Science, Faculty of Science, Chulalongkorn University, Bangkok, 10330, Thailand

    Nagul Cooharojananone, Siriwat Kasamwattanarote & Rajalida Lipikorn

  2. National Institute of Informatics, 2-1-2 Hitotsubashi, Chiyoda-ku, Tokyo, 101-8430, Japan

    Shin’ichi Satoh

Authors
  1. Nagul Cooharojananone
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Siriwat Kasamwattanarote
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Rajalida Lipikorn
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Shin’ichi Satoh
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Siriwat Kasamwattanarote.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Cooharojananone, N., Kasamwattanarote, S., Lipikorn, R. et al. Automated real-time video surveillance summarization framework. J Real-Time Image Proc 10, 513–532 (2015). https://doi.org/10.1007/s11554-012-0280-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11554-012-0280-7

Keywords

Search

Navigation