Abstract
Event detection has advanced significantly in the past decades relying on pixel- and feature-level representations of video-clips. Although effective those representations have difficulty on incorporating scene semantics. Ontology and description-based approaches can explicitly embed scene semantics, but their deterministic nature is susceptible to noise from underlying components of vision systems. We propose a probabilistic framework to handle uncertainty on a constraint-based ontology framework for event detection. This work focuses on elementary event (scenario) uncertainty and proposes probabilistic constraints to quantify the spatial relationship between person and contextual objects. The uncertainty modeling framework is demonstrated on the detection of activities of daily living of participants of an Alzheimer’s disease study, monitored by a vision system using a RGB-D sensor (Kinect, Microsoft) as input. Two evaluations were carried out: the first, a 3-fold cross-validation focusing on elementary scenario detection (n:10 participants); and the second devoted for complex scenario detection (semi-probabilistic approach, n:45). Results showed the uncertainty modeling improves the detection of elementary scenarios in recall (e.g., In zone phone: 84 to 100 %) and precision indices (e.g., In zone Reading: 54.5 to 85.7%), and the recall of Complex scenarios.
Chapter PDF
Similar content being viewed by others
References
Brendel, W., Fern, A., Todorovic, S.: Probabilistic event logic for interval-based event recognition. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3329–3336, June 2011
Cao, Y., Tao, L., Xu, G.: An event-driven context model in elderly health monitoring. In: Symposia and Workshops on Ubiquitous, Autonomic and Trusted Computing, pp. 120–124 (2009)
Ceusters, W., Corso, J.J., Fu, Y., Petropoulos, M., Krovi, V.: Introducing ontological realism for semi-supervised detection and annotation of operationally significant activity in surveillance videos. In: Proceedings of the 5th International Conference on Semantic Technologies for Intelligence, Defense and Security (STIDS) (2010). http://www.cse.buffalo.edu/jcorso/pubs/stids2010_istare_withresponses.pdf
Chau, D.P., Bremond, F., Thonnat, M.: A multi-feature tracking algorithm enabling adaptation to context (2011)
Crispim-Junior, C., Bathrinarayanan, V., Fosty, B., Konig, A., Romdhane, R., Thonnat, M., Bremond, F.: Evaluation of a monitoring system for event recognition of older people. In: 2013 10th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 165–170, August 2013
Folstein, M.F., Robins, L.N., Helzer, J.E.: The mini-mental state examination. Archives of General Psychiatry 40(7), 812 (1983). http://dx.doi.org/10.1001/archpsyc.1983.01790060110016
Izadinia, Hamid, Shah, Mubarak: Recognizing Complex Events Using Large Margin Joint Low-Level Event Model. In: Fitzgibbon, Andrew, Lazebnik, Svetlana, Perona, Pietro, Sato, Yoichi, Schmid, Cordelia (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 430–444. Springer, Heidelberg (2012)
Kitani, Kris M., Ziebart, Brian D., Bagnell, James Andrew, Hebert, Martial: Activity Forecasting. In: Fitzgibbon, Andrew, Lazebnik, Svetlana, Perona, Pietro, Sato, Yoichi, Schmid, Cordelia (eds.) ECCV 2012, Part IV. LNCS, vol. 7575, pp. 201–214. Springer, Heidelberg (2012)
Kumar, P., Ranganath, S., Weimin, H., Sengupta, K.: Framework for real-time behavior interpretation from traffic video. IEEE Transactions on Intelligent Transportation Systems 6(1), 43–53 (2005)
Kwak, S., Han, B., Han, J.H.: Scenario-based video event recognition by constraint flow. In: CVPR, pp. 3345–3352. IEEE (2011)
Lavee, G., Rivlin, E., Rudzsky, M.: Understanding video events: A survey of methods for automatic interpretation of semantic occurrences in video. IEEE Transactions on Systems, Man, and Cybernetics, Part C: Applications and Reviews 39(5), 489–504 (2009)
Le, Q.V., Zou, W.Y., Yeung, S.Y., Ng, A.Y.: Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis. In: Proceedings of the 2011 IEEE Conference on Computer Vision and Pattern Recognition, CVPR 2011, pp. 3361–3368. IEEE Computer Society, Washington, DC (2011). http://dx.doi.org/10.1109/CVPR.2011.5995496
Lv, F., Song, X., Wu, B., Kumar, V., Nevatia, S.R.: Left luggage detection using bayesian inference. In: PETS (2006)
Nghiem, A.T., Auvinet, E., Meunier, J.: Head detection using kinect camera and its application to fall detection. In: 2012 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA), pp. 164–169. July 2012
Oltramari, A., Lebiere, C.: Using ontologies in a cognitivegrounded system: Automatic action recognition in video surveillance. In: Proceedings of STIDS 2012 (7th International Conference on “Semantic Technology for Intelligence, Defense, and Security (2013)
Park, S., Aggarwal, J.K.: A hierarchical bayesian network for event recognition of human actions and interactions. Multimedia Syst. 10(2), 164–179 (2004)
Ryoo, M.S., Aggarwal, J.K.: Recognition of composite human activities through context-free grammar based representation. In: CVPR (2), pp. 1709–1718. IEEE Computer Society (2006)
Ryoo, M.S., Aggarwal, J.K.: Semantic representation and recognition of continued and recursive human activities. International Journal of Computer Vision 82(1), 1–24 (2009)
Tran, Son D., Davis, Larry S.: Event Modeling and Recognition Using Markov Logic Networks. In: Forsyth, David, Torr, Philip, Zisserman, Andrew (eds.) ECCV 2008, Part II. LNCS, vol. 5303, pp. 610–623. Springer, Heidelberg (2008)
Vu, V.T., Bremond, F., Thonnat, M.: Automatic video interpretation: A novel algorithm for temporal scenario recognition. In: Proc. 8th Int. Joint Conf. Artif. Intell., pp. 9–15 (2003)
Wang, H., Klaser, A., Schmid, C., Liu, C.L.: Action recognition by dense trajectories. In: 2011 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 3169–3176, June 2011
Zaidenberg, S., Boulay, B., Brmond, F.: A generic framework for video understanding applied to group behavior recognition. CoRR abs/1206.5065 (2012)
Zouba, N., Bremond, F., Thonnat, M.: An activity monitoring system for real elderly at home: Validation study. In: 2010 Seventh IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS), pp. 278–285, August 2010
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2015 Springer International Publishing Switzerland
About this paper
Cite this paper
Crispim-Junior, C.F., Bremond, F. (2015). Uncertainty Modeling Framework for Constraint-Based Elementary Scenario Detection in Vision Systems. In: Agapito, L., Bronstein, M., Rother, C. (eds) Computer Vision - ECCV 2014 Workshops. ECCV 2014. Lecture Notes in Computer Science(), vol 8926. Springer, Cham. https://doi.org/10.1007/978-3-319-16181-5_19
Download citation
DOI: https://doi.org/10.1007/978-3-319-16181-5_19
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-16180-8
Online ISBN: 978-3-319-16181-5
eBook Packages: Computer ScienceComputer Science (R0)