Semantic Interpretation of Novelty in Images Using Histograms of Oriented Gradients
An approach for the semantic interpretation of image-based novelty in real-world environments is presented. We measure novelty using the concept of pixel-based surprise, which quantifies how much a new observation changes the robot’s current probabilistic appearance model of the environment. The corresponding surprise maps are utilized as prior information to reduce the search space of a “Histograms of Oriented Gradients” object detector. Specifically, detection windows are scored and selected using surprise values. Several object classes are simultaneously searched for and learned from a low number of manually taken reference images. Experiments are performed on a human-size robot in a cluttered household environment. Compared to object detection based on a search of the complete image, a 35-fold speed-up is observed. Additionally, the detection performance increases significantly.
Keywordsobject class detection novelty detection visual attention
Unable to display preview. Download preview PDF.
- 1.Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proc. CVPR, San Diego, CA, USA (June 2005)Google Scholar
- 3.Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proc. CVPR, Kauai, Hawaii, USA (December 2001)Google Scholar
- 4.Maier, W., Mair, E., Burschka, D., Steinbach, E.: Visual homing and surprise detection for cognitive mobile robots using image-based environment representations. In: Proc. ICRA, Kobe, Japan (May 2009)Google Scholar
- 7.Wang, H., Ullah, M.M., Klaser, A., Laptev, I., Schmid, C.: Evaluation of local spatio-temporal features for action recognition. In: BMVC, London, United Kingdom (September 2009)Google Scholar
- 10.Ranganathan, A., Dellaert, F.: Bayesian surprise and landmark detection. In: Proc. ICRA, Kobe, Japan (May 2009)Google Scholar
- 11.Maier, W., Eschey, M., Steinbach, E.: Image-based object detection under varying illumination in environments with specular surfaces. In: Proc. ICIP, Brussels, Belguim (September 2011)Google Scholar
- 12.Chang, C., Lin, C.: LIBSVM: a library for support vector machines. ACM Transactions on Intelligent Systems and Technology 2(3) (2011)Google Scholar
- 13.Shum, H., Chan, S., Kang, S.: Image-Based Rendering. Springer, New York (2007)Google Scholar