Personal and Ubiquitous Computing

, Volume 16, Issue 7, pp 835–857

Context-based scene recognition from visual data in smart homes: an Information Fusion approach

  • Juan Gómez-Romero
  • Miguel A. Serrano
  • Miguel A. Patricio
  • Jesús García
  • José M. Molina
Original Article

DOI: 10.1007/s00779-011-0450-9

Cite this article as:
Gómez-Romero, J., Serrano, M.A., Patricio, M.A. et al. Pers Ubiquit Comput (2012) 16: 835. doi:10.1007/s00779-011-0450-9

Abstract

Ambient Intelligence (AmI) aims at the development of computational systems that process data acquired by sensors embedded in the environment to support users in everyday tasks. Visual sensors, however, have been scarcely used in this kind of applications, even though they provide very valuable information about scene objects: position, speed, color, texture, etc. In this paper, we propose a cognitive framework for the implementation of AmI applications based on visual sensor networks. The framework, inspired by the Information Fusion paradigm, combines a priori context knowledge represented with ontologies with real time single camera data to support logic-based high-level local interpretation of the current situation. In addition, the system is able to automatically generate feedback recommendations to adjust data acquisition procedures. Information about recognized situations is eventually collected by a central node to obtain an overall description of the scene and consequently trigger AmI services. We show the extensible and adaptable nature of the approach with a prototype system in a smart home scenario.

Keywords

Ambient intelligenceComputer visionData and information fusionContextOntologies

Copyright information

© Springer-Verlag London Limited 2011

Authors and Affiliations

  • Juan Gómez-Romero
    • 1
  • Miguel A. Serrano
    • 1
  • Miguel A. Patricio
    • 1
  • Jesús García
    • 1
  • José M. Molina
    • 1
  1. 1.University Carlos III of MadridColmenarejo, MadridSpain