Chapter

Computer Vision – ACCV 2009

Volume 5996 of the series Lecture Notes in Computer Science pp 548-559

Visual Focus of Attention Recognition in the Ambient Kitchen

  • Ligeng DongAffiliated withKey Lab on Pervasive Computing, Department of Computer Science and Technology, Tsinghua University
  • , Huijun DiAffiliated withKey Lab on Pervasive Computing, Department of Computer Science and Technology, Tsinghua University
  • , Linmi TaoAffiliated withKey Lab on Pervasive Computing, Department of Computer Science and Technology, Tsinghua University
  • , Guangyou XuAffiliated withKey Lab on Pervasive Computing, Department of Computer Science and Technology, Tsinghua University
  • , Patrick OliverAffiliated withCulture Lab, Computing Science, Newcastle University

* Final gross prices may vary according to local VAT.

Get Access

Abstract

This paper presents a model for visual focus of attention recognition in the Ambient Kitchen, a pervasive computing prototyping environment. The kitchen is equipped with several blended displays on one wall and users may use information presented on these displays from multiple locations. Our goal is to recognize which display the user is looking at so that the environment can adjust the display content accordingly. We propose a dynamic Bayesian network model to infer the focus of attention, which models the relation between multiple foci of attention, multiple user locations and faces captured by the multiple cameras in the environment. Head pose is not explicitly computed but measured by a similarity vector which represents the likelihoods of multiple face clusters. Video data are collected in the Ambient Kitchen environment and experimental results demonstrate the effectiveness of our model.