Advertisement

Machine Vision and Applications

, Volume 17, Issue 2, pp 83–93 | Cite as

Tracking the activity of participants in a meeting

  • Hammadi Nait Charif
  • Stephen J. McKennaEmail author
Original Paper

Abstract

A vision system suitable for a smart meeting room able to analyse the activities of its occupants is described. Multiple people were tracked using a particle filter in which samples were iteratively re-weighted using an approximate likelihood in each frame. Trackers were automatically initialised and constrained using simple contextual knowledge of the room layout. Person–person occlusion was handled using multiple cameras. The method was evaluated on video sequences of a six person meeting. The tracker was demonstrated to outperform standard sampling importance re-sampling. All meeting participants were successfully tracked and their actions were recognised throughout the meeting scenarios tested.

Keywords

Smart meeting room Person tracking Particle filtering Action recognition 

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Ferryman, J. (ed.): Fourth IEEE International Workshop on Performance Evaluation of Tracking and Surveillance (PETS-ICVS). Graz, Austria (2003)Google Scholar
  2. 2.
    Bengio, S., Bourlard, H. (eds.): First International Workshop on Machine Learning for Multimodal Interaction (MLMI), Lecture Notes in Computer Science, vol. 3361. Springer, Martigny, Switzerland (2004)Google Scholar
  3. 3.
    Busso, C., Hernanz, S., Chu, C.-W., Kwon, S., Lee, S., Georgiou, P.G., Cohen, I., Narayanan, S.: Smart Room: Participant and speaker localization and identification. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP). Philadelphia (2005)Google Scholar
  4. 4.
    Huang, K.S., Trivedi, M.M.: Video arrays for real-time tracking of persons, head and face in an intelligent room. Machine Vis. Appl 14(2), 103–111 (2003)Google Scholar
  5. 5.
    Waibel, A., Schultz, T., Bett, M., Denecke, M., Malkin, R., Rogina, I., Stiefelhagen, R., Yang, J.: SMaRT: The smart meeting room task at ISL. In: International Conference on Acoustics, Speech, and Signal Processing (ICASSP), vol. IV, pp. 752–755 (2003)Google Scholar
  6. 6.
    Wallhoff, F., Zobl, M., Rigoll, G., Potucek, I.: Face Tracking in Meeting Room Scenarios Using Omnidirectional Views. In: International Conference on Pattern Recognition (ICPR), vol. IV, pp. 933–936. Cambridge, UK (2004)Google Scholar
  7. 7.
    Zhang, D., Gatica-Perez, D., Bengio, S., McOwan, I., Lathoud, G.: Modeling individual and group actions in meetings: a two-layer HMM framework. In: IEEE Conference on Computer Vision and Pattern Recognition: Workshop on Event Mining in Video (CVPR-EVENT). Washington DC (2004)Google Scholar
  8. 8.
    Jaimes, A., Omura, K., Nagamine, T., Hirata, K.: Memory cues for meeting video retrieval. In: First ACM Workshop on Continuous Archival and Retrieval of Personal Experiences (CARPE), pp. 74–85. New York (2004)Google Scholar
  9. 9.
    Nait-Charif, H., McKenna, S.J.: Tracking poorly modelled motion using particle filters with iterated likelihood weighting. In: Asian Conference on Computer Vision, pp. 156–161. Jeju Island, Korea (2004)Google Scholar
  10. 10.
    Isard, M., Blake, A.: Contour tracking by stochastic propagation of conditional density. In: European Conference on Computer Vision, vol. 1, pp. 343–356 (1996)Google Scholar
  11. 11.
    Gordon, N., Salmond, D., Smith, A.F.M.: Novel approach to nonlinear and non-Gaussian Bayesian state estimation. IEE Proceedings-F 140, 107–113 (1993)Google Scholar
  12. 12.
    Choo, K., Fleet, D.J.: People tracking using hybrid Monte Carlo filtering. In: IEEE International Conference on Computer Vision, pp. 321–328. Vancouver (2001)Google Scholar
  13. 13.
    Rui, Y., Chen, Y.: Better proposal distributions: Object tracking using unscented particle filter. In: IEEE Conference on Computer Vision and Pattern Recognition, pp. 786–793. Hawaii (2001)Google Scholar
  14. 14.
    Deutscher, J., Blake, A., Reid, I.: Articulated body motion capture by annealed particle filtering. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 126–133. South Carolina, USA (2000)Google Scholar
  15. 15.
    Deutscher, J., Davison, A., Reid, I.: Automatic partitioning of high dimensional search spaces associated with articulated body motion capture. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 669–676. Hawaii (2001)Google Scholar
  16. 16.
    Isard, M., MacCormick, J.: BraMBLe: A Bayesian multiple-blob tracker. In: IEEE International Conference on Computer Vision, vol. 2, pp. 34–41. Vancouver (2001)Google Scholar
  17. 17.
    Isard, M., Blake, A.: Icondensation: Unifying low-level and high-level tracking in a stochastic framework. In: European Conference on Computer Vision, vol. I, pp. 893–908. Freiburg, Germany (1998)Google Scholar
  18. 18.
    Pitt, M., Shephard, N.: Filtering via simulation: Auxiliary particle filters. J. Am. Stat. Assoc. 94(446), 590–599 (1999)zbMATHCrossRefMathSciNetGoogle Scholar
  19. 19.
    Carpenter, J., Clifford, P., Fearnhead, P.: An Improved particle filter for non-linear problems. In: IEE Proceedings on Radar and Sonar Navigation vol. 146, pp. 2–7 (1999)Google Scholar
  20. 20.
    Musso, C., Oudjane, N., LeGland, F.: Improving Regularised Particle Filters. In: Doucet, A., de Freitas, J.F.G., Gordon, N.J. (eds.) Sequential Monte Carlo Methods in Practice. Springer-Verlag, Berlin Heidelberg New York (2001)Google Scholar
  21. 21.
    Arulampalam, S., Maskell, S.R., Gordon, N.J., Clapp, T.: A tutorial on particle filters for on-line nonlinear/non-Gaussian Bayesian tracking. IEEE Trans. Signal Process. 50(2), 174–188 (2002)CrossRefGoogle Scholar
  22. 22.
    King, O., Forsyth, D.A.: How does Condensation behave with a finite number of samples? In: European Conference on Computer Vision, pp. 695–709 (2000)Google Scholar
  23. 23.
    Zlochin, M., Baram, Y.: The bias-variance dilemma of the Monte Carlo method. In: Dorffner, G., Bischof, H., Hornik, K. (eds.) Artificial Neural Networks: ICANN. Springer-Verlag, Berlin Heidelberg New York (2001)Google Scholar
  24. 24.
    Roberts, T., McKenna, S.J., Ricketts, I.W.: Adaptive learning of statistical appearance models for 3D human tracking. In: British Machine Vision Conference, pp. 333–342. Cardiff (2002)Google Scholar
  25. 25.
    Nummiaro, K., Koller-Meier, E., Van Gool, L.: A colour-based particle filter. In: Pece, A.E.C. (ed.) First International Workshop on Generative-Model-Based Vision, vol. 2002/01, pp. 53–60 (2002)Google Scholar
  26. 26.
    Birchfield, S.: Elliptical head tracking using intensity gradients and colour histograms. In: IEEE Conference on Computer Vision and Pattern Recognition. Santa Barbara, CA (1998)Google Scholar
  27. 27.
    Comaniciu, D., Ramesh, V., Meer, P.: Real-time tracking of non-rigid objects using mean shift. In: IEEE Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 142–149. South Carolina (2000)Google Scholar
  28. 28.
    Comaniciu, D., Ramesh, V., Meer, P.: Kernel-based object tracking. IEEE Trans. Pattern Anal. Machine Intell. 25(5), 564–577 (2003)CrossRefGoogle Scholar
  29. 29.
    McKenna, S.J., Jabri, S., Duric, Z., Rosenfeld, A., Wechsler, H.: Tracking groups of People. Comput. Vis. Image Understanding 80, 42–56 (2000)CrossRefzbMATHGoogle Scholar

Copyright information

© Springer-Verlag 2006

Authors and Affiliations

  1. 1.Division of Applied ComputingUniversity of DundeeDundeeScotland

Personalised recommendations