Tissue Tracking in Thermo-physiological Imagery through Spatio-temporal Smoothing

  • Yan Zhou
  • Panagiotis Tsiamyrtzis
  • Ioannis T. Pavlidis
Part of the Lecture Notes in Computer Science book series (LNCS, volume 5762)


Accurate tracking of facial tissue in thermal infrared imaging is challenging because it is affected not only by positional but also physiological (functional) changes. This article presents a particle filter tracker driven by a probabilistic template function with both spatial and temporal smoothing components, which is capable of adapting to abrupt positional and physiological changes. The method was tested on tracking facial regions of subjects under varying physiological and environmental conditions in 12 thermal clips. It demonstrated robustness and accuracy, outperforming other strategies. This new method promises improved performance in a host of biomedical applications that involve physiological measurements on the face, like unobtrusive sleep studies.


Thermal Imaging Facial Tissue Temporal Smoothing Spatial Smoothness Temporal Smoothness 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

Supplementary material

Supplementary material(1,675 KB)

Supplementary material(1,529 KB)


  1. 1.
    Eveland, C., Socolinsky, D., Wolff, L.: Tracking human faces in infrared video. Image and Vision Computing 21, 579–590 (2003)CrossRefGoogle Scholar
  2. 2.
    Kong, S., Heo, J., Abidi, B., Paik, J., Abidi, M.: Recent advances in visual and infrared face recognition - A review. Computer Vision and Image Understanding 97, 103–135 (2005)CrossRefGoogle Scholar
  3. 3.
    Sun, N., Garbey, M., Merla, A., Pavlidis, I.: Imaging the cardiovascular pulse. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, San Diego, California, vol. 2, pp. 416–421 (2005)Google Scholar
  4. 4.
    Sun, N., Pavlidis, I., Garbey, M., Fei, J.: Harvesting the thermal cardiac pulse signal. In: Larsen, R., Nielsen, M., Sporring, J. (eds.) MICCAI 2006. LNCS, vol. 4191, pp. 569–576. Springer, Heidelberg (2006)CrossRefGoogle Scholar
  5. 5.
    Murthy, R., Pavlidis, I.: Noncontact measurement of breathing function. IEEE Engineering in Medicine and Biology Magazine 25(3), 57–67 (2006)CrossRefGoogle Scholar
  6. 6.
    Chekmenev, S., Farag, A., Essock, E.: Thermal imaging of the superficial temporal artery: An arterial pulse recovery model. In: Proceedings of the 2007 IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, Minnesota, June 17-22 (2007)Google Scholar
  7. 7.
    Pavlidis, I., Dowdall, J., Sun, N., Puri, C., Fei, J., Garbey, M.: Interacting with human physiology. Computer Vision and Image Understanding 108(1-2), 150–170 (2007)CrossRefGoogle Scholar
  8. 8.
    Murthy, J., Faiz, S., Fei, J., Pavlidis, I., Abeulhagia, A., Castriota, R.: Remote infrared imaging: A novel non-contact method to monitor airflow during polysomnography. In: Chest Meeting Abstracts, Chicago, Illinois, October 20-25, vol. 132, p. 464 (2007)Google Scholar
  9. 9.
    Tsiamyrtzis, P., Dowdall, J., Shastri, D., Pavlidis, I., Frank, M., Ekman, P.: Imaging facial physiology for the detection of deceit. International Journal of Computer Vision 71(2), 197–214 (2006)CrossRefGoogle Scholar
  10. 10.
    Faser, B., Luettin, J.: Automatic facial expression analysis: A survey. Pattern Recognition 36(1), 259–275 (2003)CrossRefGoogle Scholar
  11. 11.
    Jepson, A., Fleet, D., El-Maraghi, T.: Robust online appearance models for visual tracking. IEEE Transactions of Pattern Analysis and Machine Intelligence 25(10), 415–422 (2003)CrossRefGoogle Scholar
  12. 12.
    Dowdall, J., Pavlidis, I., Tsiamyrtzis, P.: Coalitional tracking. Computer Vision and Image Understanding 106(2-3), 205–219 (2007)CrossRefGoogle Scholar
  13. 13.
    Levin, A., Lischinski, D., Weiss, Y.: A closed form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine Intelligence 30(2), 228–242 (2008)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2009

Authors and Affiliations

  • Yan Zhou
    • 1
  • Panagiotis Tsiamyrtzis
    • 2
  • Ioannis T. Pavlidis
    • 1
  1. 1.Department of Computer ScienceUniversity of HoustonHoustonUSA
  2. 2.Department of StatisticsAthens UniversityAthensGreece

Personalised recommendations