A Biologically Inspired Model for the Detection of External and Internal Head Motions

  • Stephan Tschechne
  • Georg Layher
  • Heiko Neumann
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8131)


Non-verbal communication signals are to a large part conveyed by visual motion information of the user’s facial components (intrinsic motion) and head (extrinsic motion). An observer perceives the visual flow as a superposition of both types of motions. However, when visual signals are used for training of classifiers for non-articulated communication signals, a decomposition is advantageous. We propose a biologically inspired model that builds upon the known functional organization of cortical motion processing at low and intermediate stages to decompose the composite motion signal. The approach extends previous models to incorporate mechanisms that represent motion gradients and direction sensitivity. The neural models operate on larger spatial scales to capture properties in flow patterns elicited by turning head movements. Center-surround mechanisms build contrast-sensitive cells and detect local facial motion. The model is probed with video samples and outputs occurrences and magnitudes of extrinsic and intrinsic motion patterns.


Social Interaction HCI Motion Patterns Cortical Processing 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Akakin, H.C., Sankur, B.: Robust Classification of Face and Head Gestures in Video. Image and Vision Computing 29, 470–483 (2011)CrossRefGoogle Scholar
  2. 2.
    Argyle, M.: Bodily Communication, vol. 2. Routledge, London (1988)Google Scholar
  3. 3.
    Bascle, B., Blake, A.: Separability of Pose and Expression in Facial Tracking and Animation. In: Proc. Int. Conf. on Computer Vision, pp. 323–328 (1998)Google Scholar
  4. 4.
    Benyon, D.: Designing Interactive Systems, 2nd edn. Pearson, Addison–Wesley, London (2010)Google Scholar
  5. 5.
    Benyon, D., Mival, O.: Landscaping Personification Technologies: From Interactions to Relationships. In: CHI Ext. Abs. on Human Factors in Computing Systems, pp. 3657–3662 (2008)Google Scholar
  6. 6.
    Black, M., Yacoob, Y.: Recognizing Facial Expressions in Image Sequences Using Local Parameterized Models of Image Motion. International Journal of Computer Vision 25(1), 23–48 (1997)CrossRefGoogle Scholar
  7. 7.
    Brox, T., Bruhn, A., Papenberg, N., Weickert, J.: High Accuracy Optical Flow Estimation Based on a Theory for Warping. In: Pajdla, T., Matas, J(G.) (eds.) ECCV 2004. LNCS, vol. 3024, pp. 25–36. Springer, Heidelberg (2004)CrossRefGoogle Scholar
  8. 8.
    Donato, G., Bartlett, M.S., Hager, J.C., Ekman, P., Sejnowski, T.J.: Classifying Facial Actions. IEEE Transactions on Pattern Analysis and Machine Intelligence 21(10), 974–989 (1999)CrossRefGoogle Scholar
  9. 9.
    Frith, C.D., Wolpert, D.M.: The Neuroscience of Social Interaction: Decoding, imitating, and influencing the actions of others. Oxford University Press (2004)Google Scholar
  10. 10.
    Longuet-Higgins, H.C.: A Computer Algorithm for Reconstructing a Scene from Two Projections. Nature 293, 133–135 (1981)CrossRefGoogle Scholar
  11. 11.
    Niese, R., Al-Hamadi, A., Farag, A., Neumann, H., Michaelis, B.: Facial Expression Recognition Based on Geometric and Optical Flow Features in Colour Image Sequences. IET Computer Vision, 1–11 (2011)Google Scholar
  12. 12.
    Orban, G.: Higher Order Visual Processing in Macaque Extrastriate Cortex. Physiology Review 88(88), 59–89 (2008)CrossRefGoogle Scholar
  13. 13.
    Rosenblum, M., Yacoob, Y., Davis, L.S.: Human Expression Recognition from Motion Using a Radial Basis Function Network Architecture. IEEE Transactions on Neural Networks 7(5), 1121–1138 (1996)CrossRefGoogle Scholar
  14. 14.
    Wendemuth, A., Biundo, S.: A Companion Technology for Cognitive Technical Systems. In: Esposito, A., Esposito, A.M., Vinciarelli, A., Hoffmann, R., Müller, V.C. (eds.) COST 2102. LNCS, vol. 7403, pp. 89–103. Springer, Heidelberg (2012)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Stephan Tschechne
    • 1
  • Georg Layher
    • 1
  • Heiko Neumann
    • 1
  1. 1.Institute of Neural Information ProcessingUniversity of UlmUlmGermany

Personalised recommendations