Automatic Extraction of Deceptive Behavioral Cues from Video

  • Thomas O. Meservy
  • Matthew L. Jensen
  • John Kruse
  • Judee K. Burgoon
  • Jay F. Nunamaker
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3495)


This research initiative is an initial investigation into a novel approach for deriving indicators of deception from video-taped interaction. The team utilized two-dimensional spatial inputs extracted from video to construct a set of discrete and inter-relational features. The features for thirty-eight video interactions were then analyzed using discriminant analysis. Additionally, features were used to build a multivariate regression model. Through this exploratory study, the team established the validity of the approach, and identified a number of promising features, opening the door for further investigation.


Nonverbal Behavior Video Segment Triangle Area Truth Teller Deception Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Vrij, A.: Detecting Lies and Deceit: The Psychology of Lying and the Implications for Professional Practice. John Wily & Sons Ltd, West Sussex (2000)Google Scholar
  2. 2.
    Ben-Shakhar, G., Elaad, E.: The Validity of Psychophysiological Detection of Information with the Guilty Knowledge Test: A Meta-Analytic Review. Journal of Applied Psychology 88, 131–151 (2003)CrossRefGoogle Scholar
  3. 3.
    Ganis, G., Kosslyn, S.M., Stose, S., Thompson, W.L., Yurgelun-Todd, D.A.: Neural Correlates of Different Types of Deception: An fMRI Investigation. Cerebral Cortex 13, 830–836 (2003)CrossRefGoogle Scholar
  4. 4.
    Johnson, R., Barnhardt, J., Zhu, J.: The contribution of executive processes to deceptive responding. Neuropsychologia 42, 878–901 (2004)CrossRefGoogle Scholar
  5. 5.
    Tippett, R.G.: A Comparison Between Decision Accuracy Rates Obtained Using the Polygraph Instrument and the Computer Voice Stress Analyzer in the Absence of Jeopardy. In: Florida Department of Law Enforcement, vol. 2003 (1994)Google Scholar
  6. 6.
    DePaulo, B., Lindsay, J., Malone, B., Muhlenbruck, L., Charlton, K., Cooper, H.: Cues to deception. Psychological Bulletin 129, 74–118 (2003)CrossRefGoogle Scholar
  7. 7.
    Ekman, P., Friesen, W.V.: Nonverbal Leakage and Clues to Deception. Psychiatry 32, 88–105 (1969)Google Scholar
  8. 8.
    Zuckerman, M., Driver, R.E.: Telling Lies: Verbal and Nonverbal Correlates of Deception. In: Siegman, A.W., Feldstein, S. (eds.) Nonverbal Communication: An Integrated Perspective, pp. 129–147. Erlbaum, Hillsdale (1985)Google Scholar
  9. 9.
    Buller, D., Burgoon, J., White, C., Ebesu, A.: Interpersonal Deception: VII. Behavioral Profiles of Falsification, Equivocation and Concealment. Journal of Language and Social Psychology 13, 366–395 (1994)CrossRefGoogle Scholar
  10. 10.
    Vrij, A., Edward, K., Roberts, K.P., Bull, R.: Detecting Deceit via Analysis of Verbal and Nonverbal Behavior. Journal of Nonverbal Behavior 24, 239–263 (2000)CrossRefGoogle Scholar
  11. 11.
    Buller, D.B., Burgoon, J.K.: Interpersonal Deception Theory. Communication Theory 6, 203–242 (1996)CrossRefGoogle Scholar
  12. 12.
    Lu, S., Metaxas, D., Samaras, D., Oliensis, J.: Using Multiple Cues for Hand Tracking and Model Refinement. Presented at IEEE CVPR 2003, Madison, Wisconsin (2003)Google Scholar
  13. 13.
    Lu, S., Tsechpenakis, G., Metaxas, D.N., Jensen, M.L., Kruse, J.: Blob Analysis of the Head and Hands: A Method for Deception Detection. Presented at Hawaii International Conference on System Science (HICSS 2005), Hawaii (2005)Google Scholar
  14. 14.
    Burgoon, J.K., Adkins, M., Kruse, J., Jensen, M.L., Meservy, T., Twitchell, D.P., Deokar, A., Nunamaker, J.F., Lu, S., Tsechpenakis, G., Metaxas, D.N., Younger, R.E.: An Approach for Intent Identification by Building on Deception Detection. Presented at Hawaii International Conference on System Science (HICSS 2005), Hawaii (2005)Google Scholar
  15. 15.
    Burgoon, J.K., Blair, J.P., Qin, T., Nunamaker, J.F.: Detecting Deception Through Linguistic Analysis. In: Chen, H., Miranda, R., Zeng, D.D., Demchak, C.C., Schroeder, J., Madhusudan, T. (eds.) ISI 2003. LNCS, vol. 2665, pp. 91–101. Springer, Heidelberg (2003)CrossRefGoogle Scholar
  16. 16.
    Burgoon, J.K., Blair, J.P., Moyer, E.: Effects of Communication Modality on Arousal, Cognitive Complexity, Behavioral Control and Deception Detection During Deceptive Episodes. Presented at Annual Meeting of the National Communication Association, Miami Beach, Florida (2003)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2005

Authors and Affiliations

  • Thomas O. Meservy
    • 1
  • Matthew L. Jensen
    • 1
  • John Kruse
    • 1
  • Judee K. Burgoon
    • 1
  • Jay F. Nunamaker
    • 1
  1. 1.Center for the Management of InformationUniversity of ArizonaTucson

Personalised recommendations