Driver’s Hand Detection and Tracking Based on Address Event Representation

  • Antonio Ríos
  • Cristina Conde
  • Isaac Martín de Diego
  • Enrique Cabello
Part of the Lecture Notes in Computational Vision and Biomechanics book series (LNCVB, volume 15)


This chapter presents a novel biologically-inspired system capable of detecting and tracking the hands of the driver during the driving task. The system needs neither marks nor special device in the hands, so a totally natural driving is allowed. Visual information acquisition has been made using an innovative dynamic vision sensor (DVS) that discards the frame concept entirely, encoding the information in the form of Address-Event-Representation (AER) data. This representation allows the information transmission and processing at the same time. An algorithm for detecting and tracking hands using this information in real time is presented. This method has been designed to work with infra-red visual information, avoiding the dependence of the illumination conditions. The proposed system has been integrated in a highly realistic car simulator and several tests have been carried out. Detailed experiments showing the improvement of using AER representation are presented. The presented work is the first approach to introduce AER technology in an automotive environment.


Address event representation Hands tracking Bio-inspired system 



Supported by the Minister for Science and Innovation of Spain project VULCANO (TEC2009-10639-C04-04).


  1. 1.
    Berner R (2006) Highspeed USB 2.0 AER interface, Diploma thesis, Institute of Neuroinformatics UNI–ETH Zurich, Department of architecture and computer technology, University of Seville, 14 April 2006Google Scholar
  2. 2.
    Camunas-Mesa L, Acosta-Jimenez A, Zamarreno-Ramos C, Serrano-Gotarredona T, Linares-Barranco B (2011) A 32 x 32 pixel convolution processor chip for address event vision sensors with 155 ns event latency and 20 Meps throughput. IEEE Trans Circuits Syst I Regul Pap 58(4):777–790CrossRefMathSciNetGoogle Scholar
  3. 3.
    Conradt J, Berner R, Cook M, Delbruck, T (2009) An embedded AER dynamic vision sensor for low-latency pole balancing. In: IEEE 12th international conference on computer vision workshops (ICCV workshops), pp 780–785Google Scholar
  4. 4.
    Crespo R, Martín de Diego I, Conde C, Cabello E (2010) Detection and tracking of driver’s hands in real time. In: Progress in pattern recognition, image analysis, computer vision, and applications, vol 6419. pp 212–219Google Scholar
  5. 5.
    Delbruck T (2008) Frame-free dynamic digital vision. In: Symposium on secure-life electronics, advanced electronics for quality life and society, pp 21–26Google Scholar
  6. 6.
    Union E (2004) Aide - adaptive integrated driver-vehicle interface. European project fp6 (ist-1-507674-ip).
  7. 7.
    Gómez- Rodríguez F, Miró-Amarante L, Diaz-del-Rio F, Linares-Barranco A, Jimenez G (2010) Real time multiple objects tracking based on a bio-inspired processing cascade architecture. In: Proceedings of IEEE international symposium on circuits and systems (ISCAS), pp 1399–1402Google Scholar
  8. 8.
    IEEE (2004) Standard for motor vehicle event data recorders (mvedrs).
  9. 9.
    Jimenez-Fernandez A, Fuentes-del-Bosh JL, Paz-Vicente R, Linares-Barranco A, Jiménez G (2010) Neuro-inspired system for real-time vision sensor tilt correction. In: Proceedings of 2010 IEEE international symposium on circuits and systems (ISCAS), pp 1394–1397, 30 May 2010–2 June 2010Google Scholar
  10. 10.
    Klauer S, Guo F, and Sudweeks J (2010) An analysis of driver inattention using a case-crossover approach on 100-car data: final report. National highway traffic safety administration. U.S. Department of transportation, Technical representativeGoogle Scholar
  11. 11.
    Lichtsteiner P, Posch C, Delbruck T (2008) A 128x128 120 dB 30 mW asynchronous vision sensor that responds to relative intensity change. IEEE J Solid-State Circuits 43:566–576CrossRefGoogle Scholar
  12. 12.
    Linares-Barranco A, Gomez-Rodriguez F, Jimenez-Fernandez A, Delbruck T, Lichtensteiner P (2007) Using FPGA for visuo-motor control with a silicon retina and a humanoid robot. ISCAS 2007. In: IEEE international symposium on circuits and systems, pp 1192–1195, 27–30 May 2007Google Scholar
  13. 13.
    Linares-Barranco A, Paz-Vicente R, Gómez-Rodríguez F, Jiménez A, Rivas M, Jiménez G, Civit A (2010) On the AER convolution processors for FPGA. In: Proceedings of IEEE international symposium on circuits and systems (ISCAS), pp 4237–4240Google Scholar
  14. 14.
    Litzenberger M, Posch C, Bauer D, Belbachir AN, Schön P, Kohn B, Garn H (2006) Embedded vision system for real-time object tracking using an asynchronous transient vision sensor. In: Digital signal processing workshop 12th–signal processing education, workshop 4th September 2006, pp 173–178Google Scholar
  15. 15.
    McAllister G, McKenna SJ, Ricketts IW (2000) Tracking a driver’s hands using computer vision. In: Systems, man, and cybernetics, 2000 IEEE international conference on, vol 2, pp 1388–1393Google Scholar
  16. 16.
    Nations U (2010) Decreasing driver distraction. International telecommunication union. ITU-T technology watch report, Technical representative.
  17. 17.
    NTHSA (2005) Drowsy driver detection and warning system for commercial vehicle drivers: field proportional test design, analysis and progress. In: National highway traffic safety administration, Washington, DC, Technical representatives.
  18. 18.
    Pérez-Carrasco JA et al (2010) Fast vision through frameless event-based sensing and convolutional processing: application to texture recognition. IEEE Trans Neural Networks 21:609–620Google Scholar
  19. 19.
    Serrano-Gotarredona T, Linares-Barranco B (2013) A 128 128 1.5 % Contrast Sensitivity 0.9 % FPN 3 \(\mu \)s Latency 4 mW asynchronous frame-free dynamic vision sensor using transimpedance preamplifiers. IEEE J Solid-Stated Circuits 48(3):827–838Google Scholar
  20. 20.
    Serrano-Gotarredona T, Park J, Linares-Barranco A, Jiménez A, Benosman R, Linares-Barranco B (2012) Improved contrast sensitivity DVS and its application to event-driven stereo vision, TellurideGoogle Scholar
  21. 21.
    Sivilotti M (1991) Wiring considerations in analog VLSI systems with application to field-programmable networks, Ph.D. dissertation, computer science division, California institute of technology, PasadenaGoogle Scholar
  22. 22.
    Serrano-Gotarredona R et al (2009) A 45k neuron, 5m synapse, 12g connects/s aer hardware sensory processing learningactuating system for high-speed visual object recognition and tracking. IEEE Trans Neural Networks 20(9):1417–1438CrossRefGoogle Scholar
  23. 23.
    Serrano-Gotarredona R et al (2008) On real-time aer 2-d convolutions hardware for neuromorphic spike-based cortical processing. IEEE Trans Neural Networks 19(7):1196–1219CrossRefGoogle Scholar
  24. 24.
    Tzou K (1987) Progressive image transmission: a review and comparison of techniques. Opt Eng 26(7):581–589CrossRefGoogle Scholar
  25. 25.
    Zhang H, Schreiner C, Zhang K, Torkkola K (2007) Naturalistic use of cell phones in driving and context-based user assistance. In: Proceedings of the 9th international conference on Human computer interaction with mobile devices and services, ser. MobileHCI ’07. New York, ACM, pp 273–276Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Antonio Ríos
    • 1
  • Cristina Conde
    • 1
  • Isaac Martín de Diego
    • 1
  • Enrique Cabello
    • 1
  1. 1.Face Recognition and Artificial Vision GroupUniversidad de Rey Juan CarlosMadridSpain

Personalised recommendations