Multi-modal Sensing for Distracted Driving Mitigation Using Cameras and Crowdsourcing



Driving-related accidents and human casualties are on the rise in the US and around the globe (Brace et al. in Analysis of the literature: the use of mobile phones while driving, 2007). The US government spends more than 10 billion dollars a year to address the aftermath of accidents caused due to distracted driving and driving in dangerous conditions.


Gaussian Mixture Model Traffic Congestion Dangerous Zone Cognitive Distraction Road Geometry 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


  1. 1.
    Brace C, Young K, Regan M (2007) Analysis of the literature: the use of mobile phones while driving. In VagverketGoogle Scholar
  2. 2.
    Rakauska M, Gugerty L, Ward N (2011) Effects of naturalistic cell phone conversations on driving performance. J Saf ResGoogle Scholar
  3. 3.
    David Strayer, Drews Frank (2006) Drivers on Cell Phone Are as Bad as Drunks. In U News Center University of Utah, Salt LakeGoogle Scholar
  4. 4.
    Article (2000) Cellular phones and driving: weighing the risks and benefits. In: Risk in perspective. Harvard Center for Risk AnalysisGoogle Scholar
  5. 5.
    Carol Cruzan Morton Why cell phone ban’s won’t work.
  6. 6.
    Startup. TextBlocker.
  7. 7.
    Startup. izup.
  8. 8.
    Startup. Zoomsafer.
  9. 9.
    Startup. Driversafely.
  10. 10.
    Lindqvist J, Hong J (2011) Undistracted driving: a mobile phone that doesnt distract. In: HotMobileGoogle Scholar
  11. 11.
    Insurance. Progressive snapshot.
  12. 12.
  13. 13.
    Salvucci DD, Bogunovich P (2010) Multitasking and monotasking: the effects of mental workload on deferred task interruptions. In: SIGCHI conference on human factors in computing systemsGoogle Scholar
  14. 14.
    Bogunovich P, Salvucci DD (2011) The effects of time constraints on user behavior for deferrable interruptions. In: SIGCHI conference on human factors in computing systemsGoogle Scholar
  15. 15.
    Gould SJJ, Brumby DP, Cox AL, Gonzlez VM, Salvucci DD, Taatgen NA (2012) Multitasking and interruptions: a SIG on bridging the gap between research on the micro and macro worlds. In: SIGCHI conference on human factors in, computing systemsGoogle Scholar
  16. 16.
    Lee J, Lee JD, Salvucci DD (2012) Evaluating the distraction potential of connected vehicles. In: International conference on automotive user interfaces and interactive vehicular applications (AutoUI)Google Scholar
  17. 17.
    Kushleyeva Y, Salvucci DD, Lee FJ (2005) Deciding when to switch tasks in time-critical multitasking, In: Cognitive systems researchGoogle Scholar
  18. 18.
    Salvucci DD, Mandalia HM, Kuge N, Yamamura T (2007) Lane-change detection using a computational driver model. In: Human factorsGoogle Scholar
  19. 19.
    Salvucci DD (2006) Modeling driver behavior in a cognitive architecture. In: Human factorsGoogle Scholar
  20. 20.
    Pradhan AK, Divekar G, Masserang K, Romoser M, Zafian T, Blomberg RD, Thomas FD, Reagan I, Knodler, Pollatsek AM, Fisher DL The effects of focused attention training (FOCAL) on the duration of novice drivers’ glances inside the vehicle. In: ErgonomicsGoogle Scholar
  21. 21.
    Rothenberg H, Knodler MA , Fisher D (2010) An analysis of motorcycle crash causation, In: Accident analysis and preventionGoogle Scholar
  22. 22.
    Garay-Vega L, Pradhan AK, Weinberg G, Schmidt-Nielsen B, Harsham B, Shen Y, Divekar G, Romoser M, Knodler M, Fisher DL (2010) Evaluation of different voice and touch interfaces to in-vehicle music retrieval systems. In: Accident analysis & preventionGoogle Scholar
  23. 23.
    Pradhan AK, Pollatsek A, Knodler M, Fisher DL (2009) Can younger drivers be trained to scan for information that will reduce their risk in roadway traffic scenarios that are hard to identify as hazardous? In: ErgonomicsGoogle Scholar
  24. 24.
    Gunzelmann G, Moore LR, Salvucci DD, Gluck KA (2011) Sleep loss and driver performance: quantitative predictions with zero free parameters. In: Cognitive systems researchGoogle Scholar
  25. 25.
    Chan E, Pradhan AK, Knodler MA, A. Pollatsek A, Fisher DL (2010) Evaluation on a driving simulator of the effect on drivers’ eye behaviors from distractions inside and outside the vehicle. In: Transportation researchGoogle Scholar
  26. 26.
    Kim S, Dey AK (2009) Cognitive mapping aid for senior driver’s navigation: a windshield-based 2.5D display. In: CHIGoogle Scholar
  27. 27.
    Steinfeld A, Rao SL, Tran A, Zimmerman J, Tomasic A (2012) Co-producing value through public transit information services. In: International conference on human side of service, engineeringGoogle Scholar
  28. 28.
    Steinfeld A, Zimmerman J, Tomasic A, Yoo A, Aziz R (2012) Mobile transit rider Information via Universal design and crowdsourcing. In: Transportation research record—J Transport Res BoardGoogle Scholar
  29. 29.
    Vzquez M, Steinfeld A (2010) An assisted photography method for street ccenes. In: IEEE workshop on applications of computer vision (WACV)Google Scholar
  30. 30.
    Beyene N, Cooper R, Steinfeld A (2010) Transportation independence and community participation among older Americans in Pittsburgh, PA. In: Proceedings of the rehabilitation engineering and assistive technology society of North America conferenceGoogle Scholar
  31. 31.
    Beyene N, Lane A, Seelman K, Songer T, Cooper R, Steinfeld A (2011) Navisection: a novel method joining naturalistic driving data collection with expert witness event-logging for enhanced assessment of driver safety. In: 3rd international conference on road safety and simulationGoogle Scholar
  32. 32.
    Zimmerman J, Tomasic A, Garrod C, Yoo D, Hiruncharoenvate C, Aziz R, Thirunevgadam N, Huang Y, Steinfeld A (2011) Field trial of Tiramisu: crowd-sourcing bus arrival times to spur co-design. In: Conference on human factors in computing systems (CHI)Google Scholar
  33. 33.
    Kandula S, Chandra R, Katabi D (2008) What’s going on? Learning communication rules in edge networks, In: ACM SigcommGoogle Scholar
  34. 34.
    Smyth P, Goodman RM (1991) Knowledge discovery in databases. In: MIT Press, CambridgeGoogle Scholar
  35. 35.
    Vempala S, Kannan R, Vetta A (2000) On clusterings good. Bad and spectral, In: In FOCSGoogle Scholar
  36. 36.
    Dicianno B, Cooper R, Coltallaro J (2010) Joystick control for powered mobility: current state of technology and future directions. In: Physical medicine and rehabilitation clinics of North AmericaGoogle Scholar
  37. 37.
    Salatin B, Rice I, Teodorsk IE, Ding D, Cooper R (2010) A survey of outdoor electric powered wheelchair driving. In Proceedings of the rehabilitation engineering and assistive technology society of North America ConferenceGoogle Scholar
  38. 38.
    Salatin B, Wang H, Grindle GG, Ding D, Cooper RA (2009) Electric powered wheelchair driving strategies over difficult outdoor terrain: a focus group study. In: Rehabilitation engineering and assistive technology society of North America ConferenceGoogle Scholar
  39. 39.
  40. 40.
  41. 41.
    Musthag M, Raij A, Ganesan D, Kumar S, Shiffman S (2011) Exploring micro-incentive strategies for participant compensation in high-burden studies. In: Ubicomp, Nov 2011Google Scholar
  42. 42.
    Yan T, Kumar V, Ganesan D (2010) Crowdsearch: exploiting crowds for accurate real-time image search on mobile phones. In: Proceedings of the 8th annual international conference on mobile systems, applications and servicesGoogle Scholar
  43. 43.
    Biagioni J, Gerlich T, Merrifield T, Eriksson J (2011) Easytracker: automatic transit tracking, mapping, and arrival time prediction using smartphones. In: SensysGoogle Scholar
  44. 44.
    Arvind T, James B, Tomas G, Eriksson J (2010) Cooperative transit tracking using gps-enabled smartphones, In: SensysGoogle Scholar
  45. 45.
    Zarezadeh AA, Bobda C (2011) Probabilistic framework for person tracking on embedded distributed smart cameras. In: ICDSC, pp 1–6Google Scholar
  46. 46.
    Djakou Chati H, Muhlbauer F, Braun T, Bobda C, Berns K (2007) Hardware/software co-design of a key point detector on fpga. In: FCCM ’07 proceedings of the 15th annual IEEE symposium on field-programmable custom computing machines, IEEE computer society. Washington, DC, USA, pp 355–356Google Scholar
  47. 47.
    Chati HD, Mühlbauer F, Braun T, Bobda C, Berns K (2007) Sopc architecture for a key point detector. In: FPL, pp 710–713Google Scholar
  48. 48.
    Muhlbauer F, Bobda C (2006) Design and implementation of an object tracker on a reconfigurable system on chip. In: RSP ’06: proceedings of the 17th IEEE international workshop on rapid system prototyping. Washington, DC, USA IEEE computer society, p 230Google Scholar
  49. 49.
    Christophe B, Zarezadeha Ali A, Felix M, Robert H, Kevin C (2010) Reconfigurable architecture for distributed smart cameras. In: ERSA. CSREA PressGoogle Scholar
  50. 50.
    Brooks RR, Iyengar SS (1998) Multi-sensor fusion: fundamentals and applications with software. Prentice-Hall Inc, Upper Saddle River, NJGoogle Scholar
  51. 51.
    Sun S, Meng X, Ji L, Wu J, Wong WC (2010) Adaptive sensor data fusion in motion capture. In: Information fusion (FUSION), 2010 13th conference on, pp 1–8, July 2010Google Scholar
  52. 52.
    Munz M, Ma andhlisch M, Dietmayer K (2010) Generic centralized multi sensor data fusion based on probabilistic sensor and environment models for driver assistance systems. Intell Transport Syst Mag, IEEE 2(1):6–17CrossRefGoogle Scholar
  53. 53.
    Agrawal S, Constandache I, Gaonkar S, Roy Choudhury R, Caves K, DeRuyter F (2011) Using mobile phones to write in air. In: 9th international conference on mobile systems, applications, and services, mobiSys ’11, New York, NY, USA, 2011. ACM, pp 15–28Google Scholar
  54. 54.
    Lung Chu H, Raman V, Shen J, Choudhury RR, Kansal A, Bahl V (2011) Poster: you driving? talk to you later. In: 9th international conference on mobile systems, applications, and services, MobiSys ’11, New York, NY, USA, ACM, pp 397–398Google Scholar
  55. 55.
    Azizyan M, Constandache I, Choudhury RR (2009) Surroundsense: mobile phone localization via ambience fingerprinting. In 15th annual international conference on mobile computing and networking, MobiCom ’09, New York, NY, USA, ACM, pp 261–272Google Scholar
  56. 56.
    Hansen DW, MacKay DJC, Hansen JP, Nielsen M (2004) Eye tracking off the shelf. In Proceedings of the 2004 symposium on eye tracking research & applications, ETRA ’04, New York, NY, USA, ACM, pp 58–58Google Scholar
  57. 57.
    Chau M, Betke M (2012) Real time eye tracking and blink detection with usb cameras. In: Computer science technical report BUGoogle Scholar
  58. 58.
    Duchowski AT (2007) Eye tracking methodology, theory and practice. In: Springer, BerlinGoogle Scholar
  59. 59.
    Holzman Philip S, Proctor Leonard R, Hughes Dominic W (1973) Eye-tracking patterns in schizophrenia. Science 181(4095):179–181CrossRefGoogle Scholar
  60. 60.
    Granka LA, Joachims T, Gay G (2004) Eye-tracking analysis of user behavior in www search. In Proceedings of the 27th annual international ACM SIGIR conference on research and development in information retrieval, SIGIR ’04, New York, NY, USA, ACM, pp 478–479Google Scholar
  61. 61.
    Hartmann R, Al Machot F, Mahr P, Bobda C (2010) Camera-based system for tracking and position estimation of humans. In DASIP, pp 62–67Google Scholar
  62. 62.
    Sean R (1996) Eddy Hidden markov models. Current Opin Struct Biol 6(3):361–365CrossRefGoogle Scholar
  63. 63.
    Nicholson AJ, Noble BD (2008) Breadcrumbs: forecasting mobile connectivity. In Proceedings of the 14th ACM international conference on mobile computing and networking, MobiCom ’08, New York, NY, USA, ACM, pp 46–57Google Scholar
  64. 64.
    Constandache I, Choudhury RR, Rhee I (2010) Towards mobile phone localization without war-driving. In INFOCOM, 2010 proceedings IEEE, March 2010, pp 1–9Google Scholar
  65. 65.
    Intille SS (2004) A new research challenge: persuasive technology to motivate healthy aging. Inf Technol Biomed, IEEE Trans 8(3):235–237CrossRefGoogle Scholar
  66. 66.
    Consolvo S, Klasnja P, McDonald DW, Avrahami D, Froehlich J, LeGrand L, Libby R, Mosher K, Landay JA (2008) Flowers or a robot army?: encouraging awareness & activity with personal, mobile displays. In Proceedings of the 10th international conference on ubiquitous computing, UbiComp ’08, New York, NY, USA, ACM, pp 54–63Google Scholar
  67. 67.
    Klasnja P, Consolvo S, Pratt W (2011) How to evaluate technologies for health behavior change in hci research. In: Proceedings of the 2011 annual conference on human factors in computing systems, CHI ’11, New York, NY, USA, ACM, pp 3063–3072Google Scholar
  68. 68.
    Froehlich J, Findlater L, Landay J (2010) The design of eco-feedback technology. In: Proceedings of the 28th international conference on human factors in computing systems, CHI ’10, New York, NY, USA, ACM, pp1999–2008Google Scholar
  69. 69.
    Gajos Krzysztof Z, Hurst Amy, Findlater Leah (2012) Personalized dynamic accessibility. Interactions 19(2):69–73CrossRefGoogle Scholar
  70. 70.
    Froehlich JE, Larson E, Campbell T, Haggerty C, Fogarty J, Patel SN (2009) Hydrosense: infrastructure-mediated single-point sensing of whole-home water activity. In: Proceedings of the 11th international conference on Ubiquitous computing, Ubicomp ’09. ACM, New York, USA, pp 235–244Google Scholar
  71. 71.
    Cohn G, Gupta S, Froehlich J, Larson E, Patel SN (2010) Gassense: appliance-level, single-point sensing of gas activity in the home. In: Proceedings of the 8th international conference on pervasive computing, Pervasive’10. Springer, Berlin, pp 265–282Google Scholar
  72. 72.
    Pascoe Jason, Ryan Nick, Morse David (2000) Using while moving: Hci issues in fieldwork environments. ACM Trans Comput Hum Interact 7(3):417–437CrossRefGoogle Scholar
  73. 73.
    Holland Simon, Morse David R, Gedenryd Henrik (2002) Audiogps: spatial audio navigation with a minimal attention interface. Pers Ubiquit Comput 6:253–259. doi: 10.1007/s007790200025 CrossRefGoogle Scholar
  74. 74.
    Blattner MM, Sumikawa DA, Greenberg RM (1989) Earcons and icons: their structure and common design principles. Hum Comput Inter 4(1):11–44Google Scholar
  75. 75.
    Jeon M, Nazneen N, Akanser O, Ayala-Acevedo A, Walker B (2012) "Listen2droom": helping blind individuals understand room layouts. In: Proceedings of the 2012 ACM annual conference extended abstracts on human factors in computing systems extended abstracts, CHI EA ’12. ACM, New York, USA, pp 1577–1582Google Scholar
  76. 76.
    Nees Michael A, Walker Bruce N (2011) Auditory displays for in-vehicle technologies. Reviews of Human Factors and Ergonomics 7(1):58–99Google Scholar

Copyright information

© Springer Science+Business Media New York 2014

Authors and Affiliations

  1. 1.University of Maryland Baltimore CountyBaltimoreUSA
  2. 2.University of ArkansasFayettevilleUSA

Personalised recommendations