Ontology-Based Approach and Implementation of ADAS System for Mobile Device Use While Driving

  • Igor Lashkov
  • Alexander Smirnov
  • Alexey Kashevnik
  • Vladimir Parfenov
Conference paper
Part of the Communications in Computer and Information Science book series (CCIS, volume 518)


Many people drive while being tired or drowsy and according to experts, many drivers fail to recognize they are in a fatigued state. The paper describes an ontology-based approach and a real-time prototype of a computer vision system for monitoring driver’s dangerous behaviour patterns such as distraction, drowsiness and reduced vigilance. Our approach focuses on widely used mobile devices, such as a smartphone or a tablet, which have become an integral part of our daily life. The main components of the system consist of a front-facing camera, gyroscope sensor installed on the smartphone and various computer vision algorithms for simultaneous, real-time and non-intrusive monitoring of various visual bio-behaviours that typically characterize a driver’s level of vigilance. The visual behaviours include eyelid movement (PERCLOS percentage of eye closure, eye blink rate), face orientation (face pose), and gaze movement (pupil movement). The two ontological models presented in the paper are a driver model and a vehicle model. Based on these models and the information available from cameras and sensors, the context is created that allows the system to determine dangerous situations using the driver mobile device mounted on the windshield of the vehicle. The system was tested in a simulated environment with subjects of different ethnic backgrounds, genders, ages, with/without glasses, and under different illumination conditions, and it was found very robust, reliable and accurate.


Ontology Context Mobile device ADAS systems 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Smirnov, A., Kashevnik, A., Lashkov, I., Hashimoto, N., Boyali, A.: Smartphone-based two-wheeled self-balancing vehicles rider assistant. In: 17th Conference of the Open Innovations Association FRUCT, Yaroslavl, Russia, pp. 201–209 (2015)Google Scholar
  2. 2.
    European Field Operational Test on Activity Safety Systems.
  3. 3.
    You, C., Lane, N., Chen, F., Wang, R., Chen, Z., Bao, T., Montes-de-Oca, M., Cheng, Y., Lin, M., Torresani, L., Campbell, A.: CarSafe app: alerting drowsy and distracted drivers using dual cameras on smartphones. In: 11th International Conference on Mobile Systems, Applications, and Services, Taipei, Taiwan, pp. 461–462 (2013)Google Scholar
  4. 4.
    iOnRoad official website.
  5. 5.
    Bergasa, L., Almería, D., Almazán, J., Yebes, J., Arroyo, R.: DriveSafe: an app for alerting inattentive drivers and scoring driving behaviors. In: IEEE Intelligent Vehicles Symposium, Dearborn, MI, USA (2014)Google Scholar
  6. 6.
    Wang, T., Cardone, G., Corradi, A., Torresani, L., Campbell, A.: WalkSafe: a pedestrian safety app for mobile phone users who walk and talk while crossing roads. In: 14th International Workshop on Mobile Computing Systems and Applications, No. 5 (2012)Google Scholar
  7. 7.
    Augmented Driving website, iOS application.
  8. 8.
  9. 9.
    Smirnov, A., Lashkov, I.: State-of-the-art analysis of available advanced driver assistance systems. In: 17th Conference of the Open Innovations Association FRUCT, Yaroslavl, Russia, pp. 345–349 (2015)Google Scholar
  10. 10.
    Wierville, W.: Overview of research on driver drowsiness definition and driver drowsiness detection, ESV, Munich (1994)Google Scholar
  11. 11.
    Dinges, D., Mallis, M., Maislin, G., Powell, J.W.: Evaluation of techniques for ocular measurement as an index of fatigue and the basis for alertness management. Department of Transportation Highway Safety Publication, 808 762 (1998)Google Scholar
  12. 12.
    Anon. Proximity array sensing system: head position monitor/metric. Advanced Safety Concepts, Inc., Sante Fe (1998)Google Scholar
  13. 13.
    OpenCV library.
  14. 14.

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • Igor Lashkov
    • 1
  • Alexander Smirnov
    • 1
    • 2
  • Alexey Kashevnik
    • 1
    • 2
  • Vladimir Parfenov
    • 1
  1. 1.ITMO UniversitySt. PetersburgRussian Federation
  2. 2.SPIIRASSt. PetersburgRussian Federation

Personalised recommendations