Globally the number of people with visual impairment is very high and among them majority have low vision. They face difficulties during social interactions. In order to assist visually impaired people a new system is introduced to identify the expression or emotion of the confronting person and hence enable a better communication. In this system the blind person uses camera assistance for image acquisition of the person who is interacting with him and by using an audio device the facial emotion is detected and conveyed. This system identifies the emotion such as happy, sad and surprise, thereby the blind person can have an effective social interaction. This system identifies all the basic emotions and hence is an efficient assistive tool for the blind.


Viola-Jones algorithm Face detection Feature extraction Support Vector Machine (SVM) Expression detection Classification 


  1. 1.
    Vishwakarma, B., Dange, P., Chavan, A., Chavan, A., Galiyal, H.: Face and facıal expressıons recognıtıon for blınd people. Int. Res. J. Eng. Technol. 04 (2017)Google Scholar
  2. 2.
    Stanciu, L., Blidariu, F.: Emotional states recognition by ınterpreting facial features. In: The 6th IEEE International Conference on E-Health and Bioengineering, Grigore T. Popa University of Medicine and Pharmacy, Sinaia, Romania, 22–24 June 2017Google Scholar
  3. 3.
    Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57(2), 137–154 (2004)CrossRefGoogle Scholar
  4. 4.
    Astler, D., Chau, H., Hsu, K., Hua, A., Kannan, A., Lei, L., Nathanson, M., Wang, C., Zaidi, K., Zhang, X.: Facıal And Expressıon Recognıtıon For The Blınd Usıng Computer Vısıon. Gemstone Program University of Maryland, College Park (2012)Google Scholar
  5. 5.
    Rahim, M.A., Hossain, M.N., Wahid, T., ShafiulAzam, M.: Face recognition using Local Binary Patterns (LBP). Global J. Comput. Sci. Technol. Graph. Vis. 13 (2013)Google Scholar
  6. 6.
    Jayalekshmi, J., Mathew, T.: Facial expression recognition and emotion classification system for sentiment analysis. In: 2017 International Conference on Networks & Advances in Computational Technologies (NetACT). IEEE (2017)Google Scholar
  7. 7.
    Wang, Y.-Q.: An analysıs of the Viola-Jones face detection algorithm. Image Process. On Line 4, 128–148 (2014)CrossRefGoogle Scholar
  8. 8.
    Viola, P., Jones, M.: Rapid object detection using a boosted cascade of simple features. In: Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2001, vol. 1. IEEE (2001)Google Scholar
  9. 9.
    Huang, D., et al.: Local binary patterns and its application to facial image analysis: a survey. IEEE Trans. Syst. Man Cybern. Part C (Appl. Rev.) 41(6), 765–781 (2011)CrossRefGoogle Scholar
  10. 10.
    Michel, P., El Kaliouby, R.: Real time facial expression recognition in video using support vector machines. In: Proceedings of the 5th International Conference on Multimodal Interfaces. ACM (2003)Google Scholar
  11. 11.
    Bartlett, M.S., et al.: Recognizing facial expression: machine learning and application to spontaneous behavior. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2005, vol. 2. IEEE (2005)Google Scholar
  12. 12.
    Huang, G.B., et al.: Labeled faces in the wild: a database for studying face recognition in unconstrained environments, vol. 1, no. 2. Technical report 07-49, University of Massachusetts, Amherst (2007)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Department of Computer Science and EngineeringMar Baselios College of Engineering and TechnologyThiruvananthapuramIndia

Personalised recommendations