Skip to main content

Facial Feature Recognition System Development for Enhancing Customer Experience in Cosmetics

  • Conference paper
  • First Online:
Cross-Cultural Design. Experience and Product Design Across Cultures (HCII 2021)

Part of the book series: Lecture Notes in Computer Science ((LNISA,volume 12771))

Included in the following conference series:

Abstract

Face recognition has gained increasing attention during recent years thanks to technology development, however, the majority of its application is limited to access and security, while a much wider potential is yet to be exploited. Based on the insight provided by the literature review the present work research objective has been defined as the development of a smartphone application applying neural networks to identify and classify two eye features: color and shape. The main methodology steps include eye shape and color classes definition and selection, dataset collection and preprocessing neural network development, interface flow definition and smartphone application deployment. The result is an integrated and interactive system that is able to make relevant and customized make-up suggestionS to the user, achieving satisfying performances in terms of user-friendliness and accuracy (73.89% and 74.58% for color and shape classification, respectively). The present study proposes three main findings: definition of eye shapes and color classification, development of a neural network system for eye feature classification with high accuracy performances, deployment of a user-friendly smartphone app for personalizing customer experience in cosmetics. Therefore, the main contribution of the present study is expanding potential face recognition applications as well as providing a successful example of customer value creation through creatively applying Face recognition and Neural Networks.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Alizadeh, S., Fazel, A.: Convolutional neural networks for facial expression recognition (2017)

    Google Scholar 

  2. Arya, S., Agrawal, A.: Face recognition with partial face recognition and convolutional neural network. Int. J. Adv. Res. Comput. Eng. Technol. (IJARCET) 7(1) (2018)

    Google Scholar 

  3. Balya, D., Roska, R.: Manufactured in the Netherlands. Face and eye detection by CNN algorithms. J. VLSI Signal Process. 23, 497–511 (1999)

    Article  Google Scholar 

  4. Bhele, S.G., Mankar, V.H.: A review paper on face recognition techniques. Int. J. Adv. Res. Comput. Eng. Technol. (IJARCET) 1(8) (2012)

    Google Scholar 

  5. Burton, C.: What’s Your Eye Shape? Beautilish (2012)

    Google Scholar 

  6. Cardellino, C.: Your Ultimate Guide to Applying Eyeliner on Every Single Eye Shape, Cosmpolitan (2018)

    Google Scholar 

  7. Cox, I.J., Ghosn, J., Yianilos, P.N.: Feature-based face recognition using mixture-distance. In: Computer Vision and Pattern Recognition. IEEE Press (1996)

    Google Scholar 

  8. Dubey, A.K., Jain, V.: A review of face recognition methods using deep learning network. J. Inf. Optim. Sci. 40(2), 547–558 (2019). https://doi.org/10.1080/02522667.2019.1582875

    Article  Google Scholar 

  9. Eide, A.J., Jahren, C., Jorgensen, S., Lindblad, T., Lindsey, C.S., Osterud, K.: Eye identification for face recognition with neural networks. In: Applications and Science of Artificial Neural Networks II (1996). https://doi.org/10.1117/12.235925

  10. El-Sayed, M.A., Khfagy, M.A.: An identification system using eye detection based on wavelets and neural networks. Int. J. Comput. Inf. Technol. 01(02) (2012)

    Google Scholar 

  11. Fuentes-Hurtado, F., Mas, J.A., Naranjo, V., Alcaniz, M.: Automatic classification of human facial features based on their appearance. PLoS ONE (2019)

    Google Scholar 

  12. Hassaballah, M., Aly, S.: Face recognition: challenges, achievements and Future directions’. IET Comput. Vis. 9(4), 614–626 (2015)

    Article  Google Scholar 

  13. Kamencay, P., Benco, M., Mizidos, T., Radil, R.: A new method for face recognition using convolutional neural network digital image processing and computer graphics. 15(4) (2017)

    Google Scholar 

  14. Kanade, T.: Picture processing by computer complex and recognition of human faces (1973)

    Google Scholar 

  15. Kumar, S., Sigh, S., Kumar, J.: A study on face recognition techniques with age and gender classification (2016)

    Google Scholar 

  16. Landry, L., Fute, E., Tonye, E.: CNNSFR: a convolutional neural network system for face detection and recognition. (IJACSA) Int. J. Adv. Comput. Sci. Appl. 9(12) (2018)

    Google Scholar 

  17. Lawrence, S., Giles, C.L., Tsoi, A.C., Back, A.D.: Face recognition: a convolutional, neural-network approach. IEEE Trans. Neural Netw. 8 (1997)

    Google Scholar 

  18. Lewenberg, Y., Bachrach, Y., Shankar, S., Criminsi, A.: Predicting personal traits from facial images using convolutional neural networks augmented with facial landmark information (2016)

    Google Scholar 

  19. Mohammed, A.A., Sajjanhar, A.: Experimental comparison of approaches for feature extraction of facial attributes. Int. J. Comput. Appl. 38(4), 187–198 (2016). https://doi.org/10.1080/1206212X.2016.1207427

    Article  Google Scholar 

  20. Ranjan, R., Sankaranarayanan, S., Castillo, C.D., Chellappa, R.: An all-in one convolutional neural network for face analysis (2018)

    Google Scholar 

  21. Stringa, L.: Eyes detection for face recognition . Appl. Artif. Intell. Int. J. 7(4), 365–382 (1993). https://doi.org/10.1080/08839519308949995

    Article  Google Scholar 

  22. Sutherland, K., Renshaw, D., Denyer, P.B.: Automatic face recognition. In: First International Conference on Intelligent Systems Engineering, Piscataway, NJ, pp. 29–34. IEEE Press (1992)

    Google Scholar 

  23. Zahraddeen, S., Mohamad, F.S., Yusuf, A.A., Musa, A.N., Abdulkadir, R.: Feature extraction methods for face recognition. Int. Rev. Appl. Eng. Res. (IRAER) 5(3) (2016). ISSN 2248-9967

    Google Scholar 

Download references

Acknowledgement

This work was funded by Tsinghua University Initiative Scientific Research Program 20193080010.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Pei-Luen Patrick Rau .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Chiocchia, I., Rau, PL.P. (2021). Facial Feature Recognition System Development for Enhancing Customer Experience in Cosmetics. In: Rau, PL.P. (eds) Cross-Cultural Design. Experience and Product Design Across Cultures. HCII 2021. Lecture Notes in Computer Science(), vol 12771. Springer, Cham. https://doi.org/10.1007/978-3-030-77074-7_3

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-77074-7_3

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-77073-0

  • Online ISBN: 978-3-030-77074-7

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics