Skip to main content
SpringerLink
Log in

A color attention mechanism based on YES color space for skin segmentation

  • Original Research Paper
  • Published:
Journal of Real-Time Image Processing Aims and scope Submit manuscript

Abstract

Skin segmentation plays an important role in image processing and human–computer interaction tasks. However, it is a challenging task to accurately detect skin regions from various scenes with different illumination or color styles. In addition, in the field of video processing, reducing the computational load and improving the real-time performance of the algorithm has also become an important topic of skin segmentation. Existing deep semantic segmentation networks usually pay too much attention to the detection performance of the model and make the model structure tend to be complex, which brings heavy computational burden. To achieve the trade-off between detection performance and real-time performance of the skin segmentation algorithm, this paper proposes a lightweight skin segmentation network. Compared with existing semantic segmentation networks, this model adopts a simpler structure to improve the real-time performance. In addition, to improve the feature fitting ability of the network without slowing down its inference speed, this paper proposes a color attention mechanism, which locates skin regions in images based on the distribution features of skin colors on the E-R/G color plane generated from the YES color space, and guides the network to update parameters. Experimental results show that this method not only exhibits similar detection performance to existing semantic segmentation networks such as U-Net and DeepLab, but also the computation load of the model is 18.1% lower than Fast-SCNN.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Data availability

Before the source codes are released, the authors can carry out simulations for scholars interested in this work.

References

  1. Jones, M.J., Rehg, J.M.: Statistical color models with application to skin detection. Int. J. Comput. Vis. 46, 81–96 (2002)

    Article  MATH  Google Scholar 

  2. Francke, H., Ruiz-Del-Solar, J., Verschae, R.: Real-time hand gesture detection and recognition using boosted classifiers and active learning. In: Domingo Mery and Luis Rueda (eds.) Pacific-Rim Symposium on Image and Video Technology, pp. 533–547. Springer (2007)

  3. Wang, L., Hu, W., Tan, T.: Recent developments in human motion analysis. Pattern Recogn. 36, 585–601 (2003)

    Article  Google Scholar 

  4. Shifa, A., Imtiaz, M.B., Asghar, M.N., Fleury, M.: Skin detection and lightweight encryption for privacy protection in real-time surveillance applications. Image Vis. Comput. 94, 103859 (2020)

    Article  Google Scholar 

  5. Chen, H.S., Wang, T.M., Chen, S.H., Liu, J.S.: Skin-color correction method based on hue template mapping for wide color gamut liquid crystal display devices. Color Res. Appl. 36, 335–348 (2011)

    Article  Google Scholar 

  6. Zafarifar, B., Bellers, E.B., de With, P.H.N.: application and evaluation of texture-adaptive skin detection in TV image enhancement. In: 2013 IEEE International Conference on Consumer Electronics (ICCE), Las Vegas, NV, USA, pp. 88–91 (2013)

  7. Brancati, N., De Pietro, G., Frucci, M., Gallo, L.: Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering. Comput. Vis. Image Underst. 155, 33–42 (2017)

    Article  Google Scholar 

  8. Hsu, R.L., Abdel-Mottaleb, M., Jain, A.K.: Face detection in color images. IEEE Trans. Pattern Anal. Mach. Intell. 24, 696–706 (2002)

    Article  Google Scholar 

  9. Han, J., Awad, G., Sutherland, A.: Automatic skin segmentation and tracking in sign language recognition. IET Comput. Vis. 3, 24–35 (2009)

    Article  Google Scholar 

  10. Abbas, A.R., Farooq, A.O.: Human skin colour detection using Bayesian rough decision tree. In: Safaa O. Al-mamory, Jwan K. Alwan, Ali D. Hussein (eds.) International Conference on New Trends in Information and Communications Technology Applications, pp. 240–254. Springer, Cham (2018)

  11. Saber, E., Tekalp, A.M., Eschbach, R., Knox, K.: Automatic image annotation using adaptive color classification. Graph. Models Image Process. 58, 115–126 (1996)

    Article  Google Scholar 

  12. Wesolkowski, S., Jernigan, M., Dony, R.D.: Comparison of color image edge detectors in multiple color spaces. In: IEEE Intl Conf Image Process, 2000, Vancouver, BC, Canada, pp. 796–799 (2000)

  13. Gomez, G., Sanchez, M., Enrique Sucar, L.: On selecting an appropriate colour space for skin detection. In: MICAI 2002: Advances in Artificial Intelligence, vol 2313. Springer, Berlin, Heidelberg, pp. 69–78 (2002)

  14. Naji, S., Jalab, H.A., Kareem, S.A.: A survey on skin detection in colored images. Artif. Intell. Rev. 52, 1041–1087 (2019)

    Article  Google Scholar 

  15. Lumini, A., Nanni, L.: Fair comparison of skin detection approaches on publicly available datasets. Expert Syst. Appl. 160, 113677 (2020)

    Article  Google Scholar 

  16. Sobottka, K., Pitas, I.: A novel method for automatic face segmentation, facial feature extraction and tracking. Signal Process. Image Commun. 12, 263–281 (1998)

    Article  Google Scholar 

  17. Chai, D., Ngan, K.N.: Face segmentation using skin-color map in videophone applications. IEEE Trans. Circuits Syst. Video Technol. 9, 551–564 (1999)

    Article  Google Scholar 

  18. Garcia, C., Tziritas, G.: Face detection using quantized skin color regions merging and wavelet packet analysis. IEEE Trans. Multimed. 1, 264–277 (1999)

    Article  Google Scholar 

  19. Gupta, A., Chaudhary, A.: Robust skin segmentation using color space switching. Pattern Recognit. Image Anal. 26, 61–68 (2016)

    Article  Google Scholar 

  20. Lee, J.Y., Yoo, S.I.: An elliptical boundary model for skin color detection. In: Proc of the 2002 International Conference on Imaging Science, Systems, and Technology, Las Vegas, Nevada, USA, pp. 579–584 (2002)

  21. Wimmer, M., Radig, B.: Adaptive skin color classificatory. In: Proceedings of the first ICGST International Conference on Graphics Vision and Image Processing GVIP-05, pp. 324–327 (2005).

  22. Sun, H.M.: Skin detection for single images using dynamic skin color modeling. Pattern Recognit. 43, 1413–1420 (2010)

    Article  Google Scholar 

  23. Tan, W.R., Chan, C.S., Yogarajah, P., Condell, J.: A fusion approach for efficient human skin detection. IEEE Trans. Ind. Inf. 8, 138–147 (2012)

    Article  Google Scholar 

  24. Luo, Y., Guan, Y.P.: Adaptive skin detection using face location and facial structure estimation. IET Comput. Vis. 11, 550–559 (2017)

    Article  Google Scholar 

  25. Yang, M.H., Kriegman, D.J., Ahuja, N.: Detecting faces in images: a survey. IEEE Trans. Pattern Anal. Mach. Intell. 24, 34–58 (2002)

    Article  Google Scholar 

  26. Chai, D., Phung, S.L., Bouzerdoum, A.: A Bayesian skin/non-skin color classifier using non-parametric density estimation. In: Proceedings—IEEE International Symposium on Circuits and Systems, Bangkok, Thailand, pp. II464–II467 (2003)

  27. Phung, S.L., Chai, D., Bouzerdoum, A.: A universal and robust human skin color model using neural networks. In: Proceedings of the International Joint Conference on Neural Networks, Washington, DC, USA, pp. 2844–2849 (2001)

  28. Ronneberger, O., Fischer, P., Brox, T.: U-Net: convolutional networks for biomedical image segmentation. In: Navab, N., Hornegger, J., Wells, W., Frangi, A. (eds.) Medical Image Computing and Computer-Assisted Intervention—MICCAI 2015. MICCAI 2015. Lecture Notes in Computer Science, vol 9351, pp. 234–241. Springer, Cham (2015)

    Google Scholar 

  29. Badrinarayanan, V., Kendall, A., Cipolla, R.: SegNet: a deep convolutional encoder-decoder architecture for image segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 39, 2481–2495 (2017)

    Article  Google Scholar 

  30. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Ferrari, V., Hebert, M., Sminchisescu, C., Weiss, Y. (eds.) Computer Vision—ECCV 2018. Lecture Notes in Computer Science, pp. 833–851. Springer, Cham (2018)

    Google Scholar 

  31. He, K.M., Zhang, X.Y., Ren, S.Q., Sun, J.: Deep residual learning for image recognition. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, USA, pp. 770–778 (2016)

  32. Poudel, R.P.K., Liwicki, S., Cipolla, R.: Fast-SCNN: fast semantic segmentation network. In: British Machine Vision Conference (2019), Cardiff, Wales, UK.

  33. Levinshtein, A., Chang, C., Phung, E., Kezele, I., Guo, W., Aarabi, P.: Real-time deep hair matting on mobile devices. In: 15th CRV Conference on Computer and Robot Vision, pp. 1–7. Toronto (2018)

  34. Xu, K., Ba, J., Kiros, R., Cho, K., Courville, A., Salakhutdinov, R., Zemel, R., Bengio, Y.: Show, attend and tell: neural image caption generation with visual attention. In: Proceedings of the 32nd International Conference on International Conference on Machine Learning, Lille France, pp. 2048–2057 (2015)

  35. Kingma, D.P., Ba, J.: Adam: a method for stochastic optimization. arXiv preprint arXiv:1412.6980 (2014).

  36. Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27, 148–154 (2005)

    Article  Google Scholar 

  37. Yogarajah, P., Condell, J., Curran, K., Cheddad, A., McKevitt, P.: A dynamic threshold approach for skin segmentation in color images. In: Proceedings of International Conference Image Process, Hong Kong, China, pp. 2225–2228 (2010)

Download references

Author information

Authors and Affiliations

  1. School of Microelectronics, Tianjin University, Tianjin, China

    Shaobo Ding, Zonghui Liu & Zhichun Lei

Authors
  1. Shaobo Ding
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Zonghui Liu
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Zhichun Lei
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Zhichun Lei.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ding, S., Liu, Z. & Lei, Z. A color attention mechanism based on YES color space for skin segmentation. J Real-Time Image Proc 20, 53 (2023). https://doi.org/10.1007/s11554-023-01303-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1007/s11554-023-01303-w

Keywords

Search

Navigation