Abstract
Skin detection is an essential step in many human–machine interaction systems such as e-learning, security, communication… etc., it consists of extracting regions containing the skin in a digital image. This problem has become the subject of considerable research in the scientific community where a variety of approaches has been proposed in the literature; however, few recent reviews exist. Our principal goal in this paper is to extract skin regions using a Convolutional neural network called LeNet5. Our framework is divided into three main parts: At first, a deep learning is performed to Lenet5 network using 3354 positive examples and 5590 negative examples from SFA dataset, then and after a preprocessing of each arbitrary image the trained network will classify image pixels into skin/non-skin. Lastly, a thresholding and prost-processing of classified regions is carried out. The tests were carried out on images of variable complexity: indoor, outdoor, variable lighting, simple and complex background. The results obtained are very encouraging, we show the qualitative and quantitative results obtained on SFA and BAO datasets.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Naji, S., Jalab, H.A., Kareem, S.A.: A survey on skin detection in colored images. Artif. Intell. Rev. 52, 1041–1087 (2019). https://doi.org/10.1007/s10462-018-9664-9
Zuo, H., Fan, H., Blasch, E., Ling, H.: Combining convolutional and recurrent neural networks for human skin detection. IEEE Sig. Process. Lett. 24, 289–293 (2017). https://doi.org/10.1109/LSP.2017.2654803
Zarit, B.D., Super, B.J., Quek, F.K.H.: Comparison of five color models in skin pixel classification. In: Proceedings International Workshop on Recognition, Analysis, and Tracking of Faces and Gestures in Real-Time Systems. In Conjunction with ICCV’99 (Cat. No. PR00378). pp. 58–63 (1999). https://doi.org/10.1109/RATFG.1999.799224
Phung, S.L., Bouzerdoum, A., Chai, D.: Skin segmentation using color pixel classification: analysis and comparison. IEEE Trans. Pattern Anal. Mach. Intell. 27, 148–154 (2005). https://doi.org/10.1109/TPAMI.2005.17
Ashwini, A., Murugan, S.: Automatic skin tumour segmentation using prioritized patch based region—a novel comparative technique. IETE J. Res. 1, 12 (2020). https://doi.org/10.1080/03772063.2020.1808091
Li, B., Xue, X., Fan, J.: A robust incremental learning framework for accurate skin region segmentation in color images. Pattern Recogn. 40, 3621–3632 (2007). https://doi.org/10.1016/j.patcog.2007.04.018
Poudel, R.P., Nait-Charif, H., Zhang, J.J., Liu, D.: Region-based skin color detection. In: VISAPP (1) VISAPP 2012-Proceedings of the International Conference on Computer Vision Theory and Applications 1, pp. 301–306. VISAPP (2012)
Kolkur, S., Kalbande, D., Shimpi, P., Bapat, C., Jatakia, J.: Human skin detection using RGB, HSV and YCbCr Color Models. In: Presented at the International Conference on Communication and Signal Processing 2016 (ICCASP 2016) (2016). https://doi.org/10.2991/iccasp-16.2017.51
Brancati, N., De Pietro, G., Frucci, M., Gallo, L.: Human skin detection through correlation rules between the YCb and YCr subspaces based on dynamic color clustering. Comput. Vis. Image Underst. 155, 33–42 (2017). https://doi.org/10.1016/j.cviu.2016.12.001
Verma, A., Raj, S.A., Midya, A., Chakraborty, J.: Face detection using skin color modeling and geometric feature. In: 2014 International Conference on Informatics, Electronics Vision (ICIEV). pp. 1–6 (2014). https://doi.org/10.1109/ICIEV.2014.6850755
Shaik, K.B., Ganesan, P., Kalist, V., Sathish, B.S., Jenitha, J.M.M.: Comparative study of skin color detection and segmentation in HSV and YCbCr color space. Procedia Comput. Sci. 57, 41–48 (2015)
Nadian-Ghomsheh, A.: Pixel-based skin detection based on statistical models. J. Telecommun. Electron. Comput. Eng. (JTEC) 8, 7–14 (2016)
Oghaz, M.M.D., Argyriou, V., Monekosso, D., Remagnino, P.: Skin identification using deep convolutional neural network. In: Bebis, G., Boyle, R., Parvin, B., Koracin, D., Ushizima, D., Chai, S., Sueda, S., Lin, X., Lu, A., Thalmann, D., Wang, C., Xu, P. (eds.) Advances in Visual Computing, pp. 181–193. Springer International Publishing, Cham (2019). https://doi.org/10.1007/978-3-030-33720-9_14
Kim, Y., Hwang, I., Cho, N.I.: Convolutional neural networks and training strategies for skin detection. In: 2017 IEEE International Conference on Image Processing (ICIP), pp. 3919–3923 (2017). https://doi.org/10.1109/ICIP.2017.8297017
Lecun, Y., Jackel, L.D., Bottou, L., Cartes, C., Denker, J.S., Drucker, H., Müller, U., Säckinger, E., Simard, P., Vapnik, V., et al.: Learning algorithms for classification: a comparison on handwritten digit recognition. In: Neural Networks: The Statistical Mechanics Perspective, pp. 261–276. World Scientific (1995)
Lecun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998). https://doi.org/10.1109/5.726791
Wang, G., Gong, J.: Facial expression recognition based on improved LeNet-5 CNN. In: 2019 Chinese Control and Decision Conference (CCDC), pp. 5655–5660 (2019). https://doi.org/10.1109/CCDC.2019.8832535
Zhang, C.-W., Yang, M.-Y., Zeng, H.-J., Wen, J.-P.: Pedestrian detection based on improved LeNet-5 convolutional neural network. J. Algorithms Comput. Technol. 13, 1748302619873601 (2019). https://doi.org/10.1177/1748302619873601
Zhang, C., Yue, X., Wang, R., Li, N., Ding, Y.: Study on traffic sign recognition by optimized Lenet-5 algorithm. Int. J. Patt. Recogn. Artif. Intell. 34, 2055003 (2019). https://doi.org/10.1142/S0218001420550034
Wang, T., Lu, C., Shen, G., Hong, F.: Sleep apnea detection from a single-lead ECG signal with automatic feature-extraction through a modified LeNet-5 convolutional neural network. PeerJ7, e7731 (2019) https://doi.org/10.7717/peerj.7731
Casati, J.P.B., Moraes, D.R., Rodrigues, E.L.L.: SFA: a human skin image database based on FERET and AR facial images. In: IX workshop de Visao Computational, Rio de Janeiro (2013)
Phillips, P.J., Moon, H., Rizvi, S.A., Rauss, P.J.: The FERET evaluation methodology for face-recognition algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1090–1104 (2000). https://doi.org/10.1109/34.879790
Martinez, A., Benavente, R.: The AR face database. Tech. Rep. 24 CVC Technical Report. (1998)
Wang, X., Xu, H., Wang, H., Li, H.: Robust real-time face detection with skin color detection and the modified census transform. In: 2008 International Conference on Information and Automation, pp. 590–595 (2008). https://doi.org/10.1109/ICINFA.2008.4608068
Acknowledgements
The work described herein was partially supported by 8 Mai 1945 University and PRFU project through the grant number C00L07UN240120200001. The authors thank the staff of LAIG laboratory, who provided financial support.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this paper
Cite this paper
Bordjiba, Y., Bencheriet, C.E., Mabrek, Z. (2022). Skin Detection Based on Convolutional Neural Network. In: Ben Ahmed, M., Teodorescu, HN.L., Mazri, T., Subashini, P., Boudhir, A.A. (eds) Networking, Intelligent Systems and Security. Smart Innovation, Systems and Technologies, vol 237. Springer, Singapore. https://doi.org/10.1007/978-981-16-3637-0_6
Download citation
DOI: https://doi.org/10.1007/978-981-16-3637-0_6
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-3636-3
Online ISBN: 978-981-16-3637-0
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)