Abstract
Prematurely born infants are observed at a Neonatal Intensive Care Unit (NICU) for medical treatment. Whereas vital body functions are continuously monitored, their incubator is covered by a blanket for medical reasons. This prevents visual observation of the newborns during most time of the day, while it is known that the facial expression can give valuable information about the presence of discomfort.
This prompted the authors to develop a prototype of an automated video survey system for the detection of discomfort in newborn babies by analysis of their facial expression. Since only a reliable and situation-independent system is useful, we focus at robustness against non-ideal viewpoints and lighting conditions. Our proposed algorithm automatically segments the face from the background and localizes the eye, eyebrow and mouth regions. Based upon measurements in these regions, a hierarchical classifier is employed to discriminate between the behavioral states sleep, awake and cry.
We have evaluated the described prototype system on recordings of three healthy newborns, and we show that our algorithm operates with approximately 95% accuracy. Small changes in viewpoint and lighting conditions are allowed, but when there is a major reduction in light, or when the viewpoint is far from frontal, the algorithm fails.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
Preview
Unable to display preview. Download preview PDF.
References
Grunau, R.V.E., Craig, K.D.: Pain expression in neonates: facial action and cry. Pain 28(3), 395–410 (1987)
Stevens, B., Johnston, C., Pethryshen, P., Taddio, A.: Premature Infant Pain Profile: Development and Initial Validation. Clin. J. Pain 12(1), 13–22 (1996)
Chen, K., Chang, S., Hsiao, T., Chen, Y., Lin, C.: A neonatal facial image scoring system (NFISS) for pain response studies. BME ABC, 79–85 (2005)
Brahnam, S., Chuang, C., Shih, F.Y., Slack, M.R.: Machine recognition and representation of neonatal facial displays of acute pain. Artificial Intelligence in Medicine 36(3), 211–222 (2006)
Brahnam, S., Chuang, C., Sexton, R.S., Shih, F.Y.: Machine assessment of neonatal facial expressions of acute pain. Special Issue on Decision Support in Medicine in Decision Support Systems 43, 1247–1254 (2007)
Peng, K., Chen, L.: A Robust Algorithm for Eye Detection on Gray Intensity Face without Spectacles. Journal of Computer Science and Technology, 127–132 (2005)
Vezhnevets, V., Degtiareva, A.: Robust and Accurate Eye Contour Extraction. In: Proc. Graphicon, pp. 81–84 (2003)
Asteriadis, S., Nikolaidis, N., Hajdu, A., Pitas, I.: A novel eye-detection algorithm utilizing edge-related geometrical information. In: EUSIPCO 2006 (2006)
Sohail, A.S.M., Bhattacharya, P.: Classification of facial expressions using k-nearest neighbor classifier. In: Gagalowicz, A., Philips, W. (eds.) MIRAGE 2007. LNCS, vol. 4418, pp. 555–566. Springer, Heidelberg (2007)
Michel, P., Kaliouby, R.: Real time facial expression recognition in video using support vector machines. In: ICMI (2003)
Ioannou, S.V., Raouzaiou, A.T., Tzouvaras, V.A., Mailis, T.P., Karpouzis, K.C., Kollias, S.D.: Emotion recognition through facial expression analysis based on a neurofuzzy network. Neural Networks 18, 423–435 (2005)
Tian, Y., Kanade, T., Cohn, J.F.: Recognizing action units for facial expression analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence 23(2), 97–115 (2001)
Chen, Q., Cham, W., Lee, K.: Extracting eyebrow contour and chin contour for face recognition. Pattern Recognition 40(8), 2292–2300 (2007)
Gomez, E., Travieso, C.M., Briceno, J.C., Ferrer, M.A.: Biometric identification system by lip shape, Security Technology (2002)
Leung, S., Wang, S., Lau, W.: Lip image segmentation using fuzzy clustering incorporating an elliptic shape function. IEEE Transactions on Image Processing 13(1), 51–61 (2004)
Gocke, R., Millar, J.B., Zelensky, A., Robert-Ribes, J.: Automatic extraction of lip feature points. In: Proc. of ACRA 2000, pp. 31–36 (2000)
Author information
Authors and Affiliations
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2009 Springer-Verlag Berlin Heidelberg
About this paper
Cite this paper
Hazelhoff, L., Han, J., Bambang-Oetomo, S., de With, P.H.N. (2009). Behavioral State Detection of Newborns Based on Facial Expression Analysis. In: Blanc-Talon, J., Philips, W., Popescu, D., Scheunders, P. (eds) Advanced Concepts for Intelligent Vision Systems. ACIVS 2009. Lecture Notes in Computer Science, vol 5807. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-642-04697-1_65
Download citation
DOI: https://doi.org/10.1007/978-3-642-04697-1_65
Publisher Name: Springer, Berlin, Heidelberg
Print ISBN: 978-3-642-04696-4
Online ISBN: 978-3-642-04697-1
eBook Packages: Computer ScienceComputer Science (R0)