Deep Learning Model for Detection of Pain Intensity from Facial Expression

  • Jeffrey SoarEmail author
  • Ghazal Bargshady
  • Xujuan Zhou
  • Frank Whittaker
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10898)


Many people who are suffering from a chronic pain face periods of acute pain and resulting problems during their illness and adequate reporting of symptoms is necessary for treatment. Some patients have difficulties in adequately alerting caregivers to their pain or describing the intensity which can impact on effective treatment. Pain and its intensity can be noticeable in ones face. Movements in facial muscles can depict ones current emotional state. Machine learning algorithms can detect pain intensity from facial expressions. The algorithm can extract and classify facial expression of pain among patients. In this paper, we propose a new deep learning model for detection of pain intensity from facial expressions. This automatic pain detection system may help clinicians to detect pain and its intensity in patients and by doing this healthcare organizations may have access to more complete and more regular information of patients regarding their pain.


  1. 1.
    Bicket, M.C., Mao, J.: Chronic pain in older adults. Anesthesiol. Clin. 33, 577–590 (2015)CrossRefGoogle Scholar
  2. 2.
    Kharghanian, R.; Peiravi, A., Moradi, F.: Pain detection from facial images using unsupervised feature learning approach. In: 2016 IEEE 38th Annual International Conference of the Engineering in Medicine and Biology Society (EMBC), pp. 419–422 (2016)Google Scholar
  3. 3.
    Thomas, D., Frascella, J., Hall, T., Smith, W., Compton, W., Koroshetz, W., Briggs, J., Grady, P., Somerman, M., Volkow, N.: Reflections on the role of opioids in the treatment of chronic pain: a shared solution for prescription opioid abuse and pain. J. Intern. Med. 278, 92–94 (2015)CrossRefGoogle Scholar
  4. 4.
    Frank, M.G., Ekman, P., Friesen, W.V.: Behavioral markers and recognizability of the smile of enjoyment. J. Pers. Soc. Psychol. 64, 83 (1993)CrossRefGoogle Scholar
  5. 5.
    Fasel, B., Luettin, J.: Automatic facial expression analysis: a survey. Pattern Recogn. 36, 259–275 (2003)CrossRefGoogle Scholar
  6. 6.
    LeCun, Y., Bengio, Y., Hinton, G.: Deep learning. Nature 521, 436 (2015)CrossRefGoogle Scholar
  7. 7.
    LeCun, Y., Bottou, L., Bengio, Y., Haffner, P.: Gradient-based learning applied to document recognition. Proc. IEEE 86, 2278–2324 (1998)CrossRefGoogle Scholar
  8. 8.
    Rumelhart, D.E., Hinton, G.E., Williams, R.J.: Learning representations by back-propagating errors. Nature 323, 533 (1986)CrossRefGoogle Scholar
  9. 9.
    Zhou, J.; Hong, X.; Su, F., Zhao, G.: Recurrent convolutional neural network regression for continuous pain intensity estimation in video. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 84–92 (2016)Google Scholar
  10. 10.
    Krizhevsky, A.; Sutskever, I., Hinton, G.E.: Imagenet classification with deep convolutional neural networks. In: Advances in Neural Information Processing Systems, pp. 1097–1105 (2012)Google Scholar
  11. 11.
    Susskind, J.M., Hinton, G.E., Movellan, J.R., Anderson, A.K.: Generating facial expressions with deep belief nets. In: Affective Computing. InTech (2008)Google Scholar
  12. 12.
    Xu, M., Cheng, W., Zhao, Q., Ma, L., Xu, F.: Facial expression recognition based on transfer learning from deep convolutional networks. In: 2015 11th International Conference on Natural Computation (ICNC), pp. 702–708 (2015)Google Scholar
  13. 13.
    Liu, M., Li, S., Shan, S., Chen, X.: AU-aware deep networks for facial expression recognition. In: 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), pp. 1–6 (2013)Google Scholar
  14. 14.
    Gudi, A., Tasli, H.E., Den Uyl, T.M., Maroulis, A.: Deep learning based facs action unit occurrence and intensity estimation. In: 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG), vol. 6, pp. 1–5 (2015)Google Scholar
  15. 15.
    Zhao, K., Chu, W.-S., Zhang, H.: Deep region and multi-label learning for facial action unit detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 3391–3399 (2016)Google Scholar
  16. 16.
    Walecki, R., Rudovic, O., Pavlovic, V., Pantic, M.: Variable-state latent conditional random field models for facial expression analysis. Image Vis. Comput. 58, 25–37 (2017)CrossRefGoogle Scholar
  17. 17.
    Lafferty, J., McCallum, A., Pereira, F.C.N.: Conditional random fields: probabilistic models for segmenting and labeling sequence data. In: Proceeding of the 18th International Conference on Machine Learning 2001 (ICML 2001), pp. 282–289 (2001)Google Scholar

Copyright information

© Springer International Publishing AG, part of Springer Nature 2018

Authors and Affiliations

  • Jeffrey Soar
    • 1
    Email author
  • Ghazal Bargshady
    • 1
  • Xujuan Zhou
    • 1
  • Frank Whittaker
    • 2
  1. 1.University of Southern QueenslandQueenslandAustralia
  2. 2.Nexus eCareMelbourneAustralia

Personalised recommendations