Skip to main content
SpringerLink
Log in

Neonatal Pain Scales and Human Visual Perception: An Exploratory Analysis Based on Facial Expression Recognition and Eye-Tracking

  • Conference paper
  • First Online:
Pattern Recognition. ICPR International Workshops and Challenges (ICPR 2021)

Part of the book series: Lecture Notes in Computer Science ((LNIP,volume 12662))

Included in the following conference series:

  • 2263 Accesses

Abstract

Neonates feel pain and the more premature they are, the more immature are their pain modulation system. Facial expression recognition is a non-invasive method commonly used in clinical practice to identify and assess pain in neonates. In this context, this paper firstly carries out a systematic and state-of-the-art review of several clinical pain scales based on neonatal facial features. Then, we propose and implement an eye-tracking exploratory analysis of the neonate’s facial regions described in these scales to identify the most preferred ones visually for such pain assessment by 4 distinct sample groups of volunteers: 44 physicians, 40 health professionals, 29 parents of newborns and 30 lay people. Our results show differences in all sample groups, either experts or not, between the facial regions considered clinically relevant to the ones expressed implicitly by the human visual perception.

Supported by FEI, CAPES, CNPq and FAPESP.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    More information in [1].

References

  1. Tobii, A.B.: User’s manual tobii studio (2016). https://www.tobiipro.com/siteassets/tobii-pro/user-manuals/tobii-pro-studio-user-manual.pdf. Accessed 12 Nov 2020

  2. Anand, K.J., Carr, D.B.: The neuroanatomy, neurophysiology, and neurochemistry of pain, stress, and analgesia in newborns and children. Pediatr. Clin. North Am. 36(4), 795–822 (1989)

    Article  Google Scholar 

  3. Anand, K.J., Hickey, P.R., et al.: Pain and its effects in the human neonate and fetus. N. Engl. J. Med. 317(21), 1321–1329 (1987)

    Article  Google Scholar 

  4. Balda, R.C., Guinsburg, R.: Avaliação da dor no período neonatal. Diagnóstico e tratamento em neonatologia, pp. 577–585. Atheneu, São Paulo (2004)

    Google Scholar 

  5. Ballantyne, M., Stevens, B., McAllister, M., Dionne, K., Jack, A.: Validation of the premature infant pain profile in the clinical setting. Clin. J. Pain 15(4), 297–303 (1999)

    Article  Google Scholar 

  6. Brahnam, S., Chuang, C.F., Sexton, R.S., Shih, F.Y.: Machine assessment of neonatal facial expressions of acute pain. Decis. Support Syst. 43(4), 1242–1254 (2007)

    Article  Google Scholar 

  7. Brahnam, S., et al.: Neonatal pain detection in videos using the iCOPEvid dataset and an ensemble of descriptors extracted from Gaussian of local descriptors. Appl. Comput. Inf. (2019). https://doi.org/10.1016/j.aci.2019.05.003

  8. Buchholz, M., Karl, H.W., Pomietto, M., Lynn, A.: Pain scores in infants: a modified infant pain scale versus visual analogue. J. Pain Sympt. Manage. 15(2), 117–124 (1998)

    Article  Google Scholar 

  9. Carlini, L.P., Heideirich, T., Balda, R., Barros, M., Guinsburg, R., Thomaz, C.: Visual perception of pain in neonatal face images. Anais do XV Workshop de Visão Computacional, pp. 37–42 (2019). https://sol.sbc.org.br/index.php/wvc/article/view/7625

  10. Carlini, L.P.: A visual perception framework to analyse neonatal pain in face images. In: Campilho, A., Karray, F., Wang, Z. (eds.) ICIAR 2020. LNCS, vol. 12131, pp. 233–243. Springer, Cham (2020). https://doi.org/10.1007/978-3-030-50347-5_21

    Chapter  Google Scholar 

  11. Diatchenko, L., Nackley, A.G., Tchivileva, I.E., Shabalina, S.A., Maixner, W.: Genetic architecture of human pain perception. Trends Genet. 23(12), 605–613 (2007)

    Article  Google Scholar 

  12. van Dijk, M., Thomas, J., Millar, A., Tibboel, D., Albertyn, R.: Measuring pain and discomfort in HIV+ infants: introducing the touch visual pain scale. In: Cape Town: The 14th World Congress of Anaesthesiologists (2008)

    Google Scholar 

  13. Fournier-Charrière, E., et al.: EVENDOL, a new behavioral pain scale for children ages 0 to 7 years in the emergency department: design and validation. Pain® 153(8), 1573–1582 (2012)

    Google Scholar 

  14. Gibbins, S., et al.: Validation of the premature infant pain profile-revised (PIPP-R). Early Hum. Dev. 90(4), 189–193 (2014)

    Article  Google Scholar 

  15. Golianu, B., Krane, E.J., Galloway, K.S., Yaster, M.: Pediatric acute pain management. Pediatr. Clin. North Am. 47(3), 559–587 (2000)

    Article  Google Scholar 

  16. Grunau, R.V., Craig, K.D.: Pain expression in neonates: facial action and cry. Pain 28(3), 395–410 (1987)

    Article  Google Scholar 

  17. Grunau, R.V., Johnston, C.C., Craig, K.D.: Neonatal facial and cry responses to invasive and non-invasive procedures. Pain 42(3), 295–305 (1990)

    Article  Google Scholar 

  18. Guinsburg, R.: Avaliação e tratamento da dor no recém-nascido. J. Pediatr. (Rio J.) 75(3), 149–60 (1999)

    Article  Google Scholar 

  19. Guinsburg, R., Kopelman, B.I., Almeida, M.F.B.D., Miyoshi, M.H.: A dor do recém-nascido prematuro submetido a ventilação mecânica através de cânula traqueal. J. pediatr. (Rio J.) 82–90 (1994)

    Google Scholar 

  20. Heiderich, T.M., Leslie, A.T.F.S., Guinsburg, R.: Neonatal procedural pain can be assessed by computer software that has good sensitivity and specificity to detect facial movements. Acta Paediatr. 104(2), e63–e69 (2015)

    Article  Google Scholar 

  21. Holmqvist, K., Nyström, M., Andersson, R., Dewhurst, R., Jarodzka, H., Van de Weijer, J.: Eye Tracking: A Comprehensive Guide to Methods and Measures. OUP, Oxford (2011)

    Google Scholar 

  22. Holsti, L., Grunau, R.E.: Initial validation of the behavioral indicators of infant pain (BIIP). Pain 132(3), 264–272 (2007)

    Article  Google Scholar 

  23. Horgan, M.F.: The development and evaluation of a scale to assess pain in the post-operative neonate. Ph.D. thesis, Liverpool John Moores University (2000)

    Google Scholar 

  24. Hummel, P., Puchalski, M., Creech, S., Weiss, M.: Clinical reliability and validity of the n-pass: neonatal pain, agitation and sedation scale with prolonged pain. J. Perinatol. 28(1), 55–60 (2008)

    Article  Google Scholar 

  25. IASP: IASP publication, pain terms: a list with definitions and notes on usage. Pain (1979)

    Google Scholar 

  26. Krechel, S.W., Bildner, J.: Cries: a new neonatal postoperative pain measurement score. Initial testing of validity and reliability. Pediatr. Anesthesia 5(1), 53–61 (1995)

    Google Scholar 

  27. Lawrence, J., Alcock, D., McGrath, P., Kay, J., MacMurray, S.B., Dulberg, C.: The development of a tool to assess neonatal pain. Neonatal Netw. NN 12(6), 59 (1993)

    Google Scholar 

  28. Liaw, J.J., Yang, L.H., Chou, H.L., Yin, T., Chao, S.C., Yeh Lee, T.: Psychometric analysis of a Taiwan-version pain assessment scale for preterm infants. J. Clin. Nurs. 21, 1–2, 89–100 (2012)

    Google Scholar 

  29. Marceau, J.: Pilot study of a pain assessment tool in the neonatal intensive care unit. J. Paediatr. Child Health 39(8), 598–601 (2003)

    Article  Google Scholar 

  30. Neves, F.A.M., Corrêa, D.A.M.: Dor em recém-nascidos: a percepção da equipe de saúde. Ciência, Cuidado e Saúde 7(4), 461–467 (2008)

    Google Scholar 

  31. Rushforth, J.A., Levene, M.I.: Behavioural response to pain in healthy neonates. Arch. Disease Childh. Fetal Neonatal Edn. 70(3), F174–F176 (1994)

    Article  Google Scholar 

  32. Teruel, G.F., Heiderich, T.M., Guinsburg, R., Thomaz, C.E.: Analysis and recognition of pain in 2d face images of full term and healthy newborns. In: Proceedings of the XV Encontro Nacional de Inteligencia Artificial, ENIAC, vol. 2018, pp. 228–239 (2018)

    Google Scholar 

  33. Zamzmi, G., Paul, R., Goldgof, D., Kasturi, R., Sun, Y.: Pain assessment from facial expression: neonatal convolutional neural network (N-CNN). In: 2019 International Joint Conference on Neural Networks (IJCNN), pp. 1–7. IEEE (2019)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. University Center of FEI, São Bernardo do Campo, SP, Brazil

    Lucas Pereira Carlini, Fernanda Goyo Tamanaka, Tatiany M. Heideirich & Carlos Eduardo Thomaz

  2. Federal University of São Paulo, São Paulo, SP, Brazil

    Juliana C. A. Soares, Giselle V. T. Silva, Rita C. X. Balda, Marina C. M. Barros & Ruth Guinsburg

Authors
  1. Lucas Pereira Carlini
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Fernanda Goyo Tamanaka
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Juliana C. A. Soares
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Giselle V. T. Silva
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Tatiany M. Heideirich
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Rita C. X. Balda
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Marina C. M. Barros
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Ruth Guinsburg
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Carlos Eduardo Thomaz
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding authors

Correspondence to Lucas Pereira Carlini or Carlos Eduardo Thomaz .

Editor information

Editors and Affiliations

  1. Dipartimento di Ingegneria dell’Informazione, University of Firenze, Firenze, Italy

    Alberto Del Bimbo

  2. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Rita Cucchiara

  3. Department of Computer Science, Boston University, Boston, MA, USA

    Stan Sclaroff

  4. Dipartimento di Matematica e Informatica, University of Catania, Catania, Italy

    Giovanni Maria Farinella

  5. Cloud & AI, JD.COM, Beijing, China

    Tao Mei

  6. Dipartimento di Ingegneria dell’Informazione, Universita di Firenze, Firenze, Italy

    Marco Bertini

  7. Computational Sciences Department, National Institute of Astrophysics, Optics and Electronics (INAOE), Tonantzintla, Puebla, Mexico

    Hugo Jair Escalante

  8. Dipartimento di Ingegneria “Enzo Ferrari”, Università di Modena e Reggio Emilia, Modena, Italy

    Roberto Vezzani

Rights and permissions

Reprints and permissions

Copyright information

© 2021 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Carlini, L.P. et al. (2021). Neonatal Pain Scales and Human Visual Perception: An Exploratory Analysis Based on Facial Expression Recognition and Eye-Tracking. In: Del Bimbo, A., et al. Pattern Recognition. ICPR International Workshops and Challenges. ICPR 2021. Lecture Notes in Computer Science(), vol 12662. Springer, Cham. https://doi.org/10.1007/978-3-030-68790-8_6

Download citation

  • DOI: https://doi.org/10.1007/978-3-030-68790-8_6

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-030-68789-2

  • Online ISBN: 978-3-030-68790-8

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Societies and partnerships

Search

Navigation