Skip to main content
SpringerLink
Log in

Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions

  • Chapter
  • First Online:
Application of Infrared to Biomedical Sciences

Part of the book series: Series in BioEngineering ((SERBIOENG))

Abstract

Respiratory rate is very important vital sign that should be measured and documented in many medical situations. The remote measurement of respiration rate can be especially valuable for medical screening purposes (e.g. severe acute respiratory syndrome (SARS) , pandemic influenza, etc.). In this chapter we present a review of many different studies focused on the measurements and estimation of respiration rate using thermal imaging methods. Additionally, we present results of our research focused on the evaluation of different respiration rate estimators for the needs of data processing of image sequences recorded by small, mobile thermal cameras . We used small thermal camera modules in the prototypes of smart glasses for the evaluation of different parameters related to respiration activities. The chapter presents the used methodology and results of the respiration rate analysis, detection of apnea events, description of respiration patterns and other parameters that can be analyzed for respiration waveforms derived from the regions of the nostrils or mouth in thermal video sequences.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 169.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 219.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 219.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Moses, S.: Tachypnea (increased respiratory rate). Family Practice Notebook (2016). http://www.fpnotebook.com/lung/exam/Tchypn.htm. Accessed 20 Apr 2016

  2. World Health Organization. Geneva, Switzerland: The Management of Acute Respiratory Infections in Children: Practical Guidelines for Outpatient Care (1996)

    Google Scholar 

  3. Smith, I., Mackay, J., Fahrid, N., Krucheck, D.: Respiratory rate measurement: a comparison of methods. Br. J. Healthc. Assistants 05(01), 18–23 (2011)

    Article  Google Scholar 

  4. Neuman, M.I., Monuteaux, M.C., Scully, K.J., Bachur, R.G.: Prediction of pneumonia in a pediatric emergency department. Pediatrics 128, 246–253 (2011)

    Article  Google Scholar 

  5. Nijman, R.G., Thompson, M., van Veen, M., Perera, R., Moll, H.A., Oostenbrink, R., et al.: Derivation and validation of age and temperature specific reference values and centile charts to predict lower respiratory tract infection in children with fever: prospective observational study. BMJ 2012(345), e4224 (2012)

    Article  Google Scholar 

  6. Bonita, R., Beaglehole, R., Kjellstrom, T.: Basic Epidemiology, 2nd edn. WHO, Geneva (2006)

    Google Scholar 

  7. Cretikos, M.A., Bellomo, R., Hillman, K., Chen, J., Finfer, S., Flabouris, A.: Respiratory rate: the neglected vital sign. Med. J. Aust. 188, 657–659 (2008)

    Google Scholar 

  8. Nelson, N.M.: Members of task force on prolonged apnea. Reports of the task force on prolonged apnea of the American Academy of Pediatrics. Pediatrics 61, 651–652 (1978)

    Google Scholar 

  9. Eckert, D.J., Jordan, A.S., Merchia, P., Malhotra, A.: Central sleep apnea. Pathophysiology and treatment. Chest 131(2), 595–607 (2007)

    Article  Google Scholar 

  10. Stanifer, J.W.: A peculiar type of dyspnea: Kussmaul, Cheyne-Stokes, and Biot respiration. Historia Med. 3(1), 1–7 (2015)

    Google Scholar 

  11. Braun, S.R.: Respiratory rate and pattern. In: Walker, H.K., Hall, W.D., Hurst, J.W. (eds.) Clinical Methods: The History, Physical, and Laboratory Examinations (Chapter 43), 3rd edn. Butterworths, Boston. Available from: http://www.ncbi.nlm.nih.gov/books/NBK365/

  12. Ruminski, J., Nowakowski, A., Kaczmarek, M., Hryciuk, M.: Model-based parametric images in dynamic thermography. Pol. J. Med. Phys. Eng. 6(3), 159–165 (2000)

    Google Scholar 

  13. Ruminski, J., Kaczmarek, M., Renkielska, A., Nowakowski, A.: Thermal parametric imaging in the evaluation of skin burn depth. IEEE Trans. Biomed. Eng. 54(2), 303–312 (2007)

    Article  Google Scholar 

  14. Kaczmarek, M., Nowakowski, A., Suchowirski, M., Siebert, J., Strojek, W.: Active dynamic thermography in cardiosurgery. QIRT J. 4(1), 107–123 (2007)

    Article  Google Scholar 

  15. Nowakowski, A., Kaczmarek, M., Stojek, W., Trzeciak, B., Topolewicz, J., Rogowski, J., Siebert, J.: IR-thermal monitoring of cardiosurgery interventions. In: Sloten, V., et al. (eds.) Proceedings of the 4th European Conference of the International Federation for Medical and Biological Engineering; IFMBE, vol. 22, pp. 1329–1333. ISSN 1680-0737; CD-ROM, Springer (2008)

    Google Scholar 

  16. Ng, E.Y.K., Acharya, U.R., Suri, J.S.: Performance Evaluation of Breast Cancer, Screening, Diagnosis and Treatment. American Scientific Publishers, California, USA (2010)

    Google Scholar 

  17. Arora, N., Martins, D., Ruggerio, D., Tousimis, E., Swistel, A.J., Osborne, M.P., Simmons, R.M.: Effectiveness of a noninvasive digital infrared thermal imaging system in the detection of breast cancer. Am. J. Surg. 196(4), 523–526 (2008). doi:10.1016/j.amjsurg.2008.06.015

    Article  Google Scholar 

  18. Han, F., Shi, G., Liang, C., Wang, L., Li, K.: A simple and efficient method for breast cancer diagnosis based on infrared thermal imaging. Cell Biochem. Biophys. 71(1), 491–498 (2015). doi:10.1007/s12013-014-0229-5

    Article  Google Scholar 

  19. Ring, E.F.J.: The historical development of temperature measurement in medicine. Infrared Phys. Technol. 49, 297–301 (2007)

    Article  Google Scholar 

  20. Ring, F., Jung, A., Żuber, J.: Infrared Imaging. IOP Publishing (2015). doi:10.1088/978-0-7503-1143-4

  21. Fei, J., Zhu, Z., Pavlidis, I.: Imaging breathing rate in the CO2 absorption band. In: Proceedings of the 27th Annual International Conference of the IEEE Engineering in Medicine and Biology Society, 1–4 September 2005

    Google Scholar 

  22. Murthy, R., Pavlidis, I.: Non-contact monitoring of respiratory function using infrared imaging. IEEE Eng. Med. Biol. Mag. 25, 57–68 (2006)

    Article  Google Scholar 

  23. Murthy, J.N., van Jaarsveld, J., Fei, J., Pavlidis, I., Harrykissoon, R., Lucke, J.F.: Thermal infrared imaging. A novel method to monitor airflow during polysomnography. Sleep 32, 1521–1527 (2009)

    Google Scholar 

  24. Fei, J., Pavlidis, I.: Thermistor at a distance: unobtrusive measurement of breathing. IEEE Trans. Biomed. Eng. 57(4), 988–998 (2010)

    Article  Google Scholar 

  25. Zhu, Z., Fei, J., Pavlidis, I.: Tracking human breath in infrared imaging. In: Proceedings of IEEE BIBE 2005, pp. 227–231, Minnesota, USA (2005)

    Google Scholar 

  26. Zhou, Y., Tsiamyrtzis, P., Lindner, P., Timofeyev, I., Pavlidis, I.: Spatio-temporal smoothing as a basis for facial tissue tracking in thermal imaging. IEEE Trans. Biomed. Eng. 60(5), 1280–1289 (2013)

    Article  Google Scholar 

  27. Abbas, K., Heiman, K., Orlikowsky, T., Leonhardt, S.: Non-contact respiratory monitoring based on real-time IR-thermography. In: Proceedings of WC2009 IFMBE, 25/IV, pp. 1306–1309 (2009)

    Google Scholar 

  28. Pereira, C.B., Yu, X., Czaplik, M., Rossaint, R., Blazek, V., Leonhardt, S.: Remote monitoring of breathing dynamics using infrared thermography. Biomed. Opt. Express 6(11), 4378–4394 (2015)

    Article  Google Scholar 

  29. Pereira, C.B., Yu, X., Blazek, V., Leonhardt, S.: Robust remote monitoring of breathing function by using infrared thermography. In: Proceedings of IEEE Engineering in Medicine and Biology Society (IEEE 2015), pp. 4250–4253 (2015)

    Google Scholar 

  30. Xu, B., Mestha, L.K., Pennington, G.: Monitoring respiration with a thermal imaging system, US20120289850 A1 (2012)

    Google Scholar 

  31. Lewis, G.F., Gatto, R.G., Porges, S.W.: A novel method for extracting respiration rate and relative tidal volume from infrared thermography. Psychophysiology 48(7), 877–887 (2011)

    Article  Google Scholar 

  32. AL-Khalidi, F.Q., Saatchi, R., Burke, D., Elphick, H.: Tracking human face features in thermal images for respiration monitoring. In: ACS/IEEE International Conference on Computer Systems and Applications—AICCSA 2010, pp. 1–6, Hammamet (2010)

    Google Scholar 

  33. AL-Khalidi, F.Q., Saatchi, R., Elphick, H., Burke, D.: An evaluation of thermal imaging based respiration rate monitoring in children. Am. J. Eng. Appl. Sci. 4(4), 586–597 (2011)

    Article  Google Scholar 

  34. AL-Khalidi, F.Q., Saatchi, R., Burke, D., Elphick, H., Tan, S.: Respiration rate monitoring methods: a review. Pediatr. Pulmonol. 46, 523–529 (2011)

    Article  Google Scholar 

  35. AL-Khalidi, F.Q., Elphick, H., Saatchi, R., Burke, D.: Respiratory rate measurement in children using a thermal imaging camera. Int. J. Sci. Eng. Res. 6(4), 1747–1756 (2015)

    Google Scholar 

  36. Koide, T., Yamakawa, S., Hanawa, D., Oguchi, K.: Breathing detection by far infrared (FIR) imaging in a home health care system. In: Proceedings of IEEE ISBB 2009 [USB-Memory], pp. 206–209, Melbourne, Australia (2009)

    Google Scholar 

  37. Hanawa, D., Yaginuma, Y., Enomoto, Y., Koide, T., Terada, S., Oguchi, K.: Automation of non-intrusive nasal breathing detection by using far-infrared imaging. In: Proceedings on u-Healthcare 2010 (2010)

    Google Scholar 

  38. Hanawa, D., Morimoto, T., Terada, S., Sakai, T., Shimazaki, S., Igarashi, K., Oguchi, K.: Nose detection on far infrared image for non-contact measurement of breathing. In: Proceedings on IEEE-EMBS BHI 2012 [USB-Memory], pp. 878–881, Hongkong and Shenzhen, China (2012)

    Google Scholar 

  39. Mostafa, E., Hammoud, R., Ali, A., Farag, A.: Face recognition in low resolution thermal images. Comput. Vis. Image Underst. 117(12), 1689–1694 (2013)

    Google Scholar 

  40. Dawoud, N.N., Samir, B.B., Janier, J.: Fast template matching method based optimized sum of absolute difference algorithm for face localization. Int. J. Comput. Appl. 18(8), 30–34 (2011)

    Google Scholar 

  41. Poorna, B., Priscilla, C.V.: Invariant recognition of face. In: 2010 International Conference on Computing Communication and Networking Technologies (ICCCNT), pp. 1–6, Karur (2010)

    Google Scholar 

  42. Kith, V., El-Sharkawy, M., Bergeson-Dana, T., El-Ramly, S., Elnoubi, S.: A feature and appearance based method for eye detection on gray intensity face images. In: International Conference on Computer Engineering and Systems, ICCES 2008, pp. 41–47, Cairo (2008)

    Google Scholar 

  43. Marzec, M., Koprowski, K., Wróbel, Z.: Detection of selected face areas on thermograms with elimination of typical problems. J. Med. Inform. Technol. 16 (2010)

    Google Scholar 

  44. Wang, S., Liu, Z., Shen, P., Ji, Q.: Eye localization from thermal infrared images. Pattern Recognit. 46(10), 2613–2621 (2013)

    Google Scholar 

  45. Chieh-Li, C., Bo-Lin, J.: Infrared thermal facial image sequence registration analysis and verification. Infrared Phys. Technol. 69, 1–6 (2015)

    Google Scholar 

  46. Bhattacharjee, D., Seal, A., Ganguly, S., Nasipuri, M., Kumar Basu, D.: Comparative study of human thermal face recognition based on Haar wavelet transform and local binary pattern. Intell. Neurosci. 6, 1 pp (2012)

    Google Scholar 

  47. Philip, K.E.J., Pack, E., Cambiano, V., Rollmann, H., Weil, S., O’Beirne, J.: The accuracy of respiratory rate assessment by doctors in a London teaching hospital: a cross-sectional study. J. Clin. Monit. Comput. 29(4), 455–460 (2015)

    Article  Google Scholar 

  48. Rumiński, J.: Analysis of parameters of respiration patterns extracted from thermal image sequences. Biocybern. Biomed. Eng. 2016, 1–12 (2016)

    Google Scholar 

  49. Ruminski, J.: Estimation of respiration rate using an accelerometer and thermal camera in eGlasses. In: Proceedings of the 2016 Federated Conference on Computer Science and Information Systems, 4 pp, Gdansk (2016)

    Google Scholar 

  50. Ruminski, J.: Evaluation of the respiration rate and pattern using a portable thermal camera. In: Proceedings of the 13th Quantitative Infrared Thermography Conference, pp. 1–6, Gdansk (2016). doi:10.21611/qirt.2016.107

  51. Ruminski, J.: Analysis of the parameters of respiration patterns extracted from thermal image sequences. Biocybern. Biomed. Eng. (2016) doi:10.1016/j.bbe.2016.07.006

  52. Kwasniewska, A., Ruminski, J.: Face detection in image sequences using a portable thermal camera. In: Proceedings of the 13th Quantitative Infrared Thermography Conference, pp. 1–7, Gdansk (2016) doi:10.21611/qirt.2016.071

  53. Kwasniewska, A., Ruminski, J.: Real-time facial feature tracking in poor quality thermal imagery. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore, pp. 504–510, Portsmouth, United Kingdom, (2016). doi:10.1109/HSI.2016.7529681

  54. Viola, P., Jones, M.: Robust real-time face detection. Int. J. Comput. Vis. 57(2) (2004)

    Google Scholar 

  55. OpenCV documentation. http://docs.opencv.org/. Accessed 02 May 2016

  56. Wiley Publishing, Inc., Hoboken, New Jersey: Webster’s New World Medical Dictionary, 3rd edn. MedicineNet.Com (2008). Accessed 25 May 2016

  57. Brouillette, R.T., Morrow, A.S., Weese-Mayer, D.E., Hunt, C.E.: Comparison of respiratory inductive plethysmograpy and thoracic impedance for apnea. J. Pediatr. 111(3), 377–383 (1987)

    Article  Google Scholar 

  58. Anaxsys Technology Ltd.: RespiR8. http://www.respir8.com/about_respiR8.html (2011). Accessed 23 May 2016

  59. Macknet, M.R., Kimball-Jones, P.L., Applegate, R.L., Martin, R.D., Allard, M.W.: Accuracy and tolerance of a novel bioacoustic respiratory sensor in pediatric patients. Anesthesiology A84 (2007)

    Google Scholar 

  60. Hernandez, J., McDuff, D., Picard, R.W.: Biowatch: estimation of heart and breathing rates from wrist motions. In: 9th Pervasive Health Conference, pp. 167–176, Istanbul (2015)

    Google Scholar 

  61. Standards of Practice Committe of the American Sleep Disorders Association: Practice parameters for the indications for polysomnography and related procedures. Sleep 20, 406–422 (1997)

    Google Scholar 

  62. Przystup, P., Bujnowski, A., Ruminski, J., Wtorek, J.: A multisensor detector of a sleep apnea for using at home. In: The 6th HSI Conference, IEEE Xplore, pp. 513–517 (2013)

    Google Scholar 

  63. Duong, D., Shastri, D., Tsiamyrtzis, P., Pavlidis, I.: Spatiotemporal reconstruction of the breathing function. In: Medical Image Computing and Computer Assisted Intervention—MICCAI 2012, pp. 149–156, LNCS 7510, Springer (2012)

    Google Scholar 

  64. Sörnmo, L., Laguna, P.: Bioelectrical Signal Processing in Cardiac and Neurological Applications. Academic Press (2005)

    Google Scholar 

  65. Barlow, J.S.: The Electroencephalogram: Its Patterns and Origins. MIT Press (1993)

    Google Scholar 

  66. Rumiński, J.: Reliability of pulse measurements in videoplethysmography. Metrol. Measur. Syst. 23(3), 359–371 (2016)

    Google Scholar 

  67. Ruminski, J.: The accuracy of pulse rate estimation from the sequence of face images. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore , pp. 518–524, Portsmouth, United Kingdom (2016). doi:10.1109/HSI.2016.7529683

  68. Smiatacz, M., Rumiński, J.: Local texture pattern selection for efficient face recognition and tracking. In: Proceedings of the 9th International Conference on Computer Recognition Systems CORES 2015, Advances in Intelligent Systems and Computing, pp. 359–368, Springer International Publishing (2016)

    Google Scholar 

  69. Ruminski, J., Smiatacz, M., Bujnowski, A., Andrushevich, A., Biallas, M., Kistler, R.: Interactions with recognized patients using smart glasses. In: Proceedings of HSI 2015 Conference, IEEE Xplore, pp. 187–194 (2015)

    Google Scholar 

  70. Ruminski, J., Bujnowski, A., Kocejko, T., Andrushevich, A., Biallas, M., Kistler, R.: The data exchange between smart glasses and healthcare information systems using the HL7 FHIR standard. In: 9th International Conference on Human System Interactions (HSI) IEEE Xplore, pp. 525–531, Portsmouth, United Kingdom, (2016). doi:10.1109/HSI.2016.7529684

Download references

Acknowledgements

This work has been partially supported by NCBiR, FWF, SNSF, ANR and FNR in the framework of the ERA-NET CHIST-ERA II, European project eGLASSES—The interactive eyeglasses for mobile, perceptual computing and by Statutory Funds of Electronics, Telecommunications and Informatics Faculty, Gdansk University of Technology.

Author information

Authors and Affiliations

  1. Gdansk University of Technology, Narutowicza 11/12, 80-233, Gdansk, Poland

    Jacek Ruminski & Alicja Kwasniewska

Authors
  1. Jacek Ruminski
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Alicja Kwasniewska
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jacek Ruminski .

Editor information

Editors and Affiliations

  1. College of Engineering, Nanyang Technological University, Singapore, Singapore

    Eddie YK Ng

  2. Medical Image and Signal Processing Research Center, Isfahan University of Medical Sciences, Isfahan, Iran

    Mahnaz Etehadtavakol

Rights and permissions

Reprints and permissions

Copyright information

© 2017 Springer Nature Singapore Pte Ltd.

About this chapter

Cite this chapter

Ruminski, J., Kwasniewska, A. (2017). Evaluation of Respiration Rate Using Thermal Imaging in Mobile Conditions. In: Ng, E., Etehadtavakol, M. (eds) Application of Infrared to Biomedical Sciences. Series in BioEngineering. Springer, Singapore. https://doi.org/10.1007/978-981-10-3147-2_18

Download citation

  • DOI: https://doi.org/10.1007/978-981-10-3147-2_18

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-10-3146-5

  • Online ISBN: 978-981-10-3147-2

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation