Abstract
In the last two years, millions of lives have been lost due to COVID-19. Despite the vaccination programmes for a year, hospitalization rates and deaths are still high due to the new variants of COVID-19. Stringent guidelines and COVID-19 screening measures such as temperature check and mask check at all public places are helping reduce the spread of COVID-19. Visual inspections to ensure these screening measures can be taxing and erroneous. Automated inspection ensures an effective and accurate screening. Traditional approaches involve identification of faces and masks from visual camera images followed by extraction of temperature values from thermal imaging cameras. Use of visual imaging as a primary modality limits these applications only for good-lighting conditions. The use of thermal imaging alone for these screening measures makes the system invariant to illumination. However, lack of open source datasets is an issue to develop such systems. In this paper, we discuss our work on using machine learning over thermal video streams for face and mask detection and subsequent temperature screening in a passive non-invasive way that enables an effective automated COVID-19 screening method in public places. We open source our NTIC dataset that was used for training our models and was collected at 8 different locations. Our results show that the use of thermal imaging is as effective as visual imaging in the presence of high illumination. This performance stays the same for thermal images even under low-lighting conditions, whereas the performance with visual trained classifiers show more than 50% degradation.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
WHO Covid-19 Dashboard: https://covid19.who.int/
Cheng, K.K., Lam, T.H., Leung, C.C.: Wearing face masks in the community during the COVID-19 pandemic: altruism and solidarity. The Lancet 399(10336), e39-e40 (2022)
Mizrahi, B., et al.: Longitudinal symptom dynamics of COVID-19 infection. Nature communications 11(1), 1–10 (2020)
Sun, C., Zhai, Z.: The efficacy of social distance and ventilation effectiveness in preventing COVID-19 transmission. Sustain. Cities Soc. 62, 102390 (2020)
Martin, A., et al.: An artificial intelligence-based first-line defence against COVID-19: digitally screening citizens for risks via a chatbot. Scientific reports 10(1), 1–7 (2020)
Loey, M., et al.: A hybrid deep transfer learning model with machine learning methods for face mask detection in the era of the COVID-19 pandemic. Measurement 167, 108288 (2021)
Somboonkaew, A., et al. Mobile-platform for automatic fever screening system based on infrared forehead temperature. Opto-Electronics and Communications Conference (OECC) and Photonics Global Conference (PGC). IEEE, pp. 1–4 (2017)
Mallat, K., Dugelay, J.-L.: A benchmark database of visible and thermal paired face images across multiple variations. In: 2018 International Conference of the Biometrics Special Interest Group (BIOSIG). IEEE (2018)
Wang, S., et al.: A natural visible and infrared facial expression database for expression recognition and emotion inference. IEEE Transactions on Multimedia 12(7), 682–691 (2010)
Grgic, M., Delac, K., Grgic, S.: SCface–surveillance cameras face database. Multimedia tools and applications 51(3), 863–879 (2011)
Larxel: Face Mask Detection (December 2022) https://www.kaggle.com/andrewmvd/face-mask-detection
ITU: ITU-R Recommendations Retrieved BT.601. https://www.itu.int/rec/R-REC-BT.601/
Redmon, J., Farhadi, A.: Yolov3: An incremental improvement (2018). arXiv preprint arXiv:1804.02767
Sandler, M., Howard, A., Zhu, M., Zhmoginov, A., Chen, L-C.: Mobilenetv2: Inverted residuals and linear bottlenecks. In: Proceedings of the IEEE conference on computer vision and pattern recognition, 4510–4520 (2018)
Kumar, A., Kaur, A., Kumar, M.: Face detection techniques: a review. Artif. Intell. Rev. 52(2), 927–948 (2018). https://doi.org/10.1007/s10462-018-9650-2
Liu, W., et al.: Ssd: Single shot multibox detector. In: European conference on computer vision, pp. 21–37. Springer, Cham (2016)
Ferrari, C., Berlincioni, L., Bertini, M., Del Bimbo, A: Inner eye canthus localization for human body temperature screening. In: 2020 25th International Conference on Pattern Recognition (ICPR), pp. 8833–8840. IEEE (2021)
Zhou, Y., et al.: Clinical evaluation of fever-screening thermography: impact of consensus guidelines and facial measurement location. Journal of Biomedical optics 25(9), 097002 (2020)
Chavda, A., Dsouza, J., Badgujar, S., Damani, A.: Multi-stage cnn architecture for face mask detection. In: 2021 6th International Conference for Convergence in Technology (I2CT), pp. 1–8. IEEE (2021)
Venkateswarlu, I.B., Kakarla, J., Prakash, S.: Face mask detection using mobilenet and global pooling block. In: 2020 IEEE 4th conference on information & communication technology (CICT). IEEE (2020)
Nagrath, P., Jain, R., Madan, A., Arora, R., Kataria, P., Hemanth, J.: SSDMNV2: A real time DNN-based face mask detection system using single shot multibox detector and MobileNetV2. Sustain. Cities Soc. 66, 102692 (2021)
Ren, S., He, K., Girshick, R., Sun, J.: Faster r-cnn: Towards real-time object detection with region proposal networks. Adv. Neural. Inf. Process. Syst. 28, 91–99 (2015)
Dai, J., Li, Y., He, K., Sun, J.: R-fcn: Object detection via region-based fully convolutional networks. In: Advances in neural information processing systems, pp. 379–387 (2016)
Cho, Y., Julier, S.J., Marquardt, N., Bianchi-Berthouze, N.: Robust tracking of respiratory rate in high-dynamic range scenes using mobile thermal imaging. Biomed. Opt. Express 8(10), 4480–4503 (2017)
Acknowledgement
We would like to acknowledge British International investment (earlier called CDC UK) for their partial funding support for the project.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2022 The Author(s), under exclusive license to Springer Nature Switzerland AG
About this paper
Cite this paper
Katte, P., Kakileti, S.T., Madhu, H.J., Manjunath, G. (2022). Automated Thermal Screening for COVID-19 Using Machine Learning. In: Kakileti, S.T., et al. Artificial Intelligence over Infrared Images for Medical Applications and Medical Image Assisted Biomarker Discovery. MIABID AIIIMA 2022 2022. Lecture Notes in Computer Science, vol 13602. Springer, Cham. https://doi.org/10.1007/978-3-031-19660-7_7
Download citation
DOI: https://doi.org/10.1007/978-3-031-19660-7_7
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-031-19659-1
Online ISBN: 978-3-031-19660-7
eBook Packages: Computer ScienceComputer Science (R0)
