Abstract
The main objectives are (i) to study the relation of temperature of brown adipose tissue (BAT) with respect to obesity in different regions of the human body and to predict the most significant regional thermogram in determining the obese condition in children; (ii) to develop an customized convolutional neural network (CNN) model and to compare its performance with the modified pre-trained models for the automated screening of childhood obesity; (iii) to explore the application of quantum computing, namely variational quantum classifier (VQC), in the image classification of obesity condition. The mean skin surface temperature was measured in neck, forearm, abdomen and calf region for normal, overweight and obese children. Two modified pre-trained CNN (MobileNet-V2 and VGG-16) and Customized Net are studied for multi-class categorization of normal, overweight and obese thermograms. In addition, VQC was simulated and compared with the performance of deep learning techniques. Among the regional temperature studied, abdominal region exhibited high temperature difference of 3.72 °C (10.96%) and 5.56 °C (16.84%) between normal vs overweight and normal vs obese, respectively. The proposed Customized Net model achieved the best overall accuracy of 91.6% and 89.3% for abdomen region and neck region, respectively. Similarly, VQC has illustrated best classification accuracy in neck (84.4%) and abdomen (82.2%) regions. Moreover, VQC model promotes reduction in the computational cost for the diagnosis of obesity based on thermal imaging. Hence, regional thermogram assessment with deep learning and quantum computing approach is considered as a feasible method for preliminary screening of overweight and obesity condition in children.
This is a preview of subscription content, log in via an institution to check access.
modified by adding global averaging pooling layer followed by three fully connected layers (dense layer) before the softmax layer to classify the images according to the most probable class
modified by adding global averaging pooling layer followed by three fully connected layers (dense layer) just before the softmax layer to classify the images according to the most probable class
Similar content being viewed by others
Data availability
The data that support the findings of this study are available on request from the corresponding author, [Dr.U.Snekhalatha]. The data are not publicly available due to restrictions [e.g., their containing information that could compromise the privacy of research participants].
References
Bagavathiappan S, Saravanan T, Philip J, Jayakumar T, Raj B, Karunanithi R, Panicker TM, Korath MP, Jagadeesan K (2009) Infrared thermal imaging for detection of peripheral vascular disorders. J Med Phys 34:43–47. https://doi.org/10.4103/0971-6203.48720
Benuwa BB, Zhan Y, Ghansah B, Wornyo DK, Kataka FB (2016) A review of deep machine learning. Int J Eng Res Afr 24:124–136. https://doi.org/10.4028/www.scientific.net/JERA.24.124
Bernard V, Staffa E, Mornstein V, Bourek A (2013) Infrared camera assessment of skin surface temperature- effect of emissivity. Phys Med 29(583):591. https://doi.org/10.1016/j.ejmp.2012.09.003
Buiu C, Danaila VR, Raduta CN (2020) MobileNetV2 ensemble for cervical precancerous lesions classification. Processes 8:595–625. https://doi.org/10.3390/pr8050595
Castillo O, Sanchez MA, Gonzalez CI, Martinez GE (2017) Review of recent type-2 fuzzy image processing applications. Information 8:1–18. https://doi.org/10.3390/info8030097
Cerezo M, Arrasmith A, Babbush R, Benjamin SC, Endo S, Fujji K, McClean JR, Mitarai K, Yuan X, Cincio L, Coles P (2021) Variational quantum algorithms. Nature Rev Phys 3:625–644. https://doi.org/10.1038/s42254-021-00348-9
Chalmers J, Law J, Morris DE, Robinson L, BudgeSymonds HME (2018) The use of infrared thermography in the measurement and characterization of brown adipose tissue activation. Temperature (Austin Tex) 5:147–161. https://doi.org/10.1080/23328940.2017.1397085
Eloi JC, Epifanio M, Goncalves MM, Pellicioli A, Vieira PF, Dias HB, Bruscato N, Soder RB, Santana JC, Mouzaki M, Baldisserotto M (2017) Quantification of abdominal fat in obese and healthy adolescents using 3 tesla magnetic resonance imaging and free software for image analysis. PloS One 12:0167625. https://doi.org/10.1371/journal.pone.0167625
Esteva A, Chou K, Yeung S, Naik N, Madani A, Mottaghi A, Liu Y, Topal E, Dean J, Socher R (2021) Deep learning-enabled medical computer vision. Digital Med 4:1–9. https://doi.org/10.1038/s41746-020-00376-2
Faria SL, Faria OP, Cardeal MD, Ito MK (2014) Validation study of multi-frequency bioelectrical impedance with dual-energy X-ray absorptiometry among obese patients. Obes Surg 24:1476–1480. https://doi.org/10.1007/s11695-014-1190-5
FLIR A325sc, FLIR media: User manual. FLIR Systems Inc. (2014). https://www.flirmedia.com/MMC/THG/Brochures/RND_010/RND_010_US.pdf
Fuster EMG (2019) Variational quantum classifier. http://diposit.ub.edu/dspace/bitstream/2445/140318/1/GIL%20FUSTER%20Elies%20Miquel.pdf
Galic S, Oakhill JS, Steinberg GR (2010) Adipose tissue as an endocrine organ. Mol Cell Endocrinol 316:129–139. https://doi.org/10.1016/j.mce.2009.08.018
Garg T, Garg M, Mahela OP, Garg AR (2020) Convolutional neural network with transfer learning for recognition of COVID: a comparative study of different approaches. Artif Intell 1:586–606. https://doi.org/10.3390/ai1040034
Gonzalez CI, Melin P, Castro JR, Castillo O, Mendoza O (2016) Optimization of interval type-2 fuzzy systems for image edge detection. Appl Soft Comput 47:631–643. https://doi.org/10.1016/j.asoc.2014.12.010
Goodfellow I, Pouget-Abadie J, Mirza M, Xu B, Warde-Farley D, Ozair S, Courville A, Bengio Y (2014) Generative adversarial nets. Proceedings of the International Conference on Neural Information Processing Systems; Kuching, Malaysia, 2672–2680. http://arxiv.org/abs/1406.2661
Gungor NK (2014) Overweight and obesity in children and adolescents. J Clin Res Pediatr Endocrinol 6:129–143. https://doi.org/10.4274/Jcrpe.1471
Gupta M, Phan TT, Bunnell T, Beheshti R (2020) Obesity Prediction with EHR Data: A deep learning approach with interpretable elements. arXiv: Applications, Article e1912.02655. https://arxiv.org/ftp/arxiv/papers/1912/1912.02655.pdf
Hartwig V, Guiducci L, Marinelli M, Pistoia L, TegrimiTM LG, Quinones-Galvan A, L’Abbate A (2017) Multimodal imaging for the detection of brown adipose tissue activation in women: a pilot study using nirs and infrared thermography. J Healthcare Eng 2017:1–6. https://doi.org/10.1155/2017/5986452
Jalil B, Hartwig V, Moroni D, Salvetti O, Benassi A, Jalil Z, Pistoia L, Minutoli T, Quinones-Galvan A, Iervasi G, L’Abbate A, Guiducci L (2019) A pilot study of infrared thermography based assessment of local skin temperature response in overweight and lean women during oral glucose tolerance test. J Clin Med 8:260–270. https://doi.org/10.3390/jcm8020260
Jiang S, Britt KA, McCasky AJ, Humble TS, Kais S (2018) Quantum annealing for prime factorization. Sci Rep 8:1–9. https://doi.org/10.1038/s41598-018-36058-z
Lahiri BB, Bagavathiappan S, Jayakumar T, Philip J (2012) Medical applications of infrared thermography: a review. Infrared Phys Technol 55:221–235. https://doi.org/10.1016/j.infrared.2012.03.007
Lazarus R, Baur L, Webb K, Blyth F (1996) Body mass index in screening for adiposity in children and adolescents: Systematic evaluation using receiver operating characteristic curves. Am J ClinNutr 63:500–506. https://doi.org/10.1093/ajcn/63.4.500
Melin P, Gonzalez CI, Castro JR, Mendoza O, Castillo O (2014) Edge detection method for image processing based on generalized type-2 fuzzy logic. IEEE Trans Fuzzy Syst 22:1515–1525. https://doi.org/10.1109/TFUZZ.2013.2297159
Misra A, Shah P, Goel K, Hazra DK, Gupta R, Seth P, Tallikoti P, Mohan I, Bhargava R, Bajaj S, Madan J, Gulati S, Bhardwaj S, Sharma R, Gupta N, Pandey RM (2011) The high burden of obesity and abdominal obesity in urban Indian schoolchildren: a multicentric study of 38,296 children. Ann Nutr Metab 58:203–211. https://doi.org/10.1159/000329431
Mumtaz W, Qayyum A (2019) A deep learning framework for automatic diagnosis of unipolar depression. Int J Med Informatics 132:1–9. https://doi.org/10.1016/j.ijmedinf.2019.103983
Nattenmueller J, Hoegenauer H, Boehm J, Scherer D, Paskow M, Gigic B, Schrotz KP, Grenacher L, Ulrich C, Kauczor HU (2016) CT-based compartmental quantification of adipose tissue versus body metrics in colorectal cancer patients. Eur Radiol 26:4131–4140. https://doi.org/10.1007/s00330-016-4231-8
Nawab T, Khan Z, Khan IM, Ansari MA (2014) Influence of behavioral determinants on the prevalence of overweight and obesity among school going adolescents of Aligarh. Indian J Public Health 58:121–124. https://doi.org/10.4103/0019-557X.132289
PennyLane (2020) Quantum Embedding. https://pennylane.ai/qml/glossary/quantum_embedding.html#quantum-embedding Accessed 20th October 2021
PennyLane dev team (2020) Multiclass margin classifier. https://pennylane.ai/qml/demos/tutorial_multiclass_classification.html Accessed 20th October 2021
Poma Y, Melin P, Gonzalez CI, Martinez GE (2020) Optimization of convolutional neural network using the fuzzy gravitational search algorithm. J Autom, Mobile Robot Intell Syst 14:109–120. https://doi.org/10.14313/JAMRIS/1-2020/12
Raccuglia M, Heyde C, Lloyd A, Hodder S, Havenith G (2019) The use of infrared thermal imaging to measure spatial and temporal sweat retention in clothing. Int J Biometeorol 63:885–894. https://doi.org/10.1007/s00484-019-01701-5
Rachmadi MF, Hernandez MDCV, Agan MLF, Komura T (2017) Deep learning vs. conventional machine learning: pilot study of WMH segmentation in brain MRI with absence or mild vascular pathology. J Imag 3:66–85. https://doi.org/10.3390/jimaging3040066
Radford A, Metz L, Chintala S (2016) Unsupervised representation learning with deep convolutional generative adversarial networks. arXiv 20151511.06434. http://arxiv.org/abs/1511.06434
Rankin J, Matthews L, Cobley S, Han A, Sanders R, Wiltshire HD, Baker JS (2016) Psychological consequences of childhood obesity: psychiatric comorbidity and prevention. Adolesc Health Med Ther 7:125–146. https://doi.org/10.2147/AHMT.S101631
Rashmi R, Snekhalatha U (2019) Evaluation of body composition parameters using various diagnostic methods: a meta analysis study. Obesity Med 16:100150. https://doi.org/10.1016/j.obmed.2019.100150
Ravenzwaaij DV, Loannidis JPA (2019) True and false positive rates for different criteria of evaluating statistical evidence from clinical trials. BMC Med Res Methodol 19:1–10. https://doi.org/10.1186/s12874-019-0865-y
Ross OMH (2020) A review of quantum inspired metaheuristics: Going from classical computers to real quantum computers. IEEE Access 8:814–838. https://doi.org/10.1109/ACCESS.2019.2962155
Sangamithirai S, Snekhalatha U, Sanjeena R, Alla LSU (2018) Thermal Imaging of Abdomen in Evaluation of Obesity: A Comparison with Body Composition Analyzer––A Preliminary Study. Proceedings of the International Conference on ISMAC in Computational Vision and Bio-Engineering (ISMAC-CVB) 30:1–9. doi: https://doi.org/10.1007/978-3-030-00665-5_9
Savastano DM, Gorbach AM, Eden HS, Brady SM, Reynolds JC, Yanovski JA (2009) Adiposity and human regional body temperature. Am J Clin Nutr 90:1124–1131. https://doi.org/10.3945/ajcn.2009.27567
Sengupta K, Srivastava PR (2021) Quantum algorithm for quicker clinical prognostic analysis: an application and experimental study using CT scan images of COVID-19 patients. BMC Med Inform Decis Mak 21:1–14. https://doi.org/10.1186/s12911-021-01588-6
Setiawan W, Damayanti F (2019) Layers modification of convolutional neural network for pneumonia detection. J Phys: Conf Ser 1477:1–9. https://doi.org/10.1088/1742-6596/1477/5/052055
Sheean P, Gonzalez MC, Prado CM, McKeever L, Hall AM, Braunschweig CA (2019) American society for parenteral and enteral nutrition clinical guidelines: the validity of body composition assessment in clinical populations. J Parenter Enter Nutr 44:12–43. https://doi.org/10.1002/jpen.1669
Shen D, Wu G, Suk HI (2017) Deep learning in medical image analysis. Annu Rev Biomed Eng 19:221–248. https://doi.org/10.1146/annurev-bioeng-071516-044442
Siemon MSN, Shihavuddin ASM, Ravn-Haren G (2021) Sequential transfer learning based on hierarchical clustering for improved performance in deep learning based food segmentation. Sci Rep 11:1–14. https://doi.org/10.1038/s41598-020-79677-1
Smith RAE, Blue MNM, Trexler ET, Hirsch KR (2016) Utility of ultrasound for body fat assessment: validity and reliability compared to a multi-compartment criterion. Clin Physiol Funct Imag 38:220–226. https://doi.org/10.1111/cpf.12402
Tammina S (2019) Transfer learning using VGG with deep convolutional neural network for classifying images. Int J Scientif Res Publ 9:143–150. https://doi.org/10.29322/IJSRP.9.10.2019.p9420
Thukral BB (2015) Problems and preferences in pediatric imaging. Indian J Radiol Imag 25:359–364. https://doi.org/10.4103/0971-3026.169466
Umapathy S, Thanaraj KP, Sangamithirai K (2020) Computer aided diagnosis of obesity based on thermal imaging using various convolutional neural networks. Biomed Signal Process Control 63:1–10. https://doi.org/10.1016/j.bspc.2020.102233
Vanderwall C, Randall CR, Eickhoff J, Carrel AL (2017) BMI is a poor predictor of adiposity in young overweight and obese children. BMC Pediatr 17:135–141. https://doi.org/10.1186/s12887-017-0891-z
Varela-Santos S, Melin P (2021) A new approach for classifying coronavirus COVID-19 based on its manifestation on chest X-rays using texture features and neural networks. Inf Sci 545:403–414. https://doi.org/10.1016/j.ins.2020.09.041
Vashisth S, Dhall I, Aggarwal G (2021) Design and analysis of quantum powered support vector machine for malignant breast cancer diagnosis. J Intell Syst 30:998–1013. https://doi.org/10.1515/jisys-2020-0089
Verduin WM, Helder VDR, Doodeman HJ, Struijf E, Houdijk AP (2016) Dexa Body composition assessment in 10–11 year healthy children. PloS One 11:0165275. https://doi.org/10.1371/journal.pone.0165275
Wang W, Hu Y, Zou T, Liu H, Wang J, Wang X (2020) A new image classification approach via improved Mobilenet models with local receptive field expansion in shallow layers. Comput Intell Neurosci 2020:1–10. https://doi.org/10.1155/2020/8817849
Wang Y, Lim H (2012) The global childhood obesity epidemic and the association between socio-economic status and childhood obesity. Int Rev Psych 24:176–188. https://doi.org/10.3109/09540261.2012.688195
Wang Y, Qui Y, Thai T, Moore K, Liu H, Zeng B (2017) A two-step convolutional neural network based computer-aided detection scheme for automatically segmenting adipose tissue volume depicting on CT images. Comput Methods Programs Biomed 144:97–104. https://doi.org/10.1016/j.cmpb.2017.03.017
Xu S, Xue Y (2016) Pediatric obesity: causes, symptoms, prevention and treatment. Exp Ther Med 11:15–20. https://doi.org/10.3892/etm.2015.2853
Yoo S, Gujrathi I, Haider MA, Khalvati F (2019) Prostate cancer detection using deep convolutional neural networks. Sci Rep 9:1–10. https://doi.org/10.1038/s41598-019-55972-4
Acknowledgements
The author would like to express their sincere gratefulness to Sivananda Gurukulam School, Kattankulathur, Chennai, Tamil Nadu, India, for the facility provided in the school campus to acquire the data.
Funding
We certify that no funding has been received for the conduct of this study.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Conflict of interest
All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. All the authors of article have no conflicts of interest.
Informed consent
The informed consent was obtained from the parents/guardian of the children included in this research.
Additional information
Communicated by Oscar Castillo.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
About this article
Cite this article
Rashmi, R., Snekhalatha, U., Krishnan, P.T. et al. Fat-based studies for computer-assisted screening of child obesity using thermal imaging based on deep learning techniques: a comparison with quantum machine learning approach. Soft Comput 27, 13093–13114 (2023). https://doi.org/10.1007/s00500-021-06668-3
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00500-021-06668-3