Abstract
In this day and age, Artificial Intelligence has crept into every domain of work. It is only fitting that it be made a part of the medical domain as well. With the vast amount of healthcare data available in various forms such as image, video, text, and due to emerging technologies and advancements in data science, tools are being created to ease the process of medical analysis and provide an efficient and accurate diagnosis of the patient. Such techniques save lots of human efforts and provide a rather accurate result. In particular, the chapter focuses on emphasizing the importance of multimodal system where instead of relying on a particular data source or a particular field of data analytics; one can combine multiple sources and apply multi-domain techniques to extract information to an even greater extent. The high-quality information retrieved from the analysis can be further used to determine and diagnose more symptoms and hence help in providing accurate solutions.
This is a preview of subscription content, log in via an institution to check access.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Menegotto, A.B., Becker, C.D.L., Cazella, S.C.: Computer-aided hepatocarcinoma diagnosis using multimodal deep learning. In: International Symposium on Ambient Intelligence, pp. 3–10. Springer, Cham, June 2019
Mathews, S.M.: Explainable artificial intelligence applications in NLP, biomedical, and malware classification: a literature review. In: Intelligent Computing—Proceedings of the Computing Conference, pp. 1269–1292. Springer, Cham, July 2019
Panayides, A.S., Pattichis, C.S., Pattichis, M.S.: The promise of big data technologies and challenges for image and video analytics in healthcare. In: 2016 50th Asilomar Conference on Signals, Systems and Computers, pp. 1278–1282. IEEE, Nov 2016
Tian, H., Tao, Y., Pouyanfar, S., Chen, S.C., Shyu, M.L.: Multimodal deep representation learning for video classification. World Wide Web 22(3), 1325–1341 (2019)
Pang, B., Zha, K., Cao, H., Shi, C., Lu, C.: Deep RNN framework for visual sequential applications. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 423–432 (2019)
Simms, T., Ramstedt, C., Rich, M., Richards, M., Martinez, T., Giraud-Carrier, C.: Detecting cognitive distortions through machine learning text analytics. In 2017 IEEE International Conference on Healthcare Informatics (ICHI), pp. 508–512. IEEE (2017)
Heart Disease dataset. https://archive.ics.uci.edu/ml/datasets/Heart+Disease
Patel, J., Upadhyay, T., Patel, S.: Heart disease prediction using machine learning and data mining technique. Heart Dis. 7(1), 129–137 (2015)
Amin, M.S., Chiam, Y.K., Varathan, K.D.: Identification of significant features and data mining techniques in predicting heart disease. Telemat. Inform. 36, 82–93 (2019)
Tayade, M.C., Wankhede, S.V., Bhamare, S.B., Sabale, B.B.: Role of image processing technology in healthcare sector: review. Int. J. Healthc. Biomed. Res. 2(3), 8–11 (2014)
Chen, I.Y., Szolovits, P., Ghassemi, M.: Can AI help reduce disparities in general medical and mental health care? AMA J. Ethics 21(2), 167–179 (2019)
Yang, C., Kerr, A., Stankovic, V., Stankovic, L., Rowe, P., Cheng, S.: Human upper limb motion analysis for post-stroke impairment assessment using video analytics. IEEE Access 4, 650–659 (2016)
Zhang, Q., Zhang, Q., Shi, W., Zhong, H.: Firework: data processing and sharing for hybrid cloud-edge analytics. IEEE Trans. Parallel Distrib. Syst. 29(9), 2004–2017 (2018)
Image Analytics Dataset Link. https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia
Text Analytics Dataset Link. https://www.kaggle.com/kazanova/sentiment140
Barnouti, N.H.: Improve face recognition rate using different image pre-processing techniques. Am. J. Eng. Res. (AJER) 5(4), 46–53 (2016)
AAlAbdulsalam, A.K., Garvin, J.H., Redd, A., Carter, M.E., Sweeny, C., Meystre, S.M.: Automated extraction and classification of cancer stage mentions from unstructured text fields in a central cancer registry. In: AMIA Summits on Translational Science Proceedings, vol. 16 (2018)
Nguyen, G., Dlugolinsky, S., Bobák, M., Tran, V., García, Á.L., Heredia, I., Malík, P., Hluchý, L.: Machine learning and deep learning frameworks and libraries for large-scale data mining: a survey. Artif. Intell. Rev. 52(1), 77–124 (2019)
Shanmugamani, R.: Deep Learning for Computer Vision: Expert Techniques to Train Advanced Neural Networks Using TensorFlow and Keras. Packt Publishing Ltd. (2018)
Hsu, F.Y., Lee, H.M., Chang, T.H., Sung, Y.T.: Automated estimation of item difficulty for multiple-choice tests: an application of word embedding techniques. Inf. Process. Manag. 54(6), 969–984 (2018)
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2021 The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.
About this chapter
Cite this chapter
Hiriyannaiah, S. et al. (2021). Multi-modal Data-Driven Analytics for Health Care. In: Srinivasa, K.G., G. M., S., Sekhar, S.R.M. (eds) Artificial Intelligence for Information Management: A Healthcare Perspective. Studies in Big Data, vol 88. Springer, Singapore. https://doi.org/10.1007/978-981-16-0415-7_7
Download citation
DOI: https://doi.org/10.1007/978-981-16-0415-7_7
Published:
Publisher Name: Springer, Singapore
Print ISBN: 978-981-16-0414-0
Online ISBN: 978-981-16-0415-7
eBook Packages: Intelligent Technologies and RoboticsIntelligent Technologies and Robotics (R0)