Abstract
The integration of multimedia-assisted healthcare systems with could-computing services and mobile technologies has led to increased accessibility for healthcare providers and patients. Utilizing cloud computing infrastructures and virtualization technologies allows for the transformation of traditional healthcare systems that demand manual care and monitoring to more salient, automatic and cost effective systems. The goal of this paper is to develop a multimedia-assisted mobile healthcare application using cloud-computing virtualization technologies. We consider calorie measurement as an example healthcare application that can benefit from cloud-computing virtualization technology. The key functionalities of our application entail image segmentation, image processing and deep learning algorithms for food classification and recognition. Client side devices (e.g. smartphones, tablets etc.) have limitations in handling time sensitive and computationally intensive algorithms pertained to our application. Image processing and deep learning algorithms, used in food recognition and calorie measurement, consume devices’ batteries quickly, which is inconvenient for the user. It is also very challenging for client side devices to scale for large number of data and images, as needed for food recognition. The entire process is time-consuming and inefficient and discomforting from users’ perspective and may deter them from using the application. In this paper, we address these challenges by proposing a virtualization mechanism in cloud computing that utilizes the Android architecture. Android allows for parting an application into activities run by the front-end user and services run by the back-end tasks. In the proposed virtualization mechanism, we use both the hosted and the hypervisor models to publish our Android-based food recognition and calorie measurement application in the cloud. By so doing, the users of our application can control their virtual smartphone operations through a dedicated client application installed on their smartphones, while the processing of the application continue to run on the virtual Android image even if the user is disconnected due to any unexpected event. We have performed several experiments to validate our mechanism. Specifically, we have run our deep learning and image processing algorithms for food recognition on different configuration platforms on both the cloud and local server connected to the mobile. The results show that the accuracy of the system with the virtualization mechanism is more than 94.33 % compared to 87.16 % when we run the application locally. Also, with our virtualization mechanism the results are processed 49 % faster than the case of running the application locally.
Similar content being viewed by others
References
Bamiah M., Brohi S., Chprat S., AB Manan J.L. : A study on significance of adopting cloud computing paradigm in healthcare sector. In: IEEE International Conference on Cloud Computing Technology, Applications and Management (ICCTAM), pp. 65–68, (2012)
Seoyoung, K., Jok-Soo, K., Soonwook, H., Yoonhee, K.: Towards effective sceince cloud provisioning for a large-scale high-throughput computing. Clust. Comput. J. 17(4), 1157–1169 (2014). doi:10.1007/s10586-014-0371-2
Myoungjin, K., Seungho, H., Yun, C., Hanku, L., Hogyeon, C., Sungdae, H.: CloudDMSS robust hadoop-based multimedia streaming service architecture for a cloud computing environment. Clust. Comput. J. 17(3), 605–628 (2014)
Pouladzadeh P., Bharat Peddi S.V., Kuhad P., Yassine A., Shirmohammadi S.: Mobile cloud based food calorie measurement. In: IEEE International Confernce on Multimedia and Expo Workshops (ICMEW), pp. 1–6, Chengdu, China (2014)
Pouladzadeh, P., Shirmohammadi, S., Bakirov, A., Bulut, A., Yassine, A.: Cloud-Based SVM for food categorization. Springer’s J. Multimed. Tools Appl. (2014). doi:10.1007/s11042-014-2116-x
Pouladzadeh P., Shirmohammadi S., Yassine A.: Using graph cut segmentation for food calorie measurement. In: IEEE International Symposium on Medical Measurements and applications, pp. 1–6, Lisbon, (2014)
Hlavacek J., Bestak R.: Configuration of live migration for VoIP applications. In: MECHATRONIKA, 15th International Symposium, 5–7 Dec. pp. 1–4 (2012)
VMware “Understanding full virtualization, para- virtualization, and hardware Assist” White Paper Available at http://www.vmware.com/resources/techresources/1008. Accessed 14 Sept 2014
Kato Y., Suzuki T., Kobayashi K., Nakauchi Y.: A web application for an obesity prevention system based on individual lifestyle analysis. In: IEEE International conference on Systems, Man, and Cybernetics (SMC), pp. 1718–1723, Seoul (2012)
Chen H.C., Jia W., Li Z., Sun Y., Sun M.: 3D/2D model-to-image registration for quantitative dietary assessment. In: Bioengineering Conference (NEBEC), 38th Annual Northeast, pp. 95–96, 16–18 March (2012)
Sun M., Liu Q., Schmidt K., Yang J., Yao N., Fernstrom J.D., Fernstrom M.H., DeLany J.P., Sclabassi R.J.: IEEE International EMBS Conference on Determination of Food Portion Size by Image Processing, pp. 871–874, (2008)
Saeki, Y., Takeda, F.: Proposal of food intake measuring system in medical use and its discussion of practical capability. Knowl.-based Intell. Inf. Eng. Syst. 3683, 1266–1273 (2005)
Martin, C.K., Kaya, S., Gunturk, B.K.: Quantification of food intake using food image analysis. Int. Conf. IEEE Eng. Med. Biol. Soc. 2009, 6869–6872 (2009)
Zhua F., Mariappana A., Bousheyb C.J., Kerrd D., Lutesc K.D., Eberta D.S., Delp E.J.: Technology-assisted dietary assessment. Computational Imaging VI, Proceedings of SPIE-IS&T Electronic Imaging, SPIE vol. 6814, p. 681411 (2008)
Sobhy D., El-Sonbaty Y., Abou Elnasr M.: MedCloud heathcare cloud computing system. In: IEEE International Conference on Internet Technology and Secured Transactions, pp. 161–166 (2012)
Doan B.H. and Chen L.: Mobile cloud for assistive healthcare. IEEE Asia-Pacific Serices Computing Conference APSCC, pp. 325–332, (2010)
Yong, W.A., Cheng, A.M.K., Baek, J., Jo, M., Chen, H.: An auto-scaling mechinam for virtual resources to support mobile, pervasive, real-time healthcare applications in cloud computing. IEEE Netw. 27(5), 62–68 (2013)
Harini M., Bhairavi K., Gopicharan R., Kirupa G., Vaidehi V.: Virtualization of healthcare sensors in cloud. IEEE International Conference on Recent Trends in Information Technology, pp. 663–667, (2013)
Hossain, M.S., Muhammad, G.: Cloud-based collaborative media service framework for health-care. Int. J. Distrib.Sens. Netw. (2014)
Hossain, M.S., Muhammad, G.:Cloud-assisted speech and face recognition framework for health monitoring. Mob. Netw. Appl., pp. 1–9 (2015)
Skurski, A., Swiercz, B.: VNC-based remote control for symbian OS smartphones. In: 16th International Conference on Mixed Design of Integrated Circuit and Systems, June 25–27, Lodi, Poland, MIXDES (2009)
Kemp, R., Palmer,N., Kielmann, T., Bal, H.: Cuckoo: a computation offloading framework for smartphones. In: Proceedings of The Second International Conference on Mobile Computing, Applications, and Services, MobiCASE’10 (2012)
Van Nieuwpoort, R., Maassen, J., Wrzesińska, G., Hofman, R., Jacobs, C., Kielmann, T., Bal, H.: Ibis: a flexible and efficient java based grid programming environment. Concurr. Comput. 17, 1079–1107 (2005)
Chen, E.Y., Itoh, M.: Virtual smartphone over IP. In: IEEE International Symposium on World of Wireless Mobile and Multimedia Networks (WoWMoM) (2010)
Kemp, R., Palmer, N., Kielmann, T., Seinstra, F., Drost, N., Maassen, J., Bal, H.E.: EyeDentify : multimedia cyber foraging from a smartphone. In: IEEE International Symposium on Multimedia (2009)
Alamri, A., Hassan, M.M., Hossain, M.A., Al-Qurishi, M., Aldukhayyil, Y., Shamim, M.: Evaluating the impact of a cloud-based serious game on obese people. Comput. Hum. Behav. 30, 468–475 (2014)
Krizhevsky, A., Sutskever, I., Hinton, G.: ImageNet classification with deep convolutional neural networks. Adv. Neural Inf. Process. Syst. (NIPS) (2012)
Srivastava, N., Salakhutdinov, R.: Multimodal learning with deep Boltzmann machines. In: Proceedings Neural Information and Processing System (2012)
Pouladzadeh, P., Shirmohammadi, S., Almaghrabi, R.: Measuring calorie and nutrition from food image. IEEE Trans. Instrum. Meas 63(8), 1947–1956 (2014)
Matusiak, K., Skulimowski, P., Strumillo, P.: Object recognition in a mobile phone application for visually impaired users. In: The 6th International Conference on Human System Interaction (HSI), pp. 479–484, 6–8 June (2013)
Kemp, R., Palmer, N., Kielmann, T., Seinstra, F., Drost, N., Maassen, J., Bal, H.: eyeDentify: 11th IEEE International Symposium on Multimedia Cyber Foraging from a Smartphone, pp. 392–399, 14–16 Dec. (2009)
Okamoto, K., Yanai, K.: Real-time eating action recognition system on a smartphone. In: IEEE International Conference on Multimedia and Expo Workshops (ICMEW), pp. 1–6, 14–18 July 2014 doi:10.1109/ICMEW.2014.6890718
Hoashi, H., Joutou, T., Yanai, K.: Image recognition of 85 food categories by feature fusion. In: IEEE International Symposium on Multimedia (ISM), pp. 296–301, 13–15 Dec. 2010 doi:10.1109/ISM.2010.51
Yang, S., Chen, M., Pomerleau, D., Sukthankar, R.: Food recognition using statistics of pairwise local features. In: IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 2249–2256, 13–18 June (2010)
Zong, Z., Nguyen, D.T., Ogunbona, P., Li, W.: On the combination of local texture and global structure for food classification. In: IEEE International Symposium on Multimedia (ISM), pp. 204–211, 13–15 Dec. (2010)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Pouladzadeh, P., Peddi, S.V.B., Kuhad, P. et al. A virtualization mechanism for real-time multimedia-assisted mobile food recognition application in cloud computing. Cluster Comput 18, 1099–1110 (2015). https://doi.org/10.1007/s10586-015-0468-2
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10586-015-0468-2