Skip to main content
Book cover

ICT Analysis and Applications pp 583–592Cite as

A Model for Automated Food Logging Through Food Recognition and Attribute Estimation Using Deep Learning

  • 518 Accesses

Part of the Lecture Notes in Networks and Systems book series (LNNS,volume 154)

Abstract

The past few decades have witnessed an increase in dietary ailments, majorly caused due to unhealthy food habits. According to experts, mobile-based diet monitoring and assessment systems can capture real-time images of various food items as well as analyze the nutritional content present in it and can be very convenient to use and assist in improving food habits. This can help people lead a healthier lifestyle. This proposed model provides an innovative system that can automatically estimate various food attributes like the nutrients and ingredients by classifying the food image that is given as input. The approach involves the use of different types of deep learning models for accurate food item identification. Apart from image recognition and analysis, the food ingredients, nutrients and attributes are obtained and estimated by extracting words which are semantically related from a large collection of text, accumulated over the Internet. Experimentation has been performed with the Food-101 dataset. The proposed system assists the user to obtain the nutritional value of the food item in real-time which is effective and simple to use. The proposed system also provides supporting features such as food logging, calorie tracking and healthy recipe recommendations for self-monitoring of the user.

Keywords

  • Food image recognition
  • Attribute estimation
  • Vector embeddings
  • Convolutional neural networks (CNN)
  • Web scraping
  • Diet monitoring
  • Food logging
  • Calorie counter

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-981-15-8354-4_58
  • Chapter length: 10 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   229.00
Price excludes VAT (USA)
  • ISBN: 978-981-15-8354-4
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   299.99
Price excludes VAT (USA)
Hardcover Book
USD   299.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5

References

  1. Afshin, A., Sur, P. J., Fay, K. A., Cornaby, L., Ferrara, G., Salama, J. S., & Afarideh, M. (2019, May 11) Health effects of dietary risks in 195 countries, 1990–2017: A systematic analysis for the Global Burden of Disease Study 2017. The Lancet, 393(10184), 1958–1972.

    Google Scholar 

  2. Times of India [Online]. Available https://timesofindia.indiatimes.com/india/unhealthy-diet-bigger-killer-than-tobacco/articleshow/68759153.cms.

  3. Samsung Health. [Online]. Available https://health.apps.samsung.com/.

  4. MyFitnessPal. [Online]. Available https://www.myfitnesspal.com/.

  5. Ahmed, A., & Ozeki, T. (2015). Food image recognition by using bag-of-surf features and hog features. In Proceedings of 3rd International Conference on Human-Agent Interaction (pp. 179–180).

    Google Scholar 

  6. Hassannejad, H., Matrella, G., Ciampolini, P., De Munari, I., Mordonini, M., & Cagnoni, S. (2016). Food image recognition using very deep convolutional networks. In Proceedings of 2nd International Workshop on Multimedia Assisted Dietary Management (pp. 41–49).

    Google Scholar 

  7. Martinel, N., Foresti, G. L., & Micheloni. C. (2016). Wideslice residual networks for food recognition. [Online]. Available https://arxiv.org/abs/1612.06543.

  8. Fang, S., Zhu, F., Jiang, C., Zhang, S., Boushey, C. J., & Delp, E. J. (2016, September) A comparison of food portion size estimation using geometric models and depth images, In Proceedings of IEEE International Conference on Image Processing (ICIP) (pp. 26–30).

    Google Scholar 

  9. Pouladzadeh, P., & Shirmohammadi, S. (2017). Mobile multi-food recognition using deep learning. ACM Transactions on Multimedia Computing, Communications, and Applications, 13(3s), 36.

    Google Scholar 

  10. Krizhevsky, A., Sutskever, I., & Hinton, G. E. (2012). ImageNet classification with deep convolutional neural networks. In Proceedings of Advances in Neural Information Processing Systems (pp. 1097–1105).

    Google Scholar 

  11. Simonyan, K., & Zisserman, A. (2014). Very deep convolutional networks for large-scale image recognition. [Online]. Available https://arxiv.org/abs/1409.1556.

  12. Nasi, G., Cucciniello, M., & Guerrazzi, C. (2015). The role of mobile technologies in health care processes: The case of cancer supportive care. Journal of medical Internet research, 17(2).

    Google Scholar 

  13. Marcolino, M. S., Oliveira, J. A. Q., D’Agostino, M., Ribeiro, A. L., Alkmim, M. B. M., & Novillo–Ortiz, D. (2018). The impact of mhealth interventions: Systematic review of systematic reviews. JMIR mHealth uHealth, 6(1).

    Google Scholar 

  14. Chin, C.-L., Huang, C.-C., Lin, B.-J., Wu, G.-R., Weng, T.-C., & Chen, H.-F. (2016). Smartphone-based food category and nutrition quantity recognition in food image with deep learning algorithm. In International Conference on Fuzzy Theory and Its Applications.

    Google Scholar 

  15. Jiang, L., Qiu, B., Liu, X., Huang, C., & Lin, K. (2020). DeepFood: Food image analysis and dietary assessment via deep model. IEEE Access, 8, 47477–47489.

    CrossRef  Google Scholar 

  16. Yunus, R., et al. (2018, December). A framework to estimate the nutritional value of food in real time using deep learning techniques. 7, 2643–2652.

    Google Scholar 

  17. Meyers, A., et al. (2015, December). Im2Calories: Towards an automated mobile vision food diary. In Proceedings of IEEE International Conference on Computer Vision (pp. 1233–1241).

    Google Scholar 

  18. Ege, T., & Yanai, K. (2017). Image–based food calorie estimation using knowledge on food categories, ingredients and cooking directions. In Proceedings of Thematic Workshops (pp. 367–375).

    Google Scholar 

  19. Mikolov, T., Chen, K., Corrado, G., & Dean, J. (2013). Efficient estimation of word representations in vector space. [Online]. Available https://arxiv.org/abs/1301.3781.

  20. Zhang, W., Zhao, D., Gong, W., Li, Z., Lu, Q., & Yang, S. (2015). Food image recognition with convolutional neural networks (pp. 690–693).

    Google Scholar 

  21. Suh, H.-J., & Lee, K-,H. (2018). Real–time calorie extraction and cuisine classification through food–image recognition. International Journal of Grid and Distributed Computing, 11, 69–78.

    Google Scholar 

  22. Temdee, P., & Uttama, S. (2017). Food recognition on smartphone using transfer learning of convolution neural network (pp. 132–135). Global Wireless Summit (GWS), Cape Town.

    Google Scholar 

  23. Islam, M. T., Karim Siddique, B. M. N., Rahman, S., & Jabid, T. (2018). Food image classification with convolutional neural network. In: 2018 International Conference on Intelligent Informatics and Biomedical Sciences (ICIIBMS) (pp. 257–262), Bangkok.

    Google Scholar 

  24. Harvard Health Publishing [Online] Available https://www.health.harvard.edu/blog/why-keep-a-food-diary-2019013115855.

Download references

Author information

Authors and Affiliations

  1. School of Computer Engineering and Technology, MIT World Peace University, Pune, Maharashtra, India

    Aditi Ambadkar, Chetana Chaudhari, Megha Ghadage & Madhuri Bhalekar

Authors
  1. Aditi Ambadkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Chetana Chaudhari
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Megha Ghadage
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Madhuri Bhalekar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Aditi Ambadkar .

Editor information

Editors and Affiliations

  1. University of Macau, Zhuhai, Macao

    Dr. Simon Fong

  2. Techno India College of Engineering, Kolkata, India

    Dr. Nilanjan Dey

  3. Global Knowledge Research Foundation, Ahmedabad, India

    Amit Joshi

Rights and permissions

Reprints and Permissions

Copyright information

© 2021 The Editor(s) (if applicable) and The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd.

About this paper

Verify currency and authenticity via CrossMark

Cite this paper

Ambadkar, A., Chaudhari, C., Ghadage, M., Bhalekar, M. (2021). A Model for Automated Food Logging Through Food Recognition and Attribute Estimation Using Deep Learning. In: Fong, S., Dey, N., Joshi, A. (eds) ICT Analysis and Applications. Lecture Notes in Networks and Systems, vol 154. Springer, Singapore. https://doi.org/10.1007/978-981-15-8354-4_58

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-8354-4_58

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-8353-7

  • Online ISBN: 978-981-15-8354-4

  • eBook Packages: EngineeringEngineering (R0)