Advertisement

Multi-label Logo Classification Using Convolutional Neural Networks

  • Antonio-Javier GallegoEmail author
  • Antonio Pertusa
  • Marisa Bernabeu
Conference paper
  • 389 Downloads
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11867)

Abstract

The classification of logos is a particular case within computer vision since they have their own characteristics. Logos can contain only text, iconic images or a combination of both, and they usually include figurative symbols designed by experts that vary substantially besides they may share the same semantics. This work presents a method for multi-label classification and retrieval of logo images. For this, Convolutional Neural Networks (CNN) are trained to classify logos from the European Union TradeMark (EUTM) dataset according to their colors, shapes, sectors and figurative designs. An auto-encoder is also trained to learn representations of the input images. Once trained, the neural codes from the last convolutional layers in the CNN and the central layer of the auto-encoder can be used to perform similarity search through kNN, allowing us to obtain the most similar logos based on their color, shape, sector, figurative elements, overall features, or a weighted combination of them provided by the user. To the best of our knowledge, this is the first multi-label classification method for logos, and the only one that allows retrieving a ranking of images with these criteria provided by the user.

Keywords

Logo image retrieval Multi-Label Classification Convolutional Neural Networks 

Notes

Acknowledgments

This work is supported by the Spanish Ministry HISPAMUS project with code TIN2017-86576-R, partially funded by the EU.

References

  1. 1.
    Chiam, J.H.: Brand logo classification. Technical report, Stanford University (2015)Google Scholar
  2. 2.
    Gallego, A.J., Pertusa, A., Calvo-Zaragoza, J.: Improving convolutional neural networks’ accuracy in noisy environments using k-nearest neighbors. Appl. Sci. 8(11), 2086 (2018)CrossRefGoogle Scholar
  3. 3.
    Ghosh, S., Parekh, R.: Automated color logo recognition system based on shape and color features. Int. J. Comput. Appl. 118(12), 13–20 (2015)Google Scholar
  4. 4.
    Guru, D.S., Vinay Kumar, N.: Interval valued feature selection for classification of logo images. In: Abraham, A., Muhuri, P.K., Muda, A.K., Gandhi, N. (eds.) ISDA 2017. AISC, vol. 736, pp. 154–165. Springer, Cham (2018).  https://doi.org/10.1007/978-3-319-76348-4_16CrossRefGoogle Scholar
  5. 5.
    Iandola, F.N., Shen, A., Gao, P., Keutzer, K.: DeepLogo: hitting logo recognition with the deep neural network hammer. CoRR abs/1510.02131 (2015)Google Scholar
  6. 6.
    Kumar, N.V., Pratheek, Kantha, V.V., Govindaraju, K., Guru, D.: Features fusion for classification of logos. In: Internetional Conference on Computational Modelling and Security (CMS), vol. 85, pp. 370–379 (2016)CrossRefGoogle Scholar
  7. 7.
    van der Maaten, L., Hinton, G.: Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9(Nov), 2579–2605 (2008)zbMATHGoogle Scholar
  8. 8.
    Perez, C.A., et al.: Trademark image retrieval using a combination of deep convolutional neural networks. In: International Joint Conference on Neural Networks (IJCNN), pp. 1–7, July 2018Google Scholar
  9. 9.
    Pornpanomchai, C., Boonsripornchai, P., Puttong, P., Rattananirundorn, C.: Logo recognition system. In: ICSEC 2015, pp. 1–6 (2015)Google Scholar
  10. 10.
    Qi, H., Li, K., Shen, Y., Qu, W.: An effective solution for trademark image retrieval by combining shape description and feature matching. Pattern Recogn. 43(6), 2017–2027 (2010)CrossRefGoogle Scholar
  11. 11.
    Tsoumakas, G., Katakis, I., Vlahavas, I.: Mining multi-label data. In: Data Mining and Knowledge Discovery Handbook, pp. 667–685 (2010)CrossRefGoogle Scholar
  12. 12.
    Tursun, O., Aker, C., Kalkan, S.: A large-scale dataset and benchmark for similar trademark retrieval. CoRR abs/1701.05766 (2017)Google Scholar
  13. 13.
    Tüzkö, A., Herrmann, C., Manger, D., Beyerer, J.: Open set logo detection and retrieval. In: International Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISIGRAPP) (2018)Google Scholar
  14. 14.
    World Intellectual Property Organization: International Classification of the Figurative Elements of Marks: (Vienna Classification). WIPO Publication, World Intellectual Property Organization (2002)Google Scholar
  15. 15.
    Zeiler, M.D.: ADADELTA: an adaptive learning rate method. CoRR abs/1212.5701 (2012)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.University Institute for Computing Research (IUII)University of AlicanteSan Vicente del RaspeigSpain

Personalised recommendations