Skip to main content
Log in

Exemplar-based logo and trademark recognition

  • Original Paper
  • Published:
Machine Vision and Applications Aims and scope Submit manuscript

Abstract

Automatic logo recognition facilitates the process of searching and analyzing digital image-based resources. This is due to the simplicity and informativity of logos which can be used as a visual or semantic clue for applications such as content-based image retrieval. For automatic shape recognition, model-based approaches have gained a lot of attention due to their theoretical background and promising results. However, one of the major challenges of these approaches for logo recognition is collecting samples of logos with possible perspective tilts and non-rigid deformations that most likely happen to natural images. Therefore, a robust model cannot be trained due to the lack of sufficient samples. In this paper, we aim to overcome, or at least alleviate, this challenge by introducing an exemplar-based approach. The proposed method synthesizes new images of each logo of interest, so-called exemplars, by simulating two camera axes. This is to produce almost all possible views of a logo that may appear in a given image and guarantee that most of the distortions in the shape of a logo caused by a variation of the camera optical axis direction are covered. Subsequently, an exemplar-based model is derived based on all the exemplars using linear SVMs. Finally, for the detection and recognition, we associate observed logos with the exemplars using our exemplar-based model. Experiments are carried out on two publicly available logo datasets: FlickrLogos-27 and FlickrLogos-32. The results show the superior detection and recognition capabilities of the proposed method over the competitors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

Notes

  1. http://biomecis.uta.edu/shape_data.htm.

  2. http://riemenschneider.hayko.at/vision/dataset/task.php?did=4.

  3. https://sites.google.com/site/christophlampert/software.

  4. http://liblinear.bwaldvogel.de/.

  5. http://www.openimaj.org/.

  6. http://image.ntua.gr/iva/datasets/flickr_logos/.

  7. http://www.multimedia-computing.de/flickrlogos/.

References

  1. Malisiewicz, T., Gupta, A., Efros, A.A.: Ensemble of exemplar-svms for object detection and beyond. In: Proceedings of the International Conference on Computer Vision, pp. 89–96. IEEE (2011)

  2. Gori, M., Maggini, M., Marinai, S., Sheng, J., Soda, G.: Edge-backpropagation for noisy logo recognition. Pattern Recogn. 36(1), 103–110 (2003)

    Article  Google Scholar 

  3. Bagheri, M.A., Gao, Q.: Logo recognition based on a novel pairwise classification approach. In: Proceedings of the International Symposium on Artificial Intelligence and Signal Processing, pp. 316–321. IEEE (2012)

  4. Nan, Z.: Vehicle-logo recognition based on classifier combinations. In: Proceedings of the International Conference on System Science, Engineering Design and Manufacturing Informatization, pp. 278–281. IEEE (2012)

  5. Bagheri, M.A., Gao, Q., Escalera, S.: Logo recognition based on the dempster-shafer fusion of multiple classifiers. In: Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol. 7884, pp. 1–12. Springer, Berlin (2013)

  6. Cyganek, B.: Hybrid ensemble of classifiers for logo and trademark symbols recognition. Soft Comput. (2014). doi:10.1007/s00500-014-1323-8

  7. Doermann, D.S., Rivlin, E., Weiss, I.: Logo recognition using geometric invariants. In: Proceedings of the International Conference on Document Analysis and Recognition, pp. 894–897. IEEE (1993)

  8. Cesarini, F., Gori, M., Marinai, S., Soda, G.: A hybrid system for locating and recognizing low level graphic items. In: Graphics Recognition Methods and Applications. Lecture Notes in Computer Science, vol. 1072, pp. 135–147. Springer, Berlin (1995)

  9. Diligenti, M., Gori, M., Maggini, M., Martinelli, E.: Adaptive graphical pattern recognition for the classification of company logos. Pattern Recogn. 34(10), 2049–2061 (2001)

    Article  MATH  Google Scholar 

  10. Cortelazzo, G.M., Mian, G.A., Vezzi, G., Zamperoni, P.: Trademark shapes description by string-matching techniques. Pattern Recogn. 27(8), 1005–1018 (1994)

    Article  MATH  Google Scholar 

  11. Neumann, J., Samet, H., Soffer, A.: Integration of local and global shape analysis for logo classification. Pattern Recogn. Lett. 23(12), 1449–1457 (2002)

    Article  MATH  Google Scholar 

  12. Soffer, A., Samet, H.: Using negative shape features for logo similarity matching. In: Proceedings of the International Conference on Pattern Recognition, pp. 571–573. IEEE (1998)

  13. Jaisimha, M.Y.: Using negative shape features for logo similarity matching. In: Proceedings of the SPIE, Document Recognition III, vol. 2660, pp. 89–100 (1998)

  14. Chen, J., Leung, M.K.H., Gao, Y.: Noisy logo recognition using line segment hausdorff distance. Pattern Recogn. 36(4), 943–955 (2003)

    Article  MATH  Google Scholar 

  15. Rucklidge, W.: Efficiently locating objects using the hausdorff distance. Int. J. Comput. Vis. 24(3), 251–270 (1997)

    Article  Google Scholar 

  16. Chang, P., Krumm, J.: Object recognition with color cooccurrence histograms. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2498–2504. IEEE (1999)

  17. Hesson, A., Androutsos, D.: Logo and trademark detection in images using color wavelet cooccurrence histograms. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1233–1236. IEEE (2008)

  18. Phan, R., Chia, J., Androutsos, D.: Unconstrained logo and trademark retrieval in general color image databases using color edge gradient cooccurrence histograms. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1221–1224. IEEE (2008)

  19. Sugano, M., Sakazawa, S.: Lightweight tv logo recognition based on image moment. In: Proceedings of the International Conference on Multimedia, pp. 943–946. ACM (2010)

  20. Hu, M.-K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179–187 (1962)

    Article  MATH  Google Scholar 

  21. Zeggari, A., Hachouf, F., Foufou, S.: Trademarks recognition based on local regions similarities. In: Proceedings of the International Conference on Information Science, Signal Processing and Their Applications, pp. 37–40. IEEE (2010)

  22. Pourghassem, H.: A hierarchical logo detection and recognition algorithm using two-stage segmentation and multiple classifiers. In: Proceedings of the International Conference on Computational Intelligence and Communication Networks, pp. 227–231. IEEE (2012)

  23. Kim, Y.-S., Kim, W.-Y.: Content-based trademark retrieval system using a visually salient feature. Image Vis. Comput. 16(12–13), 931–939 (1998)

    Article  Google Scholar 

  24. Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)

    Article  Google Scholar 

  25. Sanyal, S., Sengamedu, S.H.: Logoseeker: a system for detecting and matching logos in natural images. In: Proceedings of the International Conference on Multimedia, pp. 166–167. ACM (2007)

  26. Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. Int. J. Comput. Vis. 60(1), 63–86 (2004)

    Article  Google Scholar 

  27. Arafat, S.Y., Husain, S.A., Niaz, I.A., Saleem, M.: Logo detection and recognition in video stream. In: Proceedings of the International Conference on Digital Information Management, pp. 163–168. IEEE (2010)

  28. Psyllos, A.P., Anagnostopoulos, C.-N., Kayafas, E.: Vehicle logo recognition using a sift-based enhanced matching scheme. IEEE Trans. Intell. Transp. Syst. 11(2), 322–328 (2010)

    Article  MATH  Google Scholar 

  29. Romberg, S., Pueyo, L.G., Lienhart, R., van Zwol, R.: Scalable logo recognition in real-world images. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 25–32. ACM (2011)

  30. Psyllos, A., Anagnostopoulos, C.-N., Kayafas, E.: M-sift: a new method for vehicle logo recognition. In: Proceedings of the International Conference on Vehicular Electronics and Safety, pp. 261–266. IEEE (2012)

  31. Kalantidis, Y., Pueyo, L.G., Trevisiol, M., van Zwol, R., Avrithis, Y.S.: Scalable triangulation-based logo recognition. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 1–7. ACM (2011)

  32. Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proceedings of the International Conference on Computer Vision, pp. 1470–1477. IEEE (2003)

  33. Kleban, J., Xie, X., Ma, W.-Y.: Spatial pyramid mining for logo detection in natural scenes. In: Proceedings of the International Conference on Multimedia and Expo, pp. 1077–1080. IEEE (2008)

  34. Chu, W.-T., Lin, T.-C.: Logo recognition and localization in real-world images by using visual patterns. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 973–976. IEEE (2012)

  35. Sidla, O., Kottmann, M., Benesova, W.: Real-time pose invariant logo and pattern detection. In: Proceedings of SPIE, Intelligent Robots and Computer Vision XXVIII, vol. 7878, pp. 37–40. IEEE (2011)

  36. Marr, D., Hildreth, E.: Theory of edge detection. Proc. R. Soc. Lond. Ser. B 207, 187–217 (1980)

    Article  MATH  Google Scholar 

  37. Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)

    MATH  Google Scholar 

  38. Lampert, C.H., Blaschko, M.B., Hofmann, T.: Beyond sliding windows: Object localization by efficient subwindow search. In: Proceeding of the International Conference in Computer Vision and Pattern Recognition. IEEE (2008)

  39. Yu, G., Morel, J.-M.: Asift: an algorithm for fully affine invariant comparison. Image Process. Line 1 (2011)

  40. Singh, C., Sharma, P.: Performance analysis of various local and global shape descriptors for image retrieval. Multimed. Syst. 19(1), 339–357 (2013)

    Article  Google Scholar 

  41. Farajzadeh, N., Faez, K., Pan, G.: Study on the performance of moments as invariant descriptors for practical face recognition systems. IET Comput. Vis. 4(4), 272–285 (2010)

    Article  Google Scholar 

  42. Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)

    Article  Google Scholar 

  43. Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)

    Article  MathSciNet  Google Scholar 

  44. Bar, M.: The proactive brain: using analogies and associations to generate predictions. Trends Cognit. Sci. 11(7), 280–289 (2007)

    Article  Google Scholar 

  45. Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers, pp. 61–74. MIT Press, Cambridge (1999)

  46. Fu, J., Wang, J., Zhang, Y., Lu, H.: Point-context descriptor based region search for logo recognition. In: Proceedings of the International Conference on Internet Multimedia Computing and Service, pp. 188–191. ACM (2012)

  47. Sahbi, H., Ballan, L., Serra, G., Bimbo, A.D.: Context-dependent logo matching and recognition. IEEE Trans. Image Process. 22(3), 1018–1031 (2013)

    Article  MathSciNet  Google Scholar 

  48. Revaud, J., Douze, M., Schmid, C.: Correlation-based burstiness for logo retrieval. In: Proceedings of the International Conference on Multimedia, pp. 965–968. ACM (2012)

  49. Romberg, S., Lienhart, R.: Bundle min-hashing for logo recognition. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 113–120. ACM (2013)

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Nacer Farajzadeh.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Farajzadeh, N. Exemplar-based logo and trademark recognition. Machine Vision and Applications 26, 791–805 (2015). https://doi.org/10.1007/s00138-015-0695-9

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00138-015-0695-9

Keywords

Navigation