Abstract
Automatic logo recognition facilitates the process of searching and analyzing digital image-based resources. This is due to the simplicity and informativity of logos which can be used as a visual or semantic clue for applications such as content-based image retrieval. For automatic shape recognition, model-based approaches have gained a lot of attention due to their theoretical background and promising results. However, one of the major challenges of these approaches for logo recognition is collecting samples of logos with possible perspective tilts and non-rigid deformations that most likely happen to natural images. Therefore, a robust model cannot be trained due to the lack of sufficient samples. In this paper, we aim to overcome, or at least alleviate, this challenge by introducing an exemplar-based approach. The proposed method synthesizes new images of each logo of interest, so-called exemplars, by simulating two camera axes. This is to produce almost all possible views of a logo that may appear in a given image and guarantee that most of the distortions in the shape of a logo caused by a variation of the camera optical axis direction are covered. Subsequently, an exemplar-based model is derived based on all the exemplars using linear SVMs. Finally, for the detection and recognition, we associate observed logos with the exemplars using our exemplar-based model. Experiments are carried out on two publicly available logo datasets: FlickrLogos-27 and FlickrLogos-32. The results show the superior detection and recognition capabilities of the proposed method over the competitors.
Similar content being viewed by others
Notes
References
Malisiewicz, T., Gupta, A., Efros, A.A.: Ensemble of exemplar-svms for object detection and beyond. In: Proceedings of the International Conference on Computer Vision, pp. 89–96. IEEE (2011)
Gori, M., Maggini, M., Marinai, S., Sheng, J., Soda, G.: Edge-backpropagation for noisy logo recognition. Pattern Recogn. 36(1), 103–110 (2003)
Bagheri, M.A., Gao, Q.: Logo recognition based on a novel pairwise classification approach. In: Proceedings of the International Symposium on Artificial Intelligence and Signal Processing, pp. 316–321. IEEE (2012)
Nan, Z.: Vehicle-logo recognition based on classifier combinations. In: Proceedings of the International Conference on System Science, Engineering Design and Manufacturing Informatization, pp. 278–281. IEEE (2012)
Bagheri, M.A., Gao, Q., Escalera, S.: Logo recognition based on the dempster-shafer fusion of multiple classifiers. In: Advances in Artificial Intelligence. Lecture Notes in Computer Science, vol. 7884, pp. 1–12. Springer, Berlin (2013)
Cyganek, B.: Hybrid ensemble of classifiers for logo and trademark symbols recognition. Soft Comput. (2014). doi:10.1007/s00500-014-1323-8
Doermann, D.S., Rivlin, E., Weiss, I.: Logo recognition using geometric invariants. In: Proceedings of the International Conference on Document Analysis and Recognition, pp. 894–897. IEEE (1993)
Cesarini, F., Gori, M., Marinai, S., Soda, G.: A hybrid system for locating and recognizing low level graphic items. In: Graphics Recognition Methods and Applications. Lecture Notes in Computer Science, vol. 1072, pp. 135–147. Springer, Berlin (1995)
Diligenti, M., Gori, M., Maggini, M., Martinelli, E.: Adaptive graphical pattern recognition for the classification of company logos. Pattern Recogn. 34(10), 2049–2061 (2001)
Cortelazzo, G.M., Mian, G.A., Vezzi, G., Zamperoni, P.: Trademark shapes description by string-matching techniques. Pattern Recogn. 27(8), 1005–1018 (1994)
Neumann, J., Samet, H., Soffer, A.: Integration of local and global shape analysis for logo classification. Pattern Recogn. Lett. 23(12), 1449–1457 (2002)
Soffer, A., Samet, H.: Using negative shape features for logo similarity matching. In: Proceedings of the International Conference on Pattern Recognition, pp. 571–573. IEEE (1998)
Jaisimha, M.Y.: Using negative shape features for logo similarity matching. In: Proceedings of the SPIE, Document Recognition III, vol. 2660, pp. 89–100 (1998)
Chen, J., Leung, M.K.H., Gao, Y.: Noisy logo recognition using line segment hausdorff distance. Pattern Recogn. 36(4), 943–955 (2003)
Rucklidge, W.: Efficiently locating objects using the hausdorff distance. Int. J. Comput. Vis. 24(3), 251–270 (1997)
Chang, P., Krumm, J.: Object recognition with color cooccurrence histograms. In: Proceedings of the International Conference on Computer Vision and Pattern Recognition, vol. 2, pp. 2498–2504. IEEE (1999)
Hesson, A., Androutsos, D.: Logo and trademark detection in images using color wavelet cooccurrence histograms. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1233–1236. IEEE (2008)
Phan, R., Chia, J., Androutsos, D.: Unconstrained logo and trademark retrieval in general color image databases using color edge gradient cooccurrence histograms. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 1221–1224. IEEE (2008)
Sugano, M., Sakazawa, S.: Lightweight tv logo recognition based on image moment. In: Proceedings of the International Conference on Multimedia, pp. 943–946. ACM (2010)
Hu, M.-K.: Visual pattern recognition by moment invariants. IRE Trans. Inf. Theory 8(2), 179–187 (1962)
Zeggari, A., Hachouf, F., Foufou, S.: Trademarks recognition based on local regions similarities. In: Proceedings of the International Conference on Information Science, Signal Processing and Their Applications, pp. 37–40. IEEE (2010)
Pourghassem, H.: A hierarchical logo detection and recognition algorithm using two-stage segmentation and multiple classifiers. In: Proceedings of the International Conference on Computational Intelligence and Communication Networks, pp. 227–231. IEEE (2012)
Kim, Y.-S., Kim, W.-Y.: Content-based trademark retrieval system using a visually salient feature. Image Vis. Comput. 16(12–13), 931–939 (1998)
Lowe, D.G.: Distinctive image features from scale-invariant keypoints. Int. J. Comput. Vis. 60, 91–110 (2004)
Sanyal, S., Sengamedu, S.H.: Logoseeker: a system for detecting and matching logos in natural images. In: Proceedings of the International Conference on Multimedia, pp. 166–167. ACM (2007)
Mikolajczyk, K., Schmid, C.: Scale and affine invariant interest point detectors. Int. J. Comput. Vis. 60(1), 63–86 (2004)
Arafat, S.Y., Husain, S.A., Niaz, I.A., Saleem, M.: Logo detection and recognition in video stream. In: Proceedings of the International Conference on Digital Information Management, pp. 163–168. IEEE (2010)
Psyllos, A.P., Anagnostopoulos, C.-N., Kayafas, E.: Vehicle logo recognition using a sift-based enhanced matching scheme. IEEE Trans. Intell. Transp. Syst. 11(2), 322–328 (2010)
Romberg, S., Pueyo, L.G., Lienhart, R., van Zwol, R.: Scalable logo recognition in real-world images. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 25–32. ACM (2011)
Psyllos, A., Anagnostopoulos, C.-N., Kayafas, E.: M-sift: a new method for vehicle logo recognition. In: Proceedings of the International Conference on Vehicular Electronics and Safety, pp. 261–266. IEEE (2012)
Kalantidis, Y., Pueyo, L.G., Trevisiol, M., van Zwol, R., Avrithis, Y.S.: Scalable triangulation-based logo recognition. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 1–7. ACM (2011)
Sivic, J., Zisserman, A.: Video Google: A text retrieval approach to object matching in videos. In: Proceedings of the International Conference on Computer Vision, pp. 1470–1477. IEEE (2003)
Kleban, J., Xie, X., Ma, W.-Y.: Spatial pyramid mining for logo detection in natural scenes. In: Proceedings of the International Conference on Multimedia and Expo, pp. 1077–1080. IEEE (2008)
Chu, W.-T., Lin, T.-C.: Logo recognition and localization in real-world images by using visual patterns. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing, pp. 973–976. IEEE (2012)
Sidla, O., Kottmann, M., Benesova, W.: Real-time pose invariant logo and pattern detection. In: Proceedings of SPIE, Intelligent Robots and Computer Vision XXVIII, vol. 7878, pp. 37–40. IEEE (2011)
Marr, D., Hildreth, E.: Theory of edge detection. Proc. R. Soc. Lond. Ser. B 207, 187–217 (1980)
Vapnik, V.N.: Statistical Learning Theory. Wiley, New York (1998)
Lampert, C.H., Blaschko, M.B., Hofmann, T.: Beyond sliding windows: Object localization by efficient subwindow search. In: Proceeding of the International Conference in Computer Vision and Pattern Recognition. IEEE (2008)
Yu, G., Morel, J.-M.: Asift: an algorithm for fully affine invariant comparison. Image Process. Line 1 (2011)
Singh, C., Sharma, P.: Performance analysis of various local and global shape descriptors for image retrieval. Multimed. Syst. 19(1), 339–357 (2013)
Farajzadeh, N., Faez, K., Pan, G.: Study on the performance of moments as invariant descriptors for practical face recognition systems. IET Comput. Vis. 4(4), 272–285 (2010)
Ojala, T., Pietikinen, M., Menp, T.: Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24(7), 971–987 (2002)
Tan, X., Triggs, B.: Enhanced local texture feature sets for face recognition under difficult lighting conditions. IEEE Trans. Image Process. 19(6), 1635–1650 (2010)
Bar, M.: The proactive brain: using analogies and associations to generate predictions. Trends Cognit. Sci. 11(7), 280–289 (2007)
Platt, J.C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods. In: Advances in Large Margin Classifiers, pp. 61–74. MIT Press, Cambridge (1999)
Fu, J., Wang, J., Zhang, Y., Lu, H.: Point-context descriptor based region search for logo recognition. In: Proceedings of the International Conference on Internet Multimedia Computing and Service, pp. 188–191. ACM (2012)
Sahbi, H., Ballan, L., Serra, G., Bimbo, A.D.: Context-dependent logo matching and recognition. IEEE Trans. Image Process. 22(3), 1018–1031 (2013)
Revaud, J., Douze, M., Schmid, C.: Correlation-based burstiness for logo retrieval. In: Proceedings of the International Conference on Multimedia, pp. 965–968. ACM (2012)
Romberg, S., Lienhart, R.: Bundle min-hashing for logo recognition. In: Proceedings of the International Conference on Multimedia Retrieval, pp. 113–120. ACM (2013)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Farajzadeh, N. Exemplar-based logo and trademark recognition. Machine Vision and Applications 26, 791–805 (2015). https://doi.org/10.1007/s00138-015-0695-9
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00138-015-0695-9