Skip to main content
SpringerLink
Log in

A two-stage deep learning framework for counterfeit luxury handbag detection in logo images

  • Original Paper
  • Published:
Signal, Image and Video Processing Aims and scope Submit manuscript

Abstract

Counterfeit luxury handbags are a worldwide problem that imposes a huge burden on society and the economy. The logo of a luxury handbag is a good identification point because its content is clear and often difficult to counterfeit. Generally, the authenticity of luxury handbags is identified by senior appraisers, but the number of professional appraisers is in short supply and the cost is high. Recently, convolutional neural networks (CNNs) have been widely used for counterfeit detection. However, directly applying CNNs to identify luxury handbags in logo images is still challenging due to the following two issues: (1) some identification points in logo images are very subtle and (2) both local and global information of logo images need to be considered. To address the above issues, this paper proposes a two-stage deep learning framework for counterfeit luxury handbag detection in logo images. In this framework, multiple object detection models are developed in the first stage, aiming at obtaining the location of each local identification point. In the second stage, an authenticity classification model combining local and global information is established to output the final authenticity prediction result. To verify the effectiveness of the proposed framework, we have constructed and annotated a luxury handbag dataset containing 639 logo images. The results on this dataset show that the proposed framework can accurately detect local recognition points and identify the authenticity of luxury handbags with high accuracy, outperforming the method that directly applies CNNs to classify the whole logo image (i.e., the one-stage model) and existing CNN-based counterfeit detection methods.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4

Similar content being viewed by others

Data Availability Statement

The dataset and codes of this paper are not publicly available at this time but may be obtained from the authors upon reasonable request.

Notes

  1. http://github.com/aleju/imgaug.

References

  1. Kalyoncuoglu, S., Sahin, B., et al.: Moderating role of materialism in the effect of perceived value on purchase intention of counterfeits of luxury brands. Int. J. Mark. Stud. 9(4), 76–88 (2017)

    Article  Google Scholar 

  2. Doss, F., Robinson, T.: Luxury perceptions: luxury brand vs counterfeit for young us female consumers. J. Fash. Mark. Manag. 17(4), 424–439 (2013)

    Google Scholar 

  3. Norum, P.S., Cuno, A.: Analysis of the demand for counterfeit goods. J. Fash. Mark. Manag. 15(1), 27–40 (2011)

    Google Scholar 

  4. Miaoulis, G., Jr., Manev, I.M., Rauch, M.M., Kimball, K.G.: Cross cultural analysis of purchasers’ intention to wear a counterfeit luxury product in varying social situations. Lux. Res. J. 2(1–2), 70–85 (2021)

    Google Scholar 

  5. Amaral, N.B., Loken, B.: Viewing usage of counterfeit luxury goods: social identity and social hierarchy effects on dilution and enhancement of genuine luxury brands. J. Consum. Psychol. 26(4), 483–495 (2016)

    Article  Google Scholar 

  6. Hieke, S.: Effects of counterfeits on the image of luxury brands: an empirical study from the customer perspective. J. Brand Manag. 18(2), 159–173 (2010)

    Article  Google Scholar 

  7. Vijay Shankar Chand and Chen Fei: Self-brand connection and intention to purchase a counterfeit luxury brand in emerging economies. J. Consum. Behav. 20(2), 399–411 (2021)

    Article  Google Scholar 

  8. Cedillo-Hernández, M., García-Ugalde, F., Nakano-Miyatake, M., Pérez-Meana, H.M.: Robust hybrid color image watermarking method based on DFT domain and 2d histogram modification. Signal Image Video Process. 8(1), 49–63 (2014)

    Article  Google Scholar 

  9. Xie, R., Hong, C., Zhu, S., Tao, D.: Anti-counterfeiting digital watermarking algorithm for printed QR barcode. Neurocomputing 167, 625–635 (2015)

    Article  Google Scholar 

  10. Taylor, D.: Rfid in the pharmaceutical industry: addressing counterfeits with technology. J. Med. Syst. 38(11), 1–5 (2014)

    Article  Google Scholar 

  11. Sharma, A., Srinivasan, V., Kanchan, V., Subramanian, L.: The fake vs real goods problem: microscopy and machine learning to the rescue. In: Proceedings of the 23rd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2011–2019 (2017)

  12. He, K., Zhang, X., Ren, S., Sun, J.: Deep residual learning for image recognition. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 770–778 (2016)

  13. George Ilaş, Alexandru Ş, Poruşniuc, G.-C.: Spotthefake: an initial report on a new CNN-enhanced platform for counterfeit goods detection. arXiv preprint arXiv:2002.06735 (2020)

  14. Simonyan, K., Zisserman, A.: Very deep convolutional networks for large-scale image recognition. arXiv preprint arXiv:1409.1556 (2014)

  15. Peng, J., Zou, B., He, X., Zhu, C.: Hybrid attention network with appraiser-guided loss for counterfeit luxury handbag detection. Complex Intell. Syst. 8(3), 2371–2381 (2022)

    Article  Google Scholar 

  16. Ko, E., Costello, J.P., Taylor, C.R.: What is a luxury brand? A new definition and review of the literature. J. Bus. Res. 99, 405–413 (2019)

    Article  Google Scholar 

  17. Yoo, B., Lee, S-H.: Buy genuine luxury fashion products or counterfeits? ACR North American Advances (2009)

  18. Zuiderveld, K.: Contrast limited adaptive histogram equalization. In: Graphics Gems, pp. 474–485 (1994)

  19. Lim, B., Son, S., Kim, H., Nah, S., Mu Lee, K.: Enhanced deep residual networks for single image super-resolution. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition Workshops, pp. 136–144 (2017)

  20. Kumar, S.N., Singal, G., Sirikonda, S., Nethravathi, R.: A novel approach for detection of counterfeit Indian currency notes using deep convolutional neural network. In: IOP Conference Series: Materials Science and Engineering, vol. 981, p. 022018. IOP Publishing (2020)

  21. Teymournezhad, K., Azgomi, H., Asghari, A.: Detection of counterfeit banknotes by security components based on image processing and googlenet deep learning network. In: Signal, Image and Video Processing, pp. 1–9 (2022)

  22. Desai, S., Rajadhyaksha, A., Shetty, A., Gharat, S.: CNN based counterfeit Indian currency recognition using generative adversarial network. In: 2021 International Conference on Artificial Intelligence and Smart Systems (ICAIS), pp. 626–631. IEEE (2021)

  23. An-Bing, Z., Hui-Hua, Y., Xi-Peng, P., Li-Hui, Y., Yan-Chun, F.: On-site identification of counterfeit drugs based on near-infrared spectroscopy Siamese-network modeling. IEEE Access 9, 3195–3206 (2020)

    Article  Google Scholar 

  24. Alsallal, M., Sharif, M.S., Al-Ghzawi, B., , Mutoki. S.M.M.: A machine learning technique to detect counterfeit medicine based on X-ray fluorescence analyser. In: 2018 International Conference on Computing, Electronics & Communications Engineering (iCCECE), pp. 118–122. IEEE (2018)

  25. Zhang, R., Liu, X., Jing, H., Chang, K., Liu, K.: A fast method for moving object detection in video surveillance image. SIViP 11(5), 841–848 (2017)

    Article  Google Scholar 

  26. Girshick, R.: Fast r-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 1440–1448 (2015)

  27. Ren, S., He, K., Girshick, R., Sun, J.: Faster r-CNN: towards real-time object detection with region proposal networks. Adv. Neural. Inf. Process. Syst. 28, 91–99 (2015)

    Google Scholar 

  28. He, K., Gkioxari, G., Dollár, P., Girshick, R.: Mask r-CNN. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2961–2969 (2017)

  29. Redmon, J., Divvala, S., Girshick, R., Farhadi, A.: You only look once: unified, real-time object detection. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 779–788 (2016)

  30. Liu, W., Anguelov, D., Erhan, D., Szegedy, C., Reed, S., Fu, C.-Y., Berg, A.C.: SSD: single shot multibox detector. In: European Conference on Computer Vision, pp. 21–37. Springer (2016)

  31. Lin, T.-Y., Goyal, P., Girshick, R., He, K., Dollár, P.: Focal loss for dense object detection. In: Proceedings of the IEEE International Conference on Computer Vision, pp. 2980–2988 (2017)

  32. Jocher, G., Stoken, A., Borovec, J., NanoCode012., ChristopherSTAN., Changyu, Liu.,Laughing., tkianai., Hogan, Adam., lorenzomammana, yxNONG, AlexWang1900., Diaconu, Laurentiu,. Marc., wanghaoyang0106., ml5ah, Doug., Ingham, Francisco., Frederik, Guilhen, Hatovix, Poznanski, Jake ., Fang, Jiacong., Yu, Lijun., changyu98, Wang, Mingyu., Gupta, Naman.,Akhtar, Osama., PetrDvoracek., Rai, P.: ultralytics/yolov5: v3.1—Bug Fixes and Performance Improvements (October 2020)

  33. Druzhkov, P.N., Kustikova, V.D.: A survey of deep learning methods and software tools for image classification and object detection. Pattern Recognit Image Anal. 26(1), 9–15 (2016)

    Article  Google Scholar 

  34. Sagi, O., Rokach, L.: Ensemble learning: a survey. Wiley Interdiscip. Rev. Data Min. Knowl. Discov. 8(4), e1249 (2018)

    Article  Google Scholar 

  35. Dong, X., Zhiwen, Yu., Cao, W., Shi, Y., Ma, Q.: A survey on ensemble learning. Front. Comput. Sci. 14(2), 241–258 (2020)

    Article  Google Scholar 

  36. Yu, L., Lai, K.K., Wang, S.: Multistage RBF neural network ensemble learning for exchange rates forecasting. Neurocomputing 71(16–18), 3295–3302 (2008)

    Article  Google Scholar 

  37. Hu, J., Shen, L., Sun, G.: Squeeze-and-excitation networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 7132–7141 (2018)

  38. Li, X., Wang, W., Hu, X., Yang, J.: Selective kernel networks. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp. 510–519 (2019)

  39. Woo, S., Park, J., Lee, J.-Y., Kweon, I.S.: CBAM: Convolutional block attention module. In: Proceedings of the European conference on computer vision (ECCV), pp. 3–19 (2018)

  40. Fu, J., Liu, J., Tian, H., Li, Y., Bao, Y., Fang, Z., Lu, H.: Dual attention network for scene segmentation. In: Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition, pp. 3146–3154 (2019)

Download references

Funding

This work was supported by the Scientific and Technological Innovation Leading Plan of High-tech Industry of Hunan Province (Grant Number: 2020GK2021), the National Natural Science Foundation of China (Grant Number: 61902434), the Key Research and Development Program of Hunan Province (Grant Number: 2022SK2054), the International Science and Technology Innovation Joint Base of Machine Vision and Medical Image Processing in Hunan Province (Grant Number: 2021CB1013), and the Natural Science Foundation of Hunan Province, China (Grant Number: 2019JJ50826).

Author information

Authors and Affiliations

  1. School of Computer Science and Engineering, Central South University, Changsha, 410083, China

    Jianbiao Peng, Beiji Zou & Chengzhang Zhu

  2. The College of Literature and Journalism, Central South University, Changsha, 410083, China

    Chengzhang Zhu

  3. Hunan Engineering Research Center of Machine Vision and Intelligent Medicine, Central South University, Changsha, 410083, China

    Jianbiao Peng, Beiji Zou & Chengzhang Zhu

  4. Center for Intelligent Media and Communication Research, The College of Literature and Journalism, Central South University, Changsha, 410083, China

    Chengzhang Zhu

Authors
  1. Jianbiao Peng
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Beiji Zou
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Chengzhang Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

JP and BZ designed experiments; JP carried out experiments; JP and CZ analyzed experimental results. JP and CZ wrote the manuscript. All authors reviewed the manuscript.

Corresponding author

Correspondence to Chengzhang Zhu.

Ethics declarations

Competing interests

The authors declare that they have no conflict of interest.

Ethical approval

Not applicable.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Peng, J., Zou, B. & Zhu, C. A two-stage deep learning framework for counterfeit luxury handbag detection in logo images. SIViP 17, 1439–1448 (2023). https://doi.org/10.1007/s11760-022-02352-7

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11760-022-02352-7

Keywords

Search

Navigation