Skip to main content
SpringerLink
Log in

Sketch works ranking based on improved transfer learning model

  • Published:
Multimedia Tools and Applications Aims and scope Submit manuscript

Abstract

Classification and evaluation of sketch works is an important step in sketch teaching. The speed for manual evaluation of massive works is very slow and its cost is also high. Regarding the sketch works after scoring is hard to be collected, the limitations from small dataset create many challenges for training a great scoring model. In this paper, we firstly collects 400 teaching sketches of college students from South China Normal University and constructs a dataset. Then an improved transfer learning model based on ResNet50 was proposed for learning the high-level abstract characteristics of sketch works because transfer learning can reuse knowledge from a large dataset and employ the feature extraction capability in sketch subject scenario. In our improved model, three strategies (i.e., data augmentation, dropout and feature fusion) are used to prevent the model from early overfitting and improve the accuracy and stability of the model. Comparing with traditional feature extraction algorithms, our model provides an end-to-end mechanism. Moreover, compared with the accuracy of AlexNet and ResNet50, it is improved by 24.2% and 7.82% respectively. Our results indicate that the three strategies have outstanding effects for the transfer learning model for sketch works ranking.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9

Similar content being viewed by others

References

  1. Changchun Z (2015) Art works retrieval and classification. Master?s thesis. Zhejiang University

  2. Chao L, Shouqian* S, Xin M, Weixing W, Zhichuan T (2017) Application of deep convolutional features in sketch works classification and evaluation. J Comput-Aided Design Comput Graph 029(010):1898–1904

    Google Scholar 

  3. Fan GF, Guo YH, Zheng JM, Hong WC (2020) A generalized regression model based on hybrid empirical mode decomposition and support vector regression with back-propagation neural network for mid-short-term load forecasting. Journal of Forecasting

  4. Fan GF, Wei X, Li YT, Hong WC (2020) Forecasting electricity consumption using a novel hybrid model. Sustainable Cities and Society, pp 102320

  5. Glorot X, Bordes A, Bengio Y (2011) Deep Sparse Rectifier Neural Networks. J Mach Learn Res 15:315–323

    Google Scholar 

  6. Hao X, Zhang G, Ma S (2016) Deep learning. Int J Semantic Comput 10(03):417–439

    Article  Google Scholar 

  7. He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In: pp 770–778

  8. He K, Zhang X, Ren S, Sun J (2016) Deep Residual Learning for Image Recognition

  9. Hu J, Shen L, Albanie S, Sun G, Wu E Squeeze-and-Excitation Networks. IEEE Transactions on Pattern Analysis and Machine Intelligence 2017; PP(99)

  10. Hughes JM, Graham DJ, Rockmore DN (2010) Quantification of artistic style through sparse coding analysis in the drawings of Pieter Bruegel the Elder. Proc Natl Acad Sci 107(4):1279–1283

    Article  Google Scholar 

  11. Huang Hua CW (2009) Real—time image sketch. Chinese J Comput 1:32

    Google Scholar 

  12. Iwendi C, Moqurrab SA, Anjum A, Khan S, Mohan S, Srivastava G (2020) N-Sanitization: A semantic privacy-preserving framework for unstructured medical datasets. Comput Commun 161:160–171

    Article  Google Scholar 

  13. Jia-chuan S (2013) Computerized Learning and Classification of Traditional Chinese IWPs(Ink and Wash Paintings). PhD thesis Tianjin: Tianjin University

  14. Jingte T (2018) The Research Sketch-Based Object Detection And Retrieval. Master’s thesis Jiangxi Normal University

  15. Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. In: pp 1097–1105

  16. Li MW, Geng J, Hong WC, Zhang LD (2019) Periodogram estimation based on LSSVR-CCPSO compensation for forecasting ship motion. Nonlinear Dyn 97(4):2579–2594

    Article  Google Scholar 

  17. Lu C, Xu L, Jia J (2012) Combining sketch and tone for pencil drawing production. In: Citeseer, pp 65–73

  18. Peng L (2009) Neural Network-Based Chinese Ink-Painting Artistic Style Learning[D] Tianjing: Tianjing University

  19. SANG Sang DYSY (2010) Pencil Drawing Generation Based on Texture and Profile. Journal of Shanghai University(Natural Science) 16(3):312–317

    Google Scholar 

  20. Sun ZJ, Xue L, Xu YM, Wang Z (2012) Overview of deep learning. Appl Res Comput 29(8):2806–2810

    Google Scholar 

  21. Shan-xiao G (2016) Research on real time sketch style rendering algotithm based on GPU. Master’s thesis Fujian Normal University

  22. Shuo HDw SUN (2007) Efficient region-based pencil drawing. Comput Eng Appl 43(14):34–37

    Google Scholar 

  23. Simonyan K, Zisserman A (2014) Very deep convolutional networks for large-scale image recognition. arXiv:1409.1556

  24. Srivastava N, Hinton G, Krizhevsky A, Sutskever I, Salakhutdinov R (2014) Dropout: a simple way to prevent neural networks from overfitting. The J Mach Learn Res 15(1):1929–1958

    MathSciNet  MATH  Google Scholar 

  25. Torrey L, Shavlik J (2010) Transfer learning. In: IGI global, pp 242–264

  26. Xie S, Girshick R, Dollár P, Tu Z, He K (2016) Aggregated Residual Transformations for Deep Neural Networks

  27. Yi R, Liu YJ, Lai YK, Rosin PL (2019) APDrawingGAN: Generating Artistic Portrait Drawings from Face Photos with Hierarchical GANs. In: pp 10743–10752

  28. Yi R, Liu YJ, Lai YK, Rosin PL (2020) Unpaired Portrait Drawing Generation via Asymmetric Cycle Mapping. In: pp 8217–8225

  29. Yu W, Yang K, Yao H, Sun X, Xu P (2017) Exploiting the complementary strengths of multi-layer CNN features for image retrieval. Neurocomputing 237:235–241

    Article  Google Scholar 

  30. Yu-sheng W Research on Computer Classification of Chinese Painting. PhD thesis. Xi‘an University of Architecture and Technology

  31. Yuzhi L, Jiachuan S, Bin H (2018) Improved Embedded Learning for Classification of Chinese Paintings. J Comput-Aided Design Comput Graph 30(5):893–900

    Google Scholar 

  32. Zagoruyko S, Komodakis N (2016) Wide residual networks. arXiv:1605.07146

  33. Zhang Z, Ding S, Sun Y (2020) A support vector regression model hybridized with chaotic krill herd algorithm and empirical mode decomposition for regression task. Neurocomputing

  34. Zhang Z, Hong WC (2019) Electric load forecasting by complete ensemble empirical mode decomposition adaptive noise and support vector regression with quantum-based dragonfly algorithm. Nonlinear Dyn 98(2):1107–1136

    Article  Google Scholar 

  35. Zhang H, Wu C, Zhang Z et al (2020) ResNeSt. Split-Attention Networks

  36. Zheng W, Hao-yue L, Hong-shan X, Mei-Jun S (2017) Chinese Painting Emotion Classification Based on Convolution Neural Network and SVM. Journal of Nanjing Normal University(Natural Science Edition) 40(3):79

    Google Scholar 

Download references

Acknowledgments

This work was partially supported by Guangdong Basic and Applied Basic Research Fund Regional Joint Fund Project (Key Project) (2020B1515120089) and the Featured Innovation Project of Guangdong Province Department of Education (Natural Science)(2019KTSCX035).

Author information

Author notes

  1. Jun Liang

    Present address: School of Software, South China Normal University, Nanhai District, Foshan City, Guangdong Province, China

Authors and Affiliations

  1. School of Software, South China Normal University, GuangDong, China

    SongSen Yu, ZeSheng Lin, Jun Liang, GangXu Shu, JiaLin Yu & Ao Zhu

Authors
  1. SongSen Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. ZeSheng Lin
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Jun Liang
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. GangXu Shu
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. JiaLin Yu
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Ao Zhu
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Jun Liang.

Additional information

Publisher’s note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Yu, S., Lin, Z., Liang, J. et al. Sketch works ranking based on improved transfer learning model. Multimed Tools Appl 80, 33663–33678 (2021). https://doi.org/10.1007/s11042-021-11305-0

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11042-021-11305-0

Keywords

Search

Navigation