Skip to main content
SpringerLink
Log in

Offline signature verification system: a graph neural network based approach

  • Original Research
  • Published:
Journal of Ambient Intelligence and Humanized Computing Aims and scope Submit manuscript

Abstract

Recent years have witnessed the surge of graph neural networks (GNNs) in various research fields. Compared to the convolutional neural networks (CNNs), GNNs happen to be more powerful and comprehensive as they use graphs to learn an embedding that contains information about the neighbourhood of a target node in a graph. Hence, GNN models have achieved exemplary performance in many tasks such as node classification, link prediction, and graph classification. In this work, we have come up with a solution to the problem of offline signature verification with the relational inductive biases of a GNN model. To apply the node classification strategy of a GNN model, a network is constructed. The network consists of training signature samples of a particular user, where each node represents a signature sample. GraphSAGE, an inductive representation learning algorithm, is utilized to train the model. Later, a test signature sample (i.e., a newly added node to the existing training graph) is classified into one of the two classes: genuine or forged using the trained model. The obtained results lay out a robust manifestation of the benefits of learned gray level co-occurrence matrix (GLCM) based features. The proposed method has been evaluated on two standard signature datasets, namely MCYT-75 and UTSig. The equal error rate (EER) values are 0.13 and 0.66 on MCYT-75 and UTSig datasets respectively. Use of a writer dependent schema with a distinctive model for each writer, and only with a handful number of training samples, the proposed model stands out amongst its predecessors.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  • Banerjee D, Chatterjee B, Bhowal P, Bhattacharyya T, Malakar S, Sarkar R (2021) A new wrapper feature selection method for language-invariant offline signature verification. Expert Syst Appl 186:115756. https://doi.org/10.1016/j.eswa.2021.115756

    Article  Google Scholar 

  • Barburiceanu S, Terebes R, Meza S (2021) 3D texture feature extraction and classification using glcm and lbp-based descriptors. Appl Sci 11(5):2332

    Article  Google Scholar 

  • Batool FE, Attique M, Sharif M, Javed K, Nazir M, Abbasi AA, Iqbal Z, Riaz N (2020) Offline signature verification system: a novel technique of fusion of glcm and geometric features using SVM. Multimedia Tools Appl. https://doi.org/10.1007/s11042-020-08851-4

    Article  Google Scholar 

  • Bertolini D, Oliveira LS, Justino E, Sabourin R (2010) Reducing forgeries in writer-independent off-line signature verification through ensemble of classifiers. Pattern Recogn 43(1):387–396

    Article  MATH  Google Scholar 

  • Bhowal P, Banerjee D, Malakar S, Sarkar R (2021) A two-tier ensemble approach for writer dependent online signature verification. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02872-5

    Article  Google Scholar 

  • Bhunia AK, Alaei A, Roy PP (2019) Signature verification approach using fusion of hybrid texture features. Neural Comput Appl 31(12):8737–8748

    Article  Google Scholar 

  • Chen Z, Li X, Bruna J (2017) Supervised community detection with line graph neural networks. arXiv:1705.08415

  • Data61 C (2018) Stellargraph machine learning library. https://github.com/stellargraph/stellargraph

  • Deng PS, Liao HYM, Ho CW, Tyan HR (1999) Wavelet-based off-line handwritten signature verification. Comput Vis Image Underst 76(3):173–190

    Article  Google Scholar 

  • Fillingham D (1997) A comparison of digital and handwritten signatures. Ethics Law Electron Front 6. https://groups.csail.mit.edu/mac/classes/6.805/student-papers/fall97-papers/fillingham-sig.html. Accessed 6 Nov 2021

  • Ganar AN, Gode C, Jambhulkar SM (2014) Enhancement of image retrieval by using colour, texture and shape features. In: 2014 International Conference on Electronic Systems, Signal Processing and Computing Technologies. IEEE, pp 251–255. https://doi.org/10.1109/ICESC.2014.48

  • Ghosh R (2021) A recurrent neural network based deep learning model for offline signature verification and recognition system. Expert Syst Appl 168:114249

    Article  Google Scholar 

  • Guerbai Y, Chibani Y, Hadjadji B (2015) The effective use of the one-class SVM classifier for handwritten signature verification based on writer-independent parameters. Pattern Recogn 48(1):103–113

    Article  Google Scholar 

  • Hafemann LG, Sabourin R, Oliveira LS (2017) Learning features for offline handwritten signature verification using deep convolutional neural networks. Pattern Recogn 70:163–176

    Article  Google Scholar 

  • Hamilton WL, Ying R, Leskovec J (2017) Inductive representation learning on large graphs. arXiv:1706.02216

  • Hemalatha V, Sundar C (2020) Automatic liver cancer detection in abdominal liver images using soft optimization techniques. J Ambient Intell Human Comput 12(5):4765–4774. https://doi.org/10.1007/s12652-020-01885-4

    Article  Google Scholar 

  • Jin C, Ruan T, Wu D, Xu L, Dong T, Chen T, Wang S, Du Y, Wu M (2021) Hetgat: a heterogeneous graph attention network for freeway traffic speed prediction. J Ambient Intell Human Comput. https://doi.org/10.1007/s12652-020-02807-0

    Article  Google Scholar 

  • Kim J, Kim T, Kim S, Yoo CD (2019) Edge-labeling graph neural network for few-shot learning. In: Proceedings of the IEEE/CVF conference on computer vision and pattern recognition, pp 11–20

  • Kipf TN, Welling M (2016) Semi-supervised classification with graph convolutional networks. arXiv:1609.02907

  • Li X, Sun Q, Liu Y, Zhou Q, Zheng S, Chua TS, Schiele B (2019a) Learning to self-train for semi-supervised few-shot classification. Adv Neural Inf Process Syst 32:10276–10286

    Google Scholar 

  • Li Y, Gu C, Dullien T, Vinyals O, Kohli P (2019b) Graph matching networks for learning the similarity of graph structured objects. In: Chaudhuri K, Salakhutdinov R (eds) Proceedings of the 36th International Conference on Machine Learning. Proceedings of Machine Learning Research, PMLR, pp 3835–3845

  • Li Z, Nie F, Chang X, Nie L, Zhang H, Yang Y (2018a) Rank-constrained spectral clustering with flexible embedding. IEEE Trans Neural Netw Learn Syst 29(12):6073–6082

    Article  MathSciNet  Google Scholar 

  • Li Z, Nie F, Chang X, Yang Y, Zhang C, Sebe N (2018b) Dynamic affinity graph construction for spectral clustering using multiple features. IEEE Trans Neural Netw Learn Syst 29(12):6323–6332

    Article  MathSciNet  Google Scholar 

  • Li Z, Yao L, Chang X, Zhan K, Sun J, Zhang H (2019c) Zero-shot event detection via event-adaptive concept relevance mining. Pattern Recogn 88:595–603

    Article  Google Scholar 

  • Lin CH, Chen RT, Chan YK (2009) A smart content-based image retrieval system based on color and texture feature. Image Vis Comput 27(6):658–665

    Article  Google Scholar 

  • Luo C, Li Z, Huang K, Feng J, Wang M (2017a) Zero-shot learning via attribute regression and class prototype rectification. IEEE Trans Image Process 27(2):637–648

    Article  MathSciNet  MATH  Google Scholar 

  • Luo M, Chang X, Li Z, Nie L, Hauptmann AG, Zheng Q (2017b) Simple to complex cross-modal learning to rank. Comput Vis Image Underst 163:67–77

    Article  Google Scholar 

  • Maergner P, Howe NR, Riesen K, Ingold R, Fischer A (2019a) Graph-based offline signature verification. arXiv:1906.10401

  • Maergner P, Pondenkandath V, Alberti M, Liwicki M, Riesen K, Ingold R, Fischer A (2019b) Combining graph edit distance and triplet networks for offline signature verification. Pattern Recogn Lett 125:527–533

    Article  Google Scholar 

  • Malakar S, Mohanta D, Sarkar R, Nasipuri M (2010) A novel noise-removal technique for document images. Int J Comput Commun Technol 2(2):120–124

    Google Scholar 

  • Manjunatha K, Manjunath S, Guru D, Somashekara M (2016) Online signature verification based on writer dependent features and classifiers. Pattern Recogn Lett 80:129–136

    Article  Google Scholar 

  • Mwangi KE (2008) Offline handwritten signature verification using SIFT features. Faculty of Computing and Information Technology, Makerere University. https://www.journalarjom.com/index.php/ARJOM/article/download/30170/56612

  • Narwade PN, Sawant RR, Bonde SV (2018) Offline handwritten signature verification using cylindrical shape context. 3D Res 9(4):1–12

    Article  Google Scholar 

  • Nasser AT, Dogru N (2017) Signature recognition by using SIFT and SURF with SVM basic on RBF for voting online. In: 2017 International Conference on Engineering and Technology (ICET). IEEE, pp 1–5. https://doi.org/10.1109/ICEngTechnol.2017.8308208

  • Navid SMA, Priya SH, Khandakar NH, Ferdous Z, Haque AB (2019) Signature verification using convolutional neural network. In: 2019 IEEE international conference on robotics, automation, artificial-intelligence and internet-of-things (RAAICON). IEEE, pp 35–39. https://doi.org/10.1109/RAAICON48939.2019.19

  • Okawa M (2019) Template matching using time-series averaging and DTW with dependent warping for online signature verification. IEEE Access 7:81010–81019

    Article  Google Scholar 

  • Ortega-Garcia J, Fierrez-Aguilar J, Simon D, Gonzalez J, Faundez-Zanuy M, Espinosa V, Satue A, Hernaez I, Igarza JJ, Vivaracho C et al (2003) Mcyt baseline corpus: a bimodal biometric database. IEE Proc Vision Image Signal Process 150(6):395–401

    Article  Google Scholar 

  • Ruiz V, Linares I, Sanchez A, Velez JF (2020) Off-line handwritten signature verification using compositional synthetic generation of signatures and siamese neural networks. Neurocomputing 374:30–41

    Article  Google Scholar 

  • Scarselli F, Gori M, Tsoi AC, Hagenbuchner M, Monfardini G (2008) The graph neural network model. IEEE Trans Neural Netw 20(1):61–80

    Article  Google Scholar 

  • Serdouk Y, Nemmour H, Chibani Y (2017) Handwritten signature verification using the quad-tree histogram of templates and a support vector-based artificial immune classification. Image Vis Comput 66:26–35

    Article  Google Scholar 

  • Shanker AP, Rajagopalan A (2007) Off-line signature verification using DTW. Pattern Recogn Lett 28(12):1407–1414

    Article  Google Scholar 

  • Shao H, Wu Y, Cui W, Zhang J (2008) Image retrieval based on mpeg-7 dominant color descriptor. In: 2008 The 9th International Conference for Young Computer Scientists. IEEE, pp 753–757. https://doi.org/10.1109/ICYCS.2008.89

  • Soleimani A, Araabi BN, Fouladi K (2016a) Deep multitask metric learning for offline signature verification. Pattern Recogn Lett 80:84–90

    Article  Google Scholar 

  • Soleimani A, Fouladi K, Araabi BN (2016b) Persian offline signature verification based on curvature and gradient histograms. In: 2016 6th International Conference on Computer and Knowledge Engineering (ICCKE). IEEE, pp 147–152. https://doi.org/10.1109/ICCKE.2016.7802131

  • Soleimani A, Fouladi K, Araabi BN (2016c) Utsig: A persian offline signature dataset. IET Biometrics 6(1):1–8

    Article  Google Scholar 

  • Stauffer M, Maergner P, Fischer A, Ingold R, Riesen K (2019) Offline signature verification using structural dynamic time warping. In: 2019 International conference on document analysis and recognition (ICDAR). IEEE, pp 1117–1124. https://doi.org/10.1109/ICDAR.2019.00181

  • Swaroop P, Sharma N (2016) An overview of various template matching methodologies in image processing. Int J Comput Appl 153(10):8–14

    Google Scholar 

  • Wang SH, Govindaraj V, Gorriz JM, Zhang X, Zhang YD (2021) Explainable diagnosis of secondary pulmonary tuberculosis by graph rank-based average pooling neural network. J Ambient Intell Human Comput:1–14

  • Xing ZJ, Yin F, Wu YC, Liu CL (2018) Offline signature verification using convolution siamese network. In: Ninth International Conference on Graphic and Image Processing (ICGIP 2017), International Society for Optics and Photonics, vol 10615, pp 415–423. https://doi.org/10.1117/12.2303380

  • Xu B, Huang J, Hou L, Shen H, Gao J, Cheng X (2020) Label-consistency based graph neural networks for semi-supervised node classification. In: Proceedings of the 43rd international ACM SIGIR conference on research and development in information retrieval. SIGIR '20. Association for Computing Machinery, New York, United States, pp 1897–1900. https://doi.org/10.1145/3397271.3401308

  • Yamunadevi M, Ranjani SS (2020) Efficient segmentation of the lung carcinoma by adaptive fuzzy–GLCM (AF-GLCM) with deep learning based classification. J Ambient Intell Human Comput 12(5):4715–4725. https://doi.org/10.1007/s12652-020-01874-7

    Article  Google Scholar 

  • Yapıcı MM, Tekerek A, Topaloğlu N (2021) Deep learning-based data augmentation method and signature verification system for offline handwritten signature. Pattern Anal Appl 24(1):165–179

    Article  Google Scholar 

  • Yilmaz MB, Yanikoglu B, Tirkaz C, Kholmatov A (2011) Offline signature verification using classifier combination of HOG and LBP features. In: 2011 international joint conference on Biometrics (IJCB). IEEE, pp 1–7. https://doi.org/10.1109/IJCB.2011.6117473

  • Yuan D, Chang X, Huang PY, Liu Q, He Z (2020) Self-supervised deep correlation tracking. IEEE Trans Image Process 30:976–985

    Article  Google Scholar 

  • Zhu Y, Lai S, Li Z, Jin L (2020) Point-to-set similarity based deep metric learning for offline signature verification. In: 2020 17th international conference on frontiers in handwriting recognition (ICFHR). IEEE, pp 282–287. https://doi.org/10.1109/ICFHR2020.2020.00059

  • Zois EN, Alexandridis A, Economou G (2019) Writer independent offline signature verification based on asymmetric pixel relations and unrelated training-testing datasets. Expert Syst Appl 125:14–32

    Article  Google Scholar 

  • Zois EN, Zervas E, Tsourounis D, Economou G (2020) Sequential motif profiles and topological plots for offline signature verification. In: 2020 IEEE/CVF conference on computer vision and pattern recognition (CVPR). IEEE, pp 13245–13255. https://doi.org/10.1109/CVPR42600.2020.01326

Download references

Author information

Authors and Affiliations

  1. Department of Metallurgical and Material Engineering, Jadavpur University, Kolkata, 700032, India

    Sourodeep Roy & Debjit Sarkar

  2. Department of Computer Science, Asutosh College, Kolkata, 700026, India

    Samir Malakar

  3. Department of Computer Science and Engineering, Jadavpur University, Kolkata, 700032, India

    Ram Sarkar

Authors
  1. Sourodeep Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debjit Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Samir Malakar
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ram Sarkar
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Ram Sarkar.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Roy, S., Sarkar, D., Malakar, S. et al. Offline signature verification system: a graph neural network based approach. J Ambient Intell Human Comput 14, 8219–8229 (2023). https://doi.org/10.1007/s12652-021-03592-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s12652-021-03592-0

Keywords

Search

Navigation