Analysis of 3D signatures recorded using leap motion sensor

Multimedia Tools and Applications volume 77, pages14029–14054(2018)Cite this article

Abstract

Signature recognition is identifying the signature’s owner, whereas verification is the process to find whether a signature is genuine or forged. Though, both are important in the field of forensic sciences, however, verification is more important to banks and credit card companies. In this paper, we have proposed a methodology to analyze 3D signatures captured using Leap motion sensor. We have extended existing 2D features into 3D from raw signatures and applied well-known classifiers for recognition as well as verification. We have shown that the 3rd dimension, which essentially represents instantaneous pressure during writing, can improve the accuracy of the biometric systems. We have created a large dataset containing more than 2000 signatures registered by 100 volunteers using the Leap motion interface. This has been made available online for the research community. Our analysis shows that, the proposed 3D extension is better than its original 2D version. Recognition and verification accuracy have increased by 6.8% and 9.5%, respectively using k-NN. Similarly, accuracy has increased by 9.9% (recognition) and 6.5% (verification) when HMM is used as the classifier. Similar results have been recorded on benchmark datasets. A comparison with 2D tablet-stylus interface has been carried out which also supports our claims. We believe, Leap motion can be an alternative to the existing biometric setups.

This is a preview of subscription content, access via your institution.

Access options

Buy single article

Instant access to the full article PDF.

US$ 39.95

Tax calculation will be finalised during checkout.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12
Fig. 13
Fig. 14
Fig. 15
Fig. 16

Notes

  1. 1.

    https://www.leapmotion.com/

  2. 2.

    http://www.intel.in/content/www/in/en/architecture-and-technology/realsense-overview.html

  3. 3.

    https://drive.google.com/open?id=0B8ilyO6QPWniTWYzdThsdU95enc

References

  1. 1.

    Alister K, Yanikoglu B (2005) Identity authentication using improved on-line signature verification method. Pattern Recogn Lett 26(18):2400–2408

    Google Scholar 

  2. 2.

    Bailador G, Sanchez-Avila C, Guerra-Casanova J, Santos Sierra de A (2011) Analysis of pattern recognition techniques for in-air signature biometrics. Pattern Recogn 44(10):2468–2478

    Article  Google Scholar 

  3. 3.

    Bashir M, Scharfenberg G, Kempfürgen J (2011) Person authentication by handwriting in air using a biometric smart pen device. BIOSIG 12:219–226

    Google Scholar 

  4. 4.

    Byeon W, Liwicki M, Breuel TM (2014) Texture classification using 2d lstm networks. In: 2014 22nd international conference on pattern recognition, pp 1144–1149

  5. 5.

    Chahar A, Yadav S, Nigam I, Singh R, Vatsa M (2015) A leap password based verification system. In: 7th international conference on biometrics theory, applications and systems, pp 1–6

  6. 6.

    Chuan C, Regina E, Guardino C (2014) American sign language recognition using leap motion sensor. In: Proceedings of the 13th international conference on machine learning and applications, pp 541– 544

  7. 7.

    Dolfing J, Aarts E, van Oosterhout J (1998) On-line signature verification with hidden markov models. In: Proceedings of the 14th international conference on pattern recognition, 1998, vol 2, pp 1309–1312

  8. 8.

    Draouhard J, Sabourin R, Godbout M (1996) A neural network approaches to on-line signature verification using directional pdf. Pattern Recogn 29:415–424

    Article  Google Scholar 

  9. 9.

    Elons A, Ahmed M, Shedid H, Tolba M (2014) Arabic sign language recognition using leap motion sensor. In: Proceedings of the 9th international conference on computer engineering & systems. IEEE, pp 368–373

  10. 10.

    Fang B, Leung C, Tang Y, Tse K, Kwokd P, Wonge Y (2003) Off-line signature verification by the tracking of feature and stroke positions. Pattern Recogn 36(1):91–101

    Article  MATH  Google Scholar 

  11. 11.

    Faundez-Zanuy M (2007) On-line signature recognition based on vq-dtw. Pattern Recogn 40(3):981–992

    Article  MATH  Google Scholar 

  12. 12.

    Fernandez F, Fierrez J, Diaz M, Garcia J (2009) Fusion of static image and dynamic information for signature verification. In: Proceedings of the IEEE international conference on image processing, pp 2725–2728

  13. 13.

    Ferrer M, Alonso J, Travieso C (2005) Off-line geometric parameters for automatic signature verification using fixed-point arithmetic. IEEE Trans Pattern Anal Mach Intell 993–997

  14. 14.

    Guru D, Prakash H (2009) Online signature verification and recognition: an approach based on symbolic representation. IEEE Trans Pattern Anal Mach Intell 31 (6):1059–1073

    Article  Google Scholar 

  15. 15.

    Houmani N, Garcia-Salicetti S (2014) Digitizing tablet. In: Li S, Jain AK (eds) Encyclopedia of biometrics, ISBN 978-3-642-27733-7 (online). Springer Science + Business Media New York

  16. 16.

    Impedovo D, Pirlo G (2008) Automatic signature verification - the state of the art. IEEE Trans Syst Man Cybern 38(5):609–635

    Article  Google Scholar 

  17. 17.

    Iwai Y, Shimizu H, Yachida M (1999) Real-time context-based gesture recognition using hmm and automaton. In: Proceedings of the international workshop on recognition, analysis, and tracking of faces and gestures in real-time systems, pp 127–134

  18. 18.

    Jaeger S, Manke S, Waibel A (2000) Npen++ an on-line handwriting recognition system. In: 7th international workshop on frontiers in handwriting recognition, pp 249–260

  19. 19.

    Jain A, Griess F, Colonnel S (2002) On-line signature verification. Pattern Recogn 35:2963–2972

    Article  MATH  Google Scholar 

  20. 20.

    Jambhale S, Khaparde A (2014) Gesture recognition using dtw amp; piecewise dtw. In: Proceedings of the international conference on electronics and communication systems, pp 1–5

  21. 21.

    Justino E, El Yacoubi A, Bortolozzi F, Sabourin R (2000) An off-line signature verification system using hidden markov model and cross-validation. In: Proceedings of the XIII Brazilian symposium on computer graphics and image processing, pp 105–112

  22. 22.

    Kashi R, Hu J, Nelson W, Turin W (1997) On-line handwritten signature verification using hidden markov model features. In: Proceedings of the 4th international conference on document analysis and recognition, vol 1, pp 253–257

  23. 23.

    Latecki L, Megalooikonomou V, Wang Q, Yu D (2007) An elastic partial shape matching technique. Pattern Recogn 40(11):3069–3080

    Article  MATH  Google Scholar 

  24. 24.

    Lee L, Berger T, Aviczer E (1996) Reliable on-line signature verification systems. IEEE Trans Pattern Anal Mach Intell 18(6):643–649

    Article  Google Scholar 

  25. 25.

    Li Q, Zhou X, Gu A, Li Z, Liang R (2016) Nuclear norm regularized convolutional Max Pos@ Top machine. Neural Comput & Applic 1–10

  26. 26.

    Liang R, Shi L, Wang H, Meng J, Wang J, Sun Q, Gu Y (2016) Optimizing top precision performance measure of content-based image retrieval by learning similarity function. In: 23rd international conference on pattern recognition (ICPR), pp 2954–2958

  27. 27.

    Liang R, Xie W, Li W, Wang H, Wang JJ, Taylor L (2016) A novel transfer learning method based on common space mapping and weighted domain matching. In: 28th international conference on tools with artificial intelligence (ICTAI). IEEE

  28. 28.

    Mohandes M, Aliyu S, Deriche M (2014) Arabic sign language recognition using the leap motion controller. In: Proceedings of the 23rd international symposium on industrial electronics. IEEE, pp 960–965

  29. 29.

    Nakanishi I, Sakamoto H, Nishiguchi N, Itoh Y, Fukui Y (2006) Multimatcher on-line signature verification system in dwt domain. IEICE Trans Fundam 178–185

  30. 30.

    Nguyen V, Blumenstein M, Leedham G (2009) Global features for the off-line signature verification problem. In: Proceedings of the international conference on document analysis and recognition, pp 1300–1304

  31. 31.

    Rabiner L (1989) A tutorial on hidden Markov models and selected applications in speech recognition. Proc IEEE 77(2):257–286

    Article  Google Scholar 

  32. 32.

    Rashid O, Al-Hamadi A, Michaelis B (2009) A framework for the integration of gesture and posture recognition using hmm and svm. In: Proceedings of the IEEE international conference on intelligent computing and intelligent systems, vol 4, pp 572–577

  33. 33.

    Roy P, Bhowmick S, Pal U, Ramel JY (2012) Signature based document retrieval using GHT of background information. In: Proceedings of the 13th international conference on frontiers in handwriting recognition, pp 225–230

  34. 34.

    Sabourin R, Genest G, Preteux F (1997) Off-line signature verification by local granulometric size distributions. IEEE Trans Pattern Anal Mach Intell 19(9):976–988

    Article  Google Scholar 

  35. 35.

    Shanker A, Rajagopalan A (2007) Off-line signature verification using dtw. Pattern Recognit Lett 28(12):1407–1414

    Article  Google Scholar 

  36. 36.

    Shrivastava R (2013) A hidden Markov model based dynamic hand gesture recognition system using opencv. In: Proceedings of the IEEE 3rd international advance computing conference, pp 947– 950

  37. 37.

    Vamsikrishna KM, Dogra DP, Desarkar MS (2016) Computer-vision-assisted palm rehabilitation with supervised learning. IEEE Trans Biomed Eng 63(5):991–1001

    Article  Google Scholar 

  38. 38.

    Yamato J, Ohya J, Ishii K (1992) Recognizing human action in time-sequential images using hidden markov model. In: Proceedings of the IEEE computer society conference on computer vision and pattern recognition, pp 379–385

  39. 39.

    Zhang Z, Xu Y, Yang J, Li X, Zhang D (2015) A survey of sparse representation: algorithms and applications. IEEE Access 490–530

  40. 40.

    Zou M, Tong J, Lou Z, Liu C (2003) On-line signature verification using improved segmentation. In: Proceedings of the IEEE international conference on systems, man and cybernetics, vol 1, pp 256– 261

Download references

Author information

Affiliations

  1. School of Electrical Sciences, IIT Bhubaneswar, Bhubaneswar, India

    Santosh Kumar Behera & Debi Prosad Dogra

  2. Department of Computer Science and Engineering, IIT Roorkee, Roorkee, India

    Partha Pratim Roy

Authors
  1. Santosh Kumar Behera
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Debi Prosad Dogra
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Partha Pratim Roy
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Santosh Kumar Behera.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Behera, S.K., Dogra, D.P. & Roy, P.P. Analysis of 3D signatures recorded using leap motion sensor. Multimed Tools Appl 77, 14029–14054 (2018). https://doi.org/10.1007/s11042-017-5011-4

Download citation

Keywords

  • Signature recognition
  • Signature verification
  • 3D sequence analysis