Multimedia Tools and Applications

, Volume 76, Issue 20, pp 20457–20482 | Cite as

Bimodal biometric system for hand shape and palmprint recognition based on SIFT sparse representation

  • Nesrine Charfi
  • Hanene Trichili
  • Adel M. Alimi
  • Basel Solaiman


Biometric-based hand modality is considered as one of the most popular biometric technologies especially in forensic applications. In this paper, a bimodal hand identification system was proposed based on Scale Invariant Feature Transform (SIFT) descriptors, extracted from hand shape and palmprint modalities. A local sparse representation method was adopted in order to represent images with high discrimination. Moreover, fusion was performed at feature and decision levels using a cascade fusion in order to generate the final identification rate of our bimodal system. Our experiments were applied on two hand databases: Indian Institute of Technology of Delhi (IITD) hand database and Bosphorus hand database containing, respectively, 230 and 615 subjects. The results show that the proposed method offers high accuracies compared to other popular bimodal hand biometric methods over the two hand databases. The correct identification rate reaches 99.57 % which is competitive compared to systems existing in the literature.


Hand shape features Palmprint features SIFT sparse representation Fusion 


  1. 1.
    Alsaade F, Ariyaeeinia AM, Malegaonkar AS, Pawlewski M, Pillay SG (2008) Enhancement of multimodal biometric segregation using unconstrained cohort normalisation. Pattern Recogn 41(3):814–820CrossRefzbMATHGoogle Scholar
  2. 2.
    Amayeh G, Bebis G, Erol A, Nicolescu M (2006) Peg-free hand shape verification using high order zernike moments. In: Proceedings of the 2006 conference on computer vision and pattern recognition workshop, pp 40–47Google Scholar
  3. 3.
    Boser BE, Guyon IM, Vapnik VN (1992) A training algorithm for optimal margin classifiers. In: Proceedings of the 5th annual workshop on computational learning theory, COLT ’92, pp 144–152Google Scholar
  4. 4.
    Briceño JC, Travieso CM, Alonso JB, Ferrer M (2011) Biometric identification based on hand-shape features using a hmm kernel. In: International conference on hand-based biometrics (ICHB). IEEE, pp 1–6Google Scholar
  5. 5.
    Burges CJ, Schölkopf B (1997) Improving the accuracy and speed of support vector machines. In: Advances in neural information processing systems, vol 9. MIT Press, pp 375–381Google Scholar
  6. 6.
    Buyssens P, Revenu M, Lepetit O (2009) Fusion of ir and visible light modalities for face recognition, pp 1–6Google Scholar
  7. 7.
    Chang K, Bowyer K, Sarkar S, Victor B (2003) Comparison and combination of ear and face images in appearance-based biometrics. IEEE Trans Pattern Anal Mach Intell 25(9):1160–1165CrossRefGoogle Scholar
  8. 8.
    Charfi N, Trichili H, Alimi A, Solaiman B (2015) Hand verification system based on multi-features fusion. In: 15th international conference on intelligent systems design and applications (ISDA2015), pp 189–194Google Scholar
  9. 9.
    Charfi N, Trichili H, Alimi A, Solaiman B (2015) Personal recognition system using hand modality based on local features. In: 11th international conference on information assurance and security (IAS2015), pp 13–17Google Scholar
  10. 10.
    Charfi N, Trichili H, Alimi AM, Solaiman B (2014) Bimodal biometric system based on SIFT descriptors of hand images. In: 2014 IEEE international conference on systems, man, and cybernetics, SMC 2014. San Diego, pp 4141–4145Google Scholar
  11. 11.
    Choraś RS, Choraś M (2007) Adaptive and natural computing algorithms: Proceedings, Part ii 8th international conference, icannga 2007. Warsaw, pp 407–414Google Scholar
  12. 12.
    Dong K, Feng G, Hu D (2005) Digital curvelet transform for palmprint recognition. In: Advances in biometric person authentication, pp 639–645Google Scholar
  13. 13.
    Duta N (2009) A survey of biometric technology based on hand shape. Pattern Recogn 42(11):2797–2806CrossRefGoogle Scholar
  14. 14.
    El-Sallam A, Sohel F, Bennamoun M (2011) Robust pose invariant shape-based hand recognition. In: 6th IEEE conference on industrial electronics and applications (ICIEA), pp 281–286Google Scholar
  15. 15.
    Ernst RH Hand id system. U. S. Patent No. 3576537Google Scholar
  16. 16.
    Ferrer M, Vargas F, Morales A (2011) Bispectral contactless hand based biometric system. In: 2nd national conference on telecommunications (CONATEL), 2011, pp 1–6Google Scholar
  17. 17.
    Fujisawa H (2008) Forty years of research in character and document recognition–an industrial perspective. Pattern Recogn 41(8):2435–2446CrossRefGoogle Scholar
  18. 18.
    Giot R, Rosenberger C (2012) Genetic programming for multibiometrics. Expert Syst Appl 39(2):1837–1847CrossRefGoogle Scholar
  19. 19.
    Goh MKO, TCJA (2012) A contactless biometric system using multiple hand features. J Vis Commun Image Represent (JVIS) 23(7):1068–1084CrossRefGoogle Scholar
  20. 20.
    Guesmi H, THAASB (2015) Novel biometric features fusion method based on possibility theory. In: IEEE 14th international conference on cognitive informatics cognitive computing (ICCI*CC), 2015, pp 418–425Google Scholar
  21. 21.
    Guo JM, Hsia CH, Liu YF, Yu JC, Chu MH, Le TN (2012) Contact-free hand geometry-based identification system. Expert Syst Appl 39(14):11,728–11,736CrossRefGoogle Scholar
  22. 22.
    Han CC (2004) A hand-based personal authentication using a coarse-to-fine strategy. Image Vis Comput 22(11):909–918CrossRefGoogle Scholar
  23. 23.
    Hong L, Jain A (1998) Integrating faces and fingerprints for personal identification. IEEE Trans Pattern Anal Mach Intell 20(12):1295–1307CrossRefGoogle Scholar
  24. 24.
    Hu RX, Jia W, Zhang D, Gui J, Song LT (2012) Hand shape recognition based on coherent distance shape contexts. Pattern Recogn 45(9):3348–3359CrossRefGoogle Scholar
  25. 25.
    Jain AK, DN (1999) Deformable matching of hand shapes for user verification. In: Proceedings of international conference image processing, pp 857–861Google Scholar
  26. 26.
    Jia W, Huang DS, Zhang D (2008) Palmprint verification based on robust line orientation code. Pattern Recogn 41(5):1504–1513CrossRefzbMATHGoogle Scholar
  27. 27.
    Kumar A (2008) Incorporating cohort information for reliable palmprint authentication. In: 6th Indian conference on computer vision, graphics & image processing, ICVGIP ’08, pp 583–590Google Scholar
  28. 28.
    Kumar A, Shekhar S (2011) Personal identification using multibiometrics rank-level fusion. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):743–752CrossRefGoogle Scholar
  29. 29.
    Kumar A, Shekhar S (2011) Personal identification using multibiometrics rank-level fusion. IEEE Trans Syst Man Cybern Part C Appl Rev 41(5):743–752CrossRefGoogle Scholar
  30. 30.
    Kumar A, Wong DC, Shen HC, Jain AK (2006) Personal authentication using hand images. Pattern Recogn Lett 27(13):1478–1486CrossRefGoogle Scholar
  31. 31.
    Kumar A, Wong DCM, Shen HC, Jain AK (2003) Personal verification using palmprint and hand geometry biometric. In: Proceedings of the 4th international conference on audio- and video-based biometric person authentication, pp 668–678Google Scholar
  32. 32.
    Kumar A, Zhang D (2006) Personal recognition using hand shape and texture. IEEE Trans Image Process 15(8):2454–2461CrossRefGoogle Scholar
  33. 33.
    Ladoux P, Rosenberger C, Dorizzi B (2009) Palm vein verification system based on sift matching. In: 3rd international conference ICB, pp 1290–1298Google Scholar
  34. 34.
    Lee H, Battle A, Raina R, Ng A (2007) Efficient sparse coding algorithms. In: NIPS. NIPS, pp 801–808Google Scholar
  35. 35.
    Leng L, Li M, Kim C, Bi X (2015) Dual-source discrimination power analysis for multi-instance contactless palmprint recognition. Multimedia Tools Appl 1–22Google Scholar
  36. 36.
    Leng L, Li M, Leng L, Teoh ABJ (2013) Conjugate 2dpalmhash code for secure palm-print-vein verification. In: 6th international congress on image and signal processing (CISP), 2013, vol 3, pp 1705–1710Google Scholar
  37. 37.
    Leng L, Liu G, Li M, Khan MK, Al-Khouri AM (2014) Logical conjunction of triple-perpendicular-directional translation residual for contactless palmprint preprocessing. In: 11th international conference on information technology: new generations (ITNG), 2014, pp 523–528Google Scholar
  38. 38.
    Leng L, Zhang J, Khan MK, Chen X, Alghathbar K (2010) Dynamic weighted discrimination power analysis: a novel approach for face and palmprint recognition in dct domain. Academic Journals, pp 2543–2554Google Scholar
  39. 39.
    Lin C, Wang S (2004) Training algorithms for fuzzy support vector machines with noisy data. Pattern Recogn Lett 25(14):1647–1656CrossRefGoogle Scholar
  40. 40.
    Lindeberg T (1994) Scale-space theory: a basic tool for analysing structures at different scales. J Appl Stat 21(2):224–270Google Scholar
  41. 41.
    Lowe DG (1999) Object recognition from local scale-invariant features. In: Proceedings of the international conference on computer vision, ICCV ’99, vol 2, pp 1150–1157Google Scholar
  42. 42.
    Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vis 60:91–110CrossRefGoogle Scholar
  43. 43.
    Luo YT, Zhao LY, Zhang B, Jia W, Xue F, Lu JT, Zhu YH, Xu BQ (2016) Local line directional pattern for palmprint recognition. Pattern Recogn 50:26–44CrossRefGoogle Scholar
  44. 44.
    Luque-Baena RM, Elizondo D, Lopez-Rubio E, Palomo EJ, Watson T (2013) Assessment of geometric features for individual identification and verification in biometric hand systems. Expert Syst Appl 40(9):3580–3594CrossRefGoogle Scholar
  45. 45.
    Prasad SM, Govindan VK, Sathidevi PS (2009) Bimodal personal recognition using hand images. In: Proceedings of the international conference on advances in computing, communication and control, pp 403–409Google Scholar
  46. 46.
    Raghavendra R, Dorizzi B, Rao A, Hemantha G (2009) Pso versus adaboost for feature selection in multimodal biometrics, pp 1–7Google Scholar
  47. 47.
    Ross A, Jain AK (2004) Multimodal biometrics: an overview. In: Proceedings of 12th European signal processing conference, pp 1221–1224Google Scholar
  48. 48.
    Sanchez-Reillo R, Sanchez-Avila C, Gonzalez-Marcos A (2000) Biometric identification through hand geometry measurements. IEEE Trans Pattern Anal Mach Intell 22(10):1168–1171CrossRefGoogle Scholar
  49. 49.
    Shang L, Cui M, Chen J (2012) Palm recognition using fast sparse coding algorithm. Advanced Intell Comput Theories Appl 6839:701–707Google Scholar
  50. 50.
    Shu W, Zhang D (1998) Palmprint verification: an implementation of biometric technology, vol 1, pp 219–221Google Scholar
  51. 51.
    Sim T, Zhang S, Janakiraman R, Kumar S (2007) Continuous verification using multimodal biometrics. IEEE Trans Pattern Anal Mach Intell 29(4):687–700CrossRefGoogle Scholar
  52. 52.
    Srinivas BG, Gupta P (2009) Palmprint based verification system using surf features. Commun Comput Inf Sci 40:250–262Google Scholar
  53. 53.
    Sun Z, Tan T, Wang Y, Li SZ (2005) Ordinal palmprint represention for personal identification. In: 2005 IEEE computer society conference on computer vision and pattern recognition (CVPR’05), vol 1, pp 279–284Google Scholar
  54. 54.
    Tashk A, Helfroush M, Karimi V (2012) An automatic traffic control system based on simultaneous persian license plate recognition and driver fingerprint identification. In: 20th telecommunications forum (TELFOR), 2012, pp 1729–1732Google Scholar
  55. 55.
    Tashk A, Helfroush MS, Dehghani MJ (2010) A chebyshev/legendre polynomial interpolation approach for fingerprint orientation estimation smoothing and prediction. J Zhejiang Univ Sci C 11(12): 976–988CrossRefGoogle Scholar
  56. 56.
    Tashk A, Helfroush MS, Kazemi K (2011) A novel fingerprint matcher based on an ergodic 2-d hidden markov model. Int J Electron Commun 65(9):742–749Google Scholar
  57. 57.
    Tounsi M, Moalla I, Alimi AM, Lebouregois F (2015) Arabic characters recognition in natural scenes using sparse coding for feature representations. In: 13th international conference on document analysis and recognition (ICDAR), vol 36, pp 1036–1040Google Scholar
  58. 58.
    Wang S, Xu Y (2008) A new palmprint identification algorithm based on gabor filter and moment invariant. In: IEEE conference on cybernetics and intelligent systems, 2008, pp 491–496Google Scholar
  59. 59.
    Wang WC, Chen WS, Shih SW (2009) Biometric recognition by fusing palmprint and hand-geometry based on morphology. In: Proceedings of the 2009 IEEE international conference on acoustics, speech and signal processing, pp 893–896Google Scholar
  60. 60.
    Wright J, Ma Y, Mairal J, Sapiro G, Huang T, Yan S (2010) Sparse representation for computer vision and pattern recognition. Proc IEEE 98(6):1031–1044CrossRefGoogle Scholar
  61. 61.
    Wright J, Yang A, Ganesh A, Sastry S, Ma Y (2009) Robust face recognition via sparse representation. IEEE Trans Pattern Anal Mach Intell 31 (2):210–227CrossRefGoogle Scholar
  62. 62.
    Wu K, Yap KH (2006) Fuzzy svm for content-based image retrieval: a pseudo-label support vector machine framework. Comp Intell Mag 1(2):10–16CrossRefGoogle Scholar
  63. 63.
    Wu X, Zhao Q, Bu W (2014) A sift-based contactless palmprint verification approach using iterative ransac and local palmprint descriptors. Pattern Recogn 47 (10):3314–3326CrossRefGoogle Scholar
  64. 64.
    Yang J, Yu K, Gong Y, Huang T (2009) Linear spatial pyramid matching using sparse coding for image classificationGoogle Scholar
  65. 65.
    Yap KH, Wu K (2005) A soft relevance framework in content-based image retrieval systems. IEEE Trans Circuits Syst Video Technol 15(12):1557–1568CrossRefGoogle Scholar
  66. 66.
    Yörük E, Dutağaci H, Sankur B (2006) Hand biometrics. Image Vis Comput 24(5):483–497CrossRefGoogle Scholar
  67. 67.
    Zhihan L, Alaa H, Shengzhong F, Haibo L, Shafiq Ur R (2014) Multimodal hand and foot gesture interaction for handheld devices. ACM Trans Multimedia Comput Commun Appl 11:10:1–10:19Google Scholar
  68. 68.
    Zhihan L, Alaa H, Shengzhong F, Shafiq Ur R, Haibo L (2015) Touch-less interactive augmented reality game on vision-based wearable device. Pers Ubiquit Comput 19(3-4):551–567CrossRefGoogle Scholar
  69. 69.
    Zuo W, Lin Z, Guo Z, Zhang D (2010) The multiscale competitive code via sparse representation for palmprint verification. In: IEEE conference on computer vision and pattern recognition (CVPR), 2010, pp 2265–2272Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Nesrine Charfi
    • 1
    • 2
  • Hanene Trichili
    • 1
    • 2
  • Adel M. Alimi
    • 1
  • Basel Solaiman
    • 2
  1. 1.REsearch Groups in Intelligent Machines (REGIM), ENISSfaxTunisia
  2. 2.Department of Image and Information Processing (ITI), Telecom Bretagne, Technopole Brest-IroiseBrest Cedex 3France

Personalised recommendations