Abstract
Anti-spoofing systems, regardless of the technique, biometric mode or degree of independence of external equipment, are most commonly treated as binary classification systems. The two classes that they differentiate are genuine accesses and spoofing attacks. From this perspective, their evaluation is equivalent to the established evaluation standards for the binary classification systems. However, the anti-spoofing systems are designed to operate in conjunction with recognition systems and as such can affect their performance. From the point of view of a recognition system, the spoofing attacks are a separate class that they need to detect and reject. As the problem of spoofing attacks detection grows to this pseudo-ternary status, the evaluation methodologies for the recognition systems need to be revised and updated. Consequentially, the database requirements for spoofing databases become more specific. The focus of this chapter is the task of biometric verification and its scope is threefold: first, it gives the definition of the spoofing detection problem from the two perspectives. Second, it states the database requirements for a fair and unbiased evaluation. Finally, it gives an overview of the existing evaluation techniques for anti-spoofing systems and verification systems under spoofing attacks.
Keywords
- Spoofing Attack
- Binary Classification System
- Genuine Access
- Spoofing Databases
- Biometric Verification System
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsNotes
- 1.
In this chapter, we shall treat as positive class or simply as positives, examples in a (discriminative) binary classification system one wishes to keep and, as negative class or negatives, examples that should be discarded.
References
Rodrigues RN, Ling LL, Govindaraju V (2009) Robustness of multimodal biometric fusion methods against spoofing attacks. J Vis Lang Computing 20(3):169–179
Johnson PA, Tan B, Schuckers S (2010) Multimodal fusion vulnerability to non-zero (spoof) imposters. In: IEEE international workshop information forensics and security
Akhtar Z, Fumera G, Marcialis GL, Roli F (2011) Robustness evaluation of biometric systems under spoof attacks. In: 16th International conference on image analysis and processing, pp 159–168
Akhtar Z, Fumera G, Marcialis GL, Roli F (2011) Robustness analysis of likelihood ration score fusion rule for multi-modal biometric systems under spoof attacks. In: 45th IEEE international carnahan conference on security technology, pp 237–244
Akhtar Z, Fumera G, Marcialis GL, Roli F (2012) Evaluation of serial and parallel multibiometric systems under spoofing attacks. In: 5th IEEE international conference on biometrics: theory, applications and systems
Villalba J, Lleida E (2011) Preventing replay attacks on speaker verification systems. In: 2011 IEEE international carnahan conference on security technology (ICCST), pp 1–8
Marasco E, Johnson P, Sansone C, Schuckers, S (2011) Increase the security of multibiometric systems by incorporating a spoofing detection algorithm in the fusion mechanism. In: Proceedings of the 10th international conference on multiple classifier systems, pp 309–318
Marasco E, Ding Y, Ross A (2012) Combining match scores with liveness values in a fingerprint verification system. In: 5th IEEE international conference on biometrics: theory, applications and systems
Chingovska I, Anjos A, Marcel S (2013) Anti-spoofing in action: joint operation with a verification system. In: Proceedings of IEEE conference on computer vision and pattern recognition, workshop on biometrics
Pan G, Sun L, Wu Z, Lao S (2007) Eyeblink-based anti-spoofing in face recognition from a generic webcamera. In: IEEE 11th international conference on computer vision, 2007. ICCV 2007, pp 1–8
Bao W, Li H, Li N, Jiang W (2009) A liveness detection method for face recognition based on optical flow field. In: International conference on Image analysis and signal processing, 2009. IASP 2009, pp 233–236
yan J, Zhang Z, Lei Z, Yi D, Li SZ (2012) Face liveness detection by exploring multiple scenic clues. In: 12th International conference on control, automation, robotics and vision (ICARCV 2012), China
Tan X, Li Y, Liu J, Jiang L (2010) Face liveness detection from a single image with sparse low rank bilinear discriminative model. In: Proceedings of European conference on computer vision (ECCV), LNCS, vol 6316. Springer, pp 504–517
Galbally J, Alonso-Fernandez F, Fierrez J, Ortega-Garcia J (2012) A high performance fingerprint liveness detection method based on quality related features. Future Gener Comput Syst 28(1):311–321
Yambay D, Ghiani L, Denti P, Marcialis G, Roli F, Schuckers S (2012) LivDet 2011—fingerprint liveness detection competition 2011. In: 2012 5th IAPR international conference on biometrics (ICB), pp 208–215
Mansfield AJ, Wayman JL, Dr Rayner D, Wayman JL (2002) Best practices in testing and reporting performance. NPL Report CMSC
Galbally-Herrero J, Fierrez-Aguilar J, Rodriguez-Gonzalez JD, Alonso-Fernandez F, Ortega-Garcia J, Tapiador M (2006) On the vulnerability of fingerprint verification systems to fake fingerprints attacks. In: IEEE international carnahan conference on security technology, pp 169–179
Ruiz-Albacete V, Tome-Gonzalez P, Alonso-Fernandez F, Galbally J, Fierrez J, Ortega-Garcia J (2008) Direct attacks using fake images in iris verification. In: Proceedings of COST 2101 workshop on biometrics and identity management, BIOID, Springer, pp 181–190
Galbally J, Fierrez J, Alonso-Fernandez F, Martinez-Diaz M (2011) Evaluation of direct attacks to fingerprint verification systems. Telecommunication systems, special issue on biometrics 47(3):243–254
Hastie T, Tibshirani R, Friedman JH (2001) The elements of statistical learning: data mining, inference, and prediction: with 200 full-color illustrations. Springer, New York
Lui YM, Bolme D, Phillips P, Beveridge J, Draper B (2012) Preliminary studies on the good, the bad, and the ugly face recognition challenge problem. In: 2012 IEEE computer society conference on computer vision and pattern recognition workshops (CVPRW), pp 9–16
Marcialis GL, Lewicke A, Tan B, Coli P, Grimberg D, Congiu A, Tidu A, Roli F, Schuckers S (2009) First international fingerprint liveness detection competition - livdet 2009. In: Proceeding of IAPR international conference on image analysis and processing (ICIAP), LNCS, vol 5716. pp 12–23
Ghiani L, Yambay D, Mura V, Tocco S, Marcialis G, Roli F, Schuckers S (2013) Livdet 2013—fingerprint liveness detection competition. In: IEEE International conference on biometrics (ICB)
Zhiwei Z, Yan J, Liu S, Lei Z, Yi D, Li SZ (2012) A face antispoofing database with diverse attacks. In: Proceedings of IAPR international conference on biometrics (ICB), pp 26–31
Chingovska I, Anjos A, Marcel S (2012) On the effectiveness of local binary patterns in face anti-spoofing. In: Proceedings of IEEE international conference of the biometrics special interest group (BIOSIG), pp 1–7
Peixoto B, Michelassi C, Rocha A (2011) Face liveness detection under bad illumination conditions. In: 2011 18th IEEE International conference on image processing (ICIP), pp 3557–3560
Poh N, Bengio S (2006) Database, protocols and tools for evaluating score-level fusion algorithms in biometric authentication. Pattern Recognit J 39(2):223–233
Martin A, Doddington G, Kamm T, Ordowski M (1997) The det curve in assessment of detection task performance. In: Proceedings of eurospeech, pp 1895–1898
Bengio S, Keller M, Mariéthoz J (2003) The expected performance curve. Technical report IDIAP-RR-85-2003, IDIAP
Wang L, Ding X, Fang C (2009) Face live detection method based on physiological motion analysis. Tsinghua Sci Technol 14(6):685–690
Zhang Z, Yi D, Lei Z, Li S (2011) Face liveness detection by learning multispectral reflectance distributions. In: 2011 IEEE international conference on automatic face gesture recognition and workshops (FG 2011), pp 436–441
Johnson P, Lazarick R, Marasco E, Newton E, Ross A, Schuckers S (2012) Biometric liveness detection: framework and metrics. In: International biometric performance conference
Gao X, Tsong Ng T, Qiu B, Chang SF (2010) Single-view recaptured image detection based on physics-based features. In: IEEE international conference on multimedia and expo (ICME), Singapore
Tronci R, Muntoni D, Fadda G, Pili M, Sirena N, Murgia G, Ristori M, Ricerche S, Roli F (2011) Fusion of multiple clues for photo-attack detection in face recognition systems. In: Proceedings of the 2011 international joint conference on biometrics, IJCB ’11, IEEE Computer Society, pp 1–6
Jain AK, Flynn P, Ross AA (eds) (2008) Handbook of biometrics. Springer, New York
Adler A, Schuckers S (2009) Security and liveness, overview. In: Jain AK, Li SZ (eds) Encyclopedia of biometrics. Springer, New York
Galbally J, Cappelli R, Lumini A, de Rivera GG, Maltoni D, Fiérrez J, Ortega-Garcia J, Maio D (2010) An evaluation of direct attacks using fake fingers generated from iso templates. Pattern Recogn Lett 31(8):725–732
Rodrigues R, Kamat N, Govindaraju V (2010) Evaluation of biometric spoofing in a multimodal system. In: 2010 Fourth IEEE international conference on biometrics: theory applications and systems (BTAS)
Matsumoto T, Matsumoto H, Yamada K, Hoshino S (2002) Impact of artifical “gummy” fingers on fingerprint systems. In: SPIE Proceedings: optical security and counterfeit deterrence techniques, vol. 4677
Patrick P, Aversano G, Blouet R, Charbit M, Chollet G (2005) Voice forgery using alisp: indexation in a client memory. In: Proceedings. (ICASSP ’05). IEEE international conference on acoustics, speech, and signal processing, 2005, vol 1, pp 17–20
Alegre F, Vipperla R, Evans N, Fauve B (2012) On the vulnerability of automatic speaker recognition to spoofing attacks with artificial signals. In: Signal processing conference (EUSIPCO), 2012 proceedings of the 20th European, pp 36–40
Bonastre JF, Matrouf D, Fredouille C (2007) Artificial impostor voice transformation effects on false acceptance rates. In: INTERSPEECH, pp 2053–2056
Acknowledgments
The authors would like to thank the projects BEAT (http://www.beat-eu.org) and TABULA RASA (http://www.tabularasa-euproject.org) both funded under the 7th Framework Programme of the European Union (EU) (grant agreement number 284989 and 257289) respectively.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer-Verlag London
About this chapter
Cite this chapter
Chingovska, I., Anjos, A., Marcel, S. (2014). Evaluation Methodologies. In: Marcel, S., Nixon, M., Li, S. (eds) Handbook of Biometric Anti-Spoofing. Advances in Computer Vision and Pattern Recognition. Springer, London. https://doi.org/10.1007/978-1-4471-6524-8_10
Download citation
DOI: https://doi.org/10.1007/978-1-4471-6524-8_10
Published:
Publisher Name: Springer, London
Print ISBN: 978-1-4471-6523-1
Online ISBN: 978-1-4471-6524-8
eBook Packages: Computer ScienceComputer Science (R0)