Abstract
Photographic identification (photo ID) is a well-established, non-invasive, and relatively cost-effective technique to collect longitudinal data from species that can be individually recognised based on natural markings. This method has been improved by computer-assisted pattern recognition software which speed up the processing of large numbers of images. Freely available algorithms exist for a wide range of species, but the choice of software can have significant effects on the accuracy of individual capture histories and derived demographic parameter estimates. We tested the performance of three open source, semi-automated pattern recognition software algorithms for harbour seal (Phoca vitulina vitulina) photo ID: ExtractCompare, I3S Pattern and Wild-ID. Performance was measured as the ability of the software to successfully score matching images higher than non-matching images using the cumulative density function (CDF). The CDF for the top ranked potential match was highest for Wild-ID (CDF1 = 0.34–0.58), followed by ExtractCompare (CDF1 = 0.24–0.36) and I3S pattern (CDF1 = 0.02–0.3). This trend emerged regardless of how many potential matches were inspected. The highest performing aspects in ExtractCompare were left heads, whereas in I3S Pattern and Wild-ID these were front heads. Within each aspect, images collected using a camera and lens performed higher than images taken by a camera and scope. Data processing within ExtractCompare took > 4 × longer than Wild-ID, and > 3 × longer than I3S Pattern. We found that overall, Wild-ID outperformed both ExtractCompare and I3S Pattern under tested scenarios, and we therefore recommend its assistance in harbour seal photo ID.
Similar content being viewed by others
Change history
02 October 2022
Supplementary Informaiton was updated.
References
Andrzejaczek S, Meeuwig J, Rowat D, Pierce S, Davies T, Fisher R, Meekan M (2016) The ecological connectivity of whale shark aggregations in the Indian Ocean: a photo-identification approach. Royal Soc Open Sci. https://doi.org/10.1098/rsos.160455
Arso Civil M, Smout S, Onoufriou J, Thompson D, Brownlow A, Davison N, Cummings C, Pomeroy P, McConnell B, Hall A (2016) Harbour Seal Decline - vital rates and drivers (Report to Scottish Government HSD2). Retrieved /from Sea Mammal Research Unit, University of St Andrews: http://www.smru.st-andrews.ac.uk/files/2016/10/HSD-2-annual-report-year-1.pdf. Accessed 05 Oct 2020.
Arzoumanian Z, Holmberg J, Norman B (2005) An astronomical pattern-matching algorithm for computer-aided identification of whale sharks Rhincodon typus. J Appl Ecol 42(6):999–1011. https://doi.org/10.1111/j.1365-2664.2005.01117.x
Bardier Suárez CI, Pereira G, Elgue E, Maneyro R, Toledo LF (2017) Quantitative determination of the minimumbody size for photo-identification of Melanophryniscus montevidensis (Bufonidae). Herpetol Conserv Biol 2(1):119–126
Bay H, Ess A, Tuytelaars T, Van Gool L (2008) Speeded-up robust features (SURF). Comput vis Image Underst 110(3):346–359. https://doi.org/10.1016/j.cviu.2007.09.014
Bendik NF, Morrison TA, Gluesenkamp AG, Sanders MS, O’Donnell LJ (2013) Computer-assisted photo identification outperforms visible implant elastomers in an endangered salamander Eurycea Tonkawae. Plos One. https://doi.org/10.1371/journal.pone.0059424
Bolger DT, Morrison TA, Vance B, Lee D, Farid H (2012) A computer-assisted system for photographic mark-recapture analysis. Methods Ecol Evol 3(5):813–822. https://doi.org/10.1111/j.2041-210X.2012.00212.x
Bradshaw CJ, Mollet HF, Meekan MG (2007) Inferring population trends for the world’s largest fish from mark-recapture estimates of survival. J Anim Ecol 76(3):480–489. https://doi.org/10.1111/j.1365-2656.2006.01201.x
Button CA, Rogers-Bennett L (2011) Vital rates of pink abalone Haliotis corrugata estimated from mark-recapture data to inform recovery. Mar Ecol Prog Ser 431:151–161. https://doi.org/10.3354/meps09094
Caiafa CF, Proto AN, Vergani D, Stanganelli Z (2005) Development of individual recognition of female southern elephant seals, Mirounga leonina, from Punta Norte Península Valdés, applying principal components analysis. J Biogeogr 32(7):1257–1266. https://doi.org/10.1111/j.1365-2699.2004.01215.x
Calmanovici B, Waayers D, Reisser J, Clifton J, Proietti M (2018) I3S Pattern as a mark-recapture tool to identify captured and free-swimming sea turtles: an assessment. Mar Ecol Prog Ser 589:263–268. https://doi.org/10.3354/meps12483
Chaves LCT, Hall J, Feitosa JLL, Côté IM (2016) Photo-identification as a simple tool for studying invasive lionfish Pterois volitans populations. J Fish Biol 88(2):800–804. https://doi.org/10.1111/jfb.12857
Chehrsimin T, Eerola T, Koivuniemi M, Auttila M, Levänen R, Niemi M, Kunnasranta M, Kälviäinen H (2018) Automatic individual identification of Saimaa ringed seals. IET Comput Vision 12(2):146–152. https://doi.org/10.1049/iet-cvi.2017.0082
Crall JP, Stewart CV, Berger-Wolf TY, Rubenstein DI, Sundaresan SR (2013) Hotspotter—patterned species instance recognition. IEEE Workshop on App Comput Vis (WACV). https://doi.org/10.1109/WACV.2013.6475023
Cunningham L (2009) Using computer-assisted photo-identification and capture-recapture techniques to monitor the conservation status of harbour seals (Phoca vitulina). Aquat Mamm 35(3):319–329. https://doi.org/10.1578/AM.35.3.2009.319
Gailey G, Karczmarski L (2012) Discovery: Photo-identification data-management system for individually recognizable animals. Available from: http://www.biosch.hku.hk/ecology/staffhp/lk/Discovery/. Accessed 05 Oct 2020
Germanov ES, Bejder L, Chabanne DB, Dharmadi D, Hendrawan IG, Marshall AD, Pierce SJ, van Keulen M, Loneragan NR (2019) Contrasting habitat use and population dynamics of reef manta rays within the Nusa Penida Marine Protected Area Indonesia. Front Mar Sci. https://doi.org/10.3389/fmars.2019.00215
Gimenez O, Gatti S, Duchamp C, Germain E, Laurent A, Zimmermann F, Marboutin E (2019) Spatial density estimates of Eurasian lynx (Lynx lynx) in the French Jura and Vosges Mountains. Ecol Evol 9(20):11707–11715. https://doi.org/10.1002/ece3.5668
Gore MA, Frey PH, Ormond RF, Allan H, Gilkes G (2016) Use of photo-identification and mark-recapture methodology to assess basking shark (Cetorhinus maximus) populations. PLoS One. https://doi.org/10.1371/journal.pone.0150160
Goswami VR, Madhusudan MD, Karanth KU (2007) Application of photographic capture-recapture modelling to estimate demographic parameters for male Asian elephants. Anim Conserv 10(3):391–399. https://doi.org/10.1111/j.1469-1795.2007.00124.x
Halloran KM, Murdoch JD, Becker MS (2015) Applying computer-aided photo-identification to messy datasets: a case study of Thornicroft’s giraffe (Giraffa camelopardalis thornicrofti). Afr J Ecol 53(2):147–155. https://doi.org/10.1111/aje.12145
Hammond PS, Mizroch SA, Donovan GP (1990) Individual recognition of cetaceans: Use of photo-identification and other techniques to estimate population parameters. Report of the International Whaling Commission 12.
Den Hartog J, Reijns R (2014) I3S Pattern Manual. Interactive Individual Identification System. Version 4.0.2. http://www.reijns.com/i3s/download/I3S%20Pattern.pdf. Accessed on 25th September 2020
Hastings KK, Hiby LA, Small RJ (2008) Evaluation of a computer-assisted photograph-matching system to monitor naturally marked harbor seals at Tugidak Island. Alaska J Mammal 89(5):1201–1211. https://doi.org/10.1644/07-MAMM-A-151.1
Hastings KK, Small RJ, Hiby L (2001) Use of computer-assisted matching of photographs to examine population parameters of Alaskan harbor seals. In: Harbor Seal Investigations in Alaska. Annual Report for NOAA Award NA87FX0300. Alaska Department of Fish and Game, Division of Wildlife Conservation, Anchorage, AK, 146–160.
Hiby L, Lovell P (1990) Computer aided matching of natural markings: a prototype system for grey seals. Rep Int Whaling Commis 12:57–61
Hiby L, Lundberg T, Karlsson O, Watkins J, Jüssi M, Jüssi I, Helander B (2007) Estimates of the size of the Baltic grey seal population based on photo-identification data. NAMMCO Sci Pub 6:163–175. https://doi.org/10.7557/3.2731
Hiby L, Paterson WD, Redman P, Watkins J, Twiss SD, Pomeroy P (2013) Analysis of photo-id data allowing for missed matches and individuals identified from opposite sides. Methods Ecol Evol 4(3):252–259. https://doi.org/10.1111/2041-210x.12008
Jain AK (2007) Biometric recognition. Nature 449(7158):38–40. https://doi.org/10.1038/449038a
Jiang G, Qi J, Wang G, Shi Q, Darman Y, Hebblewhite M, Miquelle DG, Li Z, Zhang X, Gu J, Chang Y (2015) New hope for the survival of the Amur leopard in China. Sci Rep 5:15475. https://doi.org/10.1038/srep15475
Kelly BP (1981) Pelage polymorphism in Pacific harbor seals. Can J Zool 59(7):1212–1219. https://doi.org/10.1139/z81-173
Kelly MJ (2001) Computer-aided photograph matching in studies using individual identification: an example from Serengeti cheetahs. J Mammal 82:440–449. https://doi.org/10.1644/1545-1542(2001)082%3c0440:CAPMIS%3e2.0.CO;2
Koivuniemi M, Auttila M, Niemi M, Levänen R, Kunnasranta M (2016) Photo-ID as a tool for studying and monitoring the endangered Saimaa ringed seal. Endangered Sp Res 30:29–36. https://doi.org/10.3354/esr00723
Lahiri M, Tantipathananandh C, Warungu R, Rubenstein DI, Berger-Wolf TY (2011) Biometric animal databases from field photographs: Identification of individual zebra in the wild. Proceed ACM Int Conf Multimedia Retrieval (ICMR). https://doi.org/10.1145/1991996.1992002
Langley I, Da Costa R, Oliver TV, Hiby L, Stringell T, Morris C, O’Cahdla O, Morgan L, Lock K, Perry S, Westcott S, Boyle D, Büche BI, Stubbings EM, Boys RM, Self H, Lindenbaum C, Strong P, Baines M, Pomeroy PP (2020) Site use and connectivity of female grey seals (Halichoerus grypus) around Wales. Mar Biol 167:86. https://doi.org/10.1007/s00227-020-03697-8
Letcher BH, Schueller P, Bassar RD, Nislow KH, Coombs JA, Sakrejda K, Morrissey M, Sigourney DB, Whiteley AR, O’Donnell MJ, Dubreuil TL (2015) Robust estimates of environmental effects on population vital rates: an integrated capture-recapture model of seasonal brook trout growth, survival and movement in a stream network. J Anim Ecol 84(2):337–352. https://doi.org/10.1111/1365-2656.12308
Lowe DG (2004) Distinctive image features from scale-invariant keypoints. Int J Comput Vision 60(2):91–110. https://doi.org/10.1023/B:VISI.0000029664.99615.94
Mackey BL, Durban JW, Middlemas SJ, Thompson PM (2008) A Bayesian estimate of harbour seal survival using sparse photo-identification data. J Zool 274(1):18–27. https://doi.org/10.1111/j.1469-7998.2007.00352.x
Matthé M, Sannolo M, Winiarski K, Spitzen-van der Sluijs A, Goedbloed D, Steinfartz S, Stachow U (2017) Comparison of photo-matching algorithms commonly used for photographic capture-recapture studies. Ecol Evol 7(15):5861–5872. https://doi.org/10.1002/ece3.3140
McCormack M (2015) Assessing the applicability of computer aided photo-identification for Pinniped studies through the determination of site fidelity in Long Island, NY harbor seals (Phoca vitulina concolor). Dissertation, University of Miami.
Mettouris O, Megremis G, Giokas S (2016) A newt does not change its spots: using pattern mapping for the identification of individuals in large populations of newt species. Ecol Res 31(3):483–489. https://doi.org/10.1007/s11284-016-1346-y
Morrison TA, Yoshizaki J, Nichols JD, Bolger DT (2011) Estimating survival in photographic capture-recapture studies: overcoming misidentification error. Methods Ecol Evol 2(5):454–463. https://doi.org/10.1111/j.2041-210X.2011.00106.x
Morton AC (1982) The effects of marking and capture on recapture frequencies of butterflies. Oecologia 53(1):105–110. https://doi.org/10.1007/BF00377143
Paterson WD, Redman P, Hiby LA, Moss SE, Hall AJ, Pomeroy P (2013) Pup to adult photo-ID: evidence of pelage stability in gray seals. Mar Mamm Sci 29(4):537–541. https://doi.org/10.1111/mms.12043
Pereira G, Maneyro R (2016) Movement patterns in a Uruguayan population of Melanophryniscus montevidensis (Philippi, 1902) (Anura: Bufonidae) using photo-identification for individual recognition. South Am J Herpetol 11(2):119–126. https://doi.org/10.2994/SAJH-D-15-00020.1
R Core Team (2019) R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. https://www.R-project.org/. Accessed 05 Oct 2020
Rocha R, Carrilho T, Rebelo R (2013) Iris photo-identification: a new methodology for the individual recognition of Tarentola geckos. Amphibia Reptilia 34:590–596. https://doi.org/10.1163/15685381-00002918
Rotella JJ, Link WA, Chambert T, Stauffer GE, Garrott RA (2012) Evaluating the demographic buffering hypothesis with vital rates estimated for Weddell seals from 30 years of mark–recapture data. J Anim Ecol 81(1):162–173. https://doi.org/10.1111/j.1365-2656.2011.01902.x
Sacchi R, Scali S, Mangiacotti M, Sannolo M, Zuffi MA (2016) Digital identification and analysis. In: Dodd CK (ed) Reptile Ecology and Conservation A Handbook of Techniques. Oxford University Press, pp 59–72
Sherwin RE, Haymond S, Stricklan D, Olsen R (2002) Freeze-branding to permanently mark bats. Wildlife Society Bulletin 97–100. https://www.jstor.org/stable/3784641. Accessed 05 Oct 2020
Steinmetz K, Webster I, Rowat D, Bluemel JK (2018) Evaluating the Software I3S Pattern for photo-Identification of Nesting Hawksbill Turtles (Eretmochelys imbricata). Mar Turt Newsl 155:15–19
Thompson PM, Wheeler H (2008) Photo-ID-based estimates of reproductive patterns in female harbor seals. Mar Mamm Sci 24(1):138–146. https://doi.org/10.1111/j.1748-7692.2007.00179.x
Vernes K, Freeman M, Nesbitt B (2009) Estimating the density of free-ranging wild horses in rugged gorges using a photographic mark-recapture technique. Wildl Res 36(5):361–367. https://doi.org/10.1071/WR07126
Vitkalova AV, Shevtsova EI (2016) A complex approach to study the Amur leopard using camera traps in protected areas in the southwest of Primorsky Krai (Russian Far East). Nature Conservation Research Зaпoвeднaя нayкa 1(3).
Wells RS, Scott MD (1990) Estimating bottlenose dolphin population parameters from individual identification and capture-release techniques. Rep Int Whaling Commis 12:407–415
Yochem PK, Stewart BS, Mina M, Zorin A, Sadovov V, Yablokov A (1990) Non-metrical analyses of pelage patterns in demographic studies of harbor seals. Rep Int Whaling Commis 12:87–90
Zimmerman GS, Gutierrez RJ, Lahaye WS (2007) Finite study areas and vital rates: sampling effects on estimates of spotted owl survival and population trends. J Appl Ecol 44(5):963–971. https://doi.org/10.1111/j.1365-2664.2007.01343.x
Acknowledgements
Data collection was funded by the Scottish Government (grant number MMSS/002/15). The authors would like to thank the expert knowledge and assistance of collaborators at each of the study sites around Scotland, without whom data collection would not have been possible. The authors would also like to thank the publishers of all three pattern recognition software programmes for making them freely available; particularly Lex Hiby from Conservation Research Ltd. who has provided training and advice over the years. We would also like to thank the two anonymous reviewers whose comments helped to improve this manuscript. This work is dedicated to Andy Law—a brilliant naturalist, photographer, colleague, and friend.
Funding
This research was approved by the University of St Andrews Animal Welfare and Ethics Committee (AWEC) and data collection was funded by the Scottish Government (grant number MMSS/002/15).
Author information
Authors and Affiliations
Contributions
IL and MAC conceived and designed the analysis, IL, EH and MAC collected the data, IL performed the analysis and wrote the paper, and EH and MAC read and commented on multiple drafts.
Corresponding author
Ethics declarations
Conflicts of interest
The authors declare that they have no conflicts of interest.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Handling editors: Stephen C.Y. Chan and Leszek Karczmarski.
This article is a contribution to the special issue on “Individual Identification and Photographic Techniques in Mammalian Ecological and Behavioural Research - Part 1: Methods and Concepts” —Editors: Leszek Karczmarski, Stephen C.Y. Chan, Daniel I. Rubenstein, Scott Y.S. Chui and Elissa Z. Cameron.
Supplementary Information
Below is the link to the electronic supplementary material.
Rights and permissions
Springer Nature or its licensor holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
About this article
Cite this article
Langley, I., Hague, E. & Civil, M.A. Assessing the performance of open-source, semi-automated pattern recognition software for harbour seal (P. v. vitulina) photo ID. Mamm Biol 102, 973–982 (2022). https://doi.org/10.1007/s42991-021-00165-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s42991-021-00165-8