Skip to main content

Advertisement

SpringerLink
Log in

Deep learning algorithm as a strategy for detection an invasive species in uncontrolled environment

  • Original Research
  • Published:
Reviews in Fish Biology and Fisheries Aims and scope Submit manuscript

Abstract

Knowledge and monitoring of invasive species are fundamental measures to determine the short- and long-term effect on invaded ecosystems, in addition to developing strategies to control the problem or its specific solution. In this context, the lionfish is an invasive species that worries managers and scientists of fisheries and marine conservation, this is due to the affected area that spread starting from the east coast of the United States to the coasts of Brazil and it is recently extending to include the Mediterranean Sea. The diet of the invasive fish is small species of fish, crustaceans and invertebrates; the consequent damage is the decrease of food for species at the next level of the food chain and the lack of species to keep coral reefs healthy. In this paper, we propose a lionfish detection system that will be installed in an autonomous underwater vehicle, as part of a monitoring strategy that will allow real-time determination of the number of Lionfish, their location and without human intervention. We compared two detection systems, namely YOLOv4 and SSD-Mobilenet-v2, by training with cross-validation and evaluation with the test set we obtained the best model with 63.66% recall, 89.79% precision, and 79.15% mAP with images in the natural environment, implemented on NVIDIA's Jetson Nano embedded system.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8

Similar content being viewed by others

Data availability

Yes. Please contact the correspondence email.

Code availability

Yes. Please contact the correspondence email.

References

  • Allken V, Handegard NO, Rosen S, Schreyeck T, Mahiout T, Malde K (2019) Fish species identification using a convolutional neural network trained on synthetic data. ICES J Mar Sci 76(1):342–349. https://doi.org/10.1093/icesjms/fsy147

    Article  Google Scholar 

  • Antaya AA, Peterson EH, Conroy KF, Ralph TV (2019) Lionfish Bot 2.0. Robotics Engineering Program, Worcester Polytechnic Institute, Final Report, Massachusetts. https://digitalcommons.wpi.edu/mqp-all/7046

  • Arbour JH, Hardie DC, Hutchings JA (2011) Morphometric and genetic analyses of two sympatric morphs of Arctic char (Salvelinus alpinus) in the Canadian High Arctic. Can J Zool 89(1):19–30. https://doi.org/10.1139/Z10-100

    Article  Google Scholar 

  • Arredondo-Chavez AT, Sanchez-Jimenez JA, Avila-Morales OG, Torres-Chavez P, Herrerias-Diego I, Medina-Nava M, Madrigal-Guridi X, Campos-Mendoza A, Dominguez-Dominguez O, Caballero-Vazquez JA (2016) Spatio-temporal variation in the diet composition of red lionfish, Pterois volitans (Actinopterygii: Scorpaeniformes: Scorpaenidae), in the Mexican Caribbean: insights into the ecological effect of the alien invasion. Acta Ichthyol Piscat 46(3):185–200. https://doi.org/10.3750/aip2016.46.3.03

    Article  Google Scholar 

  • Azzurro E, Stancanelli B, Di Martino V, Bariche M (2017) Range expansion of the common lionfish Pterois miles (Bennett, 1828) in the Mediterranean Sea: an unwanted new guest for Italian waters. BioInvasions Records 6(2):95–98. https://doi.org/10.3391/bir.2017.6.2.01

    Article  Google Scholar 

  • Bernal NA, DeAngelis DL, Schofield PJ, Sealey KS (2015) Predicting spatial and temporal distribution of Indo-Pacific lionfish (Pterois volitans) in Biscayne Bay through habitat suitability modeling. Biol Invasions 17(6):1603–1614. https://doi.org/10.1007/s10530-014-0819-6

    Article  Google Scholar 

  • Beyan C, Fisher RB (2012) A filtering mechanism for normal fish trajectories. In: Proceedings IEEE of the 21st international conference on pattern recognition, Tsukuba, Japan, November 11–15, 2012, pp 2286–2289

  • Bochkovskiy A, Wang CY, Liao HYM (2020) Yolov4: optimal speed and accuracy of object detection. Computer Vision and Pattern Recognition, arXiv:2004.10934v1, https://arxiv.org/abs/2004.10934

  • Boom BJ, He J, Palazzo S, Huang PX, Beyan C, Chou HM, Lin FP, Spampinato C, Fisher RB (2014) A research tool for long-term and continuous analysis of fish assemblage in coral-reefs using underwater camera footage. Eco Inform 23:83–97. https://doi.org/10.1016/j.ecoinf.2013.10.006

    Article  Google Scholar 

  • Chaves LCT, Hall J, Feitosa JLL, Côté IM (2016) Photo-identification as a simple tool for studying invasive lionfish Pterois volitans populations. J Fish Biol 88(2):800–804

    Article  CAS  Google Scholar 

  • Chiu YC, Tsai CY, Ruan MD, Shen GY, Lee TT (2020) Mobilenet-SSDv2: an improved object detection model for embedded systems. In: IEEE 2020 international conference on system science and engineering (ICSSE), Kagawa, Japan, July 5–8, 2020, pp 1–5

  • Chuang MC, Hwang JN, Ye JH, Huang SC, Williams K (2016) Underwater fish tracking for moving cameras based on deformable multiple kernels. IEEE Trans Syst Man Cybern Syst 47(9):2467–2477

    Google Scholar 

  • Costa C, Antonucci F, Boglione C, Menesatti P, Vandeputte M, Chatain B (2013) Automated sorting for size, sex and skeletal anomalies of cultured seabass using external shape analysis. Aquacult Eng 52:58–64. https://doi.org/10.1016/j.aquaeng.2012.09.001

    Article  Google Scholar 

  • Ding G, Song Y, Guo J, Feng C, Li G, He B, Yan T (2017) Fish recognition using convolutional neural network. In: IEEE OCEANS, Aberdeen, Scotland, June 19–22, 2017, pp 1–4

  • Ferreira CE, Luiz OJ, Floeter SR, Lucena MB, Barbosa MC, Rocha CR, Rocha LA (2015) First record of invasive lionfish (Pterois volitans) for the Brazilian coast. PLoS ONE. https://doi.org/10.1371/journal.pone.0123002

    Article  PubMed  PubMed Central  Google Scholar 

  • Ferrero FJ, Campo JC, Valledor M, Hernando M (2014) Optical systems for the detection and recognition of fish in rivers. In: IEEE 11th international multi-conference on systems, signals & devices, Barcelona, Spain, pp 1–5. https://doi.org/10.1109/ssd.2014.6808762

  • Furlan C, Boniface A (2018) Senior project: lionfish detection system. Computer Engineering Department, California Polytechnic State University, Senior Project Report, California. https://digitalcommons.calpoly.edu/cpesp/278/

  • Girshick R (2015) Fast r-cnn. In: Proceedings of the IEEE international conference on computer vision, Santiago, Chile, December 7–13, 2015, pp 1440–1448. https://doi.org/10.1109/iccv.2015.169

  • Girshick R, Donahue J, Darrell T, Malik J (2014) Rich feature hierarchies for accurate object detection and semantic segmentation. In: Proceedings of the IEEE conference on computer vision and pattern recognition, Columbus, USA, June 23–28, 2014, pp 580–587. https://doi.org/10.1109/cvpr.2014.81

  • Gökoğlu M, Teker S, Julian D (2017) Westward extension of the lionfish Pterois volitans Linnaeus, 1758 along the Mediterranean Coast of Turkey. Nat Eng Sci 2(2):67–72. https://doi.org/10.28978/nesciences.329313

  • Green SJ, Akins JL, Côté IM (2011) Foraging behaviors and prey consumption in the Indo-Pacific lionfish on Bahamian coral reefs. Mar Ecol Prog Ser 433:159–167. https://doi.org/10.3354/meps09208

    Article  Google Scholar 

  • Green SJ, Akins JL, Maljković A, Côté IM (2012) Invasive lionfish drive Atlantic coral reef fish declines. PLoS ONE. https://doi.org/10.1371/journal.pone.0032596

    Article  PubMed  PubMed Central  Google Scholar 

  • Haimovici M, Cardoso LG, Unpierre RG (2016) Stocks and management units of Micropogonias furnieri (Desmarest, 1823) in southwestern Atlantic. Lat Am J Aquat Res 44(5):1080–1095. https://doi.org/10.3856/vol44-issue5-fulltext-18

    Article  Google Scholar 

  • He K, Zhang X, Ren S, Sun J (2016) Deep residual learning for image recognition. In Proceedings of the IEEE conference on computer vision and pattern recognition, Las Vegas, USA, June 27–30, 2016, pp 770–778. https://doi.org/10.1109/cvpr.2016.90

  • Howard AG, Zhu M, Chen B, Kalenichenko D, Wang W, Weyand T, Andreeto M, Adam H (2017) MobileNets: efficient convolutional neural networks for mobile vision applications. arXiv:1704.04861, https://arxiv.org/abs/1704.04861

  • Hsiao YH, Chen CC, Lin SI, Lin FP (2014) Real-world underwater fish recognition and identification, using sparse representation. Eco Inform 23:13–21. https://doi.org/10.1016/j.ecoinf.2013.10.002

    Article  Google Scholar 

  • Hu J, Li D, Duan Q, Han Y, Chen G, Si X (2012) Fish species classification by color, texture and multi-class support vector machine using computer vision. Comput Electron Agric 88:133–140. https://doi.org/10.1016/j.compag.2012.07.008

    Article  Google Scholar 

  • Huang PX, Boom BJ, Fisher RB (2014) GMM improves the reject option in hierarchical classification for fish recognition. In: IEEE winter conference on applications of computer vision, Steamboat, USA, March 24–26, 2014, pp 371–376. https://doi.org/10.1109/wacv.2014.6836076

  • Jiang G, Wang S, Yu M, Choi TY, Kim YD (2004) New method of vision based vehicle detection and tracking in complicated background. In: IEEE region 10 conference TENCON, Chiang Mai, Thailand, November 21–24, 2004, pp 387–390. https://doi.org/10.1109/tencon.2004.1414438

  • Jin L, Liang H (2017) Deep learning for underwater image recognition in small sample size situations. In: IEEE OCEANS, Aberdeen, Scotland, June 19–22, 2017, pp 1–4. https://doi.org/10.1109/oceanse.2017.8084645

  • Krizhevsky A, Sutskever I, Hinton GE (2012) Imagenet classification with deep convolutional neural networks. Commun ACM 60(6):84–90. https://doi.org/10.1145/3065386

    Article  Google Scholar 

  • Lan Y, Ji Z, Gao J, Yaowei W (2014) Robot fish detection based on a combination method of three-frame-difference and background subtraction. In: IEEE 26th Chinese control and decision conference, Changsha, China, May 31–June 2, 2014, pp 3905–3909. https://doi.org/10.1109/CCDC.2014.6852862

  • MacLennan DN, Copland PJ, Armstrong E, Simmonds EJ (2004) Experiments on the discrimination of fish and seabed echoes. ICES J Mar Sci 61(2):201–210. https://doi.org/10.1016/j.icesjms.2003.09.005

    Article  Google Scholar 

  • Matai J, Kastner R, Cutter GR, Demer DA (2012) Automated techniques for detection and recognition of fishes using computer vision algorithms. In: Report of the national marine fisheries service automated image processing workshop, Seattle, USA, September 4–7, 2012, pp 35–37

  • Morris JA Jr, Akins JL (2013) El pez león invasor: guía para su control y manejo. Gulf Caribb Fisheries Inst Spec Publ Ser 2:126

    Google Scholar 

  • Naddaf-Sh M, Myler H, Zargarzadeh H (2018) Design and implementation of an assistive real-time red lionfish detection system for AUV/ROVs. Complexity. https://doi.org/10.1155/2018/5298294

    Article  Google Scholar 

  • Qin H, Li X, Liang J, Peng Y, Zhang C (2016) DeepFish: accurate underwater live fish recognition with a deep architecture. Neurocomputing 187:49–58. https://doi.org/10.1016/j.neucom.2015.10.122

    Article  Google Scholar 

  • Redmon J, Farhadi A (2017) YOLO9000: better, faster, stronger. In: IEEE Proceedings of the conference on computer vision and pattern recognition, Honolulu, Hawaii, USA, July 21–26, 2017, pp 7263–7271. https://doi.org/10.1109/cvpr.2017.690

  • Redmon J, Farhadi A (2018) Yolov3: an incremental improvement. arXiv:1804.02767, https://arxiv.org/abs/1804.02767

  • Redmon J, Divvala S, Girshick R, Farhadi A (2016) You only look once: unified, real-time object detection. In: IEEE proceedings of the conference on computer vision and pattern recognition, Las Vegas, USA, June 27–30, 2016, pp 779–788. https://doi.org/10.1109/cvpr.2016.91

  • Ren S, He K, Girshick R, Sun J (2015) Faster r-cnn: towards real-time object detection with region proposal networks. In: Advances in neural information processing systems, Montreal, Canada, December 7–12, 2015, pp 91–99. https://doi.org/10.1109/tpami.2016.2577031

  • Rojas JSC (2019) Vehículos submarinos autónomos. Pädi Boletín Científico de Ciencias Básicas e Ingenierías del ICBI, 7(Especial):60–70. https://doi.org/10.29057/icbi.v7iEspecial.4432

  • Salman A, Siddiqui SA, Shafait F, Mian A, Shortis MR, Khurshid K, Ulges A, Ulrich S (2019) Automatic fish detection in underwater videos by a deep neural network-based hybrid motion learning system. ICES J Mar Sci 77(4):1295–1307. https://doi.org/10.1093/icesjms/fsz025

    Article  Google Scholar 

  • Schofield PJ (2009) Geographic extent and chronology of the invasion of non-native lionfish (Pterois volitans [Linnaeus 1758] and P. miles [Bennett 1828]) in the Western North Atlantic and Caribbean Sea. Aquat Invasions 4(3):473–479. https://doi.org/10.3391/ai.2009.4.3.5

  • Siddiqui SA, Salman A, Malik MI, Shafait F, Mian A, Shortis MR, Harvey ES (2018) Automatic fish species classification in underwater videos: exploiting pre-trained deep neural network models to compensate for limited labelled data. ICES J Mar Sci 75(1):374–389. https://doi.org/10.1093/icesjms/fsx109

    Article  Google Scholar 

  • Spampinato C, Palazzo S (2012) Hidden Markov models for detecting anomalous fish trajectories in underwater footage. In 2012 IEEE international workshop on machine learning for signal processing, Santander, Spain, September 23–26, pp 1–6, 2012. https://doi.org/10.1109/mlsp.2012.6349768

  • Spampinato C, Giordano D, Di Salvo R, Chen-Burger YHJ, Fisher RB, Nadarajan G (2010) Automatic fish classification for underwater species behavior understanding. In: Proceedings of the first ACM international workshop on analysis and retrieval of tracked events and motion in imagery streams, Firenze, Italy, October, 2010, pp 45–50. https://doi.org/10.1145/1877868.1877881

  • Szegedy C, Ioffe S, Vanhoucke V, Alemi AA (2017) Inception-v4, inception-resnet and the impact of residual connections on learning. In Thirty-first AAAI conference on artificial intelligence, San Francisco, USA, February 4–9, 2017, 31(1). https://ojs.aaai.org/index.php/AAAI/article/view/11231

  • Tamou AB, Benzinou A, Nasreddine K, Ballihi L (2018) Underwater live fish recognition by deep learning. In: International conference on image and signal processing, Cherbourg, France, July 2–4, 2018, pp 275–283

  • Tzutalin (2015) LabelImg. Git code https://github.com/tzutalin/labelImg

  • Wang Y, Ye H, Li B (2010) A research based on recognition algorithm of characteristics of body surface of infected fish. In: IEEE 2010 world automation congress, Kobe, Japan, September 19–23, 2010, pp 155–160

  • Wechsler H (2017) Face recognition methods for uncontrolled settings. In: Artificial intelligence: concepts, methodologies, tools, and applications, IGI Global, pp 1440–147. https://doi.org/10.4018/978-1-4666-5966-7.ch003

  • Zhang D, Lee DJ, Zhang M, Tippetts BJ, Lillywhite KD (2016) Object recognition algorithm for the automatic identification and removal of invasive fish. Biosys Eng 145:65–75. https://doi.org/10.1016/j.biosystemseng.2016.02.013

    Article  Google Scholar 

Download references

Acknowledgements

We are grateful to Nathalie Kennedy and Michel Bakni for their valuable support in reviewing the English grammar for this article. We also appreciate the support of M in C Jorge Peniche Pérez for taking photographs and videos in the underwater field. We also thank Consejo Nacional de Ciencia y Tecnologia—CONACYT for the scholarship Granted for doctoral studies and for the financing of this Project 2015-01-786.

Funding

Yes, by Consejo Nacional de Ciencia y Tecnología.

Author information

Authors and Affiliations

  1. Centro de Investigación Científica de Yucatán (CICY), Laboratorio de Sistemas Híbridos de Energía, Unidad de Energía Renovable, Carretera Sierra Papacal-Chuburná Puerto Km 5, 97302, Sierra Papacal, Yucatán, Mexico

    Ángel Trinidad Martínez-González & Víctor Manuel Ramírez-Rivera

  2. Centro de Investigación Científica de Yucatán (CICY), Laboratorio de Ecología y Biodiversidad de Organismos Acuáticos, Unidad de Ciencias del Agua, SM 64 Mz 29 No. 39, Colonia Centro, 77500, Cancún, Quintana Roo, Mexico

    J. Adán Caballero-Vázquez

  3. Univ. Bordeaux, ESTIA Institute of Technology, Technopole Izarbel, 92 allée Théodore Modod, Bidart, France

    David Antonio Gómez Jáuregui

Authors
  1. Ángel Trinidad Martínez-González
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Víctor Manuel Ramírez-Rivera
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. J. Adán Caballero-Vázquez
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David Antonio Gómez Jáuregui
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Víctor Manuel Ramírez-Rivera.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Martínez-González, Á.T., Ramírez-Rivera, V.M., Caballero-Vázquez, J.A. et al. Deep learning algorithm as a strategy for detection an invasive species in uncontrolled environment. Rev Fish Biol Fisheries 31, 909–922 (2021). https://doi.org/10.1007/s11160-021-09667-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11160-021-09667-7

Keywords

Search

Navigation