Abstract
This chapter presents a Balance-Guaranteed Optimized Tree with Reject option (BGOTR) for live fish recognition in a non-constrained environment. It recognizes the top 15 common species of fish and detects new species in an unrestricted natural environment recorded by underwater cameras. This system can assist ecological surveillance research, e.g., obtaining fish population statistics from the open sea. BGOTR is automatically constructed based on inter-class similarities. We apply a Gaussian Mixture Model (GMM) and Bayes rule as a reject option after hierarchical classification—we estimate the posterior probability of being a certain species and then filter out less confident decisions. The proposed BGOTR-based hierarchical classification method achieves significant improvements compared to state-of-the-art techniques on a live fish image dataset of 24,150 manually labeled images from the south Taiwan sea.
Access this chapter
Tax calculation will be finalised at checkout
Purchases are for personal use only
References
Boom, B., P. Huang, J. He, and R.B. Fisher. 2012. Supporting ground-truth annotation of image datasets using clustering. In Proceedings of 21st international conference on pattern recognition (ICPR), 1542–1545. IEEE.
Brehmer, P., T.D. Chi, and D. Mouillot. 2006. Amphidromous fish school migration revealed by combining fixed sonar monitoring (horizontal beaming) with fishing data. Journal of Experimental Marine Biology and Ecology 334(1): 139–150.
Breiman, L. 2001. Random forests. Machine learning 45(1): 5–32.
Caley, M.J., M.H. Carr, M.A. Hixon, T.P. Hughes, G.P. Jones, and B.A. Menge. 1996. Recruitment and the local dynamics of open marine populations. Annual Review of Ecology and Systematics 27: 477–500.
Carlos, S., and F. Alex. 2010. A survey of hierarchical classification across different application domains. Data Mining and Knowledge Discovery 22(1–2): 31–72.
Chib, S. 1995. Marginal likelihood from the Gibbs output. Journal of the American Statistical Association 90(432): 1313–1321.
Cline, D.E., and D.R. Edgington. 2010. A detection, tracking, and classification system for underwater images. ICPR Workshop on Visual Observation and Analysis of Animal and Insect Behavior (VAIB), Istanbul.
Cortes, C., and V. Vapnik. 1995. Support-vector networks. Machine Learning 20(3): 273–297.
Deng, J., A.C. Berg, K. Li, and L. Fei-Fei. 2010. What does classifying more than 10,000 image categories tell us? In Proceedings of the 11th european conference on computer vision, 71–84. Berlin: Springer.
Duan, K., D. Parikh, D. Crandall, and K. Grauman. 2012. Discovering localized attributes for fine-grained recognition. In 2012 IEEE conference on computer vision and pattern recognition (CVPR), 3474–3481. IEEE.
Edgington, D.R., D.E. Cline, D. Davis, I. Kerkez, and J. Mariette. 2006. Detecting, tracking and classifying animals in underwater video. In OCEANS, 1–5.
Figueiredo, M.A.T., and A. Jain. 2002. Unsupervised learning of finite mixture models. IEEE Transactions on Pattern Analysis and Machine Intelligence 24(3): 381–396.
Gordon, A.D. 1987. A review of hierarchical classification. Journal of the Royal Statistical Society 150(2): 119–137.
Haralick, R., K. Shanmugam, and I. Dinstein. 1973. Textural features for image classification. IEEE Transactions on Systems, Man and Cybernetics, SMC 3(6): 610–621.
Hastie, T., R. Tibshirani, and J.J.H. Friedman. 2001. The elements of statistical learning, vol. 1. New York: Springer.
He, X.-C., and N.H. Yung. 2004. Curvature scale space corner detector with adaptive threshold and dynamic region of support. In Proceedings of the 17th international conference on pattern recognition, ICPR, vol. 2, 791–794. IEEE.
Ho, T.K. 1995. Random decision forests. In Proceedings of the third international conference on document analysis and recognition, 278–282.
Huang, X.P. 2014. Balance-Guaranteed Optimized Tree with Reject option for live fish recognition. PhD thesis, University of Edinburgh.
Huang, P. X., B.J. Boom and R.B. Fisher. 2012. Underwater live fish recognition using balance-guaranteed optimized tree. In Proceedings of the 11th Asian Conference on Computer Vision, vol. 7724, pages 422–433.
Huang, P.X., B.J. Boom, and R.B. Fisher. 2014. GMM improves the reject option in hierarchical classification for fish recognition. In Proceedings of Workshop on Applications of Computer Vision 2014. 371–376.
Larsen, R., H. Ólafsdóttir, and B. Ersbøll. 2009. Shape and texture based classification of fish species. In Proceedings of the scandinavian conference on image analysis, 745–749.
Lee, D., R.B. Schoenberger, D. Shiozawa, X.Q. Xu, and P.C. Zhan. 2004. Contour matching for a fish recognition and migration-monitoring system. Proceedings of SPIE 5606(1): 37–48.
Liang, Y., J. Li, and B. Zhang. 2010. Learning vocabulary-based hashing with adaboost. In Proceedings of the 16th international conference on advances in multimedia modeling, 545–555. Springer.
Maron, O., and T. Lozano-Pérez. 1998. A framework for multiple-instance learning. In Proceedings of the conference on advances in neural information processing systems, 570–576.
Mokhtarian, F., and R. Suomela. 1998. Robust image corner detection through curvature scale space. IEEE Transactions on Pattern Analysis and Machine Intelligence 20(12): 1376–1381.
Nadarajan, G., Y.-H. Chen-Burger, R.B. Fisher, and C. Spampinato. 2011. A flexible system for automated composition of intelligent video analysis. In Proceedings of the 7th international symposium on image and signal processing and analysis (ISPA), 259–264. IEEE.
Rother, C., V. Kolmogorov, and A. Blake. 2004. “GrabCut”: interactive foreground extraction using iterated graph cuts. ACM Transaction on Graphics 23(3): 309–314.
Rova, A., G. Mori, and L.M. Dill. 2007. One fish, two fish, butterfish, trumpeter: Recognizing fish in underwater video. In IAPR conference on machine vision applications, 404–407.
Ruff, B.P., J.A. Marchant, and A.R. Frost. 1995. Fish sizing and monitoring using a stereo image analysis system applied to fish farming. Aquacultural Engineering 14(2): 155–173.
Shakhnarovich, G., J.W. Fisher, and T. Darrell. 2002. Face recognition from long-term observations. In Proceedings of the 7th European conference on computer vision, 851–865. Springer.
Shental, N., A. Bar-hillel, T. Hertz, and D. Weinshall. 2003. Computing gaussian mixture models with EM using equivalence constraints. In Advances in neural information processing systems 16. MIT Press.
Soh, L.-K., and C. Tsatsoulis. 1999. Texture analysis of SAR sea ice imagery using gray level co-occurrence matrices. IEEE Transactions on Geoscience and Remote Sensing 37(2): 780–795.
Spampinato, C., S. Palazzo, B. Boom, J. van Ossenbruggen, I. Kavasidis, R. Di Salvo, F.-P. Lin, D. Giordano, L. Hardman, and R. Fisher. 2014b. Understanding fish behavior during typhoon events in real-life underwater environments. Multimedia Tools and Applications 70(1): 199–236.
Strachan, N.J.C. 1993. Recognition of fish species by colour and shape. Image and Vision Computing 11: 2–10.
Tibshirani, R. 1996. Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society. Series B (Methodological), 267–288.
Toh, Y.H., T.M. Ng, and B.K. Liew. 2009. Automated fish counting using image processing. In International conference on computational intelligence and software engineering, 1–5.
Wang, Y.-C.F., and D. Casasent. 2009. A support vector hierarchical method for multi-class classification and rejection. In Proceedings of the international joint conference on neural networks IJCNN, 3281–3288.
Yang, J., R. Yan, and A.G. Hauptmann. 2005. Multiple instance learning for labeling faces in broadcasting news video. In Proceedings of the 13th annual ACM international conference on multimedia, 31–40.
Zhang, Q., and S.A. Goldman. 2001. EM-DD: An improved multiple-instance learning technique. In Advances in neural information processing systems, 1073–1080.
Zou, H., and T. Hastie. 2005. Regularization and variable selection via the elastic net. Journal of the Royal Statistical Society: Series B (Statistical Methodology) 67(2): 301–320.
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2016 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Huang, P.X. (2016). Hierarchical Classification System with Reject Option for Live Fish Recognition. In: Fisher, R., Chen-Burger, YH., Giordano, D., Hardman, L., Lin, FP. (eds) Fish4Knowledge: Collecting and Analyzing Massive Coral Reef Fish Video Data. Intelligent Systems Reference Library, vol 104. Springer, Cham. https://doi.org/10.1007/978-3-319-30208-9_11
Download citation
DOI: https://doi.org/10.1007/978-3-319-30208-9_11
Published:
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-30206-5
Online ISBN: 978-3-319-30208-9
eBook Packages: EngineeringEngineering (R0)