Multimedia Tools and Applications

, Volume 76, Issue 5, pp 6915–6939 | Cite as

An efficient low vision plant leaf shape identification system for smart phones

  • Shitala Prasad
  • P. Sateesh Kumar
  • Debashis Ghosh
Article

Abstract

In computer vision research, the first most important step is to represent the captured object into some mathematical transformed feature vector describing the proper shape, texture and/or color information for the classification. To understand the nature’s biodiversity, together with computer vision (CV), the emerging ubiquitous mobile technologies are now used. Therefore, in this paper, a novel low computational, efficient, and accurate rotation-scale-translation invariant shape profile transform called Angle View Projection (AVP) is proposed. The leaf images captured via mobile devices are transformed to an AVP shape profile curve (a set of four shapelets) and then compacted using Discrete Cosine Transform (DCT) to improve the performance of the system. It also reduces the energy consumption of the device. The algorithm is tested on five different types of leaf datasets: Flavia dataset, 100 plant species leaves dataset, Swedish database, Intelligent Computing Laboratory leaf dataset and Diseased leaf dataset. An ‘Agent’ on mobile device decides whether the module needs to offload to the Server or to compute on the device itself. The experiments carried out clearly indicates that the proposed system outperforms the state-of-the-art with a fast response time even in a low vision environment. AVP also outperforms other methods when tested over incomplete leaves caused due to the physiological or pathological phenomenon. This AVP shape profile based mobile plant biometric system is developed for general applications in our society to better understand the nature and helps in botanical studies and researches.

Keywords

Mobile plant biometric system Low vision Shape profile curve Discrete Cosine Transform (DCT) k-NN Angle View Projection (AVP) 

References

  1. 1.
    Abbasi S, Mokhtarian F, Kittler J (1999) Curvature scale space image in shape similarity retrieval. Multimedia Systems 7(6):467–476CrossRefGoogle Scholar
  2. 2.
    Adamek T, O’Connor NE (2004) A multiscale representation method for nonrigid shapes with a single closed contour. IEEE Trans Circ Syst Video Technol 14:742–753CrossRefGoogle Scholar
  3. 3.
    Alajlan N, El Rube I, Kamel MS, Freeman G (2007) Shape retrieval using triangle-area representation and dynamic space warping. Pattern Recogn 40:1912–1920CrossRefMATHGoogle Scholar
  4. 4.
    Beghin T, Cope JS, Remagnino P, Barman S (2010) Shape and texture based plant leaf classification. Adv Concepts Intelligent Vision Systems, 345–353Google Scholar
  5. 5.
    Chahooki MAZ, Charkari NM (2012) Shape retrieval based on manifold learning by fusion of dissimilarity measures. IET Image Process 6(4):327–336MathSciNetCrossRefGoogle Scholar
  6. 6.
    Cope JS, Corney D, Clark JY, Remagnino P, Wilkin P (2012) Plant species identification using digital morphometrics: a review. Expert Syst with Appl 39(8):7562–7573CrossRefGoogle Scholar
  7. 7.
    Daliri MR, Torre V (2008) Robust symbolic representation for shape recognition and retrieval. Pattern Recogn 41:1782–1798CrossRefMATHGoogle Scholar
  8. 8.
    Daribo I, Florencio D, Cheung G (2014) Arbitrarily shaped motion prediction for depth video compression using arithmetic edge coding. IEEE Trans Image Process 23(11):4696–4708MathSciNetCrossRefGoogle Scholar
  9. 9.
    Eggleston P (1993) Constraint-based feature indexing and retrieval for image databases. Appl Optical Sci Eng, 27–39Google Scholar
  10. 10.
    Fan J, Zhou N, Peng J, Gao L (2015) Hierarchical learning of tree classifiers for large-scale plant species identification. IEEE Trans Image Process 24(11):4172–4184MathSciNetCrossRefGoogle Scholar
  11. 11.
    Fowlkes CC. Surveying shape spacesGoogle Scholar
  12. 12.
    Guo G, Jiang T, Wang Y, Gao W (2013) 2-D shape completion with shape priors. Chin Sci Bull 58(27):3430–3436CrossRefGoogle Scholar
  13. 13.
    Intelligent Computing Laboratory, Chinese Academy of Sciences Homepage: http://www.intelengine.cn/English/dataset
  14. 14.
    Kurtek S, Shen M, Laga H (2014) Elastic reflection symmetry based shape descriptors. 2014 I.E. Winter Conf Appl Comput Vision (WACV), 293–300Google Scholar
  15. 15.
    Laga H, Kurtek S, Srivastava A, Miklavcic SJ (2014) Landmark-free statistical analysis of the shape of plant leaves. J Theoretical BiolGoogle Scholar
  16. 16.
    Lampert CH, Nickisch H, Harmeling S (2014) Attribute-based classification for zero-shot visual object categorization. IEEE Trans Pattern Analysis Machine Intelligence 36(3):453–465CrossRefGoogle Scholar
  17. 17.
    Lester JM, Williams HA, Weintraub BA, Brenner JF (1978) Two graph searching techniques for boundary finding in white blood cell images. Comput Biol Med 8(4):293–308CrossRefGoogle Scholar
  18. 18.
    Ling H, Jacobs DW (2007) Shape classification using the inner-distance. IEEE Trans Pattern Anal Mach Intell 29:286–299CrossRefGoogle Scholar
  19. 19.
    Mallah C, Cope J, Orwell J (2013) Plant leaf classification using probabilistic integration of shape, texture and margin features. Signal Proc, Pattern Recognition ApplGoogle Scholar
  20. 20.
    Manatiadis A, Kaburlasos VG, Gasteratos A, Papadakis SE (2011) Evaluation of shape descriptors for shape-based image retrieval. IET Image Proc, 5(5), 493–499Google Scholar
  21. 21.
    Mouine S, Yahiaoui I, Verroust-Blondet A (2013) A shape-based approach for leaf classification using multiscale triangular representation. Proc 3rd ACM Int Conf Int Conf Multimedia Retrieval, 127–134Google Scholar
  22. 22.
    Niblack CW, Barber R, Equitz W, Flickner MD, Glasman EH, Petkovic D, et al. (1993) QBIC project: querying images by content, using color, texture, and shape. IS&T/SPIE’s Symposium Electronic Imaging: Sci Technol, 173–187Google Scholar
  23. 23.
    Otsu N (1975) A threshold selection method from gray-level histograms. Automatica 11(285–296):23–27Google Scholar
  24. 24.
    Persoon E, Fu KS (1977) Shape discrimination using Fourier descriptors. IEEE Trans Systems, Man Cybernetics 7(3):170–179MathSciNetCrossRefGoogle Scholar
  25. 25.
    Prasad S, Peddoju SK, Ghosh D (2013) AgroMobile: a cloud-based framework for agriculturists on mobile platform. Int J Adv Sci Technol 59:41–52CrossRefGoogle Scholar
  26. 26.
    Prasad S, Peddoju SK, Ghosh D (2014) Energy efficient mobile vision system for plant leaf disease identification. IEEE 2014 Wireless Communication Networking Conf, (WCNC’14), Istanbul, Turkey, 3356–3361Google Scholar
  27. 27.
    Prasad S, Peddoju SK, Ghosh D (2015) Multi-resolution mobile vision system for plant leaf disease diagnosis. Signal Image Video Proc. 1–10Google Scholar
  28. 28.
    Rensink RA, Enns JT (1998) Early completion of occluded objects. Vis Res 38(15):2489–2505CrossRefGoogle Scholar
  29. 29.
    Söderkvist O (2001) Computer vision classification of leaves from Swedish trees. Ph.D. ThesisGoogle Scholar
  30. 30.
    Tangelder JW, Veltkamp RC (2008) A survey of content based 3D shape retrieval methods. Multimedia Tools Appl 39(3):441–471CrossRefGoogle Scholar
  31. 31.
    Venkatesh VM, Cheung SS (2006) Symmetric shape completion under severe occlusions. IEEE Int Conf Image Proc, 709–712Google Scholar
  32. 32.
    Vretblad A (2003) Fourier analysis and its applications (Vol. 223). Springer Sci Business MediaGoogle Scholar
  33. 33.
    Wang B, Brown D, Gao Y, La Salle J (2015) MARCH: multiscale-arch-height description for mobile retrieval of leaf images. Inf Sci 302:132–148CrossRefGoogle Scholar
  34. 34.
    Wang Z, Chi Z, Feng D (2003) Shape based leaf image retrieval. Vision, Image Signal Proc, IEE Proc 150(1):34–43CrossRefGoogle Scholar
  35. 35.
    Wang B, Gao Y (2014) Hierarchical string cuts: a translation, rotation, scale, and mirror invariant descriptor for fast shape retrieval. IEEE Trans Image Process 23(9):4101–4111MathSciNetCrossRefGoogle Scholar
  36. 36.
    Wu SG, Bao FS, Xu EY, Wang YX, Chang YF, Xiang QL (2007) A leaf recognition algorithm for plant classification using probabilistic neural network. 2007 I.E. Int Symp Signal Proc Information Technol, 11–16Google Scholar

Copyright information

© Springer Science+Business Media New York 2016

Authors and Affiliations

  • Shitala Prasad
    • 1
  • P. Sateesh Kumar
    • 2
  • Debashis Ghosh
    • 3
  1. 1.GREYC CNRS UMR6072University of Caen NormandyCaenFrance
  2. 2.Department of Computer Science and EngineeringIndian Institute of TechnologyRoorkeeIndia
  3. 3.Department of Electronics and Communication EngineeringIndian Institute of TechnologyRoorkeeIndia

Personalised recommendations