Self-Organizing Trees and Forests: A Powerful Tool in Pattern Clustering and Recognition

  • Ling Guan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4141)


As the fruit of the Information Age comes to bare, the question of how such information, especially visual information, might be effectively harvested, archived and analyzed, remains a monumental challenge facing today’s research community. The processing of such information, however, is often fraught with the need for conceptual interpretation: a relatively simple task for humans, yet arduous for computers. In attempting to handle oppressive volumes of visual information becoming readily accessible within consumer and industrial sectors, some level of automation remains a highly desired goal. To achieve such a goal requires computational systems that exhibit some degree of intelligence in terms of being able to formulate their own models of the data in question with little or no user intervention – a process popularly referred to as Pattern Clustering or Unsupervised Pattern Classification. One powerful tool in pattern clustering is the computational technologies based on principles of Self-Organization. In this talk, we explore a new family of computing architectures that have a basis in self organization, yet are somewhat free from many of the constraints typical of other well known self-organizing architectures. The basic processing unit in the family is known as the Self-Organizing Tree Map (SOTM). We will look at how this model has evolved since its inception in 1995, how it has inspired new models, and how it is being applied to complex pattern clustering problems in image processing and retrieval, and three dimensional data analysis and visualization.


Image Retrieval Relevance Feedback Adaptive Resonance Theory CBIR System Query Class 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Turing, A.M.: The chemical basis of morphogenesis. Philosophical Transactions of the Royal Society, B 237, 5–72 (1952)CrossRefGoogle Scholar
  2. 2.
    Haykin, S.: Neural Networks: A Comprehensive Foundation, 2nd edn. Prentice Hall, New Jersey (1999)MATHGoogle Scholar
  3. 3.
    Hebb, D.O.: The Organization of Behavior: A Neuropsychological Theory. Wiley, New York (1949)Google Scholar
  4. 4.
    Kohonen, T.: Self-organized formation of topologically correct feature maps. Biological Cybernetics 43, 59–69Google Scholar
  5. 5.
    Yen, G.G., Wu, Z.: Ranked Centroid Projection: a Data Visualization Approach for Self-Organizing Maps. In: Proc. Int. Joint Conf. on Neural Networks, Montreal, Canada, July 31 - August 4, pp. 1587–1592 (2005)Google Scholar
  6. 6.
    Kohonen, T.: Self-organization and associative memory. Springer, Berlin (1984)MATHGoogle Scholar
  7. 7.
    Grossberg, S.: Adaptive pattern classification and universal recoding: I. Parallel development and coding of neural feature detectors. Biological Cybernetics 23, 121–131 (1976)CrossRefMathSciNetMATHGoogle Scholar
  8. 8.
    Martinetz, T., Schulten, K.: A ‘Neural-Gas’ network learns topologies. Artificial Neural Network I, 247–402 (1991)Google Scholar
  9. 9.
    Miikkulainen, R.: Script recognition with hierarchical feature maps. Connection Science 2 (1990)Google Scholar
  10. 10.
    Kong, H., Guan, L.: Detection and removal of impulse noise by a neural network guided adaptive median filter. In: Proc. IEEE Int. Conf. on Neural Networks, Perth, Australia, pp. 845–849 (1995)Google Scholar
  11. 11.
    Randall, J., Guan, L., Zhang, X., Li, W.: Investigations of the self-organizing tree map. In: Proc. Of Int. Conf. on Neural Information Processing, vol. 2, pp. 724–728 (November 1999)Google Scholar
  12. 12.
    Kyan, M., Guan, L., Liss, S.: Dynamic Feature Fusion in the Self-Organizing Tree Map – applied to the segmentation of biofilm images. In: Proc. Of Int. Joint Conf. on Neural Networks, Montreal, Canada, July 31-August 4 (2005)Google Scholar
  13. 13.
    Grossberg, S.: Studies of Ming and Brain. Reidel, Boston (1982)Google Scholar
  14. 14.
    Carpenter, G., Grossberg, S.: The ART of adaptive pattern recognition by a self-organizing neural network. Computer 21(3), 77–87 (1988)CrossRefGoogle Scholar
  15. 15.
    Carpenter, G.A., Grossberg, S., Reynolds, J.H.: ARTMAP: supervised real-time learning and classification of nonstationary data by a self-organizing neural network. Neural Networks 4, 565–588 (1991)CrossRefGoogle Scholar
  16. 16.
    Kyan, M., Guan, L., Liss, S.: Refining competition in the self-organizing tree map for unsupervised biofilm segmentation. Neural Networks 18(5-6), 850–860 (2005)CrossRefGoogle Scholar
  17. 17.
    Muneesawang, P., Guan, L.: Interactive CBIR using RBF-based relevance feedback for WT/VQ coded images. In: Proc. IEEE Int. Conf. on Acoustics, Speech, and Signal Processing, Salt Lake City, USA, vol. 3, pp. 1641–1644 (May 2001)Google Scholar
  18. 18.
    Muneesawang, P.: Retrieval of image/video content by adaptive machine and user interaction. Ph.D. Thesis, The University of Sydney (2002)Google Scholar
  19. 19.
    Muneesawang, P., Guan, L.: Automatic machine interactions for content-based image retrieval using a self-organizing tree map architecture. IEEE Trans. on Neural Networks 13(4), 821 (2002)CrossRefGoogle Scholar
  20. 20.
    Rui, Y., Huang, T.-S.: Optimizing learning in image retrieval. In: Proc. IEEE Int. Conf. on Computer Vision and Pattern Recognition, Hilton Head, SC, vol. 1, pp. 223–243 (June 2000)Google Scholar
  21. 21.
    Jarrah, K., Kyan, M., Krishnan, S., Guan, L.: Computational intelligence techniques and their Applications in Content-Based Image Retrieval. In: IEEE Int. Conf. on Multimedia & Expo., Toronto, July 9-12 (accepted, 2006)Google Scholar
  22. 22.
    Cogswell, C.J., Sheppard, C.J.R.: Confocal differential interference contrast (DIC) microscopy: Including a theoretical analysis of conventional and confocal DIC imaging. Journal of Microscopy 165(1), 81–101 (1992)MathSciNetGoogle Scholar
  23. 23.
    Kyan, M.J., Guan, L., Arnison, M.R., Cogswell, C.J.: Feature Extraction of Chromosomes From 3-D Confocal Microscope Images. IEEE Trans. on Biomedical Engineering 48(11), 1306–1318 (2001)CrossRefGoogle Scholar
  24. 24.
    Otsu, N.: A Threshold Selection Method from Gray-Level Histograms. IEEE Trans. on Systems Man and Cybernetics 9(1), 62–66 (1979)CrossRefMathSciNetGoogle Scholar
  25. 25.
    Besag, J.: On the statistical analysis of dirty pictures (with discussion). J. Roy Statist Soc. Ser. B 48, 259–302 (1986)MathSciNetMATHGoogle Scholar
  26. 26.
    Image Structure Analyzer ISA, Center for Biolfilm Engineering, Montana State UniversityGoogle Scholar
  27. 27.
    Kyan, M., Guan, L.: Local Variance Driven Self-Organization for Unsupervised Clustering. In: Int. Conf. on Pattern Recognition, Hong Kong, August 20-24 (accepted, 2006)Google Scholar
  28. 28.
    Oja, E.: A simplified neuron model as a principal component analyzer. Journal of Mathematical Biology 15, 267–273Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Ling Guan
    • 1
  1. 1.Multimedia Research LaboratoryRyerson UniversityTorontoCanada

Personalised recommendations