Machine Perception MU—Picture Classes

  • Zbigniew LesEmail author
  • Magdalena Les
Part of the Studies in Computational Intelligence book series (SCI, volume 842)


Perceptual abilities enable us to go beyond the data that are in the image, since we can achieve reliable identification from a small subset of the predicted correspondences and then use our knowledge to infer many properties of the scene that may not be directly supported by visual data or solve other complex perceptual problems. Without constraining influence of prior expectations, many perceptual problems would be under constrained to the extent that they could never be solved. This emphasis on world knowledge parallels developments in most other areas of machine perception, in which large amounts of problem-specific knowledge are increasingly being used both to constrain solutions and to speed the process of obtaining the solution. In machine perception MU, the knowledge that is needed during solving perceptual problems is supplied by the contextual information that is coded in the categorical structure of the shape classes, the 3D object classes, the picture classes, and the perceptual and ontological categories of visual objects.


  1. 1.
    Les Z (1996) An aesthetic evaluation method based on image understanding approach. In: The first international conference on visual information systems VISUAL’96, Melbourne, 5–6 Feb 1996. VUT, pp 317–327Google Scholar
  2. 2.
    Les Z, Les M (2018) Machine understanding—testing visual understanding ability of machine: the visual intelligence test. Int J Underst 7Google Scholar
  3. 3.
    Biederman I, Mezzanotte RJ, Rabinowitz JC (1982) Scene perception: Detecting and judging objects undergoing relational violations. Cognit Psychol 14(2):143–177CrossRefGoogle Scholar
  4. 4.
    Carbonetto P, de Freitas N, Barnard K (2004) A statistical model for general contextual object recognition. In: European conference on computer vision (ECCV), pp 350–362Google Scholar
  5. 5.
    Fink M, Perona P (2003) Mutual boosting for contextual inference. In: Conference on neural information processing systems (NIPS)Google Scholar
  6. 6.
    Galleguillos C, Rabinovich A, Belongie S (2008) Object categorization using cooccurrence, location and appearance. Paper presented at the conference on computer vision and pattern recognition (CVPR)Google Scholar
  7. 7.
    He X, Zemel RS, Carreira-Perpinan MA (2004) Multiscale conditional random fields for image labelling. In: Conference on computer vision and pattern recognition (CVPR), 2004. pp 695–702Google Scholar
  8. 8.
    Rabinovich A, Vedaldi A, Galleguillos C, Wiewiora E, Belongie S (2007) Objects in context. In: Proceedings of the international conference on computer vision (ICCV)Google Scholar
  9. 9.
    Torralba A (2003) Contextual priming for object detection. Int J Comput Vis (IJCV) 53(2):169–191CrossRefGoogle Scholar
  10. 10.
    Russell BC, Torralba A, Murphy KP, Freeman WT (2008) LabelMe: a database and web-based tool for image annotation. Int J Comput Vis (IJCV) 77(1–3):157–173CrossRefGoogle Scholar
  11. 11.
    Tsotsos JK, Mylopoulos J, Covvey HD, Zucker SW (1980) A framework for visual motion understanding. IEEE Trans Pattern Anal Mach Intell 2(6):563–573CrossRefGoogle Scholar
  12. 12.
    Brooks R (1981) Symbolic reasoning among 3-dimensional models and 2-dimensional images. Artif Intell 17:285–349CrossRefGoogle Scholar
  13. 13.
    Matsuyama T, Hwang V (1990) SIGMA: a knowledge-based aerial image understanding system. Plenum Press, New YorkCrossRefGoogle Scholar
  14. 14.
    Dance S, Caelli T (1997) Soo-pin: picture interpretation networks. In: Caelli T, Bishof WF (eds) Advances in computer vision and machine intelligence. Plenum Publishing Cooperation, New York, pp 225–254CrossRefGoogle Scholar
  15. 15.
    Salzbrunn R (1997) Wissensbasierte Erkennung und Lokarisierung von objekten. Shaker Verlag, AachenGoogle Scholar
  16. 16.
    Arnheim R (1974) Art and visual perception. a psychology of the creative eye. University of California Press, BerkeleyGoogle Scholar
  17. 17.
    Les Z, Les M (2008) Shape understanding system. The first steps toward the visual thinking machines. In: Studies in computational intelligence. Springer, BerlinGoogle Scholar
  18. 18.
    Les Z, Les M (2013) Shape understanding system—knowledge implementation and learning. In: Studies in computational intelligence. Springer, BerlinGoogle Scholar
  19. 19.
    Les Z, Les M (2015) Shape understanding system—machine understanding and human understanding. In: Studies in computational intelligence. Springer, BerlinGoogle Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.The St. Queen Jadwiga Research Institute of UnderstandingToorak, MelbourneAustralia

Personalised recommendations