Skip to main content
Book cover

European Conference on Logics in Artificial Intelligence

JELIA 2016: Logics in Artificial Intelligence pp 223–239Cite as

Exploiting Contextual Knowledge for Hybrid Classification of Visual Objects

Part of the Lecture Notes in Computer Science book series (LNAI,volume 10021)

Abstract

We consider the problem of classifying visual objects in a scene by exploiting the semantic context. For this task, we define hybrid classifiers (HC) that combine local classifiers with context constraints, and can be applied to collective classification problems (CCPs) in general. Context constraints are represented by weighted ASP constraints using object relations. To integrate probabilistic information provided by the classifier and the context, we embed our encoding in the formalism \(LP^{MLN}\), and show that an optimal labeling can be efficiently obtained from the corresponding \(LP^{MLN}\) program by employing an ordinary ASP solver. Moreover, we describe a methodology for constructing an HC for a CCP, and present experimental results of applying an HC for object classification in indoor and outdoor scenes, which exhibit significant improvements in terms of accuracy compared to using only a local classifier.

Keywords

  • Scale Invariant Feature Transform
  • Semantic Context
  • Local Classifier
  • Weak Constraint
  • Context Constraint

These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.

This research has been supported by the Austrian Science Fund (FWF) projects P27730 and W1255-N23.

This is a preview of subscription content, access via your institution.

Chapter
USD   29.95
Price excludes VAT (USA)
  • DOI: 10.1007/978-3-319-48758-8_15
  • Chapter length: 17 pages
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
eBook
USD   79.99
Price excludes VAT (USA)
  • ISBN: 978-3-319-48758-8
  • Instant PDF download
  • Readable on all devices
  • Own it forever
  • Exclusive offer for individuals only
  • Tax calculation will be finalised during checkout
Softcover Book
USD   99.99
Price excludes VAT (USA)
Learn about institutional subscriptions
Fig. 1.
Fig. 2.
Fig. 3.

Notes

  1. 1.

    As the logic program rules here are more restricted than in [10], we adapt the translation defined there. Real-valued weights can be approximated by integers in weak constraints.

  2. 2.

    http://opencv.org/.

  3. 3.

    https://pypi.python.org/pypi/Shapely.

References

  1. Angin, P., Bhargava, B.: A confidence ranked co-occurrence approach for accurate object recognition in highly complex scenes. J. Internet Technol. 14(1), 13–19 (2013)

    Google Scholar 

  2. Buccafurri, F., Leone, N., Rullo, P.: Enhancing disjunctive datalog by constraints. IEEE Trans. Knowl. Data Eng. 12(5), 845–860 (2000)

    CrossRef  Google Scholar 

  3. Chechetka, A., Dash, D., Philipose, M.: Relational learning for collective classification of entities in images. In: AAAI Workshops on Statistical Relational Artificial Intelligence, AAAI Workshop 2010. AAAI (2010)

    Google Scholar 

  4. Csurka, G., Dance, C.R., Fan, L., Willamowski, J., Bray, C.: Visual categorization with bags of keypoints. In: Workshop on Statistical Learning in Computer Vision, ECCV 2004, pp. 1–22 (2004)

    Google Scholar 

  5. Eiter, T., Ianni, G., Schindlauer, R., Tompits, H.: A uniform integration of higher-order reasoning and external evaluations in answer-set programming. In: International Joint Conference on Artificial Intelligence, IJCAI 2005, pp. 90–96. Professional Book Center (2005)

    Google Scholar 

  6. Galleguillos, C., Rabinovich, A., Belongie, S.J.: Object categorization using co-occurrence, location and appearance. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, CVPR 2008. IEEE Computer Society (2008)

    Google Scholar 

  7. Gebser, M., Kaufmann, B., Kaminski, R., Ostrowski, M., Schaub, T., Schneider, M.T.: Potassco: the potsdam answer set solving collection. AI Commun. 24(2), 107–124 (2011)

    MathSciNet  MATH  Google Scholar 

  8. Gelfond, M., Lifschitz, V.: Classical negation in logic programs and disjunctive databases. New Gener. Comput. 9(3/4), 365–386 (1991)

    CrossRef  MATH  Google Scholar 

  9. Getoor, L.: Introduction to Statistical Relational Learning. MIT Press, Cambridge (2007)

    MATH  Google Scholar 

  10. Lee, J., Wang, Y.: Weighted rules under the stable model semantics. In: Proceedings of the Fifteenth International Conference on Principles of Knowledge Representation and Reasoning, KR 2016, pp. 145–154. AAAI Press (2016)

    Google Scholar 

  11. London, B., Getoor, L.: Collective classification of network data. In: Aggarwal, C.C. (ed.) Data Classification: Algorithms and Applications, pp. 399–416. CRC Press, Boca Raton (2014)

    Google Scholar 

  12. Lowe, D.G.: Object recognition from local scale-invariant features. In: 7th IEEE International Conference on Computer Vision, ICCV 1999, pp. 1150–1157 (1999)

    Google Scholar 

  13. Marton, Z.C., Rusu, R.B., Jain, D., Klank, U., Beetz, M.: Probabilistic categorization of kitchen objects in table settings with a composite sensor. In: International Conference on Intelligent Robots and Systems, IEEE/RSJ 2009, pp. 4777–4784. IEEE (2009)

    Google Scholar 

  14. Pedregosa, F., Varoquaux, G., Gramfort, A., Michel, V., Thirion, B., Grisel, O., Blondel, M., Prettenhofer, P., Weiss, R., Dubourg, V., VanderPlas, J., Passos, A., Cournapeau, D., Brucher, M., Perrot, M., Duchesnay, E.: Scikit-learn: machine learning in Python. J. Mach. Learn. Res. 12, 2825–2830 (2011)

    MathSciNet  MATH  Google Scholar 

  15. Rabinovich, A., Belongie, S.J.: Scenes vs. objects: a comparative study of two approaches to context based recognition. In: IEEE Conference on Computer Vision and Pattern Recognition, CVPR Workshops 2009, pp. 92–99. IEEE Computer Society (2009)

    Google Scholar 

  16. Rabinovich, A., Vedaldi, A., Galleguillos, C., Wiewiora, E., Belongie, S.J.: Objects in context. In: IEEE 11th International Conference on Computer Vision, ICCV 2007, pp. 1–8. IEEE Computer Society (2007)

    Google Scholar 

  17. Randell, D.A., Cui, Z., Cohn, A.G.: A spatial logic based on regions and connection. In: Proceedings of the 3rd International Conference on Principles of Knowledge Representation and Reasoning, KR 1992, pp. 165–176. Morgan Kaufmann (1992)

    Google Scholar 

  18. Richardson, M., Domingos, P.M.: Markov logic networks. Mach. Learn. 62(1–2), 107–136 (2006)

    CrossRef  Google Scholar 

  19. Russell, B.C., Torralba, A., Murphy, K.P., Freeman, W.T.: LabelMe: a database and web-based tool for image annotation. Int. J. Comput. Vis. 77(1–3), 157–173 (2008)

    CrossRef  Google Scholar 

  20. Saathoff, C., Staab, S.: Exploiting spatial context in image region labelling using fuzzy constraint reasoning. In: Ninth International Workshop on Image Analysis for Multimedia Interactive Services, WIAMIS 2008, pp. 16–19. IEEE Computer Society (2008)

    Google Scholar 

  21. Sen, P., Namata, G., Bilgic, M., Getoor, L.: Collective classification. In: Sammut, C., Webb, G.I. (eds.) Encyclopedia of Machine Learning, pp. 189–193. Springer, US (2010)

    Google Scholar 

  22. Sen, P., Namata, G., Bilgic, M., Getoor, L., Gallagher, B., Eliassi-Rad, T.: Collective classification in network data. AI Mag. 29(3), 93–106 (2008)

    Google Scholar 

  23. Strobl, C.: Dimensionally extended nine-intersection model (DE-9IM). In: Shekhar, S., Xiong, H. (eds.) Encyclopedia of GIS, pp. 240–245. Springer, US (2008)

    CrossRef  Google Scholar 

  24. Tran, S.D., Davis, L.S.: Event modeling and recognition using Markov logic networks. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008. LNCS, vol. 5303, pp. 610–623. Springer, Heidelberg (2008). doi:10.1007/978-3-540-88688-4_45

    CrossRef  Google Scholar 

  25. Zhang, H., Fritts, J.E., Goldman, S.A.: Image segmentation evaluation: a survey of unsupervised methods. Comput. Vis. Image Underst. 110(2), 260–280 (2008)

    CrossRef  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Institute of Information Systems, TU Wien, Vienna, Austria

    Thomas Eiter & Tobias Kaminski

Authors
  1. Thomas Eiter
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Tobias Kaminski
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Tobias Kaminski .

Editor information

Editors and Affiliations

  1. Open University of Cyprus, Nicosia, Cyprus

    Loizos Michael

  2. University of Cyprus, Nicosia, Cyprus

    Antonis Kakas

Rights and permissions

Reprints and Permissions

Copyright information

© 2016 Springer International Publishing AG

About this paper

Cite this paper

Eiter, T., Kaminski, T. (2016). Exploiting Contextual Knowledge for Hybrid Classification of Visual Objects. In: Michael, L., Kakas, A. (eds) Logics in Artificial Intelligence. JELIA 2016. Lecture Notes in Computer Science(), vol 10021. Springer, Cham. https://doi.org/10.1007/978-3-319-48758-8_15

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-48758-8_15

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-48757-1

  • Online ISBN: 978-3-319-48758-8

  • eBook Packages: Computer ScienceComputer Science (R0)