Development of Agent Logic Programming Means for Heterogeneous Multichannel Intelligent Visual Surveillance

  • Alexei A. MorozovEmail author
  • Olga S. Sushkova
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11238)


Experimental means developed in the Actor Prolog parallel object-oriented logic language for implementation of heterogeneous multichannel intelligent visual surveillance systems are considered. These means are examined by the instance of a logic program for permanent monitoring of people’s body parts temperature in the area of visual surveillance. The logic program implements a fusion of heterogeneous data acquired by two devices: (1) 3D coordinates of the human body are measured using a time-of-flight (ToF) camera; (2) 3D coordinates of the human body skeleton are computed on the base of 3D coordinates of the body; (3) a thermal video is acquired using a thermal imaging camera. In the considered example, the thermal video is projected to the 3D surface of the human body; then the temperature of the human body is projected to the vertices and edges of the skeleton. A special logical agent (i.e., the logic program that is written in Actor Prolog) implements these operations in real-time and transfers the data to another logical agent. The latter agent implements a time average of the temperature of the human skeletons and displays colored 3D images of the skeletons; the average temperature of the vertices and edges of the skeletons is depicted by colors. The logic programming means under consideration are developed for the purpose of the implementation of logical analysis of video scene semantics in the intelligent visual surveillance systems.



This research was supported by the Russian Foundation for Basic Research (grant number 16-29-09626-ofi-m).


  1. 1.
    Gade, R., Moeslund, T.B.: Thermal cameras and applications: a survey. Mach. Vis. Appl. 25(1), 245–262 (2014)CrossRefGoogle Scholar
  2. 2.
    Han, S., Gu, X., Gu, X.: An accurate calibration method of a multi camera system. In: Fei, M., Ma, S., Li, X., Sun, X., Jia, L., Su, Z. (eds.) LSMS/ICSEE -2017. CCIS, vol. 761, pp. 491–501. Springer, Singapore (2017). Scholar
  3. 3.
    Morozov, A., Obukhov, Y.: An approach to logic programming of intelligent agents for searching and recognizing information on the Internet. Pattern Recogn. Image Anal. 11(3), 570–582 (2001)Google Scholar
  4. 4.
    Morozov, A.A.: Actor Prolog. Programmirovanie 5, 66–78 (1994). in RussianGoogle Scholar
  5. 5.
    Morozov, A.A.: Actor Prolog: an object-oriented language with the classical declarative semantics. In: Sagonas, K., Tarau, P. (eds.) IDL 1999, pp. 39–53. France, Paris (1999)Google Scholar
  6. 6.
    Morozov, A.A.: Logic object-oriented model of asynchronous concurrent computations. Pattern Recogn. Image Anal. 13(4), 640–649 (2003)Google Scholar
  7. 7.
    Morozov, A.A.: Operational approach to the modified reasoning, based on the concept of repeated proving and logical actors. In: Salvador Abreu, V.S.C. (ed.) CICLOPS 2007, Porto, Portugal, pp. 1–15 (2007)Google Scholar
  8. 8.
    Morozov, A.A.: A GitHub repository containing source codes of Actor Prolog built-in classes (2018).
  9. 9.
    Morozov, A.A., Polupanov, A.F.: Intelligent visual surveillance logic programming: implementation issues. In: Ströder, T., Swift, T. (eds.) CICLOPS-WLPE 2014, pp. 31–45. No. AIB-2014-09 in Aachener Informatik Berichte, RWTH Aachen University, June 2014Google Scholar
  10. 10.
    Morozov, A.A., Sushkova, O.S.: The intelligent visual surveillance logic programming Web Site (2018).
  11. 11.
    Morozov, A.A., Sushkova, O.S., Polupanov, A.F.: A translator of Actor Prolog to Java. In: Bassiliades, N., et al. (eds.) RuleML 2015 DC and Challenge. CEUR, Berlin (2015)Google Scholar
  12. 12.
    Morozov, A.A., Sushkova, O.S., Polupanov, A.F.: Object-oriented logic programming of 3D intelligent video surveillance: the problem statement. In: ISIE, pp. 1631–1636. IEEE Xplore Digital Library, Washington (2017)Google Scholar
  13. 13.
    Morozov, A.A., Sushkova, O.S., Polupanov, A.F.: Object-oriented logic programming of 3D intelligent video surveillance systems: the problem statement. RENSIT 2(9), 205–214 (2017)CrossRefGoogle Scholar
  14. 14.
    Morozov, A.A., Sushkova, O.S., Polupanov, A.F.: Towards the distributed logic programming of intelligent visual surveillance applications. In: Pichardo-Lagunas, O., Miranda-Jiménez, S. (eds.) MICAI 2016. LNCS (LNAI), vol. 10062, pp. 42–53. Springer, Cham (2017). Scholar
  15. 15.
    Nakagawa, W., et al.: Visualization of temperature change using RGB-D camera and thermal camera. In: Agapito, L., Bronstein, M.M., Rother, C. (eds.) ECCV 2014. LNCS, vol. 8925, pp. 386–400. Springer, Cham (2015). Scholar
  16. 16.
    Rangel, J., Soldan, S., Kroll, A.: 3D thermal imaging: fusion of thermography and depth cameras. In: International Conference on Quantitative InfraRed Thermography (2014)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2018

Authors and Affiliations

  1. 1.Kotel’nikov Institute of Radio Engineering and Electronics of RASMoscowRussia

Personalised recommendations