Advertisement

User Behavior Tracking for Education Assisting System by Using an RGB-D Sensor

  • Haibin XiaEmail author
  • Bin Zhang
  • Tomoaki Nakamura
  • Takayuki Nagai
  • Takashi Omori
  • Masahide Kaneko
  • Rena Ushiogi
  • Natsuki Oka
  • Hun-ok Lim
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1075)

Abstract

It is difficult to track multiple people effectively for a long time in a complex environment because people’s clothes and body shapes may be similar, and their postures may be constantly changing. This paper proposes a novel method for multiple people tracking in crowded places where people can be partially or completely occluded. The people are detected by the deep learning method ConvNet from the color image first, and detection results are integrated with the depth information so that the accurate human areas can be extracted. The accurate personal color information can be extracted then without any background color information. multiple people tracking is proceeded by using particle filter based on the color information. the effectiveness of the proposed method is verified through experiments of tracking multiple children in a classroom.

Keywords

Education assisting system People tracking Particle filter 

References

  1. 1.
    Shiomi, M., Hagita, N.: Social acceptance of a childcare support robot system. In: 24th IEEE International Symposium on Robot and Human Interactive Communication, pp. 13–18 (2015)Google Scholar
  2. 2.
    Barron, C., Kakadiaris, I.: Estimating anthropometry and pose from a single uncalibrated image. Comput. Vis. Image Underst. Comput. Vis. Pattern Recogn. 81(3), 269–284 (2001)CrossRefGoogle Scholar
  3. 3.
    Glas, D., Miyashita, D., Ishiguro, H., Hagita, H.: Laser-based tracking of human position and orientation using parametric shape modeling. Adv. Robot. 23(4), 405–428 (2009)CrossRefGoogle Scholar
  4. 4.
    Joo, J., Liu, H., Tan, L., Gui, L., Nabbe, B., Matthews, I., Kanade, T., Nobuhara, S., Sheikh, Y.: Panoptic studio: a massively multiview system for social motion capture. In: IEEE International Conference on Computer Vision, pp. 33–51 (2015)Google Scholar
  5. 5.
    Tang, S., Andriluka, H., Milan, S., Schindler, K., Roth, S., Schiele, B.: Learning people detectors for tracking in crowded scenes. In: International Conference on Computer Vision and Pattern Recognition, pp. 1049–1056 (2013)Google Scholar
  6. 6.
    Wang, X., Tang, Z.M.: An improved camshift based particle filter algorithm for real-time target tracking. J. Image Graph. 15(10), 1507–1514 (2010)Google Scholar
  7. 7.
    Dalal, H., Triggs. B.: Histograms of oriented gradients for human detection. In: Computer Vision and Pattern Recognition, vol. 1, pp. 886–893 (2005)Google Scholar
  8. 8.
    Elhayek, A., de Aguiar, E., Jain, A., Tompson, J., Pishchulin, L., Andriluka, M., Bregler, C., Schiele, B., Theobalt, C.: Efficient convnet-based marker-less motion capture in general scenes with a low number of cameras. In: Computer Vision and Pattern Recognition, pp. 16–22 (2015)Google Scholar
  9. 9.
    Moreno-Noguer, F.: 3D human pose estimation from a single image via distance matrix regression. In: Computer Vision and Pattern Recognition, pp. 148–168 (2017)Google Scholar
  10. 10.
    Hu, J.S., Juan, C.W., Wang, J.J.: A spatial-color mean-shift object tracking algorithm with scale and orientation estimation. In: Pattern Recognition letters, pp. 2165–2173 (2008)CrossRefGoogle Scholar
  11. 11.
    Choi, W., Pantofaru, C., Savarese, S.: A general framework for tracking multiple people from a moving camera. IEEE Trans. Pattern Anal. Mach. Intell. 35(7), 1157–1591 (2013)Google Scholar
  12. 12.
    Doucet, A., Gordon, N.J., Krishnamurthy, V.: Particle filters for state estimation of jump Markov linear systems. IEEE Trans. Signal Process. 49, 613–624 (2001)CrossRefGoogle Scholar
  13. 13.
    Du, Y.M., Li, S.: An improved particle filtering algorithm. J. Heilongjiang Inst. Technol. 21(2), 36–40 (2007)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  • Haibin Xia
    • 1
    Email author
  • Bin Zhang
    • 1
  • Tomoaki Nakamura
    • 2
  • Takayuki Nagai
    • 2
  • Takashi Omori
    • 3
  • Masahide Kaneko
    • 2
  • Rena Ushiogi
    • 4
  • Natsuki Oka
    • 5
  • Hun-ok Lim
    • 1
  1. 1.Kanagawa UniversityYokohamaJapan
  2. 2.The University of Electro-CommunicationsChofuJapan
  3. 3.Tamagawa UniversityMachidaJapan
  4. 4.Otsuma Women’s UniversityTokyoJapan
  5. 5.Kyoto Institute of TechnologyKyotoJapan

Personalised recommendations