Robust Silhouette Extraction from Kinect Data

  • Michele Pirovano
  • Carl Yuheng Ren
  • Iuri Frosio
  • Pier Luca Lanzi
  • Victor Prisacariu
  • David W. Murray
  • N. Alberto Borghese
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8156)

Abstract

Natural User Interfaces allow users to interact with virtual environments with little intermediation. Immersion becomes a vital need for such interfaces to be successful and it is achieved by making the interface invisible to the user. For cognitive rehabilitation, a mirror view is a good interface to the virtual world, but obtaining immersion is not straightforward. An accurate player profile, or silhouette, accurately extracted from the real-world background, increases both the visual quality and the immersion of the player in the virtual environment. The Kinect SDK provides raw data that can be used to extract a simple player profile. In this paper, we present our method for obtaining a smooth player profile extraction from the Kinect image streams.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
  2. 2.
    Rizzolatti, G., Craighero, L.: The mirror neuron system. Annual Review of Neuroscience 27, 169–192 (2004)CrossRefGoogle Scholar
  3. 3.
    Cameirão, M.S., Badia, S.B.I., Oller, E.D., Verschure, P.F.M.J.: Neurorehabilitation using the virtual reality based Rehabilitation Gaming System: methodology, design, psychometrics, usability and validation. Journal of Neuroengineering and Rehabilitation 7, 48 (2010)CrossRefGoogle Scholar
  4. 4.
    Mainetti, R., Sedda, A., Ronchetti, M., Bottini, G., Borghese, N.A.: Duckneglect: video-games based neglect rehabilitation. Technology and Health care (in press, 2013)Google Scholar
  5. 5.
    Unsworth, C.A.: Cognitive and Perceptual Dysfunction. In: Schmitz, T.J., O’Sullivan, S.B. (eds.) Physical Rehabilitation, pp. 1149–1185. Davis Company, Philadelphia (2007)Google Scholar
  6. 6.
    Frosio, I., Borghese, N.A.: Real-time accurate circle fitting with occlusion. Pattern Recognition 41(3), 1041–1055 (2008)CrossRefMATHGoogle Scholar
  7. 7.
    Menna, F., Remondino, F., Battisti, R., Nocerino, E.: Geometric investigation of a gaming active device. In: Proc. of Videometrics, Range Imaging and Applications XI, SPIE Optical Metrology (2011)Google Scholar
  8. 8.
    Khoshelham, K., Elberink, S.O.: Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications. In: Sensors 2012, vol. 12, pp. 1437–1454 (2012)Google Scholar
  9. 9.
    Yuheng Ren, C., Reid, I.: A unified energy minimization frameworkfor model fitting in depth. In: 2nd Workshop on Consumer Depth Cameras for Computer Vision, CDC4CV (2012)Google Scholar
  10. 10.
    Sanford, K.: Smoothing Kinect Depth Frames in Real-Time (2012)Google Scholar
  11. 11.
    Obukhov, A., Kharlamov, A.: 8x8 Discrete Cosine Transform with CUDA, Whitepaper, http://docs.nvidia.com/cuda/cuda-samples/index.html
  12. 12.
    Pirovano, M., Mainetti, R., Baud-Bovy, G., Lanzi, P.L., Borghese, N.A.: Self-Adaptive Games for Rehabilitation at Home. In: Proc. IEEE Conference on Computational Intelligence and Games, pp. 179–186 (2012)Google Scholar
  13. 13.
    Mori, M.: The Uncanny Valley. Energy 7(4), 33–35 (1970)Google Scholar
  14. 14.
    Hartley, R., Zisserman, A.: Multiple View Geometry, Cambridge University Press (2000)Google Scholar
  15. 15.
    Frosio, I., Borghese, N.A.: 6dof tracking, with axial markers. Medical & Biological Engineering & Computing (in press, 2013), doi:10.1007/s11517-013-1052-7Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Michele Pirovano
    • 1
    • 2
  • Carl Yuheng Ren
    • 3
  • Iuri Frosio
    • 1
  • Pier Luca Lanzi
    • 2
  • Victor Prisacariu
    • 3
  • David W. Murray
    • 3
  • N. Alberto Borghese
    • 1
  1. 1.Department of Computer ScienceUniversity of MilanoMilanoItaly
  2. 2.Dipartimento di Elettronica, Informazione e BioingegneriaPolitecnico di MilanoItaly
  3. 3.Department of Engineering ScienceUniversity of OxfordOxfordEngland

Personalised recommendations