Error-Resilient Perceptual Haptic Data Communication Based on Probabilistic Receiver State Estimation

  • Julius Kammerl
  • Fernanda Brandi
  • Florian Schweiger
  • Eckehard Steinbach
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7282)


We present an error-resilient perceptual haptic data compression scheme based on a probabilistic receiver model. While the previously proposed perceptual deadband approach successfully addresses the challenges of high packet and data rates in haptic real-time communication, packet loss in the network leads to perceivable distortion. To address this issue, a sender-driven transmission scheme for low-latency packet loss compensation is proposed. In this scheme, packet transmissions are adaptively triggered only if the reveicer state is likely to deviate from the error-free signal by more than the applied perception thresholds. Conducted experiments validate that the proposed haptic communication scheme successful compensates for packet loss with low computational complexity and without the need of acknowledgments.


Haptics Communication Compression Error-resiliency 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ferrell, W.R., Sheridan, T.B.: Supervisory control of remote manipulation. IEEE Spectrum 4(10), 81–88 (1967)CrossRefGoogle Scholar
  2. 2.
    Ortega, A., Liu, Y.: Lossy compression of haptic data. In: Touch in Virtual Environments, ch. 6, pp. 119–136. Prentice Hall (2002)Google Scholar
  3. 3.
    Shahabi, C., Ortega, A., Kolahdouzan, M.R.: A comparison of different haptic compression techniques. In: Proc. of the Int. Conf. on Multimedia & Expo., Lausanne, Switzerland, pp. 657–660 (August 2002)Google Scholar
  4. 4.
    Borst, C.W.: Predictive coding for efficient host-device communication in a pneumatic force-feedback display. In: Proc. of the First Joint Eurohaptics Conf. and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, World Haptics, Pisa, Italy, pp. 596–599 (March 2005)Google Scholar
  5. 5.
    Otanez, P.G., Moyne, J.R., Tilbury, D.M.: Using deadbands to reduce communication in networked control systems. In: Proc. of the American Control Conf., Anchorage, Alaska (2002)Google Scholar
  6. 6.
    Hinterseer, P., Hirche, S., Chaudhuri, S., Steinbach, E., Buss, M.: Perception-based data reduction and transmission of haptic data in telepresence and teleaction systems. IEEE Trans. on Signal Processing 56(2), 588–597 (2008)MathSciNetCrossRefGoogle Scholar
  7. 7.
    Hinterseer, P., Steinbach, E., Hirche, S., Buss, M.: A novel, psychophysically motivated transmission approach for haptic data streams in telepresence and teleaction systems. In: Proc. of the Int. Conf. on Acoustics, Speech, and Signal Processing, Philadelphia, PA, USA, vol. 2 (March 2005)Google Scholar
  8. 8.
    Hirche, S., Hinterseer, P., Steinbach, E., Buss, M.: Transparent data reduction in networked telepresence and teleaction systems. part i: Communication without time delay. Presence: Teleoperators & Virtual Environments 16(5), 523–531 (2007)CrossRefGoogle Scholar
  9. 9.
    Hirche, S., Hinterseer, P., Steinbach, E., Buss, M.: Network traffic reduction in haptic telepresence systems by deadband control. In: Proc. of the IFAC World Congress, Int. Federation of Automatic Control. Prague, Czech Republic (2005)Google Scholar
  10. 10.
    Chakareski, J., Girod, B.: Computing rate-distortion optimized policies for streaming media with rich acknowledgments. In: Proc. of the Data Compression Conf., Snowbird, Utah, USA, pp. 202–211 (2004)Google Scholar
  11. 11.
    Chou, P., Miao, Z.: Rate-distortion optimized streaming of packetized media. IEEE Trans. on Multimedia 8(2), 390–404 (2006)CrossRefGoogle Scholar
  12. 12.
    Brandi, F., Kammerl, J., Steinbach, E.: Error-resilient perceptual coding for networked haptic interaction. In: Proc. of the ACM Multimedia, Firenze, Italy (October 2010)Google Scholar
  13. 13.
    Brandi, F., Steinbach, E.: Low-complexity error-resilient data reduction approach for networked haptic sessions. In: Proc. of the IEEE Int. Symposium on Haptic Audio-Visual Environments and Games, Nanchang, China (October 2011)Google Scholar
  14. 14.
    Weber, E.: Die Lehre vom Tastsinn und Gemeingefühl, auf Versuche gegründet. Vieweg, Braunschweig (1851)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2012

Authors and Affiliations

  • Julius Kammerl
    • 1
  • Fernanda Brandi
    • 1
  • Florian Schweiger
    • 1
  • Eckehard Steinbach
    • 1
  1. 1.Institute for Media TechnologyTechnische Universität MünchenMunichGermany

Personalised recommendations