Combining Static and Dynamic Predictions of Transfer Points for Human Initiated Handovers

  • Janneke Simmering
  • Sebastian Meyer zu BorgsenEmail author
  • Sven Wachsmuth
  • Ayoub Al-Hamadi
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 11876)


In many scenarios where robots could assist humans, handover situations are essential. But they are still challenging for robots, especially if these are initiated by the human interaction partner. Human-human handover studies report average reaction times of 0.4 s, which is only achievable for robots, if they are able to predict the object transfer point (OTP) sufficiently early and then adapt to the human movement. In this paper, we propose a hand tracking system that can be used in the context of human initiated handover as a basis for human reaching motion prediction. The OTP prediction implemented is based on the minimum jerk model and combines a static estimation utilizing the human’s initial pose and a dynamic estimation from the current hand trajectory. Results are generated and analyzed for a broad spectrum of human initiated scenarios. For these cases we examine the dynamics of different variants of the proposed prediction algorithm, i.e., how early is a robot’s prediction of the OTP within a certain error range? The tracking delivers results with an average delay, after the initialization, of 0.07 s. We show that the OTP prediction delivers results after 75 % of the movement within a 10 cm precision box.


  1. 1.
    Basili, P., Huber, M., Brandt, T., Hirche, S., Glasauer, S.: Investigating human-human approach and hand-over. In: Vernon, D., et al. (eds.) Human Centered Robot Systems, vol. 6. Springer, Heidelberg (2009). Scholar
  2. 2.
    Bray, M., Koller-Meier, E., Van Gool, L.: Smart particle filtering for 3D hand tracking. In: Proceedings of Sixth IEEE International Conference on Automatic Face and Gesture Recognition. IEEE, Seoul, Korea (2004)Google Scholar
  3. 3.
    Cao, Z., Hidalgo, G., Simon, T., Wei, S.E., Sheikh, Y.: OpenPose: Realtime Multi-Person 2D Pose Estimation using Part Affinity Fields. arXiv:1812.08008 (2018)
  4. 4.
    Chen, C., Chen, Y., Lee, P., Tsai, Y., Lei, S.: Real-time hand tracking on depth images. In: 2011 Visual Communications and Image Processing (VCIP), November 2011Google Scholar
  5. 5.
    Flash, T., Hogan, N.: The coordination of arm movements: an experimentally confirmed mathematical model. J. Neurosci. 5(7), 1688–1703 (1985)CrossRefGoogle Scholar
  6. 6.
    Hackenberg, G., McCall, R., Broll, W.: Lightweight palm and finger tracking for real-time 3D gesture control. In: 2011 IEEE Virtual Reality Conference, March 2011Google Scholar
  7. 7.
    Huber, M., et al.: Evaluation of a novel biologically inspired trajectory generator in human-robot interaction. In: RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication, September 2009Google Scholar
  8. 8.
    Kajikawa, S., Ishikawa, E.: Trajectory planning for hand-over between human and robot. In: Proceedings 9th IEEE International Workshop on Robot and Human Interactive Communication. IEEE RO-MAN 2000 (Cat. No. 00TH8499), September 2000Google Scholar
  9. 9.
    Li, Z., Hauser, K.: Predicting object transfer position and timing in human-robot handover tasks. In: Science and Systems (2015)Google Scholar
  10. 10.
    Maeda, G.J., Neumann, G., Ewerton, M., Lioutikov, R., Kroemer, O., Peters, J.: Probabilistic movement primitives for coordination of multiple human-robot collaborative tasks. Auton. Robots 41(3), 593–612 (2017)CrossRefGoogle Scholar
  11. 11.
    Meyer zu Borgsen, S., Bernotat, J., Wachsmuth, S.: Hand in hand with robots: differences between experienced and naive users in human-robot handover scenarios. In: Kheddar, A., et al. (eds.) Social Robotics. ICSR 2017. LNCS, vol. 10652. Springer, Cham (2017). Scholar
  12. 12.
    Nemlekar, H., Dutia, D., Li, Z.: Object transfer point estimation for fluent human-robot handovers. In: International Conference on Robotics and Automation (ICRA). Montreal, Canada (2019)Google Scholar
  13. 13.
    Perez-D’Arpino, C., Shah, J.A.: Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification. In: 2015 IEEE International Conference on Robotics and Automation (ICRA). IEEE, Seattle, WA, USA, May 2015Google Scholar
  14. 14.
    Shibata, S., Sahbi, B.M., Tanaka, K., Shimizu, A.: An analysis of the process of handing over an object and its application to robot motions. In: Computational Cybernetics and Simulation 1997 IEEE International Conference on Systems, Man, and Cybernetics, vol. 1, October 1997Google Scholar

Copyright information

© Springer Nature Switzerland AG 2019

Authors and Affiliations

  1. 1.Bielefeld UniversityBielefeldGermany
  2. 2.CITECBielefeld UniversityBielefeldGermany
  3. 3.IIKTUniversity of MagdeburgMagdeburgGermany

Personalised recommendations