Skip to main content
Log in

Binding human spatial interactions with mapping for enhanced mobility in dynamic environments

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

For mobile robots to operate in compliance with human presence, interpreting the impact of human activities and responding constructively is a challenging goal. In this paper, we propose a generative approach for enhancing robot mapping and mobility in the presence of humans through a joint, probabilistic treatment of static and dynamic characteristics of indoor environments. Human spatial activity is explicitly exploited for the purpose of passage detection and space occupancy prediction while effectively discarding false positive human detections using prior map information. In turn, this allows the execution of plan trajectories within unexplored areas by using human presence for resolving the uncertainty or ambiguity that is due to dynamic events. A series of experiments with an indoor robot navigating in close human proximity within a multi-floor building demonstrate the effectiveness of our approach in realistic conditions.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11

Similar content being viewed by others

References

  • Alempijevic, A., Fitch, R. & Kirchner, N. (2013). Bootstrapping navigation and path planning using human positional traces. In IEEE international conference on robotics and automation.

  • Althaus, P. & Christensen, H. (2003). Automatic map acquisition for navigation in domestic environments. In IEEE international conference on robotics and automation.

  • Azzalini, A. (1985). A class of distributions which includes the normal ones. Scandinavian Journal of Statistics, 12(2), 171–178.

    MathSciNet  MATH  Google Scholar 

  • Azzalini, A., & Valle, A. D. (1996). The multivariate skew-normal distribution. Biometrika, 83(4), 715–726.

    Article  MathSciNet  MATH  Google Scholar 

  • Chapoulie, A., Rives, P. & Filliat, D. (2012). Topological segmentation of indoors/outdoors sequences of spherical views. In IEEE international conference on intelligent robots and systems.

  • Diosi, A., Taylor, G. & Kleeman, L. (2005). Interactive slam using laser and advanced sonar. In IEEE international conference on robotics and automation.

  • Drouilly, R., Papadakis, P., Rives, P. & Morisset, B. (2014). Local map extrapolation in dynamic environments. In 2014 IEEE international conference on systems, man and cybernetics.

  • Fouhey, D., Delaitre, V., Gupta, A., Efros, A., Laptev, I., & Sivic, J. (2014). People watching: Human actions as a cue for single view geometry. International Journal of Computer Vision, 110(3), 259–274.

    Article  Google Scholar 

  • Fox, D., Burgard, W., & Thrun, S. (1997). The dynamic window approach to collision avoidance. IEEE Robotics Automation Magazine, 4(1), 23–33.

    Article  Google Scholar 

  • Grisetti, G., Stachniss, C., & Burgard, W. (2007). Improved techniques for grid mapping with rao-blackwellized particle filters. IEEE Transactions on Robotics, 23(1), 34–46.

    Article  Google Scholar 

  • Grzonka, S., Dijoux, F., Karwath, A. & Burgard, W. (2010). Mapping indoor environments based on human activity. In IEEE international conference on robotics and automation.

  • Grin-Lajoie, M., Richards, C. L., Fung, J., & McFadyen, B. J. (2008). Characteristics of personal space during obstacle circumvention in physical and virtual environments. Gait and Posture, 27(2), 239–247.

    Article  Google Scholar 

  • Hahnel, D., Triebel, R., Burgard, W. & Thrun, S. (2003). Map building with mobile robots in dynamic environments. In IEEE international conference on robotics and automation.

  • Hall, E. (1966). The hidden dimension: Man’s use of space in public and private. London: The Bodley Head Ltd.

    Google Scholar 

  • Kim, S., Cheong, H., Park, J.H. & Park, S.K. (2009). Human augmented mapping for indoor environments using a stereo camera. In IEEE international conference on intelligent robots and systems.

  • Kostavelis, I., & Gasteratos, A. (2015). Semantic mapping for mobile robotics tasks: A survey. Robotics and Autonomous Systems, 66, 86–103.

    Article  Google Scholar 

  • Kruijff, G.J.M., Zender, H. & Jensfelt, P., Christensen, H.I. (2006). Clarification dialogues in human-augmented mapping. In ACM SIGCHI/SIGART conference on human–robot interaction.

  • Kruse, T., Pandey, A., Alami, R., & Kirsch, A. (2013). Human-aware robot navigation: A survey. Robotics and Autonomous Systems, 61(512), 1726–1743.

    Article  Google Scholar 

  • Li, G., Zhu, C., Du, J., Cheng, Q., Sheng, W. & Chen, H. (2012). Robot semantic mapping through wearable sensor-based human activity recognition. In IEEE international conference on robotics and automation.

  • O’Callaghan, S., Singh, S., Alempijevic, A. & Ramos, F. (2011). Learning navigational maps by observing human motion patterns. In IEEE international conference on robotics and automation.

  • Ogawa, Y., Wang, Z., Wada, T., Hirata, Y. & Kosuge, K. (2014). Generating human motion transition map in indoor environment and analyzing human behavior by geographical clustering. In IEEE international conference on robotics and automation.

  • PAL (Personally Assisted Living) project. https://pal.inria.fr/.

  • Papadakis, P., Rives, P. & Spalanzani, A. (2014). Adaptive spacing in human–robot interactions. In IEEE international conference on intelligent robots and systems.

  • Papadakis, P., Spalanzani, A. & Laugier, C. (2013). Social mapping of human-populated environments by implicit function learning. In IEEE international conference on intelligent robots and systems.

  • Pronobis, A. & Jensfelt, P. (2012). Large-scale semantic mapping and reasoning with heterogeneous modalities. In IEEE international conference on robotics and automation.

  • Quigley, M., Conley, K., Gerkey, B., Faust, J., Foote, T., Leibs, J., Wheeler,R. & Ng, A. (2009). Ros: an open-source robot operating system. In ICRA Workshop on Open Source Software.

  • Rios-Martinez, J., Spalanzani, A., & Laugier, C. (2015). From proxemics theory to socially-aware navigation: A survey. International Journal of Social Robotics, 7(2), 137–153. doi:10.1007/s12369-014-0251-1.

    Article  Google Scholar 

  • Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A. & Blake, A. (2011). Real-time human pose recognition in parts from single depth images. In IEEE international conference on computer vision and pattern recognition.

  • Sundaram, S. & Mayol-Cuevas, W. (2012). What are we doing here? egocentric activity recognition on the move for contextual mapping. In IEEE international conference on robotics and automation.

  • Topp, E. & Christensen, H. (2006). Topological modelling for human augmented mapping. In IEEE international conference on intelligent robots and systems.

  • Wada, T., Wang, Z., Ogawa, Y., Hirata, Y. & Kosuge, K. (2012). Incremental human motion map system and human walking behavior representation in indoor environment. In IEEE international conference on robotics and biomimetics.

  • Wong, L.L., Kaelbling, L.P. & Lozano-Pérez, T. (2014). Not seeing is also believing: Combining object and metric spatial information. In IEEE international conference on robotics and automation.

  • Yanco, H., Drury, J. (2004). Classifying human–robot interaction: An updated taxonomy. In IEEE international conference on systems, man and cybernetics.

  • Zender, H., Mozos, O. M., Jensfelt, P., Kruijff, G. J., & Burgard, W. (2008). Conceptual spatial representations for indoor mobile robots. Robotics and Autonomous Systems, 56(6), 493–502.

    Article  Google Scholar 

  • Zhao, C., Mei, W., & Pan, W. (2015). Building a grid-semantic map for the navigation of service robots through human–robot interaction. Digital Communications and Networks, 1, 253.

    Article  Google Scholar 

  • Ziaeefard, M., & Bergevin, R. (2015). Semantic human activity recognition: A literature review. Pattern Recognition, 48(8), 2329–2345.

    Article  Google Scholar 

Download references

Acknowledgments

This work has been performed in the context of INRIA Project Lab PAL (Personally Assisted Living) and project ADT “P2N” (Perception to Navigation).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Panagiotis Papadakis.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Papadakis, P., Rives, P. Binding human spatial interactions with mapping for enhanced mobility in dynamic environments. Auton Robot 41, 1047–1059 (2017). https://doi.org/10.1007/s10514-016-9581-1

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-016-9581-1

Keywords

Navigation