Skip to main content
SpringerLink
Log in

Is Someone in this Office Available to Help Me?

Proactively Seeking Help from Spatially-Situated Humans

  • Published:
Journal of Intelligent & Robotic Systems Aims and scope Submit manuscript

Abstract

Robots are increasingly autonomous in our environments, but they still must overcome limited sensing, reasoning, and actuating capabilities while completing services for humans. While some work has focused on robots that proactively request help from humans to reduce their limitations, the work often assumes that humans are supervising the robot and always available to help. In this work, we instead investigate the feasibility of asking for help from humans in the environment who benefit from its services. Unlike other human helpers that constantly monitor a robot’s progress, humans in the environment are not supervisors and a robot must proactively navigate to them to receive help. We contribute a study that shows that several of our environment occupants are willing to help our robot, but, as expected, they have constraints that limit their availability due to their own work schedules. Interestingly, the study further shows that an available human is not always in close proximity to the robot. We present an extended model that includes the availability of humans in the environment, and demonstrate how a navigation planner can incorporate this information to plan paths that increase the likelihood that a robot can find an available helper when it needs one. Finally, we discuss further opportunities for the robot to adapt and learn from the occupants over time.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Similar content being viewed by others

References

  1. Angluin, D.: Queries and concept learning. Mach. Learn. 2(4), 319–342 (1988)

    Google Scholar 

  2. Argall, B., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstration. Robot. Auton. Syst. 57(5), 469–483 (2009)

    Article  Google Scholar 

  3. Armstrong-Crews, N., Veloso, M.: Oracular POMDPS: a very special case. In: ICRA ’07: International Conference on Robotics and Automation, pp. 2477–2482 (2007)

  4. Asoh, H., Hayamizu, S., Hara, I., Motomura, Y., Akaho, S., Matsui, T.: Socially embedded learning of the office-conversant mobile robot JIJO-2. In: 15th International Joint Conference on Artificial Intelligence, pp. 880–885 (1997)

  5. Bruemmer, D.J., Few, D.A., Boring, R.L., Marble, J.L., Walton, M.C., Nielsen, C.W.: Shared understanding for collaborative control. IEEE Trans. Syst. Man Cybern. 35(4), 494–504 (2005)

    Article  Google Scholar 

  6. Callison-Burch, C.: Fast, cheap, and creative: evaluating translation quality using Amazon’s mechanical turk. In: EMNLP ’09: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp. 286–295 (2009)

  7. Clark, H., Wilkes-Gibbs, D.: Referring as a Collaborative Process. Cognition, Manchester (1986)

    Google Scholar 

  8. Cohn, D., Atlas, L., Ladner, R.: Improving generalization with active learning. Mach. Learn. 15(2), 201–221 (1994)

    Google Scholar 

  9. Dautenhahn, K., Walters, M., Woods, S., Koay, K., Nehaniv, C., Sisbot, A., Alami, R., Siméon, T.: How may I serve you?: a robot companion approaching a seated person in a helping context. In: Proceedings of the ACM SIGCHI/SIGART Conference on Human–Robot Interaction, pp. 172–179 (2006)

  10. Donmez, P., Carbonell, J.G.: Proactive learning: cost-sensitive active learning with multiple imperfect oracles. In: CIKM 2008, pp. 619–628 (2008)

  11. Donmez, P., Carbonell, J.G., Schneider, J.: Efficiently learning the accuracy of labeling sources for selective sampling. In: KDD ’09: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 259–268 (2009)

  12. Dorais, G.A., Bonasso, R.P., Kortenkamp, D., Pell, B., Schreckenghost, D.: Adjustable autonomy for human-centered autonomous systems. In: Working Notes of the Sixteenth International Joint Conference on Artificial Intelligence Workshop on Adjustable Autonomy Systems, pp. 16–35 (1999)

  13. Elfes, A.: Robot navigation: integrating perception, environmental constraints and task execution within a probabilistic framework. In: Reasoning with Uncertainty in Robotics, pp. 91–130 (1996)

  14. Fogarty, J., Hudson, S.E., Atkeson, C.G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J.C., Yang, J.: Predicting human interruptibility with sensors. ACM ToCHI 12(1), 119–146 (2005)

    Article  Google Scholar 

  15. Fong, T.W., Thorpe, C., Baur, C.: Collaboration, dialogue, and human-robot interaction. In: 10th International Symposium of Robotics Research (2001)

  16. Fong, T.W., Thorpe, C., Baur, C.: Robot, asker of questions. Robot. Auton. Syst. 42(3–4), 235–243 (2003)

    Article  MATH  Google Scholar 

  17. Goodrich, M.A., Schultz, A.C.: Human-robot interaction: a survey. Found. Trends Human–Comput. Interact. 1(3), 203–275 (2007)

    Article  MATH  Google Scholar 

  18. Green, P., Wei-Haas, L.: The rapid development of user interfaces: experience with the wizard of oz method. HFES Annual Meeting 29(5), 470–474 (1985)

    Article  Google Scholar 

  19. Hayes, G., Demiris, J.: A robot controller using learning by imitation. In: 2nd International Symposium on Intelligent Robotic Systems, pp. 198–204 (1994)

  20. Hearst, M.A.: Mixed-initiative interaction: trends and controversies. In: IEEE Intelligent Systems, pp. 14–23 (1999)

  21. Hüttenrauch, H., Eklundh, S.: To help or not to help a service robot: bystander intervention as a resource in human-robot collaboration. Interact. Stud. 7(3), 455–477 (2006)

    Article  Google Scholar 

  22. Kirby, R., Simmons, R., Forlizzi, J.: Companion: a constraint optimizing method for person-acceptable navigation. In: Ro-Man ’09: Proceedings of International Symposium on Robot and Human Interactive Communication, pp. 607–612 (2009)

  23. Lee, M.K., Kielser, S., Forlizzi, J., Srinivasa, S., Rybski, P.: Gracefully mitigating breakdowns in robotic services. In: HRI ’10: 5th ACM/IEEE International Conference on Human Robot Interaction, pp. 203–210 (2010)

  24. Lockerd, A., Breazeal, C.: Tutelage and socially guided robot learning. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3475–3480 (2004)

  25. Michalowski, M., Sabanovic, S., DiSalvo, C., Busquets, D., Hiatt, L., Melchior, N., Simmons, R.: Socially distributed perception: grace plays social tag at AAAI 2005. Auton. Robots 22(4), 385–397 (2007)

    Article  Google Scholar 

  26. Parasuraman, R., Sheridan, T., Wickens, C.: A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man Cybern. 30(3), 286–297 (2000)

    Article  Google Scholar 

  27. Plutowski, M., White, H.: Selecting concise training sets from clean data. IEEE Trans. Neural Netw. 4(2), 305318 (1993)

    Article  Google Scholar 

  28. Price, R.R.: Accelerating Reinforcement Learning Through Imitation. Ph.D. Thesis, The University of British Columbia (Canada) (2003). Adviser-Boutilier, Craig

  29. Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through a symbiotic human–robot interaction. In: AAMAS ’10: 9th International Joint Conference on Autonomous Agents and Multiagent Systems (2010)

  30. Rosenthal, S., Dey, A.K., Veloso, M.: How robots’ questions affect the accuracy of the human responses. In: The International Symposium on Robot–Human Interactive Communication, pp. 1137–1142 (2009)

  31. Scholtz, J.: Evaluation Methods for Human–System Performance of Intelligent Systems. Tech. Rep. 990, NIST Special Publication (2002)

  32. Scollon, C., Kim-Prieto, C., Diener, E.: Experience sampling: promise and pitfalls, strengths and weaknesses. J Happiness Studies 4, 5–34 (2003)

    Article  Google Scholar 

  33. Sellner, B.P., Heger, F., Hiatt, L., Simmons, R., Singh, S.: Coordinated multi-agent teams and sliding autonomy for large-scale assembly. In: Proceedings of the IEEE Special Issue on Multi-Robot Systems, vol. 94(1), pp. 1425–1444 (2006)

  34. Shahaf, D., Horvitz, E.: Generalized task markets for human and machine computation. In: AAAI (2010)

  35. Shiomi, M., Sakamoto, D., Takayuki, K., Ishi, C.T., Ishiguro, H., Hagita, N.: A semi-autonomous communication robot: a field trial at a train station. In: HRI ’08: 3rd ACM/IEEE International Conference on Human Robot Interaction, pp. 303–310 (2008)

  36. Thrun, S., Beetz, M., Bennewitz, M., Burgard, W., Cremers, A., Dellaert, F., Fox, D., Hahnel, D., Rosenberg, C., Roy, N., et al.: Probabilistic algorithms and the interactive museum tour-guide robot Minerva. Int. J. Rob. Res. 19(11), 972–999 (2000)

    Article  Google Scholar 

  37. von Ahn, L., Dabbish, L.: Labeling images with a computer game. ACM conference on human factors in computing systems. In: CHI 2004, pp. 319–326 (2004)

  38. von Ahn, L., Maurer, B., McMillen, C., Abraham, D., Blum, M.: RECAPTCHA: human-based character recognition via web security measures. Science, 321(5895), 1465–1468 (2008)

    Article  MathSciNet  MATH  Google Scholar 

  39. Weiss, A., Igelsböck, J., Tscheligi, M., Bauer, A., Kühnlenz, K., Wollherr, D., Buss, M.: Robots asking for directions: the willingness of passers-by to support robots. In: HRI ’10: 5th ACM/IEEE International Conference on Human Robot Interaction, pp. 23–30 (2010)

  40. Yanco, H., Drury, J.L., Scholtz, J.: Beyond usability evaluation: analysis of human–robot interaction at a major robotics competition. Hum.-Comput. Interact. 19(1), 117–149 (2004)

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Computer Science Department, Carnegie Mellon University, Pittsburgh, PA, USA

    Stephanie Rosenthal & Manuela Veloso

  2. Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA, USA

    Anind K. Dey

Authors
  1. Stephanie Rosenthal
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Manuela Veloso
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Anind K. Dey
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Stephanie Rosenthal.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Rosenthal, S., Veloso, M. & Dey, A.K. Is Someone in this Office Available to Help Me?. J Intell Robot Syst 66, 205–221 (2012). https://doi.org/10.1007/s10846-011-9610-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10846-011-9610-4

Keywords

Mathematics Subject Classifications (2010)

Search

Navigation