Journal of Intelligent & Robotic Systems

, Volume 66, Issue 1–2, pp 205–221 | Cite as

Is Someone in this Office Available to Help Me?

Proactively Seeking Help from Spatially-Situated Humans
  • Stephanie RosenthalEmail author
  • Manuela Veloso
  • Anind K. Dey


Robots are increasingly autonomous in our environments, but they still must overcome limited sensing, reasoning, and actuating capabilities while completing services for humans. While some work has focused on robots that proactively request help from humans to reduce their limitations, the work often assumes that humans are supervising the robot and always available to help. In this work, we instead investigate the feasibility of asking for help from humans in the environment who benefit from its services. Unlike other human helpers that constantly monitor a robot’s progress, humans in the environment are not supervisors and a robot must proactively navigate to them to receive help. We contribute a study that shows that several of our environment occupants are willing to help our robot, but, as expected, they have constraints that limit their availability due to their own work schedules. Interestingly, the study further shows that an available human is not always in close proximity to the robot. We present an extended model that includes the availability of humans in the environment, and demonstrate how a navigation planner can incorporate this information to plan paths that increase the likelihood that a robot can find an available helper when it needs one. Finally, we discuss further opportunities for the robot to adapt and learn from the occupants over time.


Human–robot interaction User study Asking for help Planning 

Mathematics Subject Classifications (2010)

68T40 68T37 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Angluin, D.: Queries and concept learning. Mach. Learn. 2(4), 319–342 (1988)Google Scholar
  2. 2.
    Argall, B., Chernova, S., Veloso, M., Browning, B.: A survey of robot learning from demonstration. Robot. Auton. Syst. 57(5), 469–483 (2009)CrossRefGoogle Scholar
  3. 3.
    Armstrong-Crews, N., Veloso, M.: Oracular POMDPS: a very special case. In: ICRA ’07: International Conference on Robotics and Automation, pp. 2477–2482 (2007)Google Scholar
  4. 4.
    Asoh, H., Hayamizu, S., Hara, I., Motomura, Y., Akaho, S., Matsui, T.: Socially embedded learning of the office-conversant mobile robot JIJO-2. In: 15th International Joint Conference on Artificial Intelligence, pp. 880–885 (1997)Google Scholar
  5. 5.
    Bruemmer, D.J., Few, D.A., Boring, R.L., Marble, J.L., Walton, M.C., Nielsen, C.W.: Shared understanding for collaborative control. IEEE Trans. Syst. Man Cybern. 35(4), 494–504 (2005)CrossRefGoogle Scholar
  6. 6.
    Callison-Burch, C.: Fast, cheap, and creative: evaluating translation quality using Amazon’s mechanical turk. In: EMNLP ’09: Proceedings of the 2009 Conference on Empirical Methods in Natural Language Processing, pp. 286–295 (2009)Google Scholar
  7. 7.
    Clark, H., Wilkes-Gibbs, D.: Referring as a Collaborative Process. Cognition, Manchester (1986)Google Scholar
  8. 8.
    Cohn, D., Atlas, L., Ladner, R.: Improving generalization with active learning. Mach. Learn. 15(2), 201–221 (1994)Google Scholar
  9. 9.
    Dautenhahn, K., Walters, M., Woods, S., Koay, K., Nehaniv, C., Sisbot, A., Alami, R., Siméon, T.: How may I serve you?: a robot companion approaching a seated person in a helping context. In: Proceedings of the ACM SIGCHI/SIGART Conference on Human–Robot Interaction, pp. 172–179 (2006)Google Scholar
  10. 10.
    Donmez, P., Carbonell, J.G.: Proactive learning: cost-sensitive active learning with multiple imperfect oracles. In: CIKM 2008, pp. 619–628 (2008)Google Scholar
  11. 11.
    Donmez, P., Carbonell, J.G., Schneider, J.: Efficiently learning the accuracy of labeling sources for selective sampling. In: KDD ’09: Proceedings of the 15th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, pp. 259–268 (2009)Google Scholar
  12. 12.
    Dorais, G.A., Bonasso, R.P., Kortenkamp, D., Pell, B., Schreckenghost, D.: Adjustable autonomy for human-centered autonomous systems. In: Working Notes of the Sixteenth International Joint Conference on Artificial Intelligence Workshop on Adjustable Autonomy Systems, pp. 16–35 (1999)Google Scholar
  13. 13.
    Elfes, A.: Robot navigation: integrating perception, environmental constraints and task execution within a probabilistic framework. In: Reasoning with Uncertainty in Robotics, pp. 91–130 (1996)Google Scholar
  14. 14.
    Fogarty, J., Hudson, S.E., Atkeson, C.G., Avrahami, D., Forlizzi, J., Kiesler, S., Lee, J.C., Yang, J.: Predicting human interruptibility with sensors. ACM ToCHI 12(1), 119–146 (2005)CrossRefGoogle Scholar
  15. 15.
    Fong, T.W., Thorpe, C., Baur, C.: Collaboration, dialogue, and human-robot interaction. In: 10th International Symposium of Robotics Research (2001)Google Scholar
  16. 16.
    Fong, T.W., Thorpe, C., Baur, C.: Robot, asker of questions. Robot. Auton. Syst. 42(3–4), 235–243 (2003)zbMATHCrossRefGoogle Scholar
  17. 17.
    Goodrich, M.A., Schultz, A.C.: Human-robot interaction: a survey. Found. Trends Human–Comput. Interact. 1(3), 203–275 (2007)zbMATHCrossRefGoogle Scholar
  18. 18.
    Green, P., Wei-Haas, L.: The rapid development of user interfaces: experience with the wizard of oz method. HFES Annual Meeting 29(5), 470–474 (1985)CrossRefGoogle Scholar
  19. 19.
    Hayes, G., Demiris, J.: A robot controller using learning by imitation. In: 2nd International Symposium on Intelligent Robotic Systems, pp. 198–204 (1994)Google Scholar
  20. 20.
    Hearst, M.A.: Mixed-initiative interaction: trends and controversies. In: IEEE Intelligent Systems, pp. 14–23 (1999)Google Scholar
  21. 21.
    Hüttenrauch, H., Eklundh, S.: To help or not to help a service robot: bystander intervention as a resource in human-robot collaboration. Interact. Stud. 7(3), 455–477 (2006)CrossRefGoogle Scholar
  22. 22.
    Kirby, R., Simmons, R., Forlizzi, J.: Companion: a constraint optimizing method for person-acceptable navigation. In: Ro-Man ’09: Proceedings of International Symposium on Robot and Human Interactive Communication, pp. 607–612 (2009)Google Scholar
  23. 23.
    Lee, M.K., Kielser, S., Forlizzi, J., Srinivasa, S., Rybski, P.: Gracefully mitigating breakdowns in robotic services. In: HRI ’10: 5th ACM/IEEE International Conference on Human Robot Interaction, pp. 203–210 (2010)Google Scholar
  24. 24.
    Lockerd, A., Breazeal, C.: Tutelage and socially guided robot learning. In: IEEE/RSJ International Conference on Intelligent Robots and Systems, pp. 3475–3480 (2004)Google Scholar
  25. 25.
    Michalowski, M., Sabanovic, S., DiSalvo, C., Busquets, D., Hiatt, L., Melchior, N., Simmons, R.: Socially distributed perception: grace plays social tag at AAAI 2005. Auton. Robots 22(4), 385–397 (2007)CrossRefGoogle Scholar
  26. 26.
    Parasuraman, R., Sheridan, T., Wickens, C.: A model for types and levels of human interaction with automation. IEEE Trans. Syst. Man Cybern. 30(3), 286–297 (2000)CrossRefGoogle Scholar
  27. 27.
    Plutowski, M., White, H.: Selecting concise training sets from clean data. IEEE Trans. Neural Netw. 4(2), 305318 (1993)CrossRefGoogle Scholar
  28. 28.
    Price, R.R.: Accelerating Reinforcement Learning Through Imitation. Ph.D. Thesis, The University of British Columbia (Canada) (2003). Adviser-Boutilier, CraigGoogle Scholar
  29. 29.
    Rosenthal, S., Biswas, J., Veloso, M.: An effective personal mobile robot agent through a symbiotic human–robot interaction. In: AAMAS ’10: 9th International Joint Conference on Autonomous Agents and Multiagent Systems (2010)Google Scholar
  30. 30.
    Rosenthal, S., Dey, A.K., Veloso, M.: How robots’ questions affect the accuracy of the human responses. In: The International Symposium on Robot–Human Interactive Communication, pp. 1137–1142 (2009)Google Scholar
  31. 31.
    Scholtz, J.: Evaluation Methods for Human–System Performance of Intelligent Systems. Tech. Rep. 990, NIST Special Publication (2002)Google Scholar
  32. 32.
    Scollon, C., Kim-Prieto, C., Diener, E.: Experience sampling: promise and pitfalls, strengths and weaknesses. J Happiness Studies 4, 5–34 (2003)CrossRefGoogle Scholar
  33. 33.
    Sellner, B.P., Heger, F., Hiatt, L., Simmons, R., Singh, S.: Coordinated multi-agent teams and sliding autonomy for large-scale assembly. In: Proceedings of the IEEE Special Issue on Multi-Robot Systems, vol. 94(1), pp. 1425–1444 (2006)Google Scholar
  34. 34.
    Shahaf, D., Horvitz, E.: Generalized task markets for human and machine computation. In: AAAI (2010)Google Scholar
  35. 35.
    Shiomi, M., Sakamoto, D., Takayuki, K., Ishi, C.T., Ishiguro, H., Hagita, N.: A semi-autonomous communication robot: a field trial at a train station. In: HRI ’08: 3rd ACM/IEEE International Conference on Human Robot Interaction, pp. 303–310 (2008)Google Scholar
  36. 36.
    Thrun, S., Beetz, M., Bennewitz, M., Burgard, W., Cremers, A., Dellaert, F., Fox, D., Hahnel, D., Rosenberg, C., Roy, N., et al.: Probabilistic algorithms and the interactive museum tour-guide robot Minerva. Int. J. Rob. Res. 19(11), 972–999 (2000)CrossRefGoogle Scholar
  37. 37.
    von Ahn, L., Dabbish, L.: Labeling images with a computer game. ACM conference on human factors in computing systems. In: CHI 2004, pp. 319–326 (2004)Google Scholar
  38. 38.
    von Ahn, L., Maurer, B., McMillen, C., Abraham, D., Blum, M.: RECAPTCHA: human-based character recognition via web security measures. Science, 321(5895), 1465–1468 (2008)MathSciNetzbMATHCrossRefGoogle Scholar
  39. 39.
    Weiss, A., Igelsböck, J., Tscheligi, M., Bauer, A., Kühnlenz, K., Wollherr, D., Buss, M.: Robots asking for directions: the willingness of passers-by to support robots. In: HRI ’10: 5th ACM/IEEE International Conference on Human Robot Interaction, pp. 23–30 (2010)Google Scholar
  40. 40.
    Yanco, H., Drury, J.L., Scholtz, J.: Beyond usability evaluation: analysis of human–robot interaction at a major robotics competition. Hum.-Comput. Interact. 19(1), 117–149 (2004)CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media B.V. 2011

Authors and Affiliations

  • Stephanie Rosenthal
    • 1
    Email author
  • Manuela Veloso
    • 1
  • Anind K. Dey
    • 2
  1. 1.Computer Science DepartmentCarnegie Mellon UniversityPittsburghUSA
  2. 2.Human-Computer Interaction InstituteCarnegie Mellon UniversityPittsburghUSA

Personalised recommendations