Skip to main content

Advertisement

SpringerLink
Log in

EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces

  • Published:
Autonomous Robots Aims and scope Submit manuscript

Abstract

Assistive mobile robots that autonomously manipulate objects within everyday settings have the potential to improve the lives of the elderly, injured, and disabled. Within this paper, we present the most recent version of the assistive mobile manipulator EL-E with a focus on the subsystem that enables the robot to retrieve objects from and deliver objects to flat surfaces. Once provided with a 3D location via brief illumination with a laser pointer, the robot autonomously approaches the location and then either grasps the nearest object or places an object. We describe our implementation in detail, while highlighting design principles and themes, including the use of specialized behaviors, task-relevant features, and low-dimensional representations.

We also present evaluations of EL-E’s performance relative to common forms of variation. We tested EL-E’s ability to approach and grasp objects from the 25 object categories that were ranked most important for robotic retrieval by motor-impaired patients from the Emory ALS Center. Although reliability varied, EL-E succeeded at least once with objects from 21 out of 25 of these categories. EL-E also approached and grasped a cordless telephone on 12 different surfaces including floors, tables, and counter tops with 100% success. The same test using a vitamin pill (ca. 15 mm × 5 mm × 5 mm) resulted in 58% success.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • Asfour, T., Azad, P., Vahrenkamp, N., Regenstein, K., Bierbaum, A., Welke, K., Schröder, J., & Dillmann, R. (2007). Toward humanoid manipulation in human-centred environments. Robotics and Autonomous Systems.

  • Bluethmann, W., Ambrose, R., Fagg, A., Rosenstein, M., Platt, R., Grupen, R., Brezeal, C., Brooks, A., Lockerd, A., Peters, R., Jenkins, O., Mataric, M., & Bugajska, M. (2004). Building an autonomous humanoid tool user. In International conference on humanoid robots.

  • Brock, O., & Khatib, O. (2002). Elastic strips: A framework for motion generation in human environments. The International Journal of Robotics Research.

  • Brooks, R., Aryananda, L., Edsinger, A., Fitzpatrick, P., Kemp, C., O’Reilly, U. M., Torres-Jara, E., Varshavskaya, P., & Weber, J. (2004). Sensing and manipulating built-for-human environments. International Journal of Humanoid Robotics.

  • Choi, Y. S., Anderson, C. D., Glass, J. D., & Kemp, C. C. (2008). Laser pointers and a touch screen: Intuitive interfaces to an autonomous mobile robot for the motor impaired. In ACM SIGACCESS conference on computers and accessibility.

  • Choi, Y. S., Chen, T., Jain, A., Anderson, C., Glass, J. D., & Kemp, C. C. (2009a). Hand it over or set it down: Object delivery with an assistive mobile manipulator. In Proceedings of the IEEE 18th international symposium on Robot and Human Interactive Communication (RO-MAN) (to appear).

  • Choi, Y. S., Deyle, T., Chen, T., Glass, J. D., & Kemp, C. C. (2009b). Benchmarking assistive mobile manipulation: a list of household objects for robotic retrieval prioritized by people with ALS. In International conference on rehabilitation robotics.

  • Choi, Y. S., Deyle, T., & Kemp, C. C. (2009c). A list of household objects for robotic retrieval prioritized by people with als. Tech. Rep. 0902.2186v1. http://arxiv.org/abs/0902.2186.

  • Ciocarlie, M., Goldfeder, C., & Allen, P. (2007). Dimensionality reduction for hand-independent dexterous robotic grasping. In International conference on intelligent robots and systems (IROS).

  • Connell, J. (1989). A behavior-based arm controller. IEEE Transactions on Robotics and Automation.

  • Cowan, N., & Lee, R. F. J. (2006). Task-level control of a rapid wall following in the American cockroach. Journal of ExperimentalBiology.

  • Dallaway, J., & Jackson, R. (1992). RAID a Vocational robotic workstation. In Proceedings of the 1992 international conference on rehabilitation robotics.

  • Dario, P. (1999). MOVAID: a personal robot in everyday life of disabled and elderly people. Technology and Disability.

  • Dollar, A. M., & Howe, R. D. (2005). Towards grasping in unstructured environments: Grasper compliance and configuration optimization. Advanced Robotics.

  • Dunn, G., & Segen, J. (1988). Automatic discovery of robotic grasp configurations. In 1988 IEEE international conference on robotics and automation.

  • Ernst, H. (1962). MH-1, a computer-operated mechanical hand. PhD thesis, Massachusetts Institute of Technology.

  • Goodenough, J., McGuire, B., & Wallace, R. (1993). Perspectives on animal behavior. New York: Wiley.

    Google Scholar 

  • Graf, B., Hans, M., & Schraft, R. D. (2004). Care-O-bot II - Development of a next generation robotic home assistant. Autonomous Robots.

  • Grupen, R., & Brock, O. (2004). White paper: Integrating manual dexterity with mobility for human-scale service robotics - the case for concentrated research into science and technology supporting next-generation robotic assistants.

  • Hernandez, M., Echeverry, S., Guerra, R., Kim, D., Hamilton, C., & Behal, A. (2008). User-guided vision-based control of a wheelchair mounted assistive robotic arm in an unstructured environment. In Proc. of RESNA.

  • Hillenbrand, U., Ott, C., Brunner, B., Borst, C., & Hirzinger, G. (2004). Towards service robots for the human environment: the Robutler. In Proceedings mechatronics & robotics (MechRob).

  • Inamura, T., Okada, K., Tokutsu, S., Hatao, N., Inaba, M., & Inoue, H. (2008). HRP-2W: A humanoid platform for research on support behavior in daily life environments. Robotics and Autonomous Systems.

  • Jain, A., & Kemp, C. C. (2008). Behaviors for robust door opening and doorway traversal with a force-sensing mobile manipulator. In RSS workshop on robot manipulation: intelligence in human environments.

  • Jenkins, O. C. (2008). Sparse control for high-dof assistive robots. Intelligent Service Robotics, 1(2), 123–134.

    Article  Google Scholar 

  • Jones, E., Oliphant, T., Peterson, P. et al. (2001). SciPy: Open source scientific tools for Python. http://www.scipy.org/.

  • Kamon, I., Flash, T., & Edelman, S. (1996). Learning to grasp using visual information. In IEEE international conference on robotics and automation.

  • Katz, D., Kenney, J., & Brock, O. (2008) How can robots succeed in unstructured environments? In RSS workshop on robot manipulation: intelligence in human environments.

  • Kemp, C. C., Edsinger, A., & Torres-Jara, E. (2007). Challenges for robot manipulation in human environments. IEEE Robotics & Automation Magazine.

  • Kemp, C. C., Anderson, C. D., Nguyen, H., Trevor, A. J., & Xu, Z. (2008). A point-and-click interface for the real world: Laser designation of objects for mobile manipulation. In International conference on human-robot interaction.

  • Khatib, O., Yokoi, K., Brock, O., Chang, K., & Casal, A. (1999). Robots in human environments: Basic autonomous capabilities. International Journal of Robotics Research.

  • Kragić, D., Petersson, L., & Christensen, H. (2002). Visually guided manipulation tasks. Robotics and Autonomous Systems.

  • Kwee, H., Duimel, J., Smits, J., de Moed, A., & van Woerden, J. (1989). The MANUS Wheelchair-Borne manipulator: System Review and First Results. In Proc. IARP workshop on domestic and medical & healthcare robotics, Newcastle.

  • MacKenzie, D., & Arkin, R. (1996). Behavior-based mobile manipulation for drum sampling. In IEEE international conference on robotics and automation.

  • Meger, D., Forssen, P., Lai, K., Helmer, S., McCann, S., Southey, T., Baumann, M., Little, J., Lowe, D., & Dow, B. (2008). Curious George: An attentive semantic robot. Robotics and Autonomous Systems.

  • Natale, L., & Torres-Jara, E. (2006). A sensitive approach to grasping. In Proceedings of the sixth international workshop on epigenetic robotics.

  • Nguyen, H., Anderson, C. D., Trevor, A. J., Jain, A., Xu, Z., & Kemp, C. C. (2008a). EL-E: an assistive robot that fetches objects from flat surfaces. In Robotic helpers, int. conf. on human-robot interaction.

  • Nguyen, H., Jain, A., Anderson, C. D., & Kemp, C. C. (2008b). A clickable world: Behavior selection through pointing and context for mobile manipulation. In IEEE/RSJ international conference on intelligent robots and systems (IROS).

  • Okada, K., Ogura, T., Haneda, A., Fujimoto, J., Gravot, F., & Inaba, M. (2005). Humanoid motion generation system on HRP2-JSK for daily life environment. In IEEE international conference mechatronics and automation.

  • Open Source Computer Vision Library: Reference Manual (2001). Open source computer vision library: Reference manual. http://sourceforge.net/projects/opencvlibrary.

  • Platt, R. (2006). Learning and generalizing control-based grasping and manipulation skills. PhD thesis, University Massachusetts.

  • Platt, R., Fagg, A., & Grupen, R. (2005). Re-using schematic grasping policies. In IEEE international conference on humanoid robots.

  • Platt, R., Burridge, R., Diftler, M., Graf, J., Goza, M., Huber, E., & Brock, O. (2006). Humanoid mobile manipulation using controller refinement. In IEEE international conference on humanoid robots.

  • PR2 Technical Specs (2008). www.willowgarage.com/pages/robots/technical-specs.

  • Quigley, M., Gerkey, B., Conley, K., Faust, J., Foote, T., Leibs, J., Eric Berger, R. W., & Ng, A. (2009). ROS: an open-source Robot Operating System. In Open-source software workshop of the international conference on robotics and automation (ICRA).

  • Remazeilles, A., Leroux, C., & Chalubert, G. (2008). SAM: A robotic butler for handicapped people. In IEEE international symposium on robot and human interactive communication (RO-MAN).

  • Rusu, R., Marton, Z., Blodow, N., Dolha, M., & Beetz, M. (2008). Towards 3D Point cloud based object maps for household environments. Robotics and Autonomous Systems.

  • Sanz, P., Del Pobil, A., Iñesta, J., & Recatala, G. (1998). Vision-guided grasping of unknown objects for service robots. In IEEE international conference on robotics and automation.

  • Saxena, A., Driemeyer, J., & Ng, A. (2008a). Robotic grasping of novel objects using vision. The International Journal of Robotics Research.

  • Saxena, A., Wong, L., & Ng, A. (2008b). Learning grasp strategies with partial shape information. In AAAI.

  • Srinivasa, S., Ferguson, D., Weghe, M., Diankov, R., Berenson, D., Helfrich, C., & Strasdat, H. (2008). The robotic busboy: steps towards developing a mobile robotic home assistant. In International conference on intelligent autonomous systems.

  • Stanger, C. A., Anglin, C., Harwin, W. S., & Romilly, D. P. (1994). Devices for assisting manipulation: a summary of user task priorities. IEEE Transactions on Rehabilitation Engineering.

  • Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G. et al. (2006). Stanley: The robot that won the DARPA grand challenge. Journal of Field Robotics.

  • Ting, L. (2007). Dimensional reduction in sensorimotor systems: a framework for understanding muscle coordination of posture. In Computational neuroscience: theoretical insights into brain function.

  • Topping, M., & Smith, J. (1998). The development of Handy 1, a rehabilitation robotic system to assist the severely disabled. Industrial Robot.

  • Tsui, K., Yanco, H., Kontak, D., & Beliveau, L. (2008). Development and evaluation of a flexible interface for a wheelchair mounted robotic arm. In Proceedings of the 3rd international conference on human robot interaction.

  • Urmson, C., Anhalt, J., Bagnell, D., Baker, C., Bittner, R., Clark, M., Dolan, J., Duggins, D., Galatali, T., Geyer, C. et al. (2008). Autonomous driving in urban environments: Boss and the Urban Challenge. Journal of Field Robotics.

  • Van der Loos, H. (1995). VA/Stanford rehabilitation robotics research and development program: lessons learned in the application of robotics technology to the field of rehabilitation. IEEE Transactions on Rehabilitation Engineering, 3(1), 46–55.

    Article  MathSciNet  Google Scholar 

  • Van der Loos, M., & Reinkensmeyer, D. J. (2008). Rehabilitation and health care robotics. In Handbook of Robotics (p. 53). Berlin: Springer.

    Google Scholar 

  • Van der Loos, H., Wagner, J., Smaby, N., Chang, K., Madrigal, O., Leifer, L., & Khatib, O. (1999). ProVAR assistive robot system architecture. In IEEE international conference on robotics and automation.

  • Waarsing, B., Nuttin, M., & Brussel, H. V. (2001). Introducing robots into a human-centred environment—the behaviour-based approach. In International conference on CLAWAR.

  • Zllner, R., Asfour, T., & Dillmann, R. (2004). Programming by demonstration: dual-arm manipulation tasks for humanoid robots. In International conference on intelligent robots and systems.

Download references

Author information

Authors and Affiliations

  1. Georgia Institute of Technology, Atlanta, GA, USA

    Advait Jain & Charles C. Kemp

Authors
  1. Advait Jain
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Charles C. Kemp
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Advait Jain.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Jain, A., Kemp, C.C. EL-E: an assistive mobile manipulator that autonomously fetches objects from flat surfaces. Auton Robot 28, 45–64 (2010). https://doi.org/10.1007/s10514-009-9148-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10514-009-9148-5

Keywords

Search

Navigation