Skip to main content
SpringerLink
Log in
Book cover

Assistive Technology and Artificial Intelligence pp 194–210Cite as

Speech and gesture mediated intelligent teleoperation

  • Chapter
  • First Online:

Part of the book series: Lecture Notes in Computer Science ((LNAI,volume 1458))

Abstract

The Multimodal User Supervised Interface and Intelligent Control (MUSIIC) project addresses the issue of telemanipulation of everyday objects in an unstructured environment. Telerobot control by individuals with physical limitations pose a set of challenging problems that need to be resolved. MUSIIC addresses these problems by integrating a speech and gesture driven human-machine interface with a knowledge driven planner and a 3-D vision system. The resultant system offers the opportunity to study unstructured world telemanipulation by people with physical disabilities and provides means for generalizing to effective manipulation techniques for real-world unstructured tasks in domains where direct physical control may be limited due to time delay, lack of sensation, and coordination.

This is a preview of subscription content, log in via an institution.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. A. Andreadis and P. Tsalides. Coloured object recognition using invariant spectral features. Intelligent and Robotic Systems, 13:93–106, 1995.

    Article  Google Scholar 

  2. D. C. Bacon, T. Rahman, and W. S. Harwin, editors. Fourth International Confer-ence on Rehabilation Robotics, AI DuPont Institute, Wilmington, Delaware, USA, 1994. Applied Science and Engineering Laboratories.

    Google Scholar 

  3. A. Batavia and G. Hammer. Consumer criteria for evaluating assistive devices: Implications for technology transfer. In 12th annual Conference on Rehabilitation Technology, pages 194–195, Washington DC, 1989. RESNA Press.

    Google Scholar 

  4. Bath Institute of Medical Engineering. Fifth International Conference on Rehabilation Robotics, Bath University, Bath, UK, 1997.

    Google Scholar 

  5. S. Chai and W Tsai. Line segment matching for 3d /computer vision using a new iteration scheme. Machine Vision and Applications, 6:191–205, 1993.

    Article  Google Scholar 

  6. C. Crangle, L. Liang, P. Suppes, and M. Barlow. Using English to instruct a robotic aid: An experiment in an office-like environment. In Proc. of the International Conference of the Association for the Advancement of Rehabilitation Technology (ICAART-88), pages 466–467, Montreal, Canada, 1988.

    Google Scholar 

  7. C. Crangle and P. Suppes. Language and Learning for Robots. CSLI Publications, Stanford, CA, 1994.

    Google Scholar 

  8. J. Cruz, G. Pajares, J. Aranda, and J. Vindel. Stereo matching technique based on the perceptron criterion function. Pattern Recognition Letters, 16(9):933–944,1995.

    Article  Google Scholar 

  9. R. A. Foulds, editor. Interactive Robotics Aids-One Option for Independent Living: an International Perspective. Monograph 37. World Rehabilitation Fund, 1986.

    Google Scholar 

  10. R. A. Foulds. Multimodal user direction of a rehabilitation robot. In Rehabilitation Research Center on Robotics to Enhance the Functioning of Individuals with Disablities, volume 2, pages 41–61. Center for Applied Science and Engineering, University of Delaware, 1993.

    Google Scholar 

  11. C. Fu. An independent vocational workstation for a quadriplegic. In R. Foulds, editor, Interactive Robotics Aids-One Option for Independent Living: an International Perspective, Monograph 37, page 42. World Rehabilitation Fund, 1986.

    Google Scholar 

  12. M. Gilbert and R. Foulds. Robotics at the Tufts New England Medical Center. In 10th Annual Conference on Rehabilitation Engineering, pages 778–780, San Jose, California, 1987. RESNA Press.

    Google Scholar 

  13. M. Gilbert and J Trefsager, editors. Proceedings of the 1990 International Conference on Rehabilitation Robotics, Wilmington, Delaware, 1990. Applied Science and Engineering Laboratories.

    Google Scholar 

  14. J. Hammel, M. Van der Loos, and I. Perkash. Evaluation of DeVAR-IV with a quadriplegic employee. Technical report, Rehabilitation Research and Development Center, Palo Alto, California, 1991.

    Google Scholar 

  15. R. Haralich. Computer and Robot Vision. Addison-Wesley, 1993.

    Google Scholar 

  16. W. Harwin, A. Ginige, and R. Jackson. A potential application in early education and a possible role for a vision system in a workstation based robotic aid for physically disabled persons. In R Foulds, editor, Interactive Robotic Aids-One Option for Independent Living: An International Perspective, Monograph 37, pages 18–23. World Rehabilitation Fund, 1986.

    Google Scholar 

  17. Z. Kazi. Integrating Human-Computer Interaction with Planning for a Telerobotic System. PhD thesis, University of Delaware, Department of Computer and Information Sciences, 1997.

    Google Scholar 

  18. H. Kwee, M. Thonninsen, G. Cremers, J. Duimel, and R. Westgeest. Configuring the Manus system. In RESNA International Conference, 1992, pages 584–587,Toronto, Canada, 1992. RESNA Press.

    Google Scholar 

  19. J. Li and T. Schenk. Stereo image matching with sub-pixel accuracy. Technical paper, ACSM ASPRS, 1991.

    Google Scholar 

  20. D. McNeill. Hand and Mind: What Gestures Reveal about Thought. The University of Chicago Press, 1982.

    Google Scholar 

  21. S. Michalowski, C. Crangle, and L. Liang. Experimental study of a natural language interface to an instructable robotic aid for the severely disabled. In 10th Annual Conference on Rehabilitation Technology, pages 466–467, Washington, DC, 1987.RESNA Press.

    Google Scholar 

  22. M. Okutomi and T. Kanade. A stereo matching algorithm: an adaptive window based statistical model. Systems and Computers in Japan, 23(8):26–35, 1992.

    Google Scholar 

  23. B. Ross. A practical stereo vision system. In IEEE Computer Vision and Pattern Recognition, pages 148–153, 1993.

    Google Scholar 

  24. E. D. Sacerdoti. The non-linear nature of plans. In International Joint Conference on Artificial Intelligence, pages 1123–1145, Tbilisi, USSR, 1975.

    Google Scholar 

  25. E. D. Sacerdoti. A Structure for Plans and Behaviour. American Elsevier, New York, 1977.

    Google Scholar 

  26. W. Seamone and G. Schmeisser. Evaluation of the APL/JHU robotic arm workstation. In R. Foulds, editor, Interactive Robotics Aids-One Option for Independent Living: an International Perspective, Monograph 37, page 51. World Rehabilitation Fund, 1986.

    Google Scholar 

  27. C. A. Stanger, C. Anglin, W. S. Harwin, and D. P. Romilly. Devices for assisting manipulation: A summary of user task priorities. IEEE Transactions on Rehabilitation Engineering, 2(4):256–265, 1994.

    Article  Google Scholar 

  28. C. Stewart and J. MacCrone. Experimental analysis of a number of stereo matching components using lma. In International Conference on Pattern Recognition, volume 1, pages 254–258, 1990.

    Google Scholar 

  29. S. Tominaga. Colour classification method for color images using uniform colour space. In IEEE International Conference on Pattern Recognition, pages 803–807, 1990.

    Google Scholar 

  30. M. Van der Loos, J. Hammel, D. Lees, D. Chang, I. Perkash, and L. Leifer. Voice controlled robot systems as a quadriplegic programmer's assistant. In 13th Annual RESNA Conference, pages 327–328, Washington DC, June 1990. RESNA Press.

    Google Scholar 

  31. T. Vlachos and A. Constantinides. Graph theoretical approach to colour picture segmentation. In IEEE Part 1, pages 36–45, 1993.

    Google Scholar 

  32. L. Wolff and E. Angelopoulou. Three-dimensional stereo by photometric ratios.Journal of the Optical Society of America: Optics and Image Science and Vision, 11(11):3069–3078, November 1994.

    Article  Google Scholar 

  33. A. Zeelenberg. Domestic use of a training robot-manipulator by children with muscular dystrophy. In R. Foulds, editor, Interactive Robotic Aids-One Option for Independent Living: An International Perspective, Monograph 37, pages 29–33. World Rehabilitation Fund, 1986.

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Applied Science and Engineering Laboratories, University of Delaware/DuPont Hospital for Children, 1600 Rockland Rd., P.O. Box 269, 19803, Wilmington, DE, USA

    Zunaid Kazi, Shoupu Chen, Matthew Beitler, Daniel Chester & Richard Foulds

Authors
  1. Zunaid Kazi
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Shoupu Chen
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Matthew Beitler
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Daniel Chester
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Richard Foulds
    View author publications

    You can also search for this author in PubMed Google Scholar

Editor information

Vibhu O. Mittal Holly A. Yanco John Aronis Richard Simpson

Rights and permissions

Reprints and permissions

Copyright information

© 1998 Springer-Verlag Berlin Heidelberg

About this chapter

Cite this chapter

Kazi, Z., Chen, S., Beitler, M., Chester, D., Foulds, R. (1998). Speech and gesture mediated intelligent teleoperation. In: Mittal, V.O., Yanco, H.A., Aronis, J., Simpson, R. (eds) Assistive Technology and Artificial Intelligence. Lecture Notes in Computer Science, vol 1458. Springer, Berlin, Heidelberg. https://doi.org/10.1007/BFb0055979

Download citation

  • DOI: https://doi.org/10.1007/BFb0055979

  • Published:

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-64790-4

  • Online ISBN: 978-3-540-68678-1

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics

Search

Navigation