Skip to main content

Towards Artificial Action: Teaching by Showing

  • Chapter
Human and Machine Perception 3
  • 91 Accesses

Abstract

This paper describes an approach to using machine vision to provide sensor feedback to robotic manipulators and shows how tasks may be taught, represented and repeated. This work was undertaken in order to increase the flexibility within a plant in which robotic manipulators are used to weld ship parts. This task has several features which are characteristic of a broad range of tasks in flexible manufacturing; the robot is required to accurately position a tool relative to a target structure (the workpiece) which may be inaccurately located with respect to the robot. This requirement imposes the constraint that the robot must be able to sense the structures in its environment in some way and machine vision provides a flexible way to achieve this.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. C. Harris, Geometry from Visual Motion, in A. Blake and A. Yuille eds., Active Vision, MIT Press, chapter 16, pp. 263-284, (1992).

    Google Scholar 

  2. G. Hager, G. Grunwald and K. Toyama, Feature-Based Visual Servoing and its Application to Telerobotics, in V. Graefe ed., Intelligent Robotic Systems, Elsevier, (1995).

    Google Scholar 

  3. D. Terzopoulos and R. Szeliski, Tracking with Kaiman snakes, in A. Blake and A. Yuille eds., Active Vision, MIT Press, chapter 1, pp. 3-20, (1992).

    Google Scholar 

  4. R. Cipolla and A. Blake, Image Divergence and Deformation from Closed Curves, International Journal of Robotics Research, 16(1), pp.77-96, (1997).

    Article  Google Scholar 

  5. D. G. Lowe, Robust model-based motion tracking through the integration of search and estimation, International Journal of Computer Vision, 8(2), pp.113-122, (1992).

    Article  Google Scholar 

  6. P. Wunsch and G. Hirzinger, Real-time visual tracking of 3-Dobjects with dynamic handling of occlusion, in Proceedings of the 1997 International Conference on Robotics and Automation, pp.2868-2873, (1997).

    Google Scholar 

  7. C. Harris, Tracking with rigid models, in A. Blake and A. Yuille eds., Active Vision, MIT Press, chapter 4, pp.59-73, (1992).

    Google Scholar 

  8. M. Isard and A. Blake, CONDENSATION - Conditional Density Propagation for Visual Tracking, International Journal of Computer Vision, 29(1), pp.5-28, (1998).

    Article  Google Scholar 

  9. N. Daucher, M. Dhome, J. T. Lapresté and G. Rives, Modelled object pose estimation and tracking by monocular vision, in Proceedings of the British Machine Vision Conference, pp.249-258, (1993).

    Google Scholar 

  10. A. D. Worrall, G. D. Sullivan, and K. D. Baker, Pose refinement of active models using forces in 3D, in J. Eklundh ed., Proceedings of the Third European Conference on Computer vision (ECCV’94), (2), pp.341-352, May 1994.

    Google Scholar 

  11. E. Marchand, P. Bouthemy, F. Chaumette, and V. Moreau, Robust real-time visual tracking using a 2D-3D model-based approach, in Proceedings of ICCV’99, (1), pp. 262-268, Kerkyra, Greece, 20-27 September 1999.

    Google Scholar 

  12. T. Drummond and R.Cipolla, Application of Lie Algebras to Visual Servoing, International Journal of Computer Vision, 37(1), pp.21-41, (2000).

    Article  MATH  Google Scholar 

  13. M. Armstrong and A. Zisserman, Robust object tracking, in Proceedings of Second Asian Conference on Computer Vision, pp.58-62, (1995).

    Google Scholar 

  14. J. MacCormick and A. Blake, Spatial Dependence in the observation of visual contours, in Proceedings of the Fifth European Conference on Computer vision (ECCV’98), pp. 765-781, (1998).

    Google Scholar 

  15. M. Haag and H-H. Nagel, Tracking of complex driving manoeuvres in traffic image sequences, Image and Vision Computing, (16), pp.517-527, (1998).

    Google Scholar 

  16. S. Hutchinson, G.D. Hager, and P.I. Corke, A Tutorial on Visual Servo Control, IEEE T-Robotics and Automation, 12(5), pp.651-670, (1996).

    Article  Google Scholar 

  17. B. Espiau, F. Chaumette, and P. Rives, A New Approach to Visual Servoing in Robotics, IEEE T-Robotics and Automation, 8(3), pp.313-326, (1992).

    Article  Google Scholar 

  18. A.C. Sanderson, L.E. Weiss, and C.P. Neumann, Dynamic Sensor Based Control of Robots with Visual Feedback, IEEE Journal of Robotics and Automation, (3), pp.404-417, (1987).

    Google Scholar 

  19. R. Basri, E. Rivlin, E. and I. Shimshoni, Visual Homing: Surfing on the Epipoles, in Proceedings of International Conference on Computer Vision (ICCV ’98), pp.863-869, (1998).

    Google Scholar 

  20. W.J. Wilson, C.C. Williams Hulls, and G.S. Bell, Relative End-Effector Control Using Cartesian Position Based Visual Servoing, IEEE T-Robotics and Automation, 12(5), pp.684-696, (1996).

    Article  Google Scholar 

  21. R. Cipolla and A. Blake, The dynamic analysis of apparent contours, in Proceedings of IEEE 3rd International Conference on Computer Vision, pp.616-623, Osaka, December 1990.

    Google Scholar 

  22. M. Paterson and F. Yao, Efficient binary space partitions for hidden surface removal and solid modeling, Discrete and Computational Geometry, 5(5), pp.485-503, (1990).

    MathSciNet  MATH  Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2001 Springer Science+Business Media New York

About this chapter

Cite this chapter

Drummond, T., Cipolla, R. (2001). Towards Artificial Action: Teaching by Showing. In: Cantoni, V., Di Gesù, V., Setti, A., Tegolo, D. (eds) Human and Machine Perception 3. Springer, Boston, MA. https://doi.org/10.1007/978-1-4615-1361-2_21

Download citation

  • DOI: https://doi.org/10.1007/978-1-4615-1361-2_21

  • Publisher Name: Springer, Boston, MA

  • Print ISBN: 978-1-4613-5516-8

  • Online ISBN: 978-1-4615-1361-2

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics