Skip to main content

3D Digitization of a Hand-Held Object with a Wearable Vision Sensor

  • Conference paper
Computer Vision in Human-Computer Interaction (CVHCI 2004)

Part of the book series: Lecture Notes in Computer Science ((LNCS,volume 3058))

Abstract

It is a common human behavior to hold a small object of interest and to manipulate it for observation. A computer system, symbiotic with a human, should recognize the object and the intention of the human while the object is manipulated. To realize autonomous recognition of a hand-held object as well as to study human behavior of manipulation and observation, we have developed a wearable vision sensor, which has similar sight to a human who wears the sensor. In this paper, we show the following results obtained with the wearable vision sensor. First, we analyzed human manipulation for observation and related it with acquirable visual information. Second, we proposed dynamic space carving for 3D shape extraction of a static object occluded by a dynamic object moving around the static object. Finally, we showed that texture and silhouette information can be integrated in vacant space and the integration improves the efficiency of dynamic space carving.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. Napier, I.: The prehensile movements of the human hand. J. one and Joint Surgery 38B(4), 902–913 (1956)

    Google Scholar 

  2. Cutkosky, M.R.: On Grasp Choice, Grasp Models, and the Design of Hands for Manufacturing Tasks. IEEE Trans. Robot. Automat. 5(3), 269–279 (1989)

    Article  MathSciNet  Google Scholar 

  3. Martin, W.N., Aggarwal, J.K.: Volumetric description of objects from multiple views. IEEE Transactions on Pattern Analysis and Machine Intelligence 5(2), 150–158 (1987)

    Article  Google Scholar 

  4. Tomasi, C., Kanade, T.: Shape and motion from image streams under orthography: a factorization method. Int’l Journal of Computer Vision 9(2), 137–154 (1992)

    Article  Google Scholar 

  5. Baker, H.: Three-dimensional modelling. In: Fifth International Joint Conference on Artificial Intelligence, pp. 649–655 (1977)

    Google Scholar 

  6. Kutulakos, K.N.: S, M, Seitz.: A theory of shape by space carving. In: IEEE International Conference on Computer VisionC, pp. 307–314 (1999)

    Google Scholar 

  7. Hoppe, H., DeRose, C., Duchamp, C., McDonald, C., Stuetzle, C.: Surface reconstruction from unorganized points. Computer Graphics (SIGGRAPH 1992 Proceedings) 26, 71–78 (1992)

    Article  Google Scholar 

  8. Laurentini, A.: How far 3d shapes can be understood from 2d silhouettes. IEEE Transactions on Pattern Analysis and Machine Intelligence 17(2), 188–195 (1995)

    Article  Google Scholar 

  9. Harris, C.J., Stephens, M.: A combined corner and edge detector. In: Proc. 4th Alvey Vision Conf. Manchester, pp. 147–151 (1988)

    Google Scholar 

  10. Besl, P.J., McKey, C.D.: A method for registration of 3-D shapes. IEEE Trans. Patt. Anal. Machine Intell. 14(2), 239–256 (1992)

    Article  Google Scholar 

  11. Szymon, Rusinkiewicz.COlaf, Hall-Holt.C Marc, Levoy.: Real-Time 3D Model Acquisition. Transactions on Graphics (SIGGRAPH proceedings), 438–446 (2002)

    Google Scholar 

  12. Barnard, S.T.: Stochastic approach to stereo vision. International Journal of Computer Vision, 17–32 (1989)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2004 Springer-Verlag Berlin Heidelberg

About this paper

Cite this paper

Tsukizawa, S., Sumi, K., Matsuyama, T. (2004). 3D Digitization of a Hand-Held Object with a Wearable Vision Sensor. In: Sebe, N., Lew, M., Huang, T.S. (eds) Computer Vision in Human-Computer Interaction. CVHCI 2004. Lecture Notes in Computer Science, vol 3058. Springer, Berlin, Heidelberg. https://doi.org/10.1007/978-3-540-24837-8_13

Download citation

  • DOI: https://doi.org/10.1007/978-3-540-24837-8_13

  • Publisher Name: Springer, Berlin, Heidelberg

  • Print ISBN: 978-3-540-22012-1

  • Online ISBN: 978-3-540-24837-8

  • eBook Packages: Springer Book Archive

Publish with us

Policies and ethics