Skip to main content
SpringerLink
Log in

Using the Whole Hand in the Human-Computer Interface

  • Conference paper
Communicating with Virtual Worlds

Part of the book series: CGS CG International Series ((3056))

  • 152 Accesses

Abstract

Sensored gloves allow the user to reach into a virtual environment and manipulate virtual objects as if they were real. However, the use of gloves in VR has not progressed far beyond “point, reach, and grab” interaction, addressing the need for natural user interfaces, but not taking advantage of the full power of using the hand directly in the human-computer interface. This article discusses this problem and presents whole-hand input as a distinct study, independent of specific application or interface device. It identifies key components of whole-hand input, outlines potential application areas, discusses the important issues of whole-hand input, and suggests future research for developing the technology.

This work was supported in part by NHK (Japan Broadcasting Company), and Defense Advanced Research Projects Agency-RADC Contract #F30602-89-C-0022

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  • Badler, N. I. (1986), “Animating human figures: Perspectives and directions,” Proceedings Graphics Interface’86/Vision Interface’86, Vancouver, B.C., pp. 115–120.

    Google Scholar 

  • Barr, A. and Feigenbaum, E. A., eds. (1982), The handbook of artificial intelligence (Vol. 1), Addison-Wesley.

    MATH  Google Scholar 

  • Becker, J. C. and Thakor, N. V. (1988), “A study of motion of human fingers with application to anthropomorphic designs,” IEEE Transactions on Biomedical Engineering, 35(2), pp. 110–117.

    Article  Google Scholar 

  • Brooks, F. P.J., Ouh-Young, M., Batter, J. J., and Kilpatrick, P. J. (1990), “Project GROPE— Haptic displays for scientific visualization,” Computer Graphics, 24(4), pp. 177–185, Proc. ACM SIGGRAPH’90.

    Article  Google Scholar 

  • Buxton, W. (1990), “The pragmatics of haptic input,” ACM CHP’90 Tutorial Notes #26, Seattle, WA.

    Google Scholar 

  • Buxton, W. and Myers, B. A. (1986), “A study of two-handed input,” Proceedings of CHF’86, pp. 321–326.

    Google Scholar 

  • Calvert, T. W. and Chapman, J. (1978), “Notation of movement with computer assistance,” Proceedings of the ACM Annual Conference, pp. 731–736.

    Google Scholar 

  • Card, S. K., Mackinlay, J. D., and Robertson, G. G. (1990), “The design space of input devices,” Proceedings of CHP’90, Seattle, WA, pp. 117–124.

    Google Scholar 

  • Chao, E. Y. S., An, K-N., III, W. P. C, and Linscheid, R. L. (1989), Biomechanics of the hand: A basic research study, World Scientific Publishing Co., Inc., Teaneck, NJ.

    Book  Google Scholar 

  • Clark, F. J. and Horch, K. W. (1986), “Kinesthesia,” in Handbook of perception and human performance, v. 1. Sensory processes and perception, Boff, K. R., Kaufman, L., and Thomas, J. P. (eds.), Wiley, New York, pp. 13.1–13.62.

    Google Scholar 

  • Cohen, E., Namir, L., and Schlesinger, I. M. (1977), A new dictionary of sign language: employing the Eshkol-Wachmann movement notation system, Mouton, The Hague.

    Google Scholar 

  • Cole, K. J. and Abbs, J. H. (1986), “Coordination of three-joint digit movements for rapid finger-thumb grasp,” Journal of Neurophysiology, 55(6), pp. 1407–1423.

    Google Scholar 

  • Cutkosky, M. R. and Wright, P. K. (1986), “Modeling manufacturing grips and correlations with the design of robotic hands,” Proc. IEEE International Conference on Robotics and Automation, 3, pp. 1533–1539.

    Google Scholar 

  • Delp, D. and Delp, S. (1989), “Understanding human movement with computer graphics,” SOMA Engineering for the Human Body, 3(3), pp. 17–25.

    Google Scholar 

  • Durlach, N. I. (1989), Research on reduced-capability human hands, M.I.T. Research Laboratory of Electronics, Proposal to Office of Navel Research, Cambridge, MA.

    Google Scholar 

  • Ervin, C. A. (1988), “A standardized test battery,” in Performance of protective clothing: Second symposium, ASTM STP 1989, Mansdorf, S. Z., Sager, R., and Nielsen, A. P. (eds.), American Society for Testing and Materials, Philadelphia, pp. 50–56.

    Chapter  Google Scholar 

  • Evarts, E. V. (1974), “Sensorimotor cortex activity associated with movements triggered by visual as compared to somesthetic inputs,” in The neurosciences: Third study program, Massachusetts Institute of Technology, Cambridge, MA, pp. 327–337.

    Google Scholar 

  • Fels, S. S. (1990), Building adaptive interfaces with neural networks: The glove-talk pilot study, Department of Computer Science, University of Toronto, Technical Report CRG-TR-90–1, Toronto, Canada.

    Google Scholar 

  • Gaver, W. (1986), “Auditory icons: Using sound in computer interfaces,” Human Computer Interactions, 2, pp. 167–177.

    Article  Google Scholar 

  • Ginsberg, C. M. and Maxwell, D. (1983), “Graphical marionette,” Proc. ACM SIGGRAPH/SIGART Workshop on Motion, Toronto, Canada, pp. 172–179.

    Google Scholar 

  • Goldstein, E. B. (1989), Sensation and perception (3rd ed.), Wadsworth Publishing, Belmont, CA. Grimes,

    Google Scholar 

  • G. J. (1983), Digital data entry glove interface device, Bell Telephone Laboratories, United States Patent 4,414,537, Murray Hill, NJ.

    Google Scholar 

  • Hunter, J. M., Schneider, L. H., Mackin, E. J., and Callahan, A. D., eds. (1984), Rehabilitation of the hand (2nd ed.), CV Mosby, St. Louis.

    Google Scholar 

  • Jones, D. (1989a), “The sonic interface,” in Work with computers: Organizational, management, stress and health aspects, Smith, M. J. and Salvendy, G. (eds.), Elsevier Science Publishers B.V., Amsterdam, pp. 383–388, Proceedings of HCl’89, Boston.

    Google Scholar 

  • Jones, L. A. (1989b), “The assessment of hand function: a critical review of techniques,” Journal of Hand Surgery, 14A(2, Pt. 1), pp. 221–228.

    Google Scholar 

  • Kangari, R. and Halpin, D.W. (1989), “Potential robotics utilization in construction,” Journal of Construction Engineering and Management, 115(1), pp. 126–143.

    Article  Google Scholar 

  • Kramer, J. and Leifer, L. (1989), The Talking Glove: An expressive and receptive “verbal” communication aid for the deaf, deaf-blind, and nonvocal, Stanford University, Department of Electrical Engineering.

    Google Scholar 

  • Laban, R. (1975), Laban’s principles of dance and movement notation (2nd ed.), Plays, Inc., Boston, Published in 1956 and 1970 under the title: Principles of dance and movement notation.

    Google Scholar 

  • Levit, C. and Bryson, S. (1991), “A virtual environment for exploration of three-dimensional flowfields,” SPIE/IS&T Symposium on Electronic Imaging Science and Technology: Conf. 1457 — Stereoscopic Displays and Applications II, San Jose, CA.

    Google Scholar 

  • Machover, T. (1990), Flora, Bridge Records, compact disc recording.

    Google Scholar 

  • McCormick, B. H., DeFanti, T. A., and Brown, M. D., eds. (1987), “Visualization in scientific computing,” Computer Graphics, 21(6),

    Google Scholar 

  • McKinnon, G. M., King, M. L., and Runnings, D. (1987), “Multi-axis control of telemanipulators,” Proc. First European In-Orbit Operations Technology Symposium, Darmstaadt, W. Germany, pp. 487–491.

    Google Scholar 

  • Mesplay, K. P. and Childress, D. S. (1988), “Capacity of the human operator to move joints as control inputs to prostheses,” Modeling and Control Issues in Biomechanical Systems, Chicago, IL, pp. 17–25, Presented at the Annual Meeting of the American Society of Mechanical Engineers.

    Google Scholar 

  • Minsky, M., Ouh-young, M., Steele, O., Brooks, Jr., F. P., and Behensky, M. (1990), “Feeling and seeing: Issues in force display,” Computer Graphics, 24(2), pp. 235–243, Proc. 1990 Symposium on Interactive 3D Graphics, Snowbird, UT.

    Article  Google Scholar 

  • Noll, A. M. (1972), “Man-machine tactile communication,” SID Journal (Society for Information Display), 1(2),.

    Google Scholar 

  • Ouh-young, M. (1990), Force display in molecular docking, Department of Computer Science, Unpublished doctoral dissertation (TR90–004), University of North Carolina at Chapel Hill.

    Google Scholar 

  • Patrick, N. J. M., Sheridan, T., Massiminio, M., and Marcus, B. A. (1990), “Design and testing of a non-reactive, fingertip, tactile display for interaction with remote environments,” Proceedings of the SPIE Symposium on Advances in Intelligent Systems, Boston, MA.

    Google Scholar 

  • Pieper, S. D. (1992), CAPS: Computer-aided plastic surgery, Media Lab, Massachusetts Institute of Technology, PhD Thesis, Cambridge, MA.

    Google Scholar 

  • Poizner, H., Klima, E. S., Bellugi, U., and Livingston, R. B. (1983), “Motion analysis of grammatical processes in visual-gestural language,” Proc. ACM SIGGRAPH/SIGART Workshop on Motion, Toronto, Canada, pp. 148–171.

    Google Scholar 

  • Robertson, B. (1992), “Moving Pictures,” Computer Graphics World, 15(10), pp. 38–44.

    Google Scholar 

  • Robinette, K. M., Ervin, C., and Zehner, G. (1987), Development of a standard dexterity test battery, Armstrong Aerospace Medical Research Lab, AAMRL-TR-87–034, Wright-Patterson AFB, OH, (NTIS AD-A188314).

    Google Scholar 

  • Robotics World (1989), “Teleoperated manipulators aid underwater vehicle operation,” 7(1), pp. 21–22.

    Google Scholar 

  • Rogowitz, B. E. (1983), “The human visual system: A guide for the display technologist,” Proceedings of the SID, 24(3), pp. 235–252.

    Google Scholar 

  • Rolfe, J. M. and Staples, K. J., eds. (1986), Flight simulation, Cambridge University Press, Cambridge, UK.

    Google Scholar 

  • Rubine, D. (1991), “Specifying gestures by example,” Computer Graphics, 25(4), pp. 329–337, Proceedings ACM SIGGRAPH’91.

    Article  Google Scholar 

  • Sheridan, T. B. (1989), “Merging mind and machine,” Technology Review, pp. 33–40.

    Google Scholar 

  • Singh, B., Beatty, J. C., Booth, K. S., and Ryman, R. (1982), A Graphics Editor for Benesh Movement Notation, University of Waterloo Computer Science Dept., Tech. Report CS-82–41, Waterloo, Ontario, Canada.

    Google Scholar 

  • Stokoe, W. C.J. (1960), Sign language structure: An outline of the visual communication systems of the American deaf, Studies in Linguistics: Occasional Papers, 8, University of Buffalo, Department of Anthropology and Linguistics, Buffalo, NY, (Reissued Washington, D.C., Gallaudet College Press).

    Google Scholar 

  • Sturman, D., Zeltzer, D., and Pieper, S. (1989), “Hands-on interaction with virtual environments,” Proc. VIST’89: ACM SIGGRAPH/SIGCHI Symposium on User Interface Software and Technology, Williamsburg, VA, pp. 19–24.

    Google Scholar 

  • Sturman, D. J. (1992), Whole-hand input, Media Lab, Massachusetts Institute of Technology, Doctoral dissertation, Cambridge, MA.

    Google Scholar 

  • Takahashi, T. and Kishino, F. (1990), Hand gesture coding based on experiments using a hand gesture interface device, ATR Communication Systems Research Laboratories, Technical Report, Kyoto, Japan.

    Google Scholar 

  • Trubitt, D. (1990), “Into new worlds; virtual reality and the electronic musician,” Electronic Musician, pp. 31–40.

    Google Scholar 

  • Ware, C. and Osborne, S. (1990), “Exploration and virtual camera control in virtual three dimensional environments,” Computer Graphics, 24(2), pp. 175–183, Proceedings 1990 Symposium on Interactive Graphics.

    Article  Google Scholar 

  • Zimmerman, T. G., Lanier, J., Blanchard, C., Bryson, S., and Harvill, Y. (1987), “A hand gesture interface device,” Proc. Human Factors in Computing Systems and Graphics Interface (CHI+GI’87), Toronto, Canada, pp. 189–192.

    Google Scholar 

  • Zimmerman, T. G. and Lanier, J. Z. (1991), Computer Data Entry and Manipulation Apparatus and Method, VPL Research, Inc., United States Patent 4,988,981, Redwood City, CA.

    Google Scholar 

Download references

Author information

Author notes

  1. David J. Sturman

    Present address: MEDIALAB, 104 av. du Président Kennedy, 75016, Paris, France

Authors and Affiliations

    Authors
    1. David J. Sturman
      View author publications

      You can also search for this author in PubMed Google Scholar

    Editor information

    Editors and Affiliations

    1. MIRALab, Centre Universitaire d’Informatique, University of Geneva, 24 rue du Général-Dufour, CH-1211, Geneva 4, Switzerland

      Nadia Magnenat Thalmann

    2. Computer Graphics Lab., Swiss Federal Institute of Technology, CH-1015, Lausanne, Switzerland

      Daniel Thalmann

    Rights and permissions

    Reprints and permissions

    Copyright information

    © 1993 Springer-Verlag Tokyo

    About this paper

    Cite this paper

    Sturman, D.J. (1993). Using the Whole Hand in the Human-Computer Interface. In: Thalmann, N.M., Thalmann, D. (eds) Communicating with Virtual Worlds. CGS CG International Series. Springer, Tokyo. https://doi.org/10.1007/978-4-431-68456-5_2

    Download citation

    • DOI: https://doi.org/10.1007/978-4-431-68456-5_2

    • Publisher Name: Springer, Tokyo

    • Print ISBN: 978-4-431-68458-9

    • Online ISBN: 978-4-431-68456-5

    • eBook Packages: Springer Book Archive

    Publish with us

    Policies and ethics

    Search

    Navigation