Virtual Reality and Neural Networks

  • Nunzio Alberto Borghese
Conference paper
Part of the Perspectives in Neural Computing book series (PERSPECT.NEURAL)


Different terms have been applied to what is commonly called, with an oximoric, “Virtual Reality” (VR) or “Artificial Reality” to indicate a world which lies in the computer. At the actual state of the art, it suggests much higher performances than current technology can generally provide [1]. Other terms like “Virtual Worlds”, “Virtual Environments” or “Synthetic Environments” seem preferable because they are linguistically conservative, and related to well-established terms like virtual images. VR has a dual nature: it is cultural movement which has its roots in the philosophical thought and a technological nature which derives from computer science advanced technology.


Virtual Reality Virtual Environment Virtual World Delaunay Triangulation Collision Detection 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ellis SR. What Are Virtual Environments? IEEE CG&A 1994; 1:17–22Google Scholar
  2. 2.
    Woolley B. Virtual Worlds. Black well Publishers, 1992Google Scholar
  3. 3.
    Barthes R. Contemporary Mythes. Wiley & So, 1970Google Scholar
  4. 4.
    Comeau CP. and Brian J.S. Headsight Television System Provides Remote Surveillance. Electronics 1961; 86–90Google Scholar
  5. 5.
    Sutherland IE. Computer Displays. Scientific American 1970; 222(6):56–81CrossRefGoogle Scholar
  6. 6.
    Sturman DJ. and Zelter D. A Survey of Glove-based Input. IEEE CG&A 1994; 30–39Google Scholar
  7. 7.
    Bolt RA. Put-that-there: Voice and Gesture at the graphics Interface. Computer Graphics (Proc. Siggraph) 1980; 14(3): 262–270MathSciNetCrossRefGoogle Scholar
  8. 8.
    Burdea G and Coiffet P. Virtual Reality Technology. Wiley & So, 1994Google Scholar
  9. 9.
    Myybridge E. The Human Figure in Motion. Chapman & Hall, London, 1901Google Scholar
  10. 10.
    Marey EJ. The history of Chronophotography, Smithsonian Institution, Washington D.C.,1902Google Scholar
  11. 11.
    Tomasi C and Kanade T. Shape and Motion from Image Streams: under Orthography a Factorization Method. Int. J. Comp. Vision 1991; 9(2): 137–154CrossRefGoogle Scholar
  12. 12.
    Essa IA, Darrell T and Pentland A. Tracking Facial Motion. Proc. IEEE Workshop on Nonrigid and Articulate Motion, Ausin, Texas, 1994Google Scholar
  13. 13.
    Borghese NA, Di Rienzo M, Ferrigno G and Pedotti A. Elite: a goal-oriented vision system for moving objects detection. Robotica 1990; 9:275–282CrossRefGoogle Scholar
  14. 14.
    Moezzi S, Katkere A, Kuramura DY and lain R. Immersive Video. Proc. IEEE VRAIS96, 1996, pp 17–24Google Scholar
  15. 15.
    Goncalves L, Di Bernardo E, Ursella E and Perona P. Monocular tracking of the human arm in 3D. Proc. Int. Conf. Comp. Vision, Cambridge, MA 1995Google Scholar
  16. 16.
    Wellner P. Interacting with Paper on the DigitalDesk. Comm. ACM 1993; 36(7): 87–96CrossRefGoogle Scholar
  17. 17.
    Poggio T, Torre V and Koch C. Computational Vision and Regularization theory. Nature 1985; 317:314–319CrossRefGoogle Scholar
  18. 18.
    Poggio T and Girosi F. Regularization Algorithms for Learning That Are Equivalent to Multilayer Networks. Science 1990; 247:978–982MathSciNetCrossRefGoogle Scholar
  19. 19.
    Soatto S, Frezza R and Perona P. Motion Estimation on the Essential Manifold, Springer-Verlag, Heidelberg, 1994, pp 61–72 (Lecture Notes in Comp. Science, no. 801)Google Scholar
  20. 20.
    Hildreth EC and Koch C. The Analysis of Visual Motion: From Computational Theory to Neuronal Mechanisms, Ann. Rev. Neurosci. 1987; 477:533Google Scholar
  21. 21.
    Shi J and Tomasi C. Good Features to Track, Tech. Rep. Dep. Comp. Science, Cornell University, TR 93–1399, 1993Google Scholar
  22. 22.
    Barron JL, Fleet DJ and Beauchemin SS. Performance of Optical Flow Techniques, Int. J. Comp. Vision, 1994; 43–77Google Scholar
  23. 23.
    Mase K and Pentland A. Automatic Lip-Reading by Optical-Flow, Systems and Computers in Japan 199; 22(6).Google Scholar
  24. 24.
    Metaxis D and Terzopoulos D. Shape and non-rigid motion estimation through physics-based synthesis. IEEE Trans. PAMI, 1991; 22(6):67–76Google Scholar
  25. 25.
    Lorensen WE and Cline HE. Marching Cubes: A high resolution 3D surface reconstruction algorithm. Comp. Graphics 1987; 21 (4): 163–169CrossRefGoogle Scholar
  26. 26.
    Kohonen T. Self-Organizing maps, Springer-Verlag, Heidelberg, 1995Google Scholar
  27. 27.
    Piegl L. The NURBS book, Springer-Verlag, Heidelberg, 1993Google Scholar
  28. 28.
    Kass M, Witkin A and Terzopoulos D. Snakes: Active contour models. Int. J. of Comp. Vision 1988; 321–331Google Scholar
  29. 29.
    Hatze H. Quantitative analysis, synthesis and optimization of human motion. Human Movement Science 3 1984; 5–25CrossRefGoogle Scholar
  30. 30.
    Ferrigno G and Pedotti A. ELITE: A Digital Dedicated Hardware System for Movement Analysis Via Real-Time TV Signal Processing. IEEE Trans, on Biomed. Eng. 1990; 32:943–949CrossRefGoogle Scholar
  31. 31.
    Burdea G and Coiffet P. Virtual Reality Technology, Wiley & So, 1994Google Scholar
  32. 32.
    Borghese NA, Ferrigno G and Pedotti A. 3D Movement Detection: A Hierarchical Approach. Proc. 1988 IEEE Int. Conf. Systems, Man, and Cybernetics, Vol. I,, Pergamon Press, 1988, pp 303–306Google Scholar
  33. 33.
    Ferrigno G, Borghese NA, and Pedotti A. Pattern Recognition in 3D Automatic Human Motion Analysis— ISPRS J. of Photogr. and Rem. Sens. 1990; 45:227–246CrossRefGoogle Scholar
  34. 34.
    Borghese NA. SMART3D: Tracking of movements surveyed by a multiple set of TVcameras, Proc. X Symp. ISBS, 1992, ppl08–lllGoogle Scholar
  35. 35.
    Hu X and Ahuja N. Marching Point Features with Ordered Geometric, Rigidity and Disparity Constraints. IEEE Trans. PAMI 1994; 16(10): 1041–1049CrossRefGoogle Scholar
  36. 36.
    DeFanti TA and Sandin DJ. Final Report to the National Endowment of the Arts. Tech. Rep. Univ. Illinois, NEA R60–34–163, 1977Google Scholar
  37. 37.
    Grimes GJ. Digital Data Entry Glove Interface Device, Bell Telephone Laboratories, Murray Hill, NJ, US Patent 4,414,537, 1983Google Scholar
  38. 38.
    Kramer J and Leifer L. The Talking Glove: An Expressive and Receptive ’Verbal’ Communication Aid for the Deaf-Blind, and Non-vocal, Tech, Rep., Dept. Electr. Eng., Stanford University, 1989Google Scholar
  39. 39.
    Weng J, Cohen P and Herniou M. Camera Calibration with Distortion Models and Accuracy Evaluation. IEEE Trans. PAMI 1992; 14(10):965–979CrossRefGoogle Scholar
  40. 40.
    Wolf PR. Elements of Photogrammetry, McGraw Hill, 1983Google Scholar
  41. 41.
    Bergamasco M. The Glad-in-Art Project. Proc. VR93, Springer-Verlag, Heidelberg, 1993, pp 251–258Google Scholar
  42. 42.
    Millman PA and Colgate JE. Design of a Four Degrees of Freedom Force-Reflecting Manipulandum with a Specified Force/Torque Workspace. Proc. IEEE Robotics and Automation, vol. 2, 1991, pp 1488–1493Google Scholar
  43. 43.
    Buttolo P and Hannaford B. Pen-Based Force Display for Precision Manipulation in Virtual Environment. Proc. IEEE VRAIS95, 1995, pp 217–224Google Scholar
  44. 44.
    Hirota K, Hirose M. Surface Display: A Force Feedback System Simulating the Surface of and Object. Proc. IEEE Int. Workshop on Robot and Human Comm., 1994, pp 251–254Google Scholar
  45. 45.
    Salcudean SE and Yan J. Towards a Force-Reflecting Motion-Scaling System for Microsurgery. Proc. IEEE Robotics and Automation, vol. 3, 1994, pp 2296–2301Google Scholar
  46. 46.
    Gomi H. and Kawato M. Equilibrium-Point Control Hypothesis Examined by Measuring Arm Stiffness During Multijoint Movement. Science, 1996; 272:117–119CrossRefGoogle Scholar
  47. 47.
    Ohshima T, Yamamoto H, and Tamura H. Gaze Directed Adaptive Rendering for Interacting with Virtual Space. Proc. IEEE VRAIS96, 1996, pp 103–110Google Scholar
  48. 48.
    Chiou GI and Hwang J. A Neural Network-Based Stochastic Active Contour Model (NNS-SNAKE) for Contour Finding of Distinct Features. IEEE Trans, on Imag. Proc. 1995; 4(10):1407–1416CrossRefGoogle Scholar
  49. 49.
    Terzopoulos D and Waters K. Analysis and synthesis of facial image sequences using physical and anatomical models. IEEE Trans. PAMI 1993; 15(6):569–579CrossRefGoogle Scholar
  50. 50.
    Terzopoulos D and Metaxas D. Dynamic 3D Models with Local and Global Deformations: Deformable Superquadrics. IEEE Trans. PAMI 1991; 13(7):703–714CrossRefGoogle Scholar
  51. 51.
    Moody J and Darken CJ. Fast Learning in Networks of Locally-Tuned Processing Units. Neural Computation 1989; 1:281–294CrossRefGoogle Scholar
  52. 52.
    Poggio T and Girosi F. Regularization Algorithms for Learning that are Equivalent to Multilayer Networks. Science 1990. 247:978–982MathSciNetCrossRefGoogle Scholar
  53. 53.
    Poggio T and Girosi F. Networks for Approximation and Learning. Proc. IEEE 1990; 78(9): 1481–1497Google Scholar
  54. 54.
    Marchini S and Borghese NA. Optimal local estimation of RBF parameters, Proc. ICAN94, Lawrence Erlbaum, 1994 pp 71–75Google Scholar
  55. 55.
    Watson DF. Computing the n-dimensional Delaunay tessellation with application to Voronoi polytopes. The Computer Journal 1981; 24(2):167–172MathSciNetCrossRefGoogle Scholar
  56. 56.
    Fang T and Piegl L. Algorithm for Delaunay friangulation and convex hull computation using sparse matrix. Computer Aided Design 1992; 24(8):425–436MATHCrossRefGoogle Scholar
  57. 57.
    Cignoni P, Montani C, Perego R and Scopigno R. Parallel 3D Delaunay Trfangulation. Proc. Eurographics 93, 1993, pp 129–142Google Scholar
  58. 58.
    Ruprecht D and Muller H. Image Warping with Scattered Data Interpolation. IEEE CG&A 1995; 37–43Google Scholar
  59. 59.
    Oishi Y and Sugihara K. Topology-Oriented Divide-and-Conquer Algorithm for Voronoi Diagrams. Graphical Models and Image Processing 1995; 57(4):303–314CrossRefGoogle Scholar
  60. 60.
    Singh K, Ohya J and Parent R. Human Figure Synthesis and Animation for Virtual Space Teleconferencing. Proc. IEEE VRAIS 95, 1995, pp 118–126Google Scholar
  61. 61.
    Summerfield Q. Visual Perception of Phonetic Gestures. Modularity and the Motor Theory of Speech Perception, Mattingly G and Studdert-Kennedy M (eds), Lawrence Erlbaum Associates, Hillsdale, N. J, pp 117–137Google Scholar
  62. 62.
    Rosen JM, Laub Jr DR, Pieper SD, Mecinski AM, Soltanian H, McKenna MA, Chen D, Delp SL, Loan JP, and Basdogan C. Virtual Reality and Medicine: From Training Systems to performance Machines. Proc. IEEE VRAIS96, 1996, pp 5–13Google Scholar
  63. 63.
    Platt SM and Badler NI. Animating Facial ExpressionsComputer Graphics 1982; 15(3)Google Scholar
  64. 64.
    Bathe K. Finite Element Procedures in Engineering Analysis, Prentice-Hall, 1982.Google Scholar
  65. 65.
    Essa IA and Pentland AP. Coding, Analysis, Interpretation and Recognition of Facial Expressions. IEEE Trans. PAMI 1996, in pressGoogle Scholar
  66. 66.
    Pieper S, Rosen J and Zeltzer D. Interactive graphics for plastic surgery: A task level analysis and implementation. Computer Graphics, Special Issue: ACM Siggraph, 1992; 127–134Google Scholar
  67. 67.
    Ekman P and Friesen WV. Facial Action Coding System, Consulting Psychologists Press Inc, Palo Alto, CA, 1978Google Scholar
  68. 68.
    Savaré R, Aliverti A, Ferrigno G and Pedotti A. Surface Analysis by Laser Beam Scanning and Sterephotogrammetry. Proc. 3rd European Conference on Engineering and Medicine, Firenze, 1995Google Scholar
  69. 69.
    Martinetz TM, Berkovich G and Schulten KJ. Neural-Gas Network for Vector Quantization and its Application to Times-Series Prediction. IEEE Trans, on Neural Networks 1993; 4(4):558–569CrossRefGoogle Scholar
  70. 70.
    Fontana M, Borghese NA and Ferrari S. Image reconstruction using improved “Nerual Gas”. Proc. WIRN95, 1995, ppGoogle Scholar
  71. 71.
    Rokita P. Generating Depth-of-Field Effects in Virtual Reality Applications. IEEE CG&A, 1995; 18–21Google Scholar
  72. 72.
    Pentland A. Computational Complexity versus simulated environments, Computer Graphics 1990; 24(2): 185–192CrossRefGoogle Scholar
  73. 73.
    Garcia-Alonso A, Serrano N, and Flaquer J. Solving the collision detection problem, Computer Graphics and Applications 1994; 14(3): 36–43CrossRefGoogle Scholar
  74. 74.
    Smith A, Kitamura Y, Takemura H and Kishino F. A Simple and Efficient Method for Accurate Collision Detection Among Deformable Polyhedral Objects in Arbitrary Motion, Proc. IEEE VRAIS95, 1995 pp 136–144Google Scholar
  75. 75.
    Gilbert H, Johnson GE and Keerth SS. A fast procedure for computing the distance between complex objects in three-dimensional space. IEEE J. of Robotics and Automation 1988; 4(2): 193–203CrossRefGoogle Scholar
  76. 76.
    Vanecek G. Back-face culling applied to collision detection of polyhedra. Tech. Rep., Purdue University, Dept. of Comp. Science, 1994Google Scholar
  77. 77.
    Kitamura Y, Smith A, Takemura H, and Kishino F. Optimization and parallelization of octree-based collision detection for real-time performance. Proc. IEICE Conference,1994Google Scholar
  78. 78.
    Parke FI. Parametrized models for facial animation, CG&A 1982; 61–68Google Scholar
  79. 79.
    Granieri J and Badler NI. Simulating humans in VR. Virtual Reality and its Applications, Earnshaw R, Jones H, and Vince J (eds), Academic Press, London, UK,1995Google Scholar
  80. 80.
    Foley JD. Interfaces for Advanced Computing, Scientific American 1987; 127–135Google Scholar
  81. 81.
    Oromaner J. Flat Panels Proliferate and Challenge the CRT, Electronic Products 1992; 34(8):21–24Google Scholar
  82. 82.
    Bolas M. Human Factors in the Design of as Immersive Display, IEEE CG&A 1994; 55–59Google Scholar
  83. 83.
    Sun J and Perona P. Early Computation of Shape and Reflectance in the Visual System. Natue 1996; 379:165–169CrossRefGoogle Scholar
  84. 84.
    Gibson JJ. The Senses Considered as Perceptual Systems. Houghton-Mifflin, Boston, 1966Google Scholar
  85. 85.
    Hendrix C and Barfield W. Presence in Virtual Environment as a Function of Visual and Auditory Cues, Proc. IEEE VRAIS95, 1995, pp 74–82Google Scholar
  86. 86.
    Kolasinski EM. Simulator Sickness in Virtual Environments, Tech. Report, US Army Research Institue, Orlando FL, 1996Google Scholar
  87. 87.
    Granieri J and Crabtree N. Production and Playback of Human Figure Motion for 3DVirtual Environments, Proc. IEEE VRAIS95, 1995, pp 127–135Google Scholar
  88. 88.
    Badler N, Webber B, Becket W, Geib C, Moore M, Pelachaud C, Reich B and Stone M. Planning for animation. Interactive Computer Animation (Magnenat-Thalman N andThalman D eds), Prentice-Hall, 1995Google Scholar
  89. 89.
    Stansfield S, Shawver D, Rogers D and Hightower R. Mission visualization for planning and training. IEEE CG&A 1995; 15(5): 12–14Google Scholar
  90. 90.
    Rosen JM, Laub DR, Pieper SD, Mecinski AM, Soltanian H, McKenna MA, Chen D, Delp SL, Loan JP and Basdogan C. Virtual Reality and Medicine: From Training Systems to Performance Machines. Proc. IEEE VRAIS96, 1996, pp 5–13Google Scholar
  91. 91.
    Delp SL, Loan JP, Hoy MG, Zajac FE, Topp EL and Rosen JM. An interactive graphics-based model of the lower extremity to study orthopaedic surgical procedures. IEEE Trans. Biomed. Eng. 1990; 37(8):757CrossRefGoogle Scholar
  92. 92.
    Delp SL, and Zajac FE. Force and Moment generating capacity of the lower-limb muscles before and after tendon lengthening. Clin. Orthopaedics and Related Res. 1992; 284:247–259Google Scholar
  93. 93.
    Barrus JW, Waters RC and Anderson DB. Locales and Beacons: Efficient and Precise Support for Large Multi-User Virtual Environments. Proc. VRAIS96, 1996, pp 204–213Google Scholar

Copyright information

© Springer-Verlag London Limited 1997

Authors and Affiliations

  • Nunzio Alberto Borghese
    • 1
  1. 1.Istituto Neuroscienze e Bioimmagini - CNRMilanoItaly

Personalised recommendations