Gaze-Contingent Spatio-temporal Filtering in a Head-Mounted Display
The spatio-temporal characteristics of the human visual system vary widely across the visual field. Recently, we have developed a display capable of simulating arbitrary visual fields on high-resolution natural videos in real time by means of a gaze-contingent spatio-temporal filtering . While such a system can also be a useful tool for psychophysical research, our main motivation is to develop gaze-guidance techniques. Because the message an image sequence conveys depends on the exact pattern of eye movements an observer makes, we propose that in future information and communication systems, images will be augmented with a recommendation of where to look, of how to view them. Ultimately, we want to incorporate gaze guidance technology into mobile applications; such technology, integrated into a head-mounted display (HMD), could use computer vision techniques to enhance human visual performance.
In our demonstration, we will show a first implementation of such a device in the form of a system that implements our gaze-contingent spatio-temporal filtering algorithm in an HMD with video-see-through. Subjects will be able to walk around, seeing their natural visual environment inside the HMD. We will demonstrate that we then can manipulate what the subjects see in real time.
KeywordsHuman Visual System Visual Periphery Computer Vision Technique Exact Pattern Perceived Video Quality
Unable to display preview. Download preview PDF.
- 1.Böhme, M., Dorr, M., Martinetz, T., Barth, E.: Gaze-contingent temporal filtering of video. In: Eye Tracking Research and Applications (ETRA) (in press, 2006)Google Scholar
- 2.Perry, J.S., Geisler, W.S.: Gaze-contingent real-time simulation of arbitrary visual fields. In: Rogowitz, B.E., Pappas, T.N. (eds.) Human Vision and Electronic Imaging: Proceedings of SPIE, San Jose, CA, vol. 4662, pp. 57–69 (2002)Google Scholar
- 3.Geisler, W.S., Perry, J.S.: A real-time foveated multiresolution system for low-bandwidth video communication. In: Rogowitz, B., Pappas, T. (eds.) Human Vision and Electronic Imaging: SPIE Proceedings, pp. 294–305 (1998)Google Scholar
- 6.Dorr, M., Böhme, M., Martinetz, T., Barth, E.: Visibility of temporal blur on a gaze-contingent display. In: APGV 2005 ACM SIGGRAPH Symposium on Applied Perception in Graphics and Visualization, pp. 33–36 (2005)Google Scholar