Abstract
Visualization is one of the most standard applications of 3D video. Its essential functionality includes interactive free-viewpoint and 3D (pop-up) visualization of the captured scene as is. Following an ordinary 3D video visualization system, this chapter presents a novel free-viewpoint visualization method for 3D video stream of a single human in action. The novelty rests in that the 3D video is visualized from the performer’s viewpoint. Ordinary free-viewpoint visualization methods render the object action viewed from the outside of the scene. We may call it an objective, or third-person, view of the object action. With 3D video data, moreover, we can render a subjective, or first-person, view of the object action, where the object action is visualized as if it were captured from a head-mounted camera. Such subjective visualization is very useful to understand where to look when performing juggling or traditional dances; in MAIKO dances, for example, eye motions are very important to express mental feelings.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsReferences
Cootes, T.F., Edwards, G.J., Taylor, C.J.: Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23(6), 681–685 (2001)
Fischler, M.A., Bolles, R.C.: Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography. Commun. ACM 24, 381–395 (1981)
Furukawa, Y., Ponce, J.: Accurate, dense, and robust multi-view stereopsis. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2007)
Hansen, D.W., Ji, Q.: In the eye of the beholder: a survey of models for eyes and gaze. IEEE Trans. Pattern Anal. Mach. Intell. 32(3), 478–500 (2010)
Just, M.A., Carpenter, P.A.: Eye fixations and cognitive processes. Cogn. Psychol. 8(4), 441–480 (1976)
Kawaguchi, T., Rizon, M., Hidaka, D.: Detection of eyes from human faces by hough transform and separability filter. Electron. Commun. Jpn. 88(5), 29–39 (2005)
Kuroda, M., Nobuhara, S., Matsuyama, T.: 3d face geometry and gaze estimation from multi-view images using symmetry prior. In: Proc. of MIRU (2011) (in Japanese)
Nobuhara, S., Kimura, Y., Matsuyama, T.: Object-oriented color calibration of multi-viewpoint cameras in sparse and convergent arrangement. IPSJ Trans. Comput. Vis. Appl. 2, 132–144 (2010)
Nobuhara, S., Tsuda, Y., Ohama, I., Matsuyama, T.: Multi-viewpoint silhouette extraction with 3D context-aware error detection, correction, and shadow suppression. IPSJ Trans. Comput. Vis. Appl. 1, 242–259 (2009)
Sugimoto, A., Matsuyama, T.: Active wearable vision sensor: detecting person’s blink points and estimating human motion trajectory. In: Proceedings of the IEEE/ASME International Conference on Advanced Intelligent Mechatronics, 2003, AIM2003, vol. 1, pp. 539–545 (2003)
Tobii Technology: X120 eye tracker
Tung, T., Nobuhara, S., Matsuyama, T.: Simultaneous super-resolution and 3D video using graph-cuts. In: Proc. of IEEE Conference on Computer Vision and Pattern Recognition, pp. 1–8 (2008)
Viola, P., Jones, M.J.: Robust real-time face detection. Int. J. Comput. Vis. 57, 137–154 (2004)
Author information
Authors and Affiliations
Rights and permissions
Copyright information
© 2012 Springer-Verlag London
About this chapter
Cite this chapter
Matsuyama, T., Nobuhara, S., Takai, T., Tung, T. (2012). Visualization of 3D Video. In: 3D Video and Its Applications. Springer, London. https://doi.org/10.1007/978-1-4471-4120-4_7
Download citation
DOI: https://doi.org/10.1007/978-1-4471-4120-4_7
Publisher Name: Springer, London
Print ISBN: 978-1-4471-4119-8
Online ISBN: 978-1-4471-4120-4
eBook Packages: Computer ScienceComputer Science (R0)