Through-the-Lens Cinematography

  • Marc Christie
  • Hiroshi Hosobe
Part of the Lecture Notes in Computer Science book series (LNCS, volume 4073)


This article presents an extension of the Through-the-Lens Camera Control approach proposed by Gleicher and Witkin. It first provides a higher means of control on the camera by using virtual composition primitives and second offers a means for through-the-lens interaction with both the location of the objects in the scene and the lighting. By setting properties on the composition primitives, users convey constraints to enforce the positioning of the camera, the objects and the lights directly through the lens. The paper presents how to express all three problems of indirect camera, object and light interaction in a consistent way and provides some first results. The solving techniques rely on the expression of the image Jacobian coupled with a constrained optimizer based on Quadratic Programming. The Jacobian expresses the relation between the user input and the possible degrees of freedom on the entity to manipulate; in order to avoid solving failures that are delicate to manage in user interfaces, we propose a mass-spring interaction model. As a result, the user should be able concentrate on higher level properties such as composition, balance and unity through a natural and effective interaction process.


User Input Camera Parameter Visual Servoing Virtual Camera High Level Property 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Burtnyk, R., Khan, A., Fitzmaurice, G., Balakrishan, R., Kurtenbach, G.: Stylecam: Interactive stylized 3d navigation using integrated spatial & temporal controls. In: ACM IUST Symposium on User Interface Software & Technology (2002)Google Scholar
  2. 2.
    Chen, M., Mountford, S.J., Sellen, A.: A study in interactive 3d rotation using 2d input devices. In: Catmull, E.E. (ed.) Computer Graphics (Proceedings SIGGRAPH 1988), vol. 22(4), pp. 121–130 (August 1988)Google Scholar
  3. 3.
    Christie, M., Machap, R., Normand, J.-M., Olivier, P., Pickering, J.: Virtual camera planning: A survey. In: Smart Graphics, pp. 40–52 (2005)Google Scholar
  4. 4.
    Gleicher, M., Witkin, A.: Through-the-lens camera control. In: Proceedings of ACM SIGGRAPH 1992, pp. 331–340. ACM Press, New York (1992)CrossRefGoogle Scholar
  5. 5.
    Hanson, A., Wernert, E.: Constrained 3d navigation with 2d controllers. IEEE Visualization, 175–182 (1997)Google Scholar
  6. 6.
    He, L.-w., Cohen, M.F., Salesin, D.H.: The virtual cinematographer: A paradigm for automatic real-time camera control and directing. In: Rushmeier, H. (ed.) SIGGRAPH 1996 Conference Proceedings. Annual Conference Series, ACM SIGGRAPH, New Orleans, Louisiana, August 4–9, pp. 217–224. Addison-Wesley, Reading (1996)Google Scholar
  7. 7.
    Khan, A., Komalo, B., Stam, J., Fitzmaurice, G., Kurtenbach, G.: Hovercam: interactive 3d navigation for proximal object inspection. In: SI3D 2005: Proceedings of the 2005 symposium on Interactive 3D graphics and games, pp. 73–80. ACM Press, New York (2005)CrossRefGoogle Scholar
  8. 8.
    Kyung, M.H., Kim, M.S., Hong, S.: Through-the-lens camera control with a simple jacobian matrix. In: Proceedings of Graphics Interface 1995, pp. 117–178 (1995)Google Scholar
  9. 9.
    Kyung, M.-H., Kim, M.-S., Hong, S.J.: A new approach to through-the-lens camera control. Graphical models and image processing: GMIP 58(3), 262–285 (1996)CrossRefGoogle Scholar
  10. 10.
    Marchand, E., Courty, N.: Image-based virtual camera motion strategies. In: Fels, S., Poulin, P. (eds.) Graphics Interface Conference, GI 2000, Montreal, Quebec, May 2000, pp. 69–76. Morgan Kaufmann, San Francisco (2000)Google Scholar
  11. 11.
    Marchand, E., Courty, N.: Controlling a camera in a virtual environment. The Visual Computer Journal 18(1), 1–19 (2002)zbMATHCrossRefGoogle Scholar
  12. 12.
    Pellacini, F., Tole, P., Greenberg, D.P.: A user interface for interactive cinematic shadow design. In: SIGGRAPH 2002: Proceedings of the 29th annual conference on Computer graphics and interactive techniques, pp. 563–566. ACM Press, New York (2002)CrossRefGoogle Scholar
  13. 13.
    Pellacini, F., Vidimce, K., Lefohn, A., Mohr, A., Leone, M., Warren, J.: Lpics: A hybrid hardware-accelerated relighting engine for computer cinematography. ACM Trans. Graph. 24(3), 464–470 (2005)CrossRefGoogle Scholar
  14. 14.
    Phillips, C.B., Badler, N.I., Granieri, J.: Automatic viewing control for 3d direct manipulation. In: Proceedings of the 1992 symposium on Interactive 3D graphics, pp. 71–74. ACM Press, New York (1992)CrossRefGoogle Scholar
  15. 15.
    Poulin, P., Fournier, A.: Lights from highlights and shadows. In: Proceedings of the 1992 Western Computer Graphics Symposium, Banff, AB, Canada, April 6–8, pp. 141–145 (1992)Google Scholar
  16. 16.
    Shoemake, K.: Arcball: A user interface for specifying three-dimensional orientation using a mouse. In: Proceedings of Graphics Interface 1992, pp. 151–156 (May 1992)Google Scholar
  17. 17.
    Vanderbei, R.J.: LOQO: An interior point code for quadratic programming. Optimization Methods and Software 11, 451–484 (1999)CrossRefMathSciNetGoogle Scholar
  18. 18.
    Ware, C., Osborne, S.: Exploration and virtual camera control in virtual three dimensional environments. In: SI3D 1990: Proceedings of the 1990 symposium on Interactive 3D graphics, pp. 175–183. ACM Press, New York (1990)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Marc Christie
    • 1
  • Hiroshi Hosobe
    • 2
  1. 1.LINA – Computer Science LaboratoryFRE CNRS 2729 – University of NantesNantesFrance
  2. 2.National Institute for InformaticsTokyoJapan

Personalised recommendations