Skip to main content
SpringerLink
Log in

Personal Imaging and lookpainting as tools for personal documentary and investigative photojournalism

  • Published:
Mobile Networks and Applications Aims and scope Submit manuscript

Abstract

A means and apparatus for covert capture of extremely high‐resolution photorealistic images is presented. The apparatus embodies a new form of user‐interface – instead of the traditional “point and click” metaphor which was thought to be the simplest photography had to offer, what is proposed is a “look” metaphor in which images are generated through the natural process of looking around, in a manner that does not require conscious thought or effort. These “lookpaintings” become photographic/videographic memories that may, at times, exceed the quality attainable with even large and cumbersome professional photographic film cameras, yet they may be captured through a device that resembles ordinary sunglasses. The method is based on long‐term psychophysical adaptation using a covert sunglass‐based reality‐mediating apparatus, together with two new results in image processing. The first new result is a means of estimating the true projective coordinate transformation between successive pairs of images, and the second is that of estimating, to within a single unknown scalar constant, the quantity of light arriving at the image plane. Furthermore, what is captured is more than just a picture. The resulting environment map may be explored by one or more remote participants who may also correspond and interact with the wearer during the actual shooting process, giving rise to computer supported collaborative (collective) photography, videography, shared photographic/videographic memory, etc.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. D. Norman, Turn Signals Are the Facial Expressions of Automobiles (Addison–Wesley, 1992).

  2. S. Mann, Wearable computing: A first step toward personal imaging, IEEE Computer, 30(2) (February 1997). http://hi.eecg.toronto.edu/ ieeecomputer/index.html.

  3. C. Ryals, Lightspace: A new language of imaging, PHOTO Electronic Imaging 38(2) (1995) 14–16. http://www.peimag.com/ltspace. htm.

    Google Scholar 

  4. S. Mann, Personal imaging, Ph.D. thesis, Massachusetts Institute of Technology (MIT), 1997.

  5. S. Mann, ‘Mediated reality,’ TR 260, M.I.T. Media Lab Perceptual Computing Section, Cambridge, Massachusetts, http://wearcam.org/ mediated-reality/index.html (1994).

    Google Scholar 

  6. S. Mann, Humanistic intelligence, in: Proc. Ars Electronica (September 8–13, 1997). http://wearcam.org/ars/; http//www.aec.at/ fleshfactor.

  7. S. Mann, Shootingback, The winners of the prix ars electronica 1997 (September 8–13, 1997). http://www.rito.com/prix/winners.htm; See also: http://wearcomp.org/shootingback.html.

  8. G.M. Stratton, Vision without inversion of the retinal image, Psychological Review (1987).

  9. I. Kohler, The Formation and Transformation of the Perceptual World, Psychological issues, Vol. 3(4) Int. University press (1964).

  10. R. Azuma, Registration errors in augmented reality: NSF/ARPA Science and Technology Center for Computer Graphics and Scientific Visualization (1994). http://www.cs.unc.edu/∼azuma/ azuma_ AR.html.

  11. S. Mann and R.W. Picard, Video orbits of the projective group; a simple approach to featureless estimation of parameters, TR 338, Massachusetts Institute of Technology, Cambridge, Massachusetts, http:// n1nlf-1.eecg.toronto.edu/tip.ps.gz (1995). Also IEEE Trans. Image Proc. 6(9) (September 1997).

    Google Scholar 

  12. S. Mann, ‘Pencigraphy’ with AGC: Joint parameter estimation in both domain and range of functions in same orbit of the projective-Wyckoff group, Technical Report 384, MIT Media Lab, Cambridge, Massachusetts (December 1994); http://hi.eecg.toronto.edu/icip96/ index.html. Also in: Proc. IEEE Int. Conf. on Image ProcessS. Mann / Personal Imaging and lookpainting</del> ing (ICIP '96), Lausanne, Switzerland (September 16–19, 1996) pp. 193–196.

    Google Scholar 

  13. S. Mann and R.W. Picard, Being ‘undigital’ with digital cameras: Extending dynamic range by combining differently exposed pictures, Technical Report 323, M.I.T. Media Lab Perceptual Computing Section, Boston, Massachusetts (1994). Also IS&T's 48th Annual Conf. (May 1995) pp. 422–428.

    Google Scholar 

  14. S. Mann, Compositing multiple pictures of the same scene, in: Proc. 46th Annual IS&T Conf., Cambridge, Massachusetts, The Society of Imaging Science and Technology (May 9–14, 1993).

    Google Scholar 

  15. C.W. Wyckoff, An experimental extended response film, S.P.I.E. Newsletter (June–July 1962).

  16. C.W. Wyckoff, An experimental extended response film, Technical Report No. B-321, Edgerton, Germeshausen & Grier, Boston, Massachusetts (March 1961).

    Google Scholar 

  17. E. Chen, QuickTime VR – an image-based approach to virtual environment navigation, SIGGRAPH (1995).

  18. M. Levoy and R. Hanrahan, Light field rendering, SIGGRAPH (1996) pp. 31–42.

  19. L. McMillan and G. Bishop, Plenoptic modeling, SIGGRAPH (1995).

  20. B.K.P. Horn, Robot Vision, MIT Electrical Engineering and Computer Science Series (McGraw–Hill, 1986).

  21. B.K.P. Horn and E.J. Weldon JR, Direct methods for recovering motion, Int. J. Computer Vision (1988).

  22. O.D. Faugeras and F. Lustman, Motion and structure from motion in a piecewise planar environment, Int. J. Pattern Recognition and Artificial Intelligence 2(3) (1988) 485–508.

    Google Scholar 

  23. S. Laveau and O. Faugeras, 3–D scene representation as a collection of images, in: Proc. IEEE Conf. on Computer Vision and Pattern Recognition, Seattle, Washington (June 1994).

  24. M. Irani and S. Peleg, Improving resolution by image registration, CVGIP 53 (May 1991) 231–239.

    Google Scholar 

  25. R. Szeliski, Video mosaics for virtual environments, Computer Graphics and Applications (March 1996) pp. 22–30.

  26. R. Szeliski and H.-Y. Shum, Creating full view panoramic image mosaics and environment maps, in: Computer Graphics Proceedings, Annual Conference Series (August 1997) pp. 251–258.

  27. A.N. Venetsanopoulos, Nonlinear mean filters in image processing, IEEE Trans. ASSP 34(3) (June 1986) 573–584.

    Google Scholar 

  28. B. Horn and B. Schunk, Determining optical flow, Artificial Intelligence (1981).

  29. J. Campbell, QuickTime VR (October 18, 1996). http://www. webreference.com/content/qtvr/.

  30. R. Szeliski and J. Coughlan, Hierarchical spline-based image registration, CVPR (1994) pp. 194–201.

  31. H.S. Sawhney, Simplifying motion and structure analysis using planar parallax and image warping, ICPR 1 12th IAPR (October 1994).

  32. R. Kumar, P. Anandan and K. Hanna, Shape recovery from multiple views: a parallax based approach, in: ARPA image understanding workshop (November 1994).

  33. H. Ishii and M. Kobayashi, Clearboard: A seamless media for shared drawing and conversation with eye-contact, in: Proc. Conf. on Human Factors in Computing Systems (CHI '92), ACM SIGCHI (May 3–7, 1992) pp. 525–532.

  34. H. Ishii, M. Kobayashi and J. Grudin, Integration of interpersonal space and shared workspace: Clearboard design and experiments, ACM Trans. Information Systems (October 1993) pp. 349–375.

Download references

Author information

Authors and Affiliations

  1. Department of Electrical and Computer Engineering, University of Toronto, 10 King's College Road, Room 2001, Toronto, Ontario, Canada, M5S 3G4

    Steve Mann

Authors
  1. Steve Mann
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

About this article

Cite this article

Mann, S. Personal Imaging and lookpainting as tools for personal documentary and investigative photojournalism. Mobile Networks and Applications 4, 23–36 (1999). https://doi.org/10.1023/A:1019118025087

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1023/A:1019118025087

Keywords

Search

Navigation