Skip to main content
SpringerLink
Log in

Image and Video Enhancement

  • Chapter
  • First Online:
Smart Camera Design

Abstract

This chapter considers algorithms to enhance photos and still images. High-dynamic range algorithms, for example, generate a composite image from several images at different exposures. These algorithms are increasingly available on cameras, but they are not part of the traditional imaging chain. Many of the algorithms here require substantially more computation than was the case for the methods of Chap. 3. In the next chapter, we will take this development a step further to look at algorithms that do not produce images at all—they analyze images to produce succinct descriptions.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 159.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Ansel Adams, The Negative, The Ansel Adams Photography Series 2, New York: Little, Brown and Company, 2002.

    Google Scholar 

  2. Ansel Adams, The Print, The Ansel Adams Photography Series 3, New York: Little, Brown and Company, 2002.

    Google Scholar 

  3. Aseem Agarwala, Mira Dontcheva, Maneesh Agrawala, Steven Drucker, Alex Colburn, Brian Curless, David Salesin, and Michael Cohen. 2004. Interactive digital photomontage. In ACM SIGGRAPH 2004 Papers (SIGGRAPH '04), Joe Marks (Ed.). ACM, New York, NY, USA, pp. 294–302. doi: http://dx.doi.org.prx.library.gatech.edu/10.1145/1186562.1015718

  4. M. Brown and D. G. Lowe, “Recognising panoramas,” in Proceedings Ninth IEEE International Conference on Computer Vision, Nice, France, 2003, pp. 1218–1225 vol. 2. doi: https://doi.org/10.1109/ICCV.2003.1238630

  5. P. Burt and E. Adelson, “The Laplacian Pyramid as a Compact Image Code,” in IEEE Transactions on Communications, vol. 31, no. 4, pp. 532–540, Apr 1983. doi: https://doi.org/10.1109/TCOM.1983.1095851

  6. Paul E. Debevec and Jitendra Malik. 1997. Recovering high dynamic range radiance maps from photographs. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, pp. 369–378. doi: http://dx.doi.org.prx.library.gatech.edu/10.1145/258734.258884

  7. D. Fedorov, B. Sumengen and B. S. Manjunath, “Multi-Focus Imaging using Local Focus Estimation and Mosaicking,” in 2006 International Conference on Image Processing, Atlanta, GA, 2006, pp. 2093–2096. doi: https://doi.org/10.1109/ICIP.2006.312820

  8. Rafael C. Gonzalez and Richard E. Woods, Digital Image Processing, fourth edition, Pearson, 2017.

    Google Scholar 

  9. M. Granados, B. Ajdin, M. Wand, C. Theobalt, H. P. Seidel and H. P. A. Lensch, “Optimal HDR reconstruction with linear digital cameras,” in 2010 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 215–222. doi: https://doi.org/10.1109/CVPR.2010.5540208

  10. Richard I. Hartley, “In defense of the eight-point algorithm,” in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 19, no. 6, June 1997, pp. 580–593.

    Google Scholar 

  11. H. Hariharan, A. Koschan and M. Abidi, “Multifocus Image Fusion by Establishing Focal Connectivity,” in 2007 I.E. International Conference on Image Processing, San Antonio, TX, 2007, pp. III - 321–III - 324. doi: https://doi.org/10.1109/ICIP.2007.4379311

  12. S. W. Hasinoff, F. Durand and W. T. Freeman, “Noise-optimal capture for high dynamic range photography,” in 2010 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, San Francisco, CA, 2010, pp. 553–560. doi: https://doi.org/10.1109/CVPR.2010.5540167

  13. Samuel W. Hasinoff, Dillon Sharlet, Ryan Geiss, Andrew Adams, Jonathan T. Barron, Florian Kainz, Jiawen Chen, and Marc Levoy. 2016. “Burst photography for high dynamic range and low-light imaging on mobile cameras,” ACM Transactions on Graphics, vol. 35, no. 6, Article 192 (Nov 2016), pp. 12. doi: https://doi-org.prx.library.gatech.edu/10.1145/2980179.2980254

  14. Frederick S. Hillier and Gerald J. Lieberman, Introduction to Operations Research, seventh edition, New York: McGraw-Hill, 2001.

    MATH  Google Scholar 

  15. Hsieh Hou and H. Andrews, “Cubic splines for image interpolation and digital filtering,” in IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. 26, no. 6, pp. 508–517, Dec 1978. doi: https://doi.org/10.1109/TASSP.1978.1163154

  16. C. Hughes, M. Glavin, E. Jones and P. Denny, “Review of geometric distortion compensation in fish-eye cameras,” in IET Irish Signals and Systems Conference (ISSC 2008), Galway, 2008, pp. 162–167. doi: https://doi.org/10.1049/cp:20080656

  17. M. Irani, B. Rousso and S. Peleg, “Recovery of ego-motion using image stabilization,” in 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, Seattle, WA, 1994, pp. 454–460. doi: https://doi.org/10.1109/CVPR.1994.323866

  18. C. Ishii, Y. Sudo and H. Hashimoto, “An image conversion algorithm from fish eye image to perspective image for human eyes,” in Proceedings 2003 IEEE/ASME International Conference on Advanced Intelligent Mechatronics (AIM 2003), 2003, pp. 1009–1014 vol. 2. doi: https://doi.org/10.1109/AIM.2003.1225480

  19. Vivek Kwatra, Arno Schödl, Irfan Essa, Greg Turk, and Aaron Bobick. 2003. “Graphcut textures: image and video synthesis using graph cuts,” in ACM Transactions on Graphics, vol. 22, no. 3 (July 2003), pp. 277–286. doi: http://dx.doi.org.prx.library.gatech.edu/10.1145/882262.882264

  20. G. W. Larson, H. Rushmeier and C. Piatko, “A visibility matching tone reproduction operator for high dynamic range scenes,” in IEEE Transactions on Visualization and Computer Graphics, vol. 3, no. 4, pp. 291–306, Oct–Dec 1997. doi: https://doi.org/10.1109/2945.646233

  21. R. K. Lenz and R. Y. Tsai, “Techniques for calibration of the scale factor and image center for high accuracy 3-D machine vision metrology,” in IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 10, no. 5, pp. 713–720, Sept 1988. doi: https://doi.org/10.1109/34.6781

  22. Bruce D. Lucas and Takeo Kanade, “An iterative image registration technique with an application to stereo vision,” in Proceedings of Image Understanding Workshop, 1981, pp. 121–130.

    Google Scholar 

  23. Michael P. MacKay, “Method and apparatus for stabilizing an image produced in a video camera,” U. S. Patent 5,253,071, Oct 12, 1993.

    Google Scholar 

  24. Steve Mann and Rosiland W. Picard. “Extending dynamic range by combining different exposed pictures,” in Proceedings IS&T Annual Conference, pp. 442–448, 1995. Also MIT Media Laboratory Perceptual Computing Section Technical Report No. TR-323.

    Google Scholar 

  25. T. Mertens, J. Kautz, and F. Van Reeth, “Exposure fusion, a simple and practical alternativbe to high dynamic range photography,” in Computer Graphics Forum, vol. 28, no. 1, March 2009, pp. 161–171, doi: https://doi.org/10.1111/j.1467-8659.2008.01171.x

  26. Peyman Milanfar, “Enhance! RAISR sharp images with machine learning,” Google Research Blog, Nov 14, 2016, https://research.googleblog.com/2016/11/enhance-raisr-sharp-images-with-machine.html

  27. A. J. Patti, M. I. Sezan and A. Murat Tekalp, “Superresolution video reconstruction with arbitrary sampling lattices and nonzero aperture time,” in IEEE Transactions on Image Processing, vol. 6, no. 8, pp. 1064–1076, Aug 1997. doi: https://doi.org/10.1109/83.605404

  28. Vladan Popovic, Kerem Seyid, Elieva Pignat, Omer Cogal, Yusuf Leblebici, “Multi-camera platform for panoramic real-time HDR video construction and rendering,” in Journal of Real-Time Image Processing, vol. 26 July 2014, doi: https://doi.org/10.1007/s11554-014-0444-8

  29. M. D. Robinson, C. A. Toth, J. Y. Lo and S. Farsiu, “Efficient Fourier-Wavelet Super-Resolution,” in IEEE Transactions on Image Processing, vol. 19, no. 10, pp. 2669–2681, Oct 2010. doi: https://doi.org/10.1109/TIP.2010.2050107

  30. S. Shah and J. K. Aggarwal, “A simple calibration procedure for fish-eye (high distortion) lens camera,” in Proceedings of the 1994 I.E. International Conference on Robotics and Automation, San Diego, CA, 1994, pp. 3422–3427 vol.4. doi: https://doi.org/10.1109/ROBOT.1994.351044

  31. Kenneth R. Spring, John C. Russ, Matthew Parry-Hill, Thomas J. Fellers, and Michael W. Davidson, “Unsharp mask mkiltering,” 2012, http://olympus.magnet.fsu.edu/primer/java/digitalimaging/processing/unsharpmask/index.html

  32. Jian Sun, Nan-Ning Zheng, Hai Tao and Heung-Yeung Shum, “Image hallucination with primal sketch priors,” in 2003 I.E. Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings., 2003, pp. II-729-36 vol. 2. doi: https://doi.org/10.1109/CVPR.2003.1211539

  33. Richard Szeliski and Heung-Yeung Shum. 1997. Creating full view panoramic image mosaics and environment maps. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques (SIGGRAPH '97). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, pp. 251–258. doi: http://dx.doi.org.prx.library.gatech.edu/10.1145/258734.258861

  34. Carlo Tomasi and Takeo Kanade, Detection and Tracking of Point Features, Technical Report CMU-CS-91-132, Carnegie Mellon University, Apr 1991.

    Google Scholar 

  35. D. Zhou, X. Shen and W. Dong, “Image zooming using directional cubic convolution interpolation,” in IET Image Processing, vol. 6, no. 6, pp. 627–634, Aug 2012. doi: https://doi.org/10.1049/iet-ipr.2011.0534

  36. R. Tsai and T. Huang, “Multiframe image restoration and registration,” in Advances in Computer Vision and Image Processing, vol. 1, Greenwich CT: JAI, 1984.

    Google Scholar 

  37. J. Yang, J. Wright, T. S. Huang, and Y. Ma, “Image super-resolution via sparse representation,” IEEE Transactions on Image Processing, 19(11), November 2010, pp. 2861-2873.

    Article  MathSciNet  MATH  Google Scholar 

  38. Jason Schlessman and Marilyn Wolf, “Tailoring design for embedded computer vision applica-tions,” IEEE Computer, 48(5), May 2015, pp. 58-62.

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. School of ECE, Georgia Institute of Technology, Atlanta, GA, USA

    Marilyn Wolf

Authors
  1. Marilyn Wolf
    View author publications

    You can also search for this author in PubMed Google Scholar

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Wolf, M. (2018). Image and Video Enhancement. In: Smart Camera Design. Springer, Cham. https://doi.org/10.1007/978-3-319-69523-5_4

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-69523-5_4

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-69522-8

  • Online ISBN: 978-3-319-69523-5

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation