International Journal of Computer Vision

, Volume 60, Issue 1, pp 25–44 | Cite as

Noise Reduction in Surface Reconstruction from a Given Gradient Field

  • B. Karaçali
  • W. Snyder


We present a gradient space technique for noise reduction in surfaces reconstructed from a noisy gradient field. We first analyze the error sources in the recovered gradient field of a surface using a three-image photometric stereo method. Based on this analysis, we propose an additive noise model to describe the errors in the surface gradient estimates. We then use a vector space formulation and construct a multiscale orthonormal expansion for gradient fields. Using the sparse representation properties of this expansion, we develop techniques for reducing the gradient field noise by coefficient selection with thresholding. The simulation results indicate that the proposed technique provides significant improvement on the noise levels of both the estimated gradient fields and the reconstructed surfaces under heavy noise levels. Furthermore, the experiments using noisy photometric stereo image triplets of real range data suggest that the additive model remains viable after the nonlinear photometric stereo operation to provide accurate noise removal.

surface reconstruction gradient field noise reduction thresholding projection gradient space orthonormal representation multiscale analysis 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Buzbee, B., Golub, G., and Nielson, C. 1970. On direct methods of solving poisson's equations. SIAM Journal of Numerical Analysis, 7:627–656.Google Scholar
  2. Chang, S.G., Bin, Y., and Vetterli, M. 2000. Adaptive wavelet thresholding for image denoising and compression. IEEE Transactions on Image Processing, 9(9):1532–1546.Google Scholar
  3. Courant, R. and Hilbert, D. 1962. Methods of Mathematical Physics. John Wiley & Sons: New York.Google Scholar
  4. Daubechies, I. 1988. Orthonormal bases of compactly supported wavelets. Communications on Pure and Applied Mathematics, 41:909–996.Google Scholar
  5. Deift, P. and Sylvester, J. 1981, Some remarks on shape from shading problems in computer vision. Journal of Mathematical Analysis and Applications, 34:235–248.Google Scholar
  6. Donoho, D.L. and Johnstone, I.M. 1994. Ideal denoising in an orthonormal basis chosen from a library of bases. Comptes Rendus de l'Académie des Sciences, Série I, 319.Google Scholar
  7. Embrechts, P., Klüppelberg, C., and Mikosch, T. 1997. Modelling extremal events for insurance and finance. In Applications of Mathematics: Stochastic Modelling and Applied Probability. Springer: Berlin.Google Scholar
  8. Frankot, R.T. and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. IEEE Transactions on Pattern Analysis and Machine Intelligence, 10(4):439–451.Google Scholar
  9. Frankot, R.T. and Chellappa, R. 1989. A method for enforcing integrability in shape from shading algorithms. In Shape from Shading, B.K.P. Horn and M.J. Brooks (Eds.). The MIT Press, Chapt. 5, pp. 89–122.Google Scholar
  10. Galo, M. and Tozzi, C.L. 1996. Surface reconstruction using multiple light sources and perspective projection. In IEEE International Conference on Image Processing, vol. 2, pp. 309–312.Google Scholar
  11. Grossberg, M.D. and Nayar, S.K. 2001.Ageneral imaging model and a method for finding its parameters. In IEEE Eighth International Conference on Computer Vision, vol. 2, pp. 108–115.Google Scholar
  12. Hayakawa, H. 1994. Photometric stereo under a light-source with arbitrary motion. Journal of Optical Society of America, Serie A, 11(11):3079–3089.Google Scholar
  13. Horn, B.K.P. 1986. Robot Vision. MIT Press: Cambridge.Google Scholar
  14. Horn, B.K.P. and Brooks, M.J. 1986. The variational approach to shape from shading. Compute Vision, Graphics, and Image Processing, 33:174–208.Google Scholar
  15. Horn, K.B.P. and Brooks, M.J. (Eds.). 1989. Shape from Shading. The MIT Press.Google Scholar
  16. Hsieh, J.-W., Liao, H.-Y.M., Ko, M.-T., and Fan, K.-C. 1995. Wavelet-based shape from shading. Graphical Models and Image Processing, 57(4):343–362.Google Scholar
  17. Hurt, N.E. 1991. Mathematical methods in shape-from-shading: A review of recent results.Acta Applicandae Mathematicae, 23(2):163–188.Google Scholar
  18. Ikeuchi, K. 1981. Determining surface orientations of specular surfaces by using the photometric stereo method. IEEE Transactions on Pattern Analysis and Machine Intelligence, 3(6):661–669.Google Scholar
  19. Ikeuchi, K. and Horn, B.K.P. 1981. Numerical shape from shading and occluding boundaries. Artificial Intelligence, 17(1-3):141–184.Google Scholar
  20. Iwahori, Y., Tanaka, H., Woodham, R.J., and Ishii, N. 1994. Photometric stereo for specular surface shape based on neural network. IEICE Transactions on Information and Systems, E77-D(4):498–506.Google Scholar
  21. Iwahori, Y., Woodham, R.J., Ozaki, M., Tanaka, H., and Ishii, N. 1997. Neural network based photometric stereo with a nearby rotational moving light source. IEICE Transactions on Information and Systems, E80-D(9):948–957.Google Scholar
  22. Jain, A.K. 1989. Fundamentals of Digital Image Processing. Prentice Hall.Google Scholar
  23. Jones, A. and Taylor, C. 1994. Robust shape from shading. IVC, 12(7):411–421.Google Scholar
  24. Karaçali, B. and Snyder, W. 2002. Partial integrability in surface reconstruction from a given gradient field. In IEEE International Conference on Image Processing, vol. 2, pp. 525–528.Google Scholar
  25. Karaçali, B. 1999.Signal reconstruction using the cross-scale correlation properties of the wavelet decomposition. Technical Report TR 99/13, North Carolina State University, Center for Advanced Computing and Communications.Google Scholar
  26. Karaçali, B. 2002. Vector space methods in surface reconstruction from one or more images acquired from the same view with application to scanning electron microscopy images. Ph.D. thesis, North Carolina State University, Department of Electrical and Computer Engineering.Google Scholar
  27. Kiang, R.K. 1997. Rectifying airborne scanner measurements using neural networks. In Proceedings of SPIE, Applications and Science of Artificial Neural Networks III, vol. 3077, pp. 525–534.Google Scholar
  28. Kim, B.-H. and Park, R.-H. 1997. Shape from shading and photometric stereo using surface approximation by legendre polynomials. Computer Vision and Image Understanding, 66(3):255–270.Google Scholar
  29. Kozera, R. 1991. Existence and uniqueness in photometric stereo. Applied Mathematics and Computation, 44(2):1–103.Google Scholar
  30. Krim, H., Mallat, S., Donoho, D., and Willsky, A.S. 1995.Best basis algorithm for signal enhancement. In Proceedings of IEEE International Conference on Acoustics, Speech, and Signal Processing.Google Scholar
  31. Lambert, J.H. 1760. Photometria sive de Mensura et Gratibus Luminis, Colorum et Umbrae. Eberhard Klett, Augsburg.Google Scholar
  32. Lee, K.M. and Kuo, C.-C.J. 1994. Shape from shading with perspective projection. Computer Vision, Graphics, and Image Processing: Image Understanding, 59(2):202–212.Google Scholar
  33. Mallat, S. 1989. A theory for multiresolution signal decomposition: The wavelet representation. IEEE Transactions on Pattern analysis and Machine Intelligence, 11(7):674–693.Google Scholar
  34. Mallat, S.G. 1998. A Wavelet Tour of Signal Processing. Academic Press: San Diego.Google Scholar
  35. Noakes, L. and Kozera, R. 1999. A 2D leap-frog algorithm for optimal surface reconstruction. In Proceedings of the 44th Annual Meeting of the SPIE, Stream Vision Geometry VIII, vol. 3811, pp. 317–328.Google Scholar
  36. Noakes, L. and Kozera, R. 2001. 2D Leap-Frog: Integrability, noise and digitization. InLecture Notes in Computer Science, vol. 2243, pp. 352–364.Google Scholar
  37. Noakes, L. and Kozera, R. 2003a. Denoising images: Non-linear Leap-Frog for shape and light-source recovery. In Lecture Notes in Computer Science, T. Asano, R. Klette, and C. Ronse (Eds.), vol. 2616, pp. 419–436.Google Scholar
  38. Noakes, L. and Kozera, R. 2003b. Nonlinearities and noise reduction in 3-source photometric stereo. Journal of Mathematical Imaging and Vision, 18(2):119–127.Google Scholar
  39. Noakes, L., Kozera, R., and Klette, R. 1999. The lawn-mowing algorithm for noisy gradient vector fields. In Proceedings of the 44th Annual Meeting of the SPIE, Stream Vision Geometry VIII, vol. 3811, pp. 305–316.Google Scholar
  40. Phong, B.T. 1975. Illumination for computer generated pictures. Communications of the ACM, 18(6):311–317.Google Scholar
  41. Rajaram, K.V., Parthasarathy, G., and Faruqi, M.A. 1995. Neural network approach to photometric stereo inversion of realworld reflectance maps for extracting 3-D shapes of objects. IEEE Transactions on Systems, Man and Cybernetics, 25(1):1289–1300.Google Scholar
  42. Shevlin, F. 1994. Rectifying airborne scanner measurements using neural networks. In IEEE International Conference on Image Processing, vol. 1, pp. 1007–1011.Google Scholar
  43. Stein, F. and Medioni, G. 1992. Structural indexing: Efficient 3D object recognition. IEEE Transactions on Pattern Analysis and Machine Intelligence, 14(2):125–145.Google Scholar
  44. Symchony, T., Chellappa, R., and Shao, M. 1990. Direct analitical methods for solving poisson equation in computer vision problem. IEEE Transactions on Pattern Analysis and Machine Intelligence, 12(5):435–446.Google Scholar
  45. Tagare, H.D. and deFigueiredo, R.J.P. 1991. A theory of photometric stereo for a class of diffuse non-Lambertian surfaces. IEEE Transactions on Pattern Analysis and Machine Intelligence, 13(2):133–152.Google Scholar
  46. Woodham, R.J. 1978. Photometric stereo: A reflectance map technique for determining surface orientations from a single view. In Proceedings of SPIE, Image Understanding Systems & Industrial Applications, vol. 155, pp. 136–143.Google Scholar
  47. Zhang, R., Tsai, P.-S., Cryer, J.E., and Shah, M. 1999. Shape from shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence, 21(8):690–706.Google Scholar
  48. Zheng, Q., Klemas, V., Yan, X.-H., Wang, Z., and Kagleder, K. 1997. Digital orthorectification of space shuttle coastal ocean photographs. International Journal of Remote Sensing, 18(1):197–211.Google Scholar

Copyright information

© Kluwer Academic Publishers 2004

Authors and Affiliations

  • B. Karaçali
    • 1
  • W. Snyder
    • 2
  1. 1.Department of Radiology, Section on Biomedical Image AnalysisUniversity of PennsylvaniaPhiladelphiaUSA
  2. 2.Electrical and Computer Engineering DepartmentNorth Carolina State UniversityRaleighUSA

Personalised recommendations