Machine Vision and Applications

, Volume 4, Issue 4, pp 271–285 | Cite as

Surface reconstruction from stereoscopy and “shape from shading” in SEM images

  • W. Beil
  • I. C. Carlsen


The computational reconstruction of surface topographies from scanning electron microscope (SEM) images has been extensively investigated in the past, but fundamental image processing problems still exist. Since conventional approaches adapted from general-purpose image processing have not sufficiently met the requirements in terms of resolution and reliability, we have explored combining different methods to obtain better results.

This paper presents a least-squares combination of conventional stereoscopy with “shape from shading” and a way of obtaining self-consistent surface profiles from stereoscopy and “stereo-intrinsic shape from shading” using dynamic programming techniques. Results are presented showing how this combined analysis of multi-sensorial data yields improvements of the reconstructed surface topography that cannot be obtained from individual sensor signals alone.

Key words

Electron microscopy three-dimensional vision surface reconstruction stereo shape from shading dynamic programming 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. Barnard ST, Fischler MA (1982) Computational stereo. ACM Computing Surveys 14(4):553–572Google Scholar
  2. Beil W, Carlsen IC, Desai V, Reimer L (1989) Three-dimensional digital surface reconstruction in scanning electron microscopy using signals of a multiple detector system. In: Proceedings of the First International Conference on 3-D Image Processing in Microscopy, Giessen, European Journal of Cell Biology 25(48): 13–16Google Scholar
  3. Bellman R (1957) Dynamic programming. Princeton University Press, Princeton, NJGoogle Scholar
  4. Böngeler R, Reimer L, Senkel R (1988) Variable multiple detector system for secondary and backscattered electrons in a scanning electron microscope. In: EUREM 88, Inst. Phys. Conf. Ser. 93(1):239–240Google Scholar
  5. Breton BC, Thong JTL, Nixon WC (1987) A contactless 3-D measuring technique for IC inspection. In: Proceedings on Integrated Circuit Metrology, Inspection, and Process Control, SPIE 775:109–117Google Scholar
  6. Bruckstein AM (1988) On shape from shading. Computer Vision, Graphics, and Image Processing 44:139–154Google Scholar
  7. Burt PJ (1988) Smart sensing within a pyramid vision machine. In: Proceedings of the IEEE 76(8): 1006–1015Google Scholar
  8. Canny JF (1983) Finding edges and lines in images. Technical Report 720, MIT Artificial Intelligence Lab, Cambridge, MAGoogle Scholar
  9. Carlsen IC (1985) Reconstruction of true surface topographies in scanning electron microscopes using backscattered electrons. Scanning 7:169–177Google Scholar
  10. Chen JS, Huertas A, Medioni G (1987) Fast convolution with Laplacian-of-Gaussian masks. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-9(4):584–590Google Scholar
  11. Desai V, Reimer L (1988) Diffusion model for backscattered electrons using a diffusion matrix based on Monte Carlo calculations. In: EUREM 88, Inst. Phys. Conf. Ser. 93(2):371–372Google Scholar
  12. Eastman RD, Waxman AM (1987) Using disparity functionals for stereo correspondence and surface reconstruction. Computer Vision, Graphics, and Image Processing 39:73–101Google Scholar
  13. Ferrie FP, Le vine MD (1989) Where and why local shading analysis works. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 198–206Google Scholar
  14. Grimson WEL (1981) From images to surfaces—A computational study of the human early visual system. The MIT Press, Cambridge, MAGoogle Scholar
  15. Hackbusch W (1985) Multi-grid methods and applications. Springer Series on Computational Mathematics, Springer-Verlag, BerlinGoogle Scholar
  16. Hejna J, Reimer L (1987) Backscattered electron multidetektor systems for improved quantitative topographic contrast. Scanning 9:162–172Google Scholar
  17. Hoff W, Ahuja N (1989) Surfaces from stereo: Integrating feature matching, disparity estimation, and contour detection. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 121–136Google Scholar
  18. Horn BKP (1975) Obtaining shape from shading information. In: Winston PH (ed) The psychology of computer vision. McGraw-Hill, New York, pp. 115–155Google Scholar
  19. Horn BKP (1977) Understanding image intensities. Artificial Intelligence 8:201–231Google Scholar
  20. Horn BKP, Brooks MJ (1986) The variational approach to shape from shading. Computer Vision, Graphics, and Image Processing 33:174–208Google Scholar
  21. Ikeuchi K (1987) Determining a depth map using a dual photometric stereo. International Journal of Robotics Research 6(1): 15–31Google Scholar
  22. Ikeuchi K, Horn BKP (1981) Numerical shape from shading and occluding boundaries. Artificial Intelligence 17:141–184Google Scholar
  23. Kaczmarek D, Czyzewski Z, Hejna J, Radzimski Z (1987) Investigation of surface topography using the back-scattered electron signal. Scanning 9:109–116Google Scholar
  24. Kholodilov OV, Grigoryev AYa, Myshkin NK (1987) Reconstruction of true topographies of solid surfaces in scanning electron microscopes using secondary electrons. Scanning 9:156–161Google Scholar
  25. Lebiedzik J (1979) An automatic topographical surface reconstruction in the SEM. Scanning 2:230–237Google Scholar
  26. Lebiedzik J, White EW (1975) Multiple detector method for quantitative determination of microtopography in the SEM. Scanning Electron Microscopy, IITRI Chicago: 181–188Google Scholar
  27. Lee CH, Rosenfeld A (1985) Improved methods of estimating shape from shading using the light source coordinate system. Artificial Intelligence 26:125–143Google Scholar
  28. Marr D, Hildreth E (1979) Theory of edge detection. A.I. Memo 518, MIT Artificial Intelligence Lab, Cambridge, MAGoogle Scholar
  29. Marr D, Poggio T (1977) A computational theory of human stereo vision. A.I. Memo 451, MIT Artificial Intelligence Lab, Cambridge, MAGoogle Scholar
  30. Mayhew JEW, Frisby JP (1981) Psychophysical and computational studies towards a theory of human stereopsis. Artificial Intelligence 17:349–385Google Scholar
  31. McIntosh JH, Mutch KM (1988) Matching straight lines. Computer Vision, Graphics, and Image Processing 43:386–408Google Scholar
  32. Mohan R, Medioni G, Nevatia R (1989) Stereo error detection, correction, and evaluation. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-11(2): 113–120Google Scholar
  33. Newbury DE (1975) Image formation in the scanning electron microscope. In: Goldstein JI, Yakowitz H (eds) Practical scanning electron microscopy. Plenum Press, New York, pp. 95–148Google Scholar
  34. Olsen SI (1990) Stereo correspondence by surface reconstruction. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-12(3):309–315Google Scholar
  35. Ohta Y, Kanade T (1985) Stereo by intra- and interscanline search using dynamic programming. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-7(2): 139–154Google Scholar
  36. Pentland AP (1984) Local shading analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence PAMI-6(2): 170–187Google Scholar
  37. Pollard SB, Mayhew JEW, Frisby JP (1985) PMF: A stereo correspondence algorithm using a disparity gradient limit. Perception 14:449–470Google Scholar
  38. Reimer L, Böngeler R, Desai V (1987) Shape from shading using multiple detector signals in scanning electron microscopy. Scanning Microscopy 1(3):963–973Google Scholar
  39. Reimer L, Riepenhausen M (1985) Detector strategy for secondary and backscattered electrons using multiple detector systems. Scanning 7:221–238Google Scholar
  40. Reimer L, Riepenhausen M, Schierjott M (1986) Signal of backscattered electrons at edges and surface steps in dependence on surface tilt and take-off direction. Scanning 8:164–175Google Scholar
  41. Reimer L, Stelter D (1987) Monte Carlo calculations of electron emission at surface edges. Scanning Microscopy 1(3):951–962Google Scholar
  42. Rosenfeld A (1984) Multiresolution image processing and analysis. Springer-Verlag, BerlinGoogle Scholar
  43. Sato H, O-Hori M (1982) Surface roughness measurement by scanning electron microscope. Annals of the CIRP 31(1):457–462Google Scholar
  44. Sato H, O-Hori M (1986) Measurement of surface shape by scanning electron microscope using detection of normal. Annals of the CIRP 35(1):365–368Google Scholar
  45. Suganuma T (1985) Measurement of surface topography using SEM with two secondary electron detectors. Journal of Electron Microscopy 34(4):328–337Google Scholar
  46. Tanimoto S, Pavlidis T (1975) A hierarchical data structure for picture processing. Computer Graphics and Image Processing 4:104–119Google Scholar
  47. Wells OC (1957) The construction of a SEM and its application to the study of fibres. Ph.D. dissertation, University of CambridgeGoogle Scholar
  48. Wickramasinghe HK (1989) Scanned-probe microscopes. Scientific American 261(4):74–81Google Scholar
  49. Woodham RJ (1980) Photometric method for determining surface orientation from multiple images. Optical Engineering 19(1):139–144Google Scholar
  50. Wu Z, Li L (1988) A line-integration based method for depth recovery from surface normals. Computer Vision, Graphics, and Image Processing 43:53–66Google Scholar

Copyright information

© Springer-Verlag New York Inc. 1991

Authors and Affiliations

  • W. Beil
    • 1
  • I. C. Carlsen
    • 1
  1. 1.Philips Forschungslaboratorium GmbH HamburgHamburg 54FRG

Personalised recommendations