3D Microscopy Vision Using Multiple View Geometry and Differential Evolutionary Approaches

  • A. Pahlavan Tafti
  • A. B. Kirkpatrick
  • H. A. Owen
  • Z. Yu
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8888)


The Scanning Electron Microscope (SEM) as 2D imaging equipment has been widely used in biology and material sciences to determine the surface attributes of a microscopic object. Having 3D surfaces from SEM images would provide true anatomic shapes of micro samples which allow for quantitative measurements and informative visualization of the systems being investigated. In this contribution, we present a Differential Evolutionary (DE) approach for both SEM extrinsic calibration and 3D surface reconstruction. We show that the SEM extrinsic calibration and its 3D shape model can be accurately estimated in a global optimization platform. Several experiments from various perspectives are performed on real and synthetic data to validate the speed, reliability and accuracy of the proposed system. The present work is expected to stimulate more interest and draw attentions from the computer vision community to the fast-growing SEM application area.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
  2. 2.
    Agarwal, S., Furukawa, Y., Snavely, N., Simon, I., Curless, B., Seitz, S.M., Szeliski, R.: Building rome in a day. Commun. ACM 54(10), 105–112 (2011)CrossRefGoogle Scholar
  3. 3.
    Albouy, B., Treuillet, S., Lucas, Y., Birov, D.: Fundamental matrix estimation revisited through a global 3d reconstruction framework. In: Advanced Concepts for Intelligent Vision Systems (2004)Google Scholar
  4. 4.
    Bay, H., Ess, A., Tuytelaars, T., Gool, L.V.: Surf: Speed up robust features. Computer Cision and Image Understanding (CVIU) 110, 346–359 (2008)CrossRefGoogle Scholar
  5. 5.
    Cazaux, J.: Recent developments and new strategies in scanning electron microscopy. Journal of Microscopy 217, 16–35 (2005)CrossRefMathSciNetGoogle Scholar
  6. 6.
    Chakraborty, U.K.: Advances in Differential Evolution. Prentice-Hall, USA (2008)CrossRefzbMATHGoogle Scholar
  7. 7.
    Chen, D., Miyamoto, A., Kaneko, S.: Robust surface reconstruction in sem with two bse detectors. Mecatronics REM 2012 (2012)Google Scholar
  8. 8.
    Cignoni, P., Rocchini, C., Scopigno, R.: Metro: Measuring error on simplified surfaces. Computer Graphics Forum 17, 167–174 (1998)CrossRefGoogle Scholar
  9. 9.
    Crandall, D., Owens, A., Snavely, N., Huttenlocher, D.: Discrete-continuous optimization for large-scale structure from motion. In: CVPR (2011)Google Scholar
  10. 10.
    Egerton, R.: Physical Principles of Electron Microscopy: An Introduction to TEM, SEM, and AEM. Springer, USA (2005)CrossRefGoogle Scholar
  11. 11.
    Feoktistov, V.: Differential Evolution. Springer, Germany (2006)zbMATHGoogle Scholar
  12. 12.
    Fischler, M.A., Bolles, R.C.: Random sample consesus: a paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM (1981)Google Scholar
  13. 13.
    Ghosh, A., Mondal, A., Ghosh, S.: Moving object detection using markov random field and distributed differential evolution. Applied Soft Computing 15, 121–136 (2014)CrossRefGoogle Scholar
  14. 14.
    Hartely, R., Zisserman, A.: Multiple view geometry in computer vision. Cambridge University Press, UK (2004)CrossRefGoogle Scholar
  15. 15.
    Kodama, T., Li, X., Nakahira, K., Ito, D.: Evolutionary computation applied to the reconstruction of 3-d surface topography in the sem. Journal of Electron Microscopy 54(5), 429–435 (2005)CrossRefGoogle Scholar
  16. 16.
    Lourakis, M.A., Argyros, A.: Sba: A software package for generic sparse bundle adjustment. ACM Trans. Math. Software 36(1), 1–30 (2009)CrossRefMathSciNetGoogle Scholar
  17. 17.
    Lowe, D.G.: Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60(2), 91–110 (2004)CrossRefGoogle Scholar
  18. 18.
    Munkres, James: Topologyn. Prentice Hall, USA (1999)Google Scholar
  19. 19.
    Nyirarugira, C., Taeyong, K.: Adaptive differential evolution algorithm for real time object tracking. IEEE Transaction on Consumer Electronics 59 (2013)Google Scholar
  20. 20.
    Paluszynski, J., Slowko, W.: Surface reconstruction with the photometric method in sem. Vaccum 78, 533–537 (2005)CrossRefGoogle Scholar
  21. 21.
    Paysan, P., Knothe, R., Amberg, B., Romdhani, S., Vetter, T.: A 3d face model for pose and illumination invariant face recognition. In: Proceedings of the 6th IEEE International Conference on Advanced Video and Signal based Surveillance (AVSS) for Security, Safety and Monitoring in Smart Environments (2009)Google Scholar
  22. 22.
    Pintus, R., Podda, S., Vanzi, M.: An automatic alignment procedure for a 4-source photometric stereo technique applied to scanning electron microscopy. In: IMTC- Instrumentation and Measurement (2006)Google Scholar
  23. 23.
    Samak, D., Fischer, A., Rittel, D.: 3d reconstruction and visualization of microstructure surfaces from 2d images. Annals of the CIRP 56 (2007)Google Scholar
  24. 24.
    Triggs, B., McLauchlan, P.F., Hartley, R.I., Fitzgibbon, A.W.: Bundle adjustment – A modern synthesis. In: Triggs, B., Zisserman, A., Szeliski, R. (eds.) ICCV-WS 1999. LNCS, vol. 1883, pp. 298–372. Springer, Heidelberg (2000)CrossRefGoogle Scholar
  25. 25.
    Wohler, C.: 3D computer vision efficient methods and applications. Springer, Germany (2013)CrossRefGoogle Scholar
  26. 26.
    Zolotukhin, A., Safonov, I., Kryzhanovskii, K.: 3d reconstruction for a scanning electron microscope. Pattern Recognition and Image Analysis 23(1), 168–174 (2013)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • A. Pahlavan Tafti
    • 1
  • A. B. Kirkpatrick
    • 2
  • H. A. Owen
    • 2
  • Z. Yu
    • 1
  1. 1.Department of Computer ScienceUniversity of Wisconsin-MilwaukeeMilwaukeeUSA
  2. 2.Department of Biological SciencesUniversity of Wisconsin-MilwaukeeMilwaukeeUSA

Personalised recommendations