Digitization of Deformed Documents Using a High-Speed Multi-camera Array

  • Yoshihiro Watanabe
  • Kotaro Itoyama
  • Masahiro Yamada
  • Masatoshi Ishikawa
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7725)


Digitization of documents recently has become an important technology. However, it is difficult for existing scanners to read books at high speed and at high resolution simultaneously. In order to realize a promising new book scanning system, we aimed to scan a book containing many pages by using multiple high-speed cameras to acquire images while continuously flipping through the pages, then integrating the images viewed by different cameras to digitize all of the pages. However, high-accuracy integration with the non-uniform rectification required for such input images is a challenging task because the sheets of the document are deformed and the image resolution is so high that misalignment can easily occur. This paper proposes a new multi-camera-array book scanning system and a method of achieving high-accuracy three-dimensional deformation estimation and high-resolution rectification of the distorted document images with a system configuration in which multiple high-speed cameras are arranged with small overlapping captured areas. Experiments using the developed system showed that high-accuracy document images were reconstructed.


Document Image Developable Surface Stereo Match Surface Estimation Bezier Curve 
These keywords were added by machine and not by the authors. This process is experimental and the keywords may be updated as the learning algorithm improves.


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Nakashima, T., Watanabe, Y., Komuro, T., Ishikawa, M.: Book flipping scanning. In: Adjunct Proceedings of UIST, pp. 79–80 (2009)Google Scholar
  2. 2.
    Watanabe, Y., Nakashima, T., Komuro, T., Ishikawa, M.: Estimation of non-rigid surface deformation using developable surface model. In: Proceedings of ICPR, pp. 197–200 (2010)Google Scholar
  3. 3.
    Cao, H., Ding, X., Liu, C.: Rectifying the bound document image captured by the camera: A model based approach. In: Proceedings of ICDAR, pp. 71–75 (2003)Google Scholar
  4. 4.
    Koo, H.I., Cho, N.I.: State Estimation in a Document Image and Its Application in Text Block Identification and Text Line Extraction. In: Daniilidis, K., Maragos, P., Paragios, N. (eds.) ECCV 2010, Part II. LNCS, vol. 6312, pp. 421–434. Springer, Heidelberg (2010)CrossRefGoogle Scholar
  5. 5.
    Liang, J., DeMenthon, D., Doermann, D.: Geometric rectification of camera-captured document images. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 591–605 (2008)CrossRefGoogle Scholar
  6. 6.
    Tian, Y., Narasimhan, S.G.: Rectification and 3D Reconstruction of Curved Document Images. In: Proceedings of ICCV, pp. 377–384 (2011)Google Scholar
  7. 7.
    Yamashita, A., Kawarago, A., Kaneko, T., Miura, K.T.: Shape reconstruction and image restoration for non-flat surfaces of documents with a stereo vision system. In: Proceedings of ICPR, pp. 482–485 (2004)Google Scholar
  8. 8.
    Courteille, F., Crouzil, A., Durou, J.D., Gurdjos, P.: Shape from shading for the digitization of curved documents. Machine Vision and Applications 18, 301–316 (2007)CrossRefGoogle Scholar
  9. 9.
    Brown, M.S., Pisula, C.J.: Conformal deskewing of non-planar documents. In: Proceedings of CVPR, pp. 998–1004 (2005)Google Scholar
  10. 10.
    Brown, M.S., Seales, W.B.: Image restoration of arbitrarily warped documents. IEEE Transactions on Pattern Analysis and Machine Intelligence 26, 129–1306 (2004)CrossRefGoogle Scholar
  11. 11.
    Tanimoto, M.: Overview of free viewpoint television. Transactions on Signal Processing: Image Communication 6, 454–461 (2006)MathSciNetCrossRefGoogle Scholar
  12. 12.
    Ng, R., Levoy, M., Bredif, M., Duval, G., Horowitz, M., Hanrahan, P., Design, D.: Light field photography with a hand-held plenoptic camera. Stanford Tech. Report CTSR 2005-02 (2005)Google Scholar
  13. 13.
    Wilburn, B., Joshi, N., Vaish, V., Talvala, E.V., Antunez, E., Barth, A., Adams, A., Horowitz, M., Levoy, M.: High performance imaging using large camera arrays. ACM Transactions on Graphics 24, 765–776 (2005)CrossRefGoogle Scholar
  14. 14.
    Brown, M., Lowe, D.G.: Automatic panoramic image stitching using invariant features. International Journal of Computer Vision 74, 59–73 (2007)CrossRefGoogle Scholar
  15. 15.
    Lowe, D.G.: Object recognition from local scale-invariant features. In: Proceedings of the International Conference on Computer Vision, pp. 1150–1157 (2007)Google Scholar
  16. 16.
    Carmo, M.P.D.: Differential Geometry of Curves and Surfaces. Prentice Hall (1976)Google Scholar
  17. 17.
    Liang, J., DeMenthon, D., Doermann, D.: Unwarping Images of Curved Documents Using Global Shape Optimization. In: Proceedings of CBDAR, pp. 25–29 (2005)Google Scholar
  18. 18.
    Gumerov, N.A., Zandifar, A., Duraiswami, R., Davis, L.S.: 3d structure recovery and unwarping of surfaces applicable to planes. International Journal of Computer Vision 66, 261–281 (2006)CrossRefGoogle Scholar
  19. 19.
    Burt, P.J., Adelson, E.H.: A multiresolution spline with application to image mosaics. ACM Transactions on Graphics 2, 217–236 (1983)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Yoshihiro Watanabe
    • 1
  • Kotaro Itoyama
    • 1
  • Masahiro Yamada
    • 1
  • Masatoshi Ishikawa
    • 1
  1. 1.Graduate School of Information Science and TechnologyUniversity of TokyoJapan

Personalised recommendations