The Restoration of Camera Documents Through Image Segmentation

  • Shijian Lu
  • Chew Lim Tan
Part of the Lecture Notes in Computer Science book series (LNCS, volume 3872)


This paper presents a document restoration technique that is able to flatten curled document images captured through a digital camera. The proposed method corrects camera images of documents through image partition, which divides distorted text lines into multiple small patches based on the identified vertical stroke boundary (VSB) and the fitted x-line and baseline of text lines. Target rectangles are then constructed through the exploitation of the characters enclosed within the partitioned image patches. With the constructed target rectangles and the partitioned image patches, global geometric distortion is finally removed through the local rectification of partitioned image patches one by one. Experimental results show that the proposed technique is fast, accurate, and easy for implementation.


  1. 1.
    Pilu, M.: Undoing Paper Curl Distortion Using Applicable Surfaces. In: International Conference on Computer Vision and Pattern Recognition, Kauai, USA, pp. 67–72 (2001)Google Scholar
  2. 2.
    Brown, M.S., Seales, W.B.: Document restoration using 3D shape: a general deskewing algorithm for arbitrarily warped documents. In: International Conference on Computer Vision, Vancouver, Canada, July 2001, vol. 2, pp. 367–374 (2001)Google Scholar
  3. 3.
    Yamashita, A., Kawarago, A., Kaneko, T., Miura, K.T.: Shape Reconstruction and Image Restoration for Non-Flat Surfaces of Documents with a Stereo Vision System. In: International Conference on Pattern Recognition, Cambridge, UK, August 2004, vol. 1, pp. 482–485 (2004)Google Scholar
  4. 4.
    Agam, G., Wu, C.H.: Structural rectification of non-planar document images: application to graphics recognition. In: Fourth International Workshop on Graphics Recognition Algorithms and Applications, Kingston, Ontario, Canada, pp. 289–298 (2001)Google Scholar
  5. 5.
    Cao, H., Ding, X., Liu, C.: A Cylindrical Surface Model to Rectify the Bound Document Image. In: Ninth IEEE International Conference on Computer Vision, Nice, France, vol. 1, pp. 228–233 (2003)Google Scholar
  6. 6.
    Liang, J., DeMenthon, D., Doermann, D.: Flattening curved documents in images. In: International Conference on Computer Vision and Pattern Recognition, San Diego, USA, June, pp. 338–345 (2005)Google Scholar
  7. 7.
    Lu, S.J., Chen, B.M., Ko, C.C.: Perspective rectification of document images using fuzzy set and morphological operations. Image and Vision Computing 23, 541–553 (2005)CrossRefGoogle Scholar
  8. 8.
  9. 9.
    Dance, C.R.: Perspective estimation for document images. In: Proceedings of the SPIE Confer-ence on Document Recognition and Retrieval IX, pp. 244–254 (2002)Google Scholar
  10. 10.
    Clark, P., Mirmhedi, M.: Rectifying perspective views of text in 3Dscenes using vanishing points. Pattern Recognition 36, 2673–2686 (2003)CrossRefGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2006

Authors and Affiliations

  • Shijian Lu
    • 1
  • Chew Lim Tan
    • 1
  1. 1.School of ComputingNational University of SingaporeSingapore

Personalised recommendations