A restoration method for distorted comics to improve comic contents identification

  • Sang-Hoon Lee
  • Doyoung Kim
  • Sagar Jadhav
  • Sanghoon LeeEmail author
Original Paper


In recent years, copyright violations due to the illegal copying and distribution of e-comic contents have become an important issue. Although such violations can be rapidly and reliably detected by fingerprinting techniques, scanning introduces photometric and geometric distortions. This paper presents a restoration framework for reducing photometric and geometric distortions in copied comics to improve their content identification. First, the photometric distortion is reduced by conventional homomorphic filtering with histogram equalization. Next, the corner detection is improved by a consecutive pixel difference method. Once the corners are obtained for each page, the geometrical distortion is rectified by a perspective transformation method. When two adjacent pages are coupled, as often occurs in scanned and camera-captured comics, they are separated by a simple low-energy point method. The distortion-reducing performance is measured in terms of identification accuracy using the Hamming distance. In a simulation study, our proposed scheme improved the average fingerprint identification accuracy by more than 30 percentage point for single-page comics and by 28 percentage point for double-page comics, relative to conventional methods. We also analyzed the execution time of distortion reduction and page separation in low-, medium- and high-resolution images. Even for large images, the average processing time of our scheme was within 2 s, which is a sufficiently short time for commercial applications.


Book scanning Geometric distortion Photometric distortion Page separation Hamming distance 



This research project was supported by Ministry of Culture, Sports and Tourism(MCST) and from Korea Copyright Commission in 2015 “(2013-book_scan-9500).”


  1. 1.
    Bukhari, S.S., Shafait, F., Breuel, T.M.: Dewarping of document images using coupled-snakes. In: Proceedings of Third International Workshop on Camera-Based Document Analysis and Recognition, Barcelona, Spain, pp. 34–41 (2009)Google Scholar
  2. 2.
    Canny, J.: A computational approach to edge detection. IEEE Trans. Pattern Anal. Mach. Intell. 6, 679–698 (1986)CrossRefGoogle Scholar
  3. 3.
    Díaz-Sánchez, D., Sanvido, F., Proserpio, D., Marín, A.: DLNA, DVB-CA and DVB-CPCM integration for commercial content management. IEEE Trans. Consum. Electron. 56(1), 79–87 (2010)CrossRefGoogle Scholar
  4. 4.
    Fan, J.: Enhancement of camera-captured document images with watershed segmentation. In: CBDAR07, pp. 87–93 (2007)Google Scholar
  5. 5.
    Frazor, R.A., Geisler, W.S.: Local luminance and contrast in natural images. Vision. Res. 46(10), 1585–1598 (2006)CrossRefGoogle Scholar
  6. 6.
    Gatos, B., Pratikakis, I., Ntirogiannis, K.: Segmentation based recovery of arbitrarily warped document images. In: Ninth International Conference on Document Analysis and Recognition, 2007. ICDAR 2007, vol. 2, pp. 989–993. IEEE (2007)Google Scholar
  7. 7.
    Gavrielides, M., Sikudova, E., Pitas, I., et al.: Color-based descriptors for image fingerprinting. IEEE Trans. Multimedia 8(4), 740–748 (2006)CrossRefGoogle Scholar
  8. 8.
    Geetha Kiran, A., Murali, S.: Automatic rectification of perspective distortion from a single image using plane homography. J. Comput. Sci. Appl. 3(5), 47–58 (2013)Google Scholar
  9. 9.
    Gonzalez, R., Woods, R.: Digital Image Processing. Tom Robbins, West Long Branch (2001)Google Scholar
  10. 10.
    Gonzalez, R.C.: Digital Image Processing. Pearson Education India, New Delhi (2009)Google Scholar
  11. 11.
    Harris, C., Stephens, M.: A combined corner and edge detector. In: Alvey Vision Conference, vol. 15, p. 50. Citeseer (1988)Google Scholar
  12. 12.
    Jobson, D.J., Rahman, Z.U., Woodell, G., et al.: Properties and performance of a center/surround retinex. IEEE Trans. Image Process. 6(3), 451–462 (1997)CrossRefGoogle Scholar
  13. 13.
    Kim, H., Lee, S.: Transition of visual attention assessment in stereoscopic images with evaluation of subjective visual quality and discomfort. IEEE Trans. Multimedia 17(12), 2198–2209 (2015)CrossRefGoogle Scholar
  14. 14.
    Kim, J., Lee, S.: Fully deep blind image quality predictor. IEEE J. Sel. Top. Sign. Proces. 11(1), 206–220 (2017)CrossRefGoogle Scholar
  15. 15.
    Kim, J., Zeng, H., Ghadiyaram, D., Lee, S., Zhang, L., Bovik, A.C.: Deep convolutional neural models for picture-quality prediction: Challenges and solutions to data-driven image quality assessment. IEEE Signal Process. Mag. 34(6), 130–141 (2017)CrossRefGoogle Scholar
  16. 16.
    Land, E.H., McCann, J.J.: Lightness and retinex theory. J. Opt. Soc. Am. A 61(1), 1–11 (1971)Google Scholar
  17. 17.
    Lee, S., Yoo, C.D.: Robust video fingerprinting for content-based video identification. IEEE Trans. Circuits Syst. Video Technol. 18(7), 983–988 (2008)CrossRefGoogle Scholar
  18. 18.
    Lee, J., Lee, S., Seo, Y., Yoo, W.: Robust video fingerprinting based on hierarchical symmetric difference feature. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2089–2092. ACM (2011)Google Scholar
  19. 19.
    Lee, S.H., Kim, J., Lee, S.: An identification framework for print-scan books in a large database. Inf. Sci. 396, 33–54 (2017)CrossRefGoogle Scholar
  20. 20.
    Liang, J., DeMenthon, D., Doermann, D.: Geometric rectification of camera-captured document images. IEEE Trans. Pattern Anal. Mach. Intell. 30(4), 591–605 (2008)CrossRefGoogle Scholar
  21. 21.
    Lin, S.D., Chen, C.F.: A robust DCT-based watermarking for copyright protection. IEEE Trans. Consum. Electron. 46(3), 415–421 (2000)CrossRefGoogle Scholar
  22. 22.
    Liu, W., He, P., Li, H., Yu, H.: Improvement on the algorithm of homomorphic filtering. In: Proceedings of 2010 3rd International Conference on Future BioMedical Information Engineering, vol. 1Google Scholar
  23. 23.
    Oh, T., Choi, N., Kim, D., Lee, S.: Low-complexity and robust comic fingerprint method for comic identification. Sig. Process. Image Commun. 39, 1–16 (2015)CrossRefGoogle Scholar
  24. 24.
    Ohk, H., Seo, H., Kang, K., Kim, S., Choi, D.: A restoration method for distorted image scanned from a bound book. In: IS&T/SPIE Electronic Imaging, pp. 78,661T–78,661T. International Society for Optics and Photonics (2011)Google Scholar
  25. 25.
    Oostveen, J., Kalker, T., Haitsma, J.: Feature extraction and a database strategy for video fingerprinting. In: Recent Advances in Visual Information Systems, pp. 117–128. Springer (2002)Google Scholar
  26. 26.
    Saleh, S.A.M., Ibrahim, H.: Mathematical equations for homomorphic filtering in frequency domain: a literature survey. Proceedings of International Conference on Information and Knowledge Management 45, 74–77 (2012)Google Scholar
  27. 27.
    Stamatopoulos, N., Gatos, B., Pratikakis, I., Perantonis, S.J.: A two-step dewarping of camera document images. In: The Eighth IAPR International Workshop on Document Analysis Systems, 2008. DAS’08, pp. 209–216. IEEE (2008)Google Scholar
  28. 28.
    Sun, W., Kise, K.: Detection of exact and similar partial copies for copyright protection of manga. Int. J. Doc. Anal. Recognit. IJDAR 16(4), 331–349 (2013)CrossRefGoogle Scholar
  29. 29.
    Suzuki, Y., Yamashita, A., Kaneko, T.: Correction of geometric and photometric distortion of document images using a stereo camera system. In: MVA, pp. 215–218. Citeseer (2007)Google Scholar
  30. 30.
    Tiwari, M., Gupta, B.: Brightness preserving contrast enhancement of medical images using adaptive gamma correction and homomorphic filtering. In: IEEE Students’ Conference on Electrical, Electronics and Computer Science, pp. 1–4 (2016)Google Scholar
  31. 31.
    Tommy, R., Mohan, S.: An approach for fully automating perspective images based on symmetry and line intersection. In: 2011 International Conference on Image Information Processing (ICIIP), pp. 1–5. IEEE (2011)Google Scholar
  32. 32.
    Yuan, X., Meng, Y., Wei, X.: Illumination normalization based on homomorphic wavelet filtering for face recognition. J. Inform. Sci. Eng. 29(3), 579–594 (2013)Google Scholar
  33. 33.
    Zhang, Z., Tan, C.L.: Correcting document image warping based on regression of curved text lines. In: Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings, pp. 589–593. IEEE (2003)Google Scholar
  34. 34.
    Zhang, L., Zhang, Z., Tan, C.L., Xia, T.: 3D geometric and optical modeling of warped document images from scanners. In: IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2005. CVPR 2005, vol. 1, pp. 337–342. IEEE (2005)Google Scholar
  35. 35.
    Zhang, L., Yip, A.M., Tan, C.L.: A restoration framework for correcting photometric and geometric distortions in camera-based document images. In: IEEE 11th International Conference on Computer Vision, 2007. ICCV 2007, pp. 1–8. IEEE (2007)Google Scholar

Copyright information

© Springer-Verlag GmbH Germany, part of Springer Nature 2017

Authors and Affiliations

  • Sang-Hoon Lee
    • 1
  • Doyoung Kim
    • 1
  • Sagar Jadhav
    • 1
  • Sanghoon Lee
    • 1
    Email author
  1. 1.Multi-dimensional Insight Laboratory, Department of Electrical and Electronics EngineeringYonsei UniversitySeoulKorea

Personalised recommendations