Abstract
Due to the lack of color in manga (Japanese comics), black-and-white textures are often used to enrich visual experience. With the rising need to digitize manga, segmenting texture regions from manga has become an indispensable basis for almost all manga processing, from vectorization to colorization. Unfortunately, such texture segmentation is not easy since textures in manga are composed of lines and exhibit similar features to structural lines (contour lines). So currently, texture segmentation is still manually performed, which is labor-intensive and time-consuming. To extract a texture region, various texture features have been proposed for measuring texture similarity, but precise boundaries cannot be achieved since boundary pixels exhibit different features from inner pixels. In this paper, we propose a novel method which also adopts texture features to estimate texture regions. Unlike existing methods, the estimated texture region is only regarded an initial, imprecise texture region. We expand the initial texture region to the precise boundary based on local smoothness via a graph-cut formulation. This allows our method to extract texture regions with precise boundaries. We have applied our method to various manga images and satisfactory results were achieved in all cases.
Article PDF
Similar content being viewed by others
Explore related subjects
Discover the latest articles, news and stories from top researchers in related subjects.Avoid common mistakes on your manuscript.
References
Tuytelaars, T.; Mikolajczyk, K. Local invariant feature detectors: A survey. Foundations and Trends in Computer Graphics and Vision Vol. 3, No. 3, 177–280, 2008.
Xu, L.; Yan, Q.; Xia, Y.; Jia, J. Structure extraction from texture via relative total variation. ACM Transactions on Graphics Vol. 31, No. 6, Article No. 139, 2012.
Julesz, B. Textons, the elements of texture perception, and their interactions. Nature Vol. 290, 91–97, 1981.
Weldon, T. P.; Higgins, W. E.; Dunn, D. F. Efficient Gabor filter design for texture segmentation. Pattern Recognition Vol. 29, No. 12, 2005–2015, 1996.
Varma, M.; Zisserman, A. Texture classification: Are filter banks necessary? In: Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Vol. 2, II-691-8, 2003.
Qu, Y.; Wong, T.-T.; Heng, P.-A. Manga colorization. ACM Transactions on Graphics Vol. 25, No. 3, 1214–1220, 2006.
Hofmann, T.; Puzicha, J.; Buhmann, J. M. Unsupervised texture segmentation in a deterministic annealing framework. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 20, No. 8, 803–818, 1998.
Paragios, N.; Deriche, R. Geodesic active regions for supervised texture segmentation. In: Proceedings of the 7th IEEE International Conference on Computer Vision, Vol. 2, 926–932, 1999.
Hays, J.; Leordeanu, M.; Efros, A. A.; Liu, Y. Discovering texture regularity as a higher-order correspondence problem. In: Computer Vision–ECCV 2006. Leonardis, A.; Bischof, H.; Pinz, A. Eds. Springer Berlin Heidelberg, 522–535, 2006.
Liu, Y.; Collins, R. T.; Tsin, Y. A computational model for periodic pattern perception based on frieze and wallpaper groups. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 26, No. 3, 354–371, 2004.
Liu, Y.; Lin, W.-C.; Hays, J. Near-regular texture analysis and manipulation. ACM Transactions on Graphics Vol. 23, No. 3, 368–376, 2004.
Liuy, Y.; Belkina, T.; Hays, J. H.; Lublinerman, R. Image de-fencing. In: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, 1–8, 2008.
Siddiqui, H.; Boutin, M.; Bouman, C. A. Hardwarefriendly descreening. IEEE Transactions on Image Processing Vol. 19, No. 3, 746–757, 2010.
Kopf, J.; Lischinski, D. Digital reconstruction of halftoned color comics. ACM Transactions on Graphics Vol. 31, No. 6, Article No. 140, 2012.
Yao, C.-Y.; Hung, S.-H.; Li, G.-W.; Chen, I.-Y.; Adhitya, R.; Lai, Y.-C. Manga vectorization and manipulation with procedural simple screentone. IEEE Transactions on Visualization and Computer Graphics Vol. 23, No. 2, 1070–1084, 2017.
Aujol, J.-F.; Gilboa, G.; Chan, T.; Osher, S. Structuretexture image decomposition—Modeling, algorithms, and parameter selection. International Journal of Computer Vision Vol. 67, No. 1, 111–136, 2006.
Meyer, Y. Oscillating Patterns in Image Processing and Nonlinear Evolution Equations: The Fifteenth Dean Jacqueline B. Lewis Memorial Lectures. American Mathematical Society, 2001.
Rudin, L. I.; Osher, S.; Fatemi, E. Nonlinear total variation based noise removal algorithms. Physica D: Nonlinear Phenomena Vol. 60, Nos. 1–4, 259–268, 1992.
Yin, W.; Goldfarb, D.; Osher, S. Image cartoontexture decomposition and feature selection using the total variation regularized L 1 functional. In: Variational, Geometric, and Level Set Methods in Computer Vision. Paragios, N.; Faugeras, O.; Chan, T.; Schnörr, C. Eds. Springer Berlin Heidelberg, 73–84, 2005.
Durand, F.; Dorsey, J. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics Vol. 21, No. 3, 257–266, 2002.
Fattal, R.; Agrawala, M.; Rusinkiewicz, S. Multiscale shape and detail enhancement from multi-light image collections. ACM Transactions on Graphics Vol. 26, No. 3, Article No. 51, 2007.
Paris, S.; Durand, F. A fast approximation of the bilateral filter using a signal processing approach. In: Computer Vision–ECCV 2006. Leonardis, A.; Bischof, H.; Pinz, A. Eds. Springer Berlin Heidelberg, 568–580, 2006.
Kass, M.; Solomon, J. Smoothed local histogram filters. ACM Transactions on Graphics Vol. 29, No. 4, Article No. 100, 2010.
Farbman, Z.; Fattal, R.; Lischinski, D.; Szeliski, R. Edge-preserving decompositions for multi-scale tone and detail manipulation. ACM Transactions on Graphics Vol. 27, No. 3, Article No. 67, 2008.
Subr, K.; Soler, C.; Durand, F. Edge-preserving multiscale image decomposition based on local extrema. ACM Transactions on Graphics Vol. 28, No. 5, Article No. 147, 2009.
Xu, L.; Lu, C.; Xu, Y.; Jia, J. Image smoothing via L0 gradient minimization. ACM Transactions on Graphics Vol. 30, No. 6, Article No. 174, 2011.
Manjunath, B. S.; Ma, W.-Y. Texture features for browsing and retrieval of image data. IEEE Transactions on Pattern Analysis and Machine Intelligence Vol. 18, No. 8, 837–842, 1996.
Acknowledgements
This project was supported by the National Natural Science Foundation of China (Project No. 61272293), and Research Grants Council of the Hong Kong Special Administrative Region under RGC General Research Fund (Project Nos. CUHK14200915 and CUHK14217516).
Author information
Authors and Affiliations
Corresponding author
Additional information
This article is published with open access at Springerlink.com
Xueting Liu received her B.Eng. degree from Tsinghua University and Ph.D. degree from the Chinese University of Hong Kong in 2009 and 2014, respectively. She is currently a postdoctoral research fellow in the Department of Computer Science and Engineering, the Chinese University of Hong Kong. Her research interests include computer graphics, computer vision, computational manga and anime, and non-photorealistic rendering.
Chengze Li received his B.S. degree from University of Science and Technology of China in 2013. He is currently a Ph.D. student in the Department of Computer Science and Engineering, the Chinese University of Hong Kong. His research interests include computer vision, pattern recognition, and high-performance computing.
Tien-Tsin Wong received his B.Sc., M.Phil., and Ph.D. degrees in computer science from the Chinese University of Hong Kong in 1992, 1994, and 1998, respectively. He is currently a professor in the Department of Computer Science and Engineering, the Chinese University of Hong Kong. His main research interests include computer graphics, computational manga, precomputed lighting, image-based rendering, GPU techniques, medical visualization, multimedia compression, and computer vision. He received the IEEE Transactions on Multimedia Prize Paper Award 2005 and the Young Researcher Award 2004.
Rights and permissions
Open Access The articles published in this journal are distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
Other papers from this open access journal are available free of charge from http://www.springer.com/journal/41095. To submit a manuscript, please go to https://www.editorialmanager.com/cvmj.
About this article
Cite this article
Liu, X., Li, C. & Wong, TT. Boundary-aware texture region segmentation from manga. Comp. Visual Media 3, 61–71 (2017). https://doi.org/10.1007/s41095-016-0069-x
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s41095-016-0069-x