Learning Colours from Textures by Sparse Manifold Embedding

  • Jun Li
  • Wei Bian
  • Dacheng Tao
  • Chengqi Zhang
Part of the Lecture Notes in Computer Science book series (LNCS, volume 7106)

Abstract

The capability of inferring colours from the texture (grayscale contents) of an image is useful in many application areas, when the imaging device/environment is limited. Traditional colour assignment involves intensive human effort. Automatic methods have been proposed to establish relations between image textures and the corresponding colours. Existing research mainly focuses on linear relations.

In this paper, we employ sparse constraints in the model of texture-colour relationship. The technique is developed on a locally linear model, which assumes manifold assumption of the distribution of the image data. Given the texture of an image patch, learning the model transfers colours to the texture patch by combining known colours of similar texture patches. The sparse constraint checks the contributing factors in the model and helps improve the stability of the colour transfer. Experiments show that our method gives superior results to those of the previous work.

Preview

Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.

References

  1. 1.
    Beymer, D., Poggio, T.: Image representation for visual learning. Science (1996)Google Scholar
  2. 2.
    Chang, H., Yeung, D.Y., Xiong, Y.: Super-resolution through neighbor embedding. In: Proceedings of CVPR (2004)Google Scholar
  3. 3.
    Dalal, N., Triggs, B.: Histograms of oriented gradients for human detection. In: Proceedings of CVPR (2005)Google Scholar
  4. 4.
    Donoho, D.L., Grimes, C.: Image manifolds which are isometric to euclidean space. J. Math. Imaging Vis. 23(1), 5–24 (2005)MathSciNetCrossRefGoogle Scholar
  5. 5.
    Efron, B., Hastie, T., Johnstone, I., Tibshirani, R.: Least angle regression. Annals of Statistics 32(2), 407–451 (2004)MathSciNetCrossRefMATHGoogle Scholar
  6. 6.
    Fan, W., Yeung, D.-Y.: Image hallucination using neighbor embedding over visual primitive manifolds. In: Proceedings of CVPR (2007)Google Scholar
  7. 7.
    Huo, X., Ni, X., Smith, A.K.: A survey of manifold-based learning methods. Technical report, Statistics Group, Georgia Institute of Technology (2006)Google Scholar
  8. 8.
    Li, J., Hao, P.: Transferring colours to grayscale images by locally linear embedding. In: BMVC (2008)Google Scholar
  9. 9.
    Qu, Y., Wong, T.-T., Heng, P.-A.: Manga colorization. In: Proceedings of Siggraph (2006)Google Scholar
  10. 10.
    Roweis, S.T., Saul, L.: Nonlinear dimensionality reduction by locally linear embedding. Science (2000)Google Scholar
  11. 11.
    Seung, H.S., Lee, D.D.: The manifold way of perception. Science, 2268–2269 (2000)Google Scholar
  12. 12.
    Silberg, J.: Cinesite press article (1998), http://www.cinesite.com/core/press/articles/1998/10_00_98-team.html
  13. 13.
    Song, M., Tao, D., Chen, C., Li, X., Chen, C.W.: Color to gray: Visual cue preservation. IEEE Trans. Pattern Anal. Mach. Intell. 21(9), 1537–1552 (2010)CrossRefGoogle Scholar
  14. 14.
    Souvenir, R.: Manifold learning for natural image sets. Ph.D. thesis (2006)Google Scholar
  15. 15.
    Tibshirani, R.: Regression shrinkage and selection via the lasso. Journal of the Royal Statistical Society Series B (Methodological), 267–288 (1996)MathSciNetMATHGoogle Scholar
  16. 16.
    Verbeek, J.: Learning non-linear image manifolds by combining local linear models. IEEE Transactions on Pattern Analysis & Machine Intelligence 28(8), 1236–1250 (2006)CrossRefGoogle Scholar
  17. 17.
    Welsh, T., Ashikhmin, M., Mueller, K.: Transferring color to greyscale images. In: Proceedings of Siggraph (2002)Google Scholar
  18. 18.
    Zhang, T., Tao, D., Li, X., Yang, J.: Patch alignment for dimensionality reduction. IEEE Trans. Knowl. Data Eng. 21(9), 1299–1313 (2009)CrossRefGoogle Scholar
  19. 19.
    Zou, H., Hastie, T., Tibshirani, R.: Sparse principal component analysis. Jcgs 15(2), 262–286 (2006)MathSciNetGoogle Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2011

Authors and Affiliations

  • Jun Li
    • 1
  • Wei Bian
    • 1
  • Dacheng Tao
    • 1
  • Chengqi Zhang
    • 1
  1. 1.Center for Quantum Computation & Intelligent SystemsUniversity of TechnologySydneyAustralia

Personalised recommendations