Skip to main content

Exploring non-photorealistic rendering with genetic programming

Abstract

The field of evolutionary art focuses on using artificial evolution as a means for generating and exploring artistic images and designs. Here, we use evolutionary computation to generate painterly styles of images. A source image is read into the system, and a genetic program is evolved that will re-render the image with non-photorealistic effects. A main contribution of this research is that the colour mixing expression is evolved, which permits a variety of interesting NPR effects to arise. The mixing expression evaluates mathematical properties of the dynamically changing canvas, which results in the evolution of adaptive NPR procedures. Automatic fitness evaluation includes Ralph’s aesthetic model, colour matching, and direct luminosity matching. A few simple techniques for economical brush stroke application on the canvas are supported, which produce different stylistic effects. Using our approach, a number of established, as well as innovative, non-photorealistic painting effects were produced.

This is a preview of subscription content, access via your institution.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7
Fig. 8
Fig. 9
Fig. 10
Fig. 11
Fig. 12

Notes

  1. http://www.cosc.brocku.ca/~bross/gpnpr/.

  2. http://www.surveymonkey.com/.

References

  1. M. Baniasadi Genetic programming for non-photorealistic rendering. Master’s thesis, Brock U., Dept. of Computer Science (2013)

  2. P. Barile, V. Ciesielski, K. Trist Non-photorealistic rendering using genetic programming. In: SEAL ’08 Proceedings of the 7th International Conference on Simulated Evolution And Learning, pp. 299–308. Springer, Melbourne (2008)

  3. P. Bentley, Wakefield J. Finding acceptable solutions in the pareto-optimal range using multiobjective genetic algorithms. In: Soft Computing in Engineering Design and Manufacturing, pp. 231–240. Springer (1998)

  4. P. Bentley, D. Corne Creative evolutionary systems. Morgan Kaufmann (2002)

  5. S. Bergen, B. Ross, Evolutionary art using summed multi-objective ranks. In: genetic programming: theory and practice, vol. VIII (Springer, Berlin, 2010), pp. 227–244

    Google Scholar 

  6. S. Bergen, B. Ross, Aesthetic 3D model evolution. Genet. Program. Evolv. Mach. 4(3), 339–367 (2013)

    Article  Google Scholar 

  7. Collomosse, J., Kyprianidi, J.: Artistic stylization of images and video. Tutorial at Eurographics. Retrieved from http://kahlan.eps.surrey.ac.uk/EG2011/ (2011)

  8. Colton S., Valstar M., Pantic M. (2008) Emotionally aware automated portrait painting. In: Proceedings of the 3rd International Conference on Digital Interactive Media in Entertainment and Arts, pp. 304–311

  9. Colton, S.: The painting fool (2013). http://www.thepaintingfool.com/. Last Accessed May 10, 2013

  10. S. Colton, P. Torres Evolving approximate image filters. In: Proceedings of the EvoWorkshops, pp. 467–477. LNCS (2009)

  11. C. Corporation Kai’s power tools. http://www.corel.com/. Last accessed May 10, 2013

  12. C. Corporation Kai’s power tools. http://www.corel.com/. Last accessed May 10, 2013

  13. R. Dawkins, The blind watchmaker (Penguin Books Ltd, London, 1986)

    Google Scholar 

  14. E. den Heijer, A. Eiben Comparing aesthetic measures for evolutionary art. In: Proc. EvoMusArt, vol. 2, pp. 311–320. Springer LNCS 6025 (2010)

  15. R. Gatarski evolutionary banners: an experiment with automated advertising design. In: Proc. COTIM-99 (1999)

  16. R. Gonzalez, R. Woods, Digital image processing, 2nd edn. (Prentice Hall, Upper Saddle River, 2000)

    Google Scholar 

  17. B. Gooch A. Gooch Non-photorealistic rendering. A K Peters (2001)

  18. J. Graf, W. Banzhaf Interactive evolution of images. Proceedings International Conference on Evolutionary Programming pp. 53–65 (1995)

  19. D. Graham, C. Redies, Statistical regularities in art: relations with visual coding and perception. Vision. Res. 50(16), 1503–1509 (2010)

    Article  Google Scholar 

  20. P. Haeberli, Paint by numbers: abstract image representation. Comput. Graph. 24(4), 207–214 (1990)

    Article  Google Scholar 

  21. W.V. Haever, T.V. Laerhoven, F.D. Fiore, F.V. Reeth, From dust till drawn: a real-time bidirectional pastel simulation. Vis. Comput. 23(9–11), 925–934 (2007)

    Article  Google Scholar 

  22. D. Hearn, M. Baker, W. Carithers, Computer graphics with openGL 4e (Prentice Hall, Upper Saddle River, 2011)

    Google Scholar 

  23. E. den Heijer, A. Eiben, Comparing aesthetic measures for evolutionary art. EvoApplications 2, 311–320 (2010)

    Google Scholar 

  24. J. Hemert, A. Eiben Mondrian art by evolution. In: Proc. Dutch/Belgian Conf. on Artificial Intelligence (BNAIC ’99) (1999)

  25. A. Hertzmann Painterly rendering with curved brush strokes of multiple sizes. In: SIGGRAPH ’98 Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques, pp. 453–460. ACM, New York (1998)

  26. A. Hertzmann, C. Jacobs, N. Oliver, B. Curless, D. Salesin image analogies. In: SIGGRAPH ’01 proceedings of the 28th annual conference on computer graphics and interactive techniques, pp. 327–340. ACM, New York (2001)

  27. J.H. Holland, Adaptation in Natural and Artificial Systems (MIT Press, Cambridge, MA, 1994)

    Google Scholar 

  28. H. Huang, T.N. Fu, C.F. Li, Painterly rendering with content-dependent natural paint strokes. Vis. Comput. 27, 861–871 (2011)

    Article  Google Scholar 

  29. A. Izadi, V. Ciesielski, Evolved strokes in non photorealistic rendering, in Proceedings of the World Academy of Science Engineering and Technology, vol. 67, ed. by C. Ardil (WASET, 2010), pp. 1–6

  30. E. Jansson Brush painting algorithms. Tech. rep., datorteknik (2004)

  31. H. Kang, U. Chakraborty, C. Chui, W. He Multi-scale stroke-based rendering by evolutionary algorithm. In: Proceedings International Workshop on Frontiers of Evolutionary Algorithms, pp. 546–549. JCIS (2005)

  32. J. Koza, Genetic programming: on the programming of computers by means of natural selection (MIT Press, Cambridge, 1992)

    MATH  Google Scholar 

  33. P. Kubelka, New contribution to the optics of intensely light-scattering materials, part I. J. Opt. Soc. Am. A 38(5), 448–457 (1948)

    Article  MathSciNet  Google Scholar 

  34. W. Langdon, Graphics processing units and genetic programming: an overview. Soft. Comput. 15(8), 1657–1669 (2011)

    Article  Google Scholar 

  35. M. Lewis (2000) Aesthetic evolutionary design with data flow networks. In: Proc. Generative Art 2000

  36. S. Luke The ECJ Owner’s Manual. Tech. Rep. v. 21, George Mason University (2013)

  37. P. Machado, A. Dias, N. Duarte, A. Cardoso Giving colour to images. In: Proceedings AISB 2002 Symposium on AI and Creativity in the Arts (2002)

  38. P. Machado, A. Cardoso, All the truth about NEvAr. Appl. Intell. 16(2), 101–118 (2002)

    Article  MATH  Google Scholar 

  39. D. Montana, Strongly typed genetic programming. Evol. Comput. 3, 199–230 (1994)

    Article  Google Scholar 

  40. C. Neufeld, B. Ross, W. Ralph, The evolution of artistic filters, in The art of artificial evolution, ed. by J. Romero, P. Machado (Springer, Berlin, 2008), pp. 335–356

    Chapter  Google Scholar 

  41. Poli, R., Langdon, W., McPhee, N.: A field guide to genetic programming. http://lulu.com (2008)

  42. W. Ralph Painting the bell curve: The occurrence of the normal distribution in fine art (2006). Unpublished

  43. S. Rooke, Eons of Genetically evolved algorithmic images, in Creative evolutionary systems, ed. by P. Bentley, D. Corne (Morgan Kaufmann, Burlington, 2002), pp. 330–365

    Google Scholar 

  44. B. Ross, W. Ralph, H. Zong Evolutionary image synthesis using a model of aesthetics. In: IEEE Congress on Evolutionary Computation, pp. 1087–1094. CEC (2006)

  45. M. Shiraishi, Y. Yamaguchi An algorithm for automatic painterly rendering based on local source image approximation. In: NPAR ’00 Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering, pp. 53–58. ACM, New York (2000)

  46. K. Sims, Artificial evolution for computer graphics. ACM Comput. Graph. 25(4), 319–328 (1991)

    Article  MathSciNet  Google Scholar 

  47. J. Smith, S. Chang Visual seek: a fully automated content-based image query system. In: MULTIMEDIA ’96 proceedings of the 4th ACM international conference on multimedia, pp. 87–98. ACM, New York (1996)

  48. T. Strothotte, S. Schlechtweg, Non-photorealistic computer graphic modeling rendering and animation (Morgan Kaufmann, Burlington, 2002)

    Google Scholar 

  49. H. Takagi, Interactive Evolutionary computation: fusion of the capabilities of EC optimization and human evaluation. Proc. IEEE 89(9), 1275–1296 (2001)

    Article  Google Scholar 

  50. D. Wackerly, W. Mendenhall, R. Scheaffer Mathematical Statistics with Applications, 6 edn. Duxbury Advanced Series (2002)

  51. A. Wiens, B. Ross, Gentropy: evolving 2d textures. Comput. Graph. J. 26(1), 75–88 (2006)

    Article  Google Scholar 

  52. G. Winkenbach, D. Salesin Computer-generated pen-and-ink illustration. In: SIGGRAPH ’94 proceedings of annual conference series on computer graphics proceedings. New York, ACM Press (1994)

  53. S. Yamamoto, X. Mao, A. Imamiya Colored pencil filter with custom colors. In: PG ’04 Proceedings of 12th Pacific conference on computer graphics and applications, pp. 329–338. IEEE Computer Society Washington, DC, USA (2004)

  54. Yip C. Evolving image filters. Master’s thesis, Imperial College of Science, Technology and Medicine (2004)

  55. K. Zeng, M. Zhao, C. Xiong, S.C. Zhu, From Image parsing to painterly rendering. ACM Trans. on Graphics 29(1), 1–11 (2009)

    Article  Google Scholar 

Download references

Acknowledgments

Thanks to Cale Fairchild for his system support, and Beatrice Ombuki-Berman and Sheridan Houghten for their helpful comments. This research is funded by NSERC Discovery Grant 138467.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Brian J. Ross.

Rights and permissions

Reprints and Permissions

About this article

Verify currency and authenticity via CrossMark

Cite this article

Baniasadi, M., Ross, B.J. Exploring non-photorealistic rendering with genetic programming. Genet Program Evolvable Mach 16, 211–239 (2015). https://doi.org/10.1007/s10710-014-9234-0

Download citation

  • Received:

  • Revised:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10710-014-9234-0

Keywords

  • Non-photorealistic rendering
  • Genetic programming
  • Evolutionary art.