Abstract
This paper discusses a real-time virtual sculpting system in a non-photorealistic manner. Up till now, a majority of researchers pursuing virtual sculpting have highlighted the physical fidelity of simulation, with approaches for realizing photorealism being principal specialized contributions. We aim at capitalizing on the strengths of non-photorealistic rendering with respect to aesthetics, expression and computing expense. By means of touch-enabled manipulation, the haptic interaction is conducted to form the deformable surfaces, and the edge extraction is employed to stress boundaries. Afterwards, we utilize anisotropic diffusion to lessen unimportant details as well as a fresh inverse Gaussian bilateral filter for spot removal. Processed in a spatiotemporal style, the non-photorealistic rendering works to maintain coherence in time. Moreover, the parallel realization of the system put forward on graphics hardware (GPU) guarantees real-time behavior.
Similar content being viewed by others
References
Agusanto K, Li L, Chuangui Z, Sing N (2003) Photorealistic rendering for augmented reality using environment illumination. In: Proceedings of the 2nd IEEE/ACM international symposium on mixed and augmented reality, pp 208–216. IEEE Computer Society
Brown M, Semelka R, Nishino T (2004) MRI: basic principles and applications. Med Phys 31:170
Chen H, Sun H (2002) Real-time haptic sculpting in virtual volume space. In: Proceedings of the ACM symposium on virtual reality software and technology, pp 81–88. ACM, New York
Chen J, Paris S, Durand F (2007) Real-time edge-aware image processing with the bilateral grid. ACM Trans Graph (TOG) 26 (3):103
Collomosse J, Rowntree D, Hall P (2005) Stroke surfaces: temporally coherent artistic animations from video. IEEE Trans Vis Comput Graph 11 (5):540–549
Dachille F (1999) Haptic sculpting of dynamic surfaces. In: Symposium on interactive 3 D graphics: proceedings of the 1999 symposium on interactive 3 D graphics. Association for Computing Machinery, Inc, One Astor Plaza, 1515 Broadway, New York
Dachille Ix F, Qin H, Kaufman A (2001) A novel haptics-based interface and sculpting system for physics-based geometric design. Comput Aided Des 33 (5):403–420
DeCarlo D, Santella A (2002) Stylization and abstraction of photographs. In: Proceedings of the 29th annual conference on computer graphics and interactive techniques, pp 769–776. ACM , New York
Edwards J, Luecke G (1996) Physically based models for use in a force feedback virtual environment. In: Japan/USA symposium on flexible automation, pp 221–228
Fischer J, Bartz D, Strasser W (2005) Reality tooning: fast non-photorealism for augmented video streams. In: Proceedings of the Fourth IEEE and ACM international symposium on mixed and augmented reality, 2005, pp 186–187
Fischer J, Bartz D, Straßer W (2005) Stylized augmented reality for improved immersion. In: Proceedings of IEEE virtual reality (VR 2005), pp 195–202
Fischler M, Firschein O (1987) Intelligence: the eye, the brain, and the computer. Addison-Wesley Pub. Co., Reading
Gooch B, Reinhard E, Gooch A (2004) Human facial illustrations: creation and psychophysical evaluation. ACM Trans Graph (TOG) 23 (1):27–44
Haeberli P (1990) Paint by numbers: abstract image representations. In: Proceedings of the 17th annual conference on computer graphics and interactive techniques, pp 207–214. ACM , New York
Haller M, Landerl F, Billinghurst M (2005) More sketchy, more ar, more fun! In: ACM SIGGRAPH 2005 Posters. ACM, p 34
Higashi M, Aoki N, Kaneko T (2002) Application of haptic navigation to modify free-form surfaces through specified points and curves. J Comput Inf Sci Eng 2:265
James D, Pai D (1999) ArtDefo: accurate real time deformable objects. In: Proceedings of the 26th annual conference on computer graphics and interactive techniques, pp 65–72. ACM Press/Addison-Wesley Publishing Co., New York
Kang H, Lee S, Chui CK (2009) Flow-based image abstraction. IEEE Trans Vis Comput Graph 15 (1):62–76
Kozamernik F, Steinmann V, Sunna P, Wyckens E (2005) SAMVIQ: a new EBU methodology for video quality evaluations in multimedia. SMPTE Motion Imaging J 114 (4):152– 160
Mark W, Randolph S, Finch M, Van Verth J (1996) Adding force feedback to graphics systems: issues and solutions. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, pp 447–452. ACM, New York
McDonnell K, Qin H, Wlodarczyk R (2001) Virtual clay: a real-time sculpting system with haptic toolkits. In: Proceedings of the 2001 symposium on interactive 3D graphics, pp 179–190. ACM, New York
McMenemy K, Ferguson S (2007) A Hitchhikers guide to virtual reality. AK Peters, Ltd
Meier B (1996) Painterly rendering for animation. In: Proceedings of the 23rd annual conference on computer graphics and interactive techniques, pp 477–484. ACM, New York
Orzan A, Bousseau A, Barla P, Thollot J (2007) Structure-preserving manipulation of photographs. In: NPAR, pp 103–110
Pham TQ, van Vliet LJ (2005) Separable bilateral filtering for fast video preprocessing
Ruspini D, Kolarov K, Khatib O (1997) The haptic display of complex graphical environments. In: Proceedings of the 24th annual conference on computer graphics and interactive techniques, pp 345–352. ACM Press/Addison-Wesley Publishing Co., New York
Strothotte T, Schlechtweg S (2002) Non-photorealistic computer graphics: modeling, rendering, and animation. Morgan Kaufmann
Tomasi C, Manduchi R (1998) Bilateral filtering for gray and color images. In: Proceedings of the ICCV, pp 839–846
Verlet L (1968) Computer experiments on classical fluids. ii. equilibrium correlation functions. Phys Rev 165 (1):201–14
Wang J, Xu Y, Shum H, Cohen M (2004) Video tooning. In: International conference on computer graphics and interactive techniques, pp 574–583. ACM, New York
Winnemöller H, Olsen S, Gooch B (2006) Real-time video abstraction. ACM Trans Graph (TOG) 25 (3):1221–1226
Zhao H, Jin X, Shen J, Mao X, Feng J (2008) Real-time feature-aware video abstraction. Vis Comput 24 (7):727–734
Zilles C, Salisbury J (1995) A constraint-based god-object method for haptic display. In: Proceedings of the international conference on intelligent robots and systems, pp 146–151
Acknowledgments
Thanks to our colleagues for participating program testing and helpful discussion. The authors would like to thank all reviewers for their helpful suggestions and constructive comments. The work is supported by the National Natural Science Foundation of China (No. 61202154,61133009), and the National Basic Research Project of China (No. 2011CB302203), in part by Shanghai Pujiang Program under Grant 13PJ1404500, in part by the Open Project Program of the National Laboratory of Pattern Recognition (Chinese Academy of Sciences), and in part by the Open Project Program of the State Key Laboratory of CAD&CG, Zhejiang University, under Grant A1401.
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Lu, P., Sheng, B., Luo, S. et al. Image-based non-photorealistic rendering for realtime virtual sculpting. Multimed Tools Appl 74, 9697–9714 (2015). https://doi.org/10.1007/s11042-014-2146-4
Received:
Revised:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11042-014-2146-4