Advertisement

Multimedia Tools and Applications

, Volume 62, Issue 3, pp 581–599 | Cite as

Sketch-based design for green geometry and image deformation

  • Bin Sheng
  • Weiliang Meng
  • Hanqiu Sun
  • Enhua Wu
Article

Abstract

User interfaces have traditionally followed the WIMP (window, icon, menu, pointer) paradigm. Though functional and powerful, they are usually cumbersome for a novice user to design a complex model, requiring considerable expertise and effort. This paper presents a system for designing geometric models and image deformation with sketching curves, with the use of Green coordinates. In 3D modeling, the user first creates a 3D model by using a sketching interface, where a given 2D curve is interpreted as the projection of the 3D curve. The user can add, remove, and deform these control curves easily, as if working with a 2D line drawing. For a given set of curves, the system automatically identifies the topology and face embedding by applying graph rotation system. Green coordinates are then used to deform the generated models with detail-preserving property. Also, we have developed a sketch-based image-editing interface to deform image regions using Green coordinates. Hardware-assisted schemes are provided for both control shape deformation and the subsequent surface optimization, the experimental results demonstrate that 3D/2D deformations can be achieved in realtime.

Keywords

Sketch-based deformation Green coordinates Optimization Laplace’s equation 

Notes

Acknowledgements

The authors would like to thank all reviewers for their helpful suggestions and constructive comments, which have significantly improved our paper. Many thanks to Shunbing Chen for implementing and testing many parts of our system, to Dr. Jin Huang (Zhejiang University) for useful discussions. The work is supported by National Basic Research Program of China (973 Program) No. 2009CB320802, 2011CB302200, National Natural Science Foundation of China No. 60833007,60873136, Beijing Natural Science Foundation (Content-Aware Image Synthesis and Its Applications, No. 4112061), French System@tic Paris-Region(CSDLProject) and ANR-NSFC No.60911130368, Hong Kong Research Grants Council grants 416007 and 415806.

References

  1. 1.
    Andreou I, Sgouros N (2007) Utilizing shape retrieval in sketch synthesis. Multimed Tools Appl 32:275–291CrossRefGoogle Scholar
  2. 2.
    Arts E (2007) SPORE. http://www.spore.com
  3. 3.
    Autodesk (2008) 3DS MAX. http://www.autodesk.com/
  4. 4.
    Autodesk (2008) MAYA. http://www.autodesk.com/
  5. 5.
    Beier T, Neely S (1992) Feature-based image metamorphosis. In: SIGGRAPH ’92: proceedings of the 19th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 35–42CrossRefGoogle Scholar
  6. 6.
    Bookstein FL (1989) Principal warps: thin-plate splines and the decomposition of deformations. IEEE Trans Pattern Anal Mach Intell 11(6):567–585zbMATHCrossRefGoogle Scholar
  7. 7.
    Botsch M, Kobbelt L (2005) Real-time shape editing using radial basis functions. In: Computer graphics forum, pp 611–621Google Scholar
  8. 8.
    Derose T, Meyer M (2006) Harmonic coordinates. Tech. rep., Pixar Animation StudiosGoogle Scholar
  9. 9.
    Duchamp T, Certain A, Derose A, Stuetzle W (1997) Hierarchical computation of pl harmonic embeddings. Tech. rep.Google Scholar
  10. 10.
    Floater MS (2003) Mean value coordinates. Comput Aided Geom Des 20(1):19–27MathSciNetzbMATHCrossRefGoogle Scholar
  11. 11.
    Floater MS, Kós G, Reimers M (2005) Mean value coordinates in 3D. Comput Aided Geom Des 22(7):623–631zbMATHCrossRefGoogle Scholar
  12. 12.
    George PL, Borouchaki H (1998) Delaunay triangulation and meshing. Hermes, Paris, FranceGoogle Scholar
  13. 13.
    Guskov I, Sweldens W, Schröder P (1999) Multiresolution signal processing for meshes. In: SIGGRAPH ’99: proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 325–334CrossRefGoogle Scholar
  14. 14.
    Huang J, Shi X, Liu X, Zhou K, Wei LY, Teng SH, Bao H, Guo B, Shum HY (2006) Subspace gradient domain mesh deformation. ACM Trans Graph 25(3):1126–1134CrossRefGoogle Scholar
  15. 15.
    Igarashi T, Hughes J (2003) Smooth meshes for sketch-based freeform modeling. In: Proceedings of the 2003 symposium on interactive 3D graphics, pp 139–142Google Scholar
  16. 16.
    Igarashi T, Matsuoka S, Tanaka H (1999) Teddy: a sketching interface for 3d freeform design. In: Proceedings of ACM SIGGRAPH 1999. ACM, ACM Press/ACM SIGGRAPH, pp 409–416Google Scholar
  17. 17.
    Igarashi T, Moscovich T, Hughes JF (2005) As-rigid-as-possible shape manipulation. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 1134–1141CrossRefGoogle Scholar
  18. 18.
    Joshi P, Meyer M, DeRose T, Green B, Sanocki T (2007) Harmonic coordinates for character articulation. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers. ACM, New York, NY, USA, p 71Google Scholar
  19. 19.
    Ju T, Schaefer S, Warren J (2005) Mean value coordinates for closed triangular meshes. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 561–566CrossRefGoogle Scholar
  20. 20.
    Ju T, Schaefer S, Warren J (2005) Mean value coordinates for closed triangular meshes. ACM Trans Graph 24(3):561–566CrossRefGoogle Scholar
  21. 21.
    Karpenko OA, Hughes JF (2006) Smoothsketch: 3D free-form shapes from complex sketches. ACM Trans Graph 25(3):589–598CrossRefGoogle Scholar
  22. 22.
    Karpenko OA, Hughes JF, Raskar R (2002) Free-form sketching with variational implicit surfaces. Comput Graph Forum 21(3):585–594CrossRefGoogle Scholar
  23. 23.
    Kobbelt L, Campagna S, Vorsatz J, Seidel HP (1998) Interactive multi-resolution modeling on arbitrary meshes. In: SIGGRAPH ’98: proceedings of the 25th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, USA, pp 105–114CrossRefGoogle Scholar
  24. 24.
    Lipman Y, Levin D, Cohen-Or D (2008) Green coordinates. In: SIGGRAPH ’08: ACM SIGGRAPH 2008 papers. ACM, New York, NY, USA, pp 1–10CrossRefGoogle Scholar
  25. 25.
    Lipman Y, Sorkine O, Cohen-Or D, Levin D, Rössl C, Seidel HP (2004) Differential coordinates for interactive mesh editing. In: Proceedings of shape modeling international. IEEE Computer Society Press, Los Alamitos, CA, pp 181–190Google Scholar
  26. 26.
    MacCracken R, Joy KI (1996) Free-form deformations with lattices of arbitrary topology. In: SIGGRAPH ’96: proceedings of the 23rd annual conference on computer graphics and interactive techniques. ACM, New York, NY, USA, pp 181–188CrossRefGoogle Scholar
  27. 27.
    Meng W, Sheng B, Wang S, Sun H, Wu E (2009) Interactive image deformation using cage coordinates on gpu. In: VRCAI, pp 119–126Google Scholar
  28. 28.
    Nealen A, Igarashi T, Sorkine O, Alexa M (2007) FiberMesh: designing freeform surfaces with 3D curves. ACM SIGGRAPHGoogle Scholar
  29. 29.
    Schaefer S, McPhail T, Warren J (2006) Image deformation using moving least squares. In: SIGGRAPH ’06: ACM SIGGRAPH 2006 papers. ACM, New York, NY, USA, pp 533–540CrossRefGoogle Scholar
  30. 30.
    Sheng B, Li P, Sun H (2009) Image-based material restyling with fast non-local means filtering. In: ICIG, pp 841–846Google Scholar
  31. 31.
    Sheng B, Wu E, Sun H (2008) Sketching freeform meshes using graph rotation functions. Vis Comput 24(7–9):745–752CrossRefGoogle Scholar
  32. 32.
    Shewchuk JR (1996) Triangle: engineering a 2D quality mesh generator and delaunay triangulator. In: First workshop on applied computational geometry. ACM Press, pp 124–133Google Scholar
  33. 33.
    Sumner RW, Schmid J, Pauly M (2007) Embedded deformation for shape manipulation. In: SIGGRAPH ’07: ACM SIGGRAPH 2007 papers. ACM, New York, NY, USA, p 80CrossRefGoogle Scholar
  34. 34.
    Wan X, Jin X (2011) Data-driven facial expression synthesis via laplacian deformation. Multimed Tools Appl 1–15. doi: 10.1007/s11042-010-0688-7
  35. 35.
    Weng Y, Shi X, Bao H, Zhang J (2008) Sketching MLS image deformations on the GPU. Comput Graph Forum 27(7):1789–1796CrossRefGoogle Scholar
  36. 36.
    Yu H, Qin S, Sun G, Wright D (2011) On generating realistic avatars: dress in your own style. Multimed Tools Appl 1–18. doi: 10.1007/s11042-011-0781-6
  37. 37.
    Yu Y, Zhou K, Xu D, Shi X, Bao H, Guo B, Shum HY (2004) Mesh editing with poisson-based gradient field manipulation. In: SIGGRAPH ’04: ACM SIGGRAPH 2004 papers. ACM, New York, NY, USA, pp 644–651CrossRefGoogle Scholar
  38. 38.
    Zeleznik RC, Herndon KP, Hughes JF (1996) Sketch: an interface for sketching 3D scenes. In: Proceedings of ACM SIGGRAPH 1996. ACM Press, pp 163–170Google Scholar
  39. 39.
    Zhou K, Huang J, Snyder J, Liu X, Bao H, Guo B, Shum HY (2005) Large mesh deformation using the volumetric graph laplacian. In: SIGGRAPH ’05: ACM SIGGRAPH 2005 papers. ACM, New York, NY, USA, pp 496–503CrossRefGoogle Scholar

Copyright information

© Springer Science+Business Media, LLC 2011

Authors and Affiliations

  • Bin Sheng
    • 1
    • 2
  • Weiliang Meng
    • 3
  • Hanqiu Sun
    • 4
  • Enhua Wu
    • 5
    • 6
  1. 1.Department of Computer Science and EngineeringShanghai Jiao Tong UniversityShanghaiChina
  2. 2.Department of Computer Science and EngineeringThe Chinese University of Hong KongShatinChina
  3. 3.Institute of Software, Chinese Academy of Sciences, LIAMA-NLPR, CAS Institute of AutomationBeijingChina
  4. 4.The Chinese University of Hong KongShatinChina
  5. 5.Institute of Software, Chinese Academy of SciencesBeijingChina
  6. 6.University of MacauMacauChina

Personalised recommendations