Skip to main content
SpringerLink
Log in

Sketch-based modeling from a paper-based overtraced freehand sketch

  • ORIGINAL ARTICLE
  • Published:
The International Journal of Advanced Manufacturing Technology Aims and scope Submit manuscript

Abstract

Freehand sketch is a natural and intuitive communication channel for idea expression. Lines are drawn one after another to create the outline before additional lines are often drawn over the existing ones to make a sketch clearer. Typically, the sketch is transformed to be a 3D CAD model by a designer for use in subsequent operations. Sketch-based modeling has been researched to support this transformation but mainly for an online sketch on a digital device. For an offline sketch on a paper, commonly found used in practice, sketch-based modeling remains a challenge because a scanned image conceals enriched information on the sketch in a batch of data points. This paper proposes an approach for reconstructing a 3D model from a paper-based overtraced freehand sketch. Two main modules in this approach are single-line drawing identification and 3D reconstruction. The first module where image processing technique is applied is for transforming a paper-based overtraced freehand sketch to be a single-line drawing in order to generate more information about the sketch (i.e., the number of lines and their starting points and endpoints). The second module where progressive reconstruction approach with cubic corner is applied is for reconstructing a 3D model from the obtained single-line drawing. Steps to be taken in both modules have been formalized. The approach has been successfully implemented on LabVIEW, and tested with several samples.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Schoene C, Hoffmann J (1997) Reverse Engineering based on multi-axis digitizer data. Proceedings of International Conference on Manufacturing Automation (ICMA’97), pp. 909–914

  2. Wesley MA, Markowsky G (1981) Fleshing out projection. IBM J Res Dev 25:934–954

    Article  MathSciNet  Google Scholar 

  3. Watanabe T, Tashiro A, Fujii S (1995) Estimation of three-dimensional objects from orthographic view with inconsistencies. Comput Graph 19:815–829

    Article  Google Scholar 

  4. Shin BS, Shin YG (1998) Fast 3D solid model reconstruction from orthographic views. Comput Aided Des 30:63–76

    Article  Google Scholar 

  5. Chen KZ, Feng XA (2003) Solid model reconstruction from engineering paper drawings using genetic algorithm. Comput Aided Des 35:1235–1248

    Article  Google Scholar 

  6. Aldefeld B (1983) On automatic recognition of 3D structures from 2D representations. Comput Aided Des 15:59–64

    Article  Google Scholar 

  7. Bin H (1986) Inputting constructive solid geometry representations directly from 2D orthographic engineering drawings. Comput Aided Des 18:147–155

    Article  Google Scholar 

  8. Shum SSP, Lau WS, Yuen MMF, Yu KM (1997) Solid reconstruction from orthographic opaque views using incremental extrusion. Comput Graph 21:787–800

    Article  Google Scholar 

  9. Tam KS, Atkinson J (2003) An approach for creating solid models from orthogonal views by identification of Boolean operations. J Mater Process Technol 138:163–169

    Article  Google Scholar 

  10. Lamb D, Bandopadhay A (1990) Interpreting a 3D object from a rough 2D line drawing. Proceedings of the 1st IEEE Conference on Visualization, San Francisco, California, USA, pp. 59–66

  11. Company P, Contero M, Varley P, Aleixos N, Naya F (2009) Computer-aided sketching as a tool to promote innovation in the new product development process. Comput Ind 60:592–603

    Article  Google Scholar 

  12. Lim S, Qin SF, Prieto P, Wright D, Shackleton J (2004) A study of sketching behavior to support free-form surface modeling from online sketching. Des Stud 25:393–413

    Article  Google Scholar 

  13. Won PH (2000) The comparison between visual thinking using computer and conventional media in the concept generation stages of design. Autom Constr 10:319–325

    Article  Google Scholar 

  14. Stones C (2007) Comparing synthesis strategies of novice graphic designers using digital and traditional design tools. Des Stud 28:59–72

    Article  Google Scholar 

  15. Olsen L, Samavati FF, Sousa MC, Jorge JA (2009) Sketch-based modeling: a survey. Comput Graph 33:85–103

    Article  Google Scholar 

  16. Shesh A, Chen B (2004) SMARTPAPER: an interactive and user friendly sketching system. Comput Graph Forum 23:301–310

    Article  Google Scholar 

  17. Ku DC, Qin SF, Wright DK (2006) Interpretation of overtracing freehand sketching for geometric shapes. Proceedings of WSCG’ 2006 Conference in Central Europe on Computer Graphics, Visualization and Computer Vision, Plzen, Czech Republic, pp. 263–270

  18. Pusch R, Samavati F, Nasri A, Wyvill B (2007) Improving the sketch-based interface: forming curves from many small strokes. Vis Comput Int J Comput Graph 23:955–962

    Google Scholar 

  19. Marti E, Regions J, Lopez-Krahe J, Villanueva JJ, Line drawing interpretation as polyhedral objects to man–machine interaction in CAD systems. Pattern Recognition and Image Analysis 1–12

  20. Haron H, Mohamed D, Shamsuddin SM (2003) Extraction of junctions, lines and regions of irregular line drawing: the chain code processing algorithm. Jurnal Teknologi 38:1–28

    Article  Google Scholar 

  21. Farrugia PJ, Borg JC, Camilleri KP, Spiteri C, Bartolo A (2004) A cameraphone-based approach for the generation of 3D models from paper sketches. Proceeding of EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling pp. 33–42

  22. Bae SH, Balakrishnan R, Singh K (2008) ILoveSketch: as-natural-as-possible sketching system for creating 3D curve models. Proceedings of the 21st annual ACM symposium on User interface software and technology Monterey, California, USA, pp. 151–160

  23. Varley PAC, Takahashi Y, Mitani J, Suzuki H (2004) A two-stage approach for interpreting line drawings of curved objects. Proceedings of EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling, pp. 117–126

  24. Yang C, Sharon D, Panne M (2005) Sketch-based modeling of parameterized objects. Proceedings of the 2nd EUROGRAPHICS Workshop on Sketch-Based Interfaces and Modeling

  25. Kara LB, D’Eramo CM, Shimada K (2006) Pen-based styling design of 3D geometry using concept sketches and template models. Proceedings of the 2006 ACM Symposium on Solid and Physical Modeling Conference, Cardiff, Wales, United Kingdom

  26. Cheon SU, Han SH (2008) A template-based reconstruction of plane-symmetric 3D models from freehand sketches. Comput Aided Des 40:975–986

    Article  Google Scholar 

  27. Lipson H, Shpitalni M (1995) A new interfaced for conceptual design based on object reconstruction form a single freehand sketch. Annals of the CIRP 44:133–136

    Article  Google Scholar 

  28. Lipson H, Shpitalni M (1996) Optimization based reconstruction of a 3D object from a single freehand line drawing. Comput Aided Des 28:651–663

    Article  Google Scholar 

  29. Company P, Contero M, Conesa J, Piquer A (2004) An optimization-based reconstruction engine for 3D modeling by sketching. Comput Graph 28:955–979

    Article  Google Scholar 

  30. Kang D, Masry M, Lipson H (2004) Reconstruction of a 3D object from a main axis system. Proceeding of the American Association for Artificial Intelligence Fall Symposium on Making Pen-based Interaction Intelligent and Nature, pp. 63–69

  31. Masry M, Kang D, Lipson H (2005) A freehand sketching interface for progressive construction of 3D objects. Comput Graph 29:563–575

    Article  Google Scholar 

  32. Yuan S, Tsui LY, Jie S (2008) Regularity selection for effective 3D object reconstruction from a single line drawing. Pattern Recognit Lett 29:1486–1495

    Article  Google Scholar 

  33. Tian C, Masry M, Lipson H (2009) Physical sketching: reconstruction and analysis of 3D objects from freehand sketches. Comput Aided Des 41:147–158

    Article  Google Scholar 

  34. Jenkins DL, Martin RR (1992) Applying constraints to enforce users’ intentions in freehand 2D sketches. Intelligent System Engineering 1:31–49

    Article  Google Scholar 

  35. Shpitalni M, Lipson H (1995) Classification of sketch strokes and corner detection using conic sections and adaptive clustering. J Mech Des 119:131–135

    Article  Google Scholar 

  36. Qin SF (2005) Intelligent classification of sketch strokes. Proceedings of EUROCON 2005, Sebia & Montenegro, Belgrade

  37. Matsuda K, Sugishita S, Xu Z, Kondo K, Sato H, Shimada S (1997) Freehand sketch system for 3D geometric modeling. Proceedings of International Conference on Shape Modeling and Applications, Aizu-Wakamatsu, Japan, pp. 55–62

  38. Sezgin TM, Davis R (2004) Handling overtraced strokes in hand-drawn sketch. Proceedings of the AAAI Spring Symposium Series: Making Pen-Based Interaction Intelligent and Natural, Washington DC, USA, pp. 141–144

  39. Chansri N, Koomsap P (2011) Automatic single line drawing creation from a paper-based overtraced freehand sketch. Int J Adv Manuf Technol 59:221–242

    Article  Google Scholar 

  40. Wu MC, Lin MS (1996) Automatic construction of CSG solids from a single isometric drawing. Int J Comput Integr Manuf 9:1–21

    Article  MathSciNet  Google Scholar 

  41. Grimstead IJ, Martin RR (1995) Creating solid models from single 2D sketches, Proceedings of the 3rd Symposium on Solid Modeling Applications, Utah, USA, pp. 323–327

  42. Varley PAC, Martin RR (2000) A system for constructing boundary representation solid models from a two-dimensional sketch. Proceedings of the 1st Korea-UK Joint Workshop on Geometric Modeling and Computer Graphics, Seoul, pp 113–128

    Google Scholar 

  43. Clowes MB (1971) On seeing things. Artif Intell 2:79–112

    Article  Google Scholar 

  44. Huffman DA, Impossible objects as nonsense sentences. Machine Intelligence 295–323

  45. Waltz DL (1975) Understanding line drawings of scenes with shadows. The Psychology of Computer Vision. McGraw-Hill, New York, pp 19–91

    Google Scholar 

  46. Shpitalni M, Lipson H (1996) Identification of faces in a 2D line drawing projection of a wireframe object. IEEE Transactions on Pattern Analysis and Machine Intelligence 18:1000–1012

    Article  Google Scholar 

  47. Liu JZ, Lee YT (2001) A graph-based method for face identification from a single 2D line drawing. IEEE Transactions on Pattern Analysis and Machine Intelligence 23:1106–1119

    Article  Google Scholar 

  48. Oh BS, Kim CH (2003) Progressive reconstruction of 3D objects from a single freehand line drawing. Comput Graph 27:581–592

    Article  Google Scholar 

  49. Kuagoolkijgarn P, Koomsap P, Chansri N, A new algorithm for tracing nests of interconnected contours. Int. J. Adv. Manuf. Technol. 50: 717–727

  50. Sturges H (1926) The choice of a class-interval. J Am Stat Assoc 21:65–66

    Article  Google Scholar 

  51. Lee YT, Fang F (2011) 3D reconstruction of polyhedral objects from single parallel projections using cubic corner. Comput Aided Des 43:1025–1034

    Article  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Industrial Engineering, Faculty of Engineering at Si Racha, Kasetsart University, Chonburi, Thailand

    Natthavika Chansri

  2. Industrial and Manufacturing Engineering, School of Engineering and Technology, Asian Institute of Technology, Pathumthani, Thailand

    Pisut Koomsap

Authors
  1. Natthavika Chansri
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Pisut Koomsap
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Natthavika Chansri.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chansri, N., Koomsap, P. Sketch-based modeling from a paper-based overtraced freehand sketch. Int J Adv Manuf Technol 75, 705–729 (2014). https://doi.org/10.1007/s00170-014-6161-4

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00170-014-6161-4

Keywords

Search

Navigation