Skip to main content
SpringerLink
Log in

Sketching 3D Immersed Experiences Rapidly by Hand Through 2D Cross Sections

  • Conference paper
  • First Online:
Online Engineering & Internet of Things

Part of the book series: Lecture Notes in Networks and Systems ((LNNS,volume 22))

Abstract

Sketching 3D immersed experiences often require the designer to use some 3D modelling tool. The tools slow down the designers and can be a hindrance to the creative process. Moreover, the results often have the appearance of finished products. Hand sketching however, allows the designer more rapidly to express ideas that suddenly emerge and quickly disappear. Moreover, sketches drawn by hand have the advantage of looking unfinished. This paper proposes a simple method for making 3D sketches by hand and even on paper. Tool support is provided for transforming the sketches into 3D models that can be viewed using standard viewers that give viewers the immersed experience. The sketches can also be overlaid on existing panoramic images used for backgrounds. Sketches of 3D scenes and models are created by sketching various cross-sections of the scene from various angles. Several cases are used to illustrate how the framework is used. The sketches are viewed using a standard off-the-shelf panorama or point cloud viewers.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 259.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 329.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

References

  1. Buxton, B.: Sketching User Experiences: Getting the Design Right and the Right Design: Getting the Design Right and the Right Design. Morgan Kaufmann, San Francisco (2010)

    Google Scholar 

  2. Black, A.: Visible planning on paper and on screen: the impact of working medium on decision-making by novice graphic designers. Behav. Inf. Technol. 9, 283–296 (1990)

    Article  Google Scholar 

  3. Sandnes, F.E., Jian, H.L.: Sketching with Chinese calligraphy. Interactions 19, 62–66 (2012)

    Article  Google Scholar 

  4. Landay, J.A., Myers, B.A.: Interactive sketching for the early stages of user interface design. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 43–50. ACM Press/Addison-Wesley Publishing Co. (1995)

    Google Scholar 

  5. Landay, J., Myers, B.: Sketching interfaces: toward more human interface design. Computer 34, 56–64 (2001)

    Article  Google Scholar 

  6. Olsen, L., Samavati, F.F., Sousa, M.C., Jorge, J.A.: Sketch-based modeling: a survey. Comput. Graph. 33, 85–103 (2009)

    Article  Google Scholar 

  7. Kondo, K.: Interactive geometric modeling using freehand sketches. J. Geom. Graph. 13, 195–207 (2009)

    MathSciNet  MATH  Google Scholar 

  8. Huang, Y.P., Wang, S.S., Sandnes, F.E.: RFID-based guide gives museum visitors more freedom. IT Prof. Mag. 13, 25 (2011)

    Article  Google Scholar 

  9. Xiong, Y., Turkowski, K.: Registration, calibration and blending in creating high quality panoramas. In: Fourth IEEE Workshop on of Applications of Computer Vision (WACV 1998), pp. 69–74. IEEE Press (1998)

    Google Scholar 

  10. Kweon, G., Choi, Y.: Image-processing based panoramic camera employing single fisheye lens. J. Opt. Soc. Korea 14, 245–259 (2010)

    Article  Google Scholar 

  11. Senore, F.: FSPViewer. http://www.fsoft.it/FSPViewer/. Accessed 20 Nov 2015

  12. Keane, T.P., Cahill, N.D., Rhody, H., Hu, B., Tarduno, J., Jacobs, R., Pelz. J.: Sphere 2: Jerry’s rig, an OpenGL application for non-linear panorama viewing and interaction. In: Image Processing Workshop (WNYIPW), pp. 13–16. IEEE Press (2012)

    Google Scholar 

  13. Anguelov, D., Dulong, C., Filip, D., Frueh, C., Lafon, S., Lyon, R., Ogale, A., Vincent, L., Weaver, J.: Google street view: capturing the world at street level. Computer 6, 32–38 (2010)

    Article  Google Scholar 

  14. Kwiatek, K., Woolner, M.: Transporting the viewer into a 360 heritage story: panoramic interactive narrative presented on a wrap-around screen. In: 16th International Conference on Virtual Systems and Multimedia (VSMM), pp. 234–241. IEEE Press (2010)

    Google Scholar 

  15. Ku, D.C., Qin, S.F., Wright, D.K.: What is on the backside of the paper? From 2D sketch to 3D model. In: The 20th BCS HCI Group Conference, British Computer Society (2006)

    Google Scholar 

  16. Naya, F., Jorge, J., Conesa, J., Contero, M., Gomis, J.M.: Direct modeling: from sketches to 3D models. In: Proceedings of the 1st Ibero-American Symposium in Computer Graphics SIACG, pp. 109–117 (2002)

    Google Scholar 

  17. Contero, M., Naya, F., Gomis, J.M., Conesa, J.: Calligraphic interfaces and geometric reconstruction. In: 12th ADM International Conference on Design Tools (2001)

    Google Scholar 

  18. Cherlin, J.J., Samavati, F., Sousa, M.C., Jorge, J.A.: Sketch-based modeling with few strokes. In: Proceedings of the 21st Spring Conference on Computer Graphics, pp. 137–145. ACM (2005)

    Google Scholar 

  19. Matondang, M.Z., Mardzuki, S., Haron, H.: Transformation of engineering sketch to valid solid object. In: Proceedings of International Conference of the 9th Asia Pacific Industrial Engineering & Management Systems (APIEMS 2008) Conference and The 11th Asia Pacific Regional Meeting of International Foundation for Production Research, pp. 2707–2715 (2008)

    Google Scholar 

  20. Eggli, L., Hsu, C., Brüderlin, B.D., Elber, G.: Inferring 3D models from freehand sketches and constraints. Comput. Aided Des. 29, 101–112 (1997)

    Article  Google Scholar 

  21. Contero, M., Naya, F., Jorge, J., Conesa, J.: CIGRO: a minimal instruction set calligraphic interface for sketch-based modeling. In: Computational Science and Its Applications—ICCSA 2003, pp. 549–558. Springer, Berlin Heidelberg (2003)

    Google Scholar 

  22. Huang, Y.P., Chang, T.W., Chen, Y.R., Sandnes, F.E.: A back propagation based real-time license plate recognition system. Int. J. Pattern Recognit. Artif. Intell. 22, 233–251 (2008)

    Article  Google Scholar 

  23. Huang, Y.P., Hsu, L.W., Sandnes, F.E.: An intelligent subtitle detection model for locating television commercials. IEEE Trans. Syst. Man Cybern. Part B 37(2), 485–492 (2007)

    Article  Google Scholar 

  24. Qin, S.F., Wright, D.K., Jordanov, I.N.: From on-line sketching to 2D and 3D geometry: a system based on fuzzy knowledge. Comput. Aided Des. 32, 851–866 (2000)

    Article  Google Scholar 

  25. Yang, C., Sharon, D., van de Panne, M.: Sketch-based modeling of parameterized objects. In: EG Workshop on Sketch-Based Interfaces and Modeling, pp. 63–72 (2005)

    Google Scholar 

  26. Fiorentino, M., Monno, G., Renzulli, P.A., Uva, A.E.: 3D sketch stroke segmentation and fitting in virtual reality. In: Proceedings of GRAPHICON, pp. 188–191 (2003)

    Google Scholar 

  27. Kim, D.H., Kim, M.J.: A new modeling interface for the pen-input displays. Comput. Aided Des. 38, 210–223 (2006)

    Article  Google Scholar 

  28. Shtof, A., Agathos, A., Gingold, Y., Shamir, A., Cohen-Or, S.: Geosemantic snapping for sketch-based modeling. Comput. Graph. Forum 32, 245–253 (2013)

    Article  Google Scholar 

  29. Roth-Koch, S.: Digitalization of paper sketches integration of the non digital draft. In: Proceedings of the 2011 Conference on Designing Pleasurable Products and Interfaces, p. 39. ACM (2011)

    Google Scholar 

  30. Kerautret, B., Granier, X., Braquelaire. A.: Intuitive shape modeling by shading design. In: Smart Graphics, pp. 163–174. Springer, Heidelberg (2005)

    Google Scholar 

  31. Shin, H., Igarashi, T.: Magic canvas: interactive design of a 3-D scene prototype from freehand sketches. In: Proceedings of Graphics Interface 2007, pp. 63–70. ACM (2007)

    Google Scholar 

  32. Igarashi, T., Matsuoka, S., Tanaka, H.: Teddy: a sketching interface for 3D freeform design. In: ACM SIGGRAPH 2007 Courses, p. 21. ACM (2007)

    Google Scholar 

  33. Tai, C.L., Zhang, H., Fong, J.C.K.: Prototype modeling from sketched silhouettes based on convolution surfaces. Comput. Graph. Forum 23, 71–83 (2004)

    Article  Google Scholar 

  34. Tolba, O., Dorsey, J., McMillan, L.: Sketching with projective 2D strokes. In: Proceedings of the 12th Annual ACM Symposium on User Interface Software and Technology, pp. 149–157. ACM (1999)

    Google Scholar 

  35. Sandnes, F.E.: Communicating panoramic 360 degree immersed experiences: a simple technique for sketching in 3D. In: Antona, M., Stephanidis, C. (eds.) Proceedings of HCI International 2016, Universal Access in Human-Computer Interaction. Interaction Techniques and Environments. LNCS, vol. 9738, pp. 338–346. Springer, Heidelberg (2016)

    Google Scholar 

  36. Sandnes, F.E.: Where was that photo taken? Deriving geographical information from image collections based on temporal exposure attributes. Multimed. Syst. 16, 309–318 (2010)

    Article  Google Scholar 

  37. Sandnes, F.E.: Determining the geographical location of image scenes based on object shadow lengths. J. Signal Process. Syst. 65, 35–47 (2011)

    Article  Google Scholar 

  38. Sandnes, F.E.: PanoramaGrid – a graph paper tracing framework for sketching 360-degree immersed experiences. In: Proceedings of the International Working Conference on Advanced Visual Interfaces (AVI 2016), pp. 342–343. ACM (2016)

    Google Scholar 

  39. Sandnes, F.E., Huang, Y.P.: Translating the viewing position in single equirectangular panoramic images. In: Proceedings of SMC 2016. IEEE Press (2016)

    Google Scholar 

  40. Shi, F., Laganiere, R., Dubois, E., Labrosse, F.: On the use of ray-tracing for viewpoint interpolation in panoramic imagery. In: Canadian Conference on Computer and Robot Vision (CRV 2009), pp. 200–207. IEEE Press (2009)

    Google Scholar 

  41. Kolhatkar, S., Laganiere, R.: Real-time virtual viewpoint generation on the GPU for scene navigation. In: Canadian Conference on Computer and Robot Vision (CRV), pp. 55–62. IEEE Press (2010)

    Google Scholar 

  42. Zhang, C., Zhao, Y., Wu, F.: Triangulation of cubic panorama for view synthesis. Appl. Opt. 50, 4286–4294 (2011)

    Article  Google Scholar 

  43. Cohen, J.M., Hughes, J.F., Zeleznik. R.C.: Harold: a world made of drawings. In: Proceedings of the 1st International Symposium on Non-photorealistic Animation and Rendering. ACM (2000)

    Google Scholar 

  44. Fei, G.: 3D animation creation using space canvases for free-hand drawing. In: Proceedings of the 7th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry. ACM (2008)

    Google Scholar 

  45. Dorsey, J.: The mental canvas: a tool for conceptual architectural design and analysis. In: 15th Pacific Conference on Computer Graphics and Applications (PG 2007). IEEE (2007)

    Google Scholar 

  46. Greenberg, S., Carpendale, S., Marquardt, N., Buxton, N.: Sketching User Experiences: The Workbook. Elsevier, Waltham (2011)

    Google Scholar 

  47. Girardeau-Montaut, D.: Cloudcompare-open source project. OpenSource Project (2011)

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department Computer Science, Faculty of Technology, Art and Design, Oslo and Akershus University College of Applied Sciences, Oslo, Norway

    Frode Eika Sandnes

  2. Faculty of Technology, Westerdals Oslo School of Art, Communication and Technology, Oslo, Norway

    Frode Eika Sandnes

Authors
  1. Frode Eika Sandnes
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Frode Eika Sandnes .

Editor information

Editors and Affiliations

  1. Carinthia University of Applied Sciences , Villach, Austria

    Michael E. Auer

  2. Carinthia University of Applied Sciences , Villach, Austria

    Danilo G. Zutin

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer International Publishing AG

About this paper

Cite this paper

Sandnes, F.E. (2018). Sketching 3D Immersed Experiences Rapidly by Hand Through 2D Cross Sections. In: Auer, M., Zutin, D. (eds) Online Engineering & Internet of Things. Lecture Notes in Networks and Systems, vol 22. Springer, Cham. https://doi.org/10.1007/978-3-319-64352-6_93

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-64352-6_93

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-64351-9

  • Online ISBN: 978-3-319-64352-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation