Skip to main content

Digital Models and Sensory Substitution Devices: An Inclusive Communication of Architecture Through Sound

  • Conference paper
  • First Online:
Graphic Horizons (EGA 2024)

Abstract

The singular nature of architecture, compared to other types of artistic experience, admits the spatial component as the main reference for understanding an object. While scientific advances in the production of digital models have allowed for more and more interaction on the part of the common user, in the field of communication for the blind and visually impaired, we still often rely on physical models that make touch the instrument of the subject's overall perception. Storing so much information in a model that only acts on one level of perception could be reductive and compromise the experience of the user who would find himself interacting with a scaled-down product with only some of the features of the real object. The aim of the study is to proceed by integrating the gaps in the image formation process resulting from the processing of sensory data, reconstructing the path of information that, thanks to virtual reality, translates into stimuli that are easier to understand.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 219.00
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Hardcover Book
USD 279.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Amedi, A., Merabet, L.B., Bermpohl, F., Pascual-Leone, A.: The occipital cortex in the blind: Lessons about plasticity and vision. Curr. Dir. Psychol. Sci. 14(6), 306–311 (2005)

    Article  Google Scholar 

  2. Arbel, R., Heimler, B., Amedi, A.: Face shape processing via visual-to-auditory sensory substitution activates regions within the face processing networks in the absence of visual experience. Front. Neurosci. 16 (2022)

    Google Scholar 

  3. Netzer, O., Heimler, B., Shur, A., et al.: Backward spatial perception can be augmented through a novel visual-to-auditory sensory substitution algorithm. Sci. Rep. 11, 11944 (2021)

    Article  Google Scholar 

  4. Arbel, R., Heimler, B., Amedi, A.: Congenitally blind adults can learn to identify face-shapes via auditory sensory substitution and successfully generalize some of the learned features. Sci. Rep. 12, 4330 (2022). https://doi.org/10.1038/s41598-022-08187-z

    Article  Google Scholar 

  5. Bergamo, F.: Il Disegno del paesaggio sonoro. Mimesis/Architettura: Milano (2018)

    Google Scholar 

  6. Meijer, P.B.L.: An experimental system for auditory image representation. IEEE Trans. Biomed. Eng. 39(2), 112–121 (1992)

    Article  Google Scholar 

  7. Chebat, D.-R., Maidenbaum, S., Amedi, A.: Navigation using sensory substitution in real and virtual mazes. PLoS ONE 10(6), 1–18 (2015)

    Article  Google Scholar 

  8. Collignon, O., Lassonde, M., Lepore, F., Bastien, D., Veraart, C.: Functional cerebral reorganization for auditory spatial processing and auditory substitution of vision in early blind subjects. Cereb. Cortex 17(2), 457–465 (2007). https://doi.org/10.1093/cercor/bhj162

    Article  Google Scholar 

  9. Garroni, E.: Immagine Linguaggio Figura. Laterza: Roma (2010)

    Google Scholar 

  10. Kubovy, M., Van Valkenburg, D.: Auditory and visual objects. Cognition 80, 97–126 (2001)

    Article  Google Scholar 

  11. Legge 9 gennaio 1989, n. 13, “Provisions to promote the overcoming and elimination of architectural barriers in private buildings”

    Google Scholar 

  12. Legge 3 aprile 2001, n. 138, “Classification and quantification of visual impairments and standards for eye tests”

    Google Scholar 

  13. Maidenbaum, S., Buchs, G., Abboud, S., Lavi-Rotbain, O., Amedi, A.: Perception of graphical virtual environments by blind users via sensory substitution. PLoS ONE 11(2), 1–21 (2016). https://doi.org/10.1371/journal.pone.0147501

    Article  Google Scholar 

  14. Maidenbaum, S., Levy-Tzedek, S., Chebat, D.R., Amedi, A.: Increasing accessibility to the blind of virtual environments, using a virtual mobility aid based on the “EyeCane”: feasibility study. PLoS ONE 8(8), 1–7 (2013). https://doi.org/10.1371/journal.pone.0072555

    Article  Google Scholar 

  15. Merleau-Ponty, M.: Il visibile e l’invisibile. Bompiani: Milano (1993)

    Google Scholar 

  16. Migliari, R.: Il disegno degli ordini e il rilievo dell’architettura classica: Cinque Pezzi Facili. Disegnare idee e immagini 1(2), 49–66 (1990)

    Google Scholar 

  17. Sacks, O.: Musicofilia. Adelphi: Milano (2010)

    Google Scholar 

  18. Schafer, R.M.: The Soundscape: Our Sonic Environment and the Tuning of the World. Destiny Books, Rochester (1997)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Salvatore Di Pace .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2024 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Di Pace, S., Ippolito, A., Vidal, F.J. (2024). Digital Models and Sensory Substitution Devices: An Inclusive Communication of Architecture Through Sound. In: Hermida González, L., Xavier, J.P., Amado Lorenzo, A., Fernández-Álvarez, Á.J. (eds) Graphic Horizons. EGA 2024. Springer Series in Design and Innovation , vol 43. Springer, Cham. https://doi.org/10.1007/978-3-031-57575-4_40

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-57575-4_40

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-57574-7

  • Online ISBN: 978-3-031-57575-4

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics