Skip to main content
SpringerLink
Log in

Multisensory Fruition Between Cultural Heritage and Digital Transformation

  • Chapter
  • First Online:
Perspectives on Design and Digital Communication III

Part of the book series: Springer Series in Design and Innovation ((SSDI,volume 24))

Abstract

The current context is characterised by the speed of change in the technological sphere and in particular by the interconnection—to the point of overlaying—between physical and digital space. This stimulates consideration on the opportunities to explore the new frontiers of knowledge through advanced technologies and unprecedented cognitive-sensory perceptions, both from the user’s viewpoint and from that of the researcher. The chapter provides a critical-analytical reflection on accessibility and multisensory issues as fundamental tools for transferring multilevel knowledge between physical and digital. Based on this study, it proposes the configuration of immersive knowledge-sharing environments where cultural heritage and scientific research intersect, placing the user at the centre of experience. The augmented, multilevel fruition, the tracking within the multisensory environment of psycho-physiological and behavioural users’ data, together with the assessment of experience itself, have guided the design experimentations undertaken for the new layout of the Museum of Contemporary Mediterranean Ceramics in Cava de’ Tirreni. This was conceived as a multisensory and accessible phygital laboratory of inclusion and dialogue, a dynamic and adaptive space for sharing and experiencing knowledge.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 84.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 109.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info
Hardcover Book
USD 109.99
Price excludes VAT (USA)
  • Durable hardcover edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Similar content being viewed by others

Notes

  1. 1.

    CEN: European Committee for Standardization, CENELEC: European Committee for Electrotechnical Standardization and ETSI: European Telecommunications Standards Institute.

  2. 2.

    Generative Adversarial Network.

References

  1. Anthes C, García-Hernández RJ, Wiedemann M, Kranzlmüller D (2016) State of the art of virtual reality technology. In: Proceedings of the 2016 IEEE aerospace conference, pp 1–19

    Google Scholar 

  2. ArtBooms (2021) Con dei robot fluttuanti e 53 litri di profumo Anicka Yi ha trasformato la Tate in uno stravagante acquario. https://www.artbooms.com/blog/anicka-yi-in-love-with-the-world. Last accessed 18 Feb 2022

  3. Badaloni F (2016) Architettura della Comunicazione. ilmiolibro self publishing

    Google Scholar 

  4. Baltz E (2017) Dream machine. https://emiliebaltz.com/commissions/dream-machine/. Last accessed 20 Feb 2022

  5. Balzola A, Rosa P (2019) L’arte fuori di sé: un manifesto per l’età post-tecnologica. Feltrinelli Editore, Milano

    Google Scholar 

  6. Bolter JD, Grusin R (2002) Remediation: competizione e integrazione tra media vecchi e nuovi. Guerini e associati, Milano

    Google Scholar 

  7. Bonacini E (2020) I musei e le forme dello storytelling digitale. Aracne Editrice, Canterano

    Google Scholar 

  8. Buiatti E (2014) Forma Mentis Neuroergonomia sensoriale applicata alla progettazione. FrancoAngeli, Milano

    Google Scholar 

  9. Buono M, Capece S (2017) Technological research and invention in the industrial design. Des J 20(1):S4052–S4064. https://doi.org/10.1080/14606925.2017.1352907

    Article  Google Scholar 

  10. Burdick A, Drucker J, Lunenfeld P, Presner T, Schnapp J (2012) Digital_Humanities. The MIT Press, Cambridge

    Book  Google Scholar 

  11. Carbone M (2022) Un metaverso tutto da inventare tra visioni partecipative e isolamento. Nòva 24 Frontiere, Il Sole 24 Ore (6 Feb 2022)

    Google Scholar 

  12. CASA BATLLÓ, Barcelona (2021) A JOURNEY INTO GAUDÍ’S BRILLIANCE. https://www.casabatllo.es/it/experience/. Last accessed 19 Feb 2022

  13. Castelfranchi C (2006) From conversation to interaction via behavioral communication: for a semiotic design of object, environments, and behaviors. In: Bagnara S, Crampton-Smith G (eds) Theories and practice in interaction design, pp 157–179. Lawrence Erlbaum Associates, Mahwah, NJ

    Google Scholar 

  14. Centraal Museum Utrecht (2021) The Blind Spot. https://www.centraalmuseum.nl/nl/agenda/the-blind-spot. Last accessed 20 Feb 2022

  15. Chivăran C, Nappi ML, Capece S, Buono M (2022) Multisensory museum models for knowledge transfer. In: Martins N, Brandao D (eds) Advances in design and digital communication II proceedings of the 5th international conference on design and digital communication, November 4–6, 2021. Springer series in design and innovation, Barcelos, Portugal

    Google Scholar 

  16. Christillin E, Greco C (2021) Le memorie del futuro. Giulio Einaudi Editore, Torino

    Google Scholar 

  17. Chu JH, Mazalek A (2019) Embodied engagement with narrative: a design framework for presenting cultural heritage artifacts. Multimodal Technol Interact 3.1(1). https://doi.org/10.3390/mti3010001.

  18. Conti C (2012) L’accessibilità, requisito del progetto di architettura per la valorizzazione dei beni culturali. In: Garofalo I, Conti C (eds) Accessibilità e valorizzazione dei beni culturali. Temi per la progettazione di luoghi e spazi per tutti. FrancoAngeli Editore, Milano

    Google Scholar 

  19. Darbellay F (2012) The circulation of knowledge as an interdisciplinary process: travelling concepts, analogies and metaphors. Issues Integr Stud 30:1–18

    Google Scholar 

  20. Direzione generale Musei-MIBAC (2019) Piano Triennale per la Digitalizzazione e l’Innovazione dei Musei. http://musei.beniculturali.it/wp-content/uploads/2019/08/Piano-Triennale-per-la-Digitalizzazione-e-l’Innovazione-dei-Musei.pdf. Last accessed 19 Feb 2022

  21. Dogger S (2021) TIK-TIK. Simon Dogger inventive inclusive design. https://www.simondogger.nl/tiktik.html. Last accessed 20 Feb 2022

  22. European Commission (2021) COMMUNICATION FROM THE COMMISSION TO THE EUROPEAN PARLIAMENT, THE COUNCIL, THE EUROPEAN ECONOMIC AND SOCIAL COMMITTEE AND THE COMMITTEE OF THE REGIONS union of equality: strategy for the rights of persons with disabilities 2021–2030, Bruxelles. https://eur-lex.europa.eu/legal-content/EN/ALL/?uri=COM:2021:101:FIN. Last accessed 20 Feb 2022

  23. European Economic and Social Committee (2021) EU disability strategy: time to translate words into action (09 June 2021). https://www.eesc.europa.eu/en/news-media/news/eu-disability-strategy-time-translate-words-action. Last accessed 28 Feb 2022

  24. European Parliament and Council (2019) Directive (EU) 2019/882 of the European parliament and of the council of 17 April 2019 on the accessibility requirements for products and services. https://eur-lex.europa.eu/legal-content/EN/TXT/?qid=1578644817269&uri=CELEX%3A32019L0882. Last accessed 18 Feb 2022

  25. Falk JH, Dierking LD (2008) Enhancing visitor interaction and learning with mobile technologies. In: Tallon L, Walker K (eds) Digital technologies and the museum experience: handheld guides and other media. Altamira Press, Lanham, pp 19–34

    Google Scholar 

  26. Frateili E, Perugia M (1995) Dieci lezioni di Disegno Industriale Breve storia. FrancoAngeli, Milano

    Google Scholar 

  27. Gibson JJ (1979) The ecological approach to visual perception. Houghton Mifflin, Boston

    Google Scholar 

  28. Giugliano G, Laudante E (2020) Design as collaborative connection between user, technology and cultural context. In: IOP conference series: materials science and engineering International conference Florence Heri-Tech: the future of heritage science and technologies, vol 949, 14–16 oct 2020, Online Edition

    Google Scholar 

  29. Grinter RE, Aoki PM, Hurst A, Szymanski MH, Thornton JD, Woodruff A (2002) Revisiting the visit: understanding how technology can shape the museum visit. In: Proceedings of the computer supported collaborative work (CSCW), New Orleans, LA, USA, 16–20 November 2002, pp 146–155. ACM Press, New Orleans, LA, USA

    Google Scholar 

  30. HTC Corporation Homepage (2018) https://www.vive.com/us/product/vive-flow/overview/. Last accessed 18 Feb 2022

  31. il POST (2021) Il primo deposito di opere d’arte che si può visitare. Il POST (6 November 2021). https://www.ilpost.it/2021/11/06/depot-boijmans-rotterdam-arte/. Last accessed 27 Feb 2022

  32. ISO/IEC Guide 71:2014 Guide ISO/IEC 71: 2014—guide for addressing accessibility in standards, https://www.iso.org/standard/57385.html. Last accessed 28 Feb 2022

  33. ISO/TR 22411:2021—Ergonomics data for use in the application of ISO/IEC guide 71:2014. https://www.iso.org/standard/78847.html. Last accessed 28 Feb 2022

  34. Kirchberg V, Tröndle M (2015) The museum experience: mapping the experience of fine art. Curator Museum J 58(2):169–193

    Article  Google Scholar 

  35. Klonk C (2009) Spaces of experience: art gallery interiors from 1800 to 2000. Yale University Press, New Haven

    Google Scholar 

  36. Kosmas P, Galanakis G, Constantinou V, Drossis G, Christofi M, Klironomos I, Zaphiris P, Antona M, Stephanidis C (2020) Enhancing accessibility in cultural heritage environments: considerations for social computing. Univ Access Inf Soc 19:471–482. https://doi.org/10.1007/s10209-019-00651-4

    Article  Google Scholar 

  37. LIEU.city, Homepage (2021) https://lieu.city/. Last accessed 19 Feb 2022

  38. Lombardo V, Damiano R (2012) Storytelling on mobile devices for cultural heritage. New Rev Hypermedia Multimedia 18:11–35

    Article  Google Scholar 

  39. Lupo E (2021) Design and innovation for the cultural heritage. Phygital connections for a heritage of proximity. AGATHÓN|International Journal of Architecture, Art and Design 10: 186–199

    Google Scholar 

  40. Lupton E (2018) Sensory Environments. In: Lupton E, Lipps A (eds) The Senses: design beyond vision. Princeton Architectural Press, Cooper Hewitt Smithsonian Design Museum, Hudson, NY, pp 123–137

    Google Scholar 

  41. Lupton E, Lipps A (eds) (2018) The senses: design beyond vision. Princeton Architectural Press, Cooper Hewitt Smithsonian Design Museum, Hudson, NY

    Google Scholar 

  42. Lupton E, Lipps A (2018) Sensory materials. In: Lupton E, Lipps A (eds) The senses: design beyond vision. Princeton Architectural Press, Cooper Hewitt Smithsonian Design Museum, Hudson, NY, pp 72–86

    Google Scholar 

  43. Mackay W (1998) Augmented reality: linking real and virtual worlds: a new paradigm for interacting with computers. In: Proceedings of the working conference on advanced visual interfaces ’98, pp 13–21. ACM Press, New York

    Google Scholar 

  44. Maiocchi M (2015) The neuroscientific basis of successful design how emotions and perceptions matter. SpringerBriefs in applied sciences and technology. Springer, London

    Google Scholar 

  45. MEET Center (2022) Renaissance dreams, la magia di Refik Anadol. https://www.meetcenter.it/it/event/renaissance-dreams-la-magia-di-refik-anadol-2/. Last accessed 19 Feb 2022

  46. Mesiti Caulfied LA, Lussenhop A, Paneto SC (2020) Chapter 4: A model for accessible evaluation of inclusive museum exhibits. In: Ziebarth B, Majewski J, Marquis RL, Proctor N (eds) Inclusive digital interactives: best practices and research Smithsonian institution. Access Smithsonian, Institute for human centered design, MuseWeb, pp 93–114

    Google Scholar 

  47. Microsoft (2021) Castel del Monte diventa un HoloMuseum: con Hevolus, Infratel Italia e Microsoft l’esperienza del museo diventa digitale. https://news.microsoft.com/it-it/2021/01/14/castel-del-monte-diventa-un-holomuseum-con-hevolus-infratel-italia-e-microsoft-lesperienza-del-museo-diventa-digitale/. Last accessed 19 Feb 2022

  48. Murray JH (2017) Hamlet on the holodeck: the future of narrative in cyberspace. Mit Press, Cambridge, MA, USA

    Google Scholar 

  49. Muscarà M, Sani C (2019) Accessibility to cultural heritage, some project outcomes. Educ Sci Soc—Open Access, 10(1). https://journals.francoangeli.it/index.php/ess/article/view/7701

  50. Narumi T (2016) Multi-sensorial virtual reality and augmented human food interaction. In: Nijholt A, Velasco C, Huisman G, Karunanayaka K (eds) Proceedings of the 1st workshop on multi-sensorial approaches to human-food interaction (MHFI ’16), p 6. ACM, New York, NY. https://doi.org/10.1145/3007577.3007587

  51. Noble SU (2018) Algorithms of oppression: how search engines reinforce racism. New York University Press, New York

    Book  Google Scholar 

  52. Nofal E, Reffat RM, Moere VA (2017) Phygital heritage: an approach for heritage communication. In: Proceedings of the 3rd immersive learning research network conference (iLRN2017), pp 220–229. Springer, Portugal

    Google Scholar 

  53. Norman DA (2007) The design of future things. Basic Books, New York

    Google Scholar 

  54. O’ Ferrall E (2019) Accessibility of products and services following a design for all approach in standards. In: Proceedings of the 20th congress of the international ergonomics association, pp 1543–1552. Springer, Cham

    Google Scholar 

  55. Othman MK (2012) Measuring visitors’ experiences with mobile guide technology in cultural spaces. The University of York, York, UK

    Google Scholar 

  56. Pavliscak P (2019) Emotionally intelligent design. O’Reilly Media, Sebastopol, CA, USA

    Google Scholar 

  57. Perret J, Poorten VE (2018) Touching virtual reality: a review of haptic gloves. In: Proceedings of the ACTUATOR 2018, 16th international conference on new actuators, Bremen, Germany

    Google Scholar 

  58. Pisa R (2022) Nella mente di Antoni Gaudí con l’installazione immersiva di Refik Anadol, Artribune. https://www.artribune.com/television/2022/01/video-nella-mente-di-antoni-gaudi-con-linstallazione-immersiva-di-refik-anadol/. Last accessed 19 Feb 2022

  59. Pisoni G, Díaz-Rodríguez N, Gijlers H, Tonolli L (2021) Human-centered artificial intelligence for designing accessible cultural heritage. Appl Sci 11(2), 870

    Google Scholar 

  60. Portalés C, Lerma JL, Navarro S (2010) Augmented reality and photogrammetry: a synergy to visualize physical and virtual city environments. ISPRS J Photogram 65(1):134–142

    Article  Google Scholar 

  61. Proctor N (2011) Mobile apps for museums: the AAM guide to planning and strategy, 2nd ed. AAM Press, Washington, DC, USA

    Google Scholar 

  62. Radical Media (2020) The Museum of Feelings. https://www.radicalmedia.com/work/the-museum-of-feelings. Last accessed 18 Feb 2022

  63. Rappolt-Schlichtmann G, Todd K, Daley S (2020) Universal design for—emotion in—learning: a practice for the creation of emotionally accessible digital learning experiences. In: Ziebarth B, Majewski J, Marquis RL, Proctor N (eds) Inclusive digital interactives: best practices and research Smithsonian institution. Access Smithsonian, Institute for human centered design, MuseWeb, pp 139–166

    Google Scholar 

  64. Riva G, Gaggioli A (2019) Realtà virtuali. Gli Aspetti Psicologici Delle Tecnologie Simulative e il Loro Impatto Sull’esperienza Umana. Giunti Psychometrics, Milano

    Google Scholar 

  65. Saleme EB, Covaci A, Mesfin G, Santos CA, Ghinea G (2019) Mulsemedia DIY: a survey of devices and a tutorial for building your own mulsemedia environment. ACM Comput Surv (CSUR) 2019(52):1–29

    Google Scholar 

  66. Schnapp JT (2014) Knowledge design. Herrenhausen lectures. Volkswagen-stiftung, Hannover

    Google Scholar 

  67. Simon N (2010) The participatory museum. Museum 2.0, Santa Cruz

    Google Scholar 

  68. Tallon L, Walker K (eds) (2008) Digital technologies and the museum experience: handheld guides and other media. AltaMira Press, Lanham, MD, USA

    Google Scholar 

  69. Tate Modern Museum (2022) Hyundai commission Anicka Yi In love with the world. https://www.tate.org.uk/whats-on/tate-modern/exhibition/hyundai-commission-anicka-yi. Last accessed 20 Feb 2022

  70. Testón AM, Muñoz A (2021) Digital avatars as humanized museum guides in the convergence of extended reality. MW21: MW 2021. https://mw21.museweb.net/paper/digital-avatars-as-humanized-museum-guides-in-the-convergence-of-extended-reality/

  71. Trocchianesi R (2014) Design e narrazioni per il patrimonio culturale. Maggioli Editore, Santarcangelo di Romagna

    Google Scholar 

  72. Ultraleap Homepage (2022) https://www.ultraleap.com/product/leap-motion-controller/. Last accessed 10 Feb 2022

  73. UNI EN 17161: 2019—Design for all—accessibility following a design for all approach in products, goods and services—extending the range of users. http://store.uni.com/catalogo/uni-en-17161-2019?josso_back_to=http://store.uni.com/josso-security-check.php&josso_cmd=login_optional&josso_partnerapp_host=store.uni.com. Last accessed 28 Feb 2022

    Google Scholar 

  74. United Nations (2007) Convention on the rights of persons with disabilities and optional protocol. https://www.un.org/disabilities/documents/convention/convoptprot-e.pdf. Last accessed 20 Feb 2022

  75. United Nations (2015) Transforming our world: the 2030 agenda for sustainable development. United Nations, New York

    Google Scholar 

  76. Van Abbe Museum (2022) Blind and partially sighted. https://vanabbemuseum.nl/en/mediation/inclusion/blind-and-partially-sighted/. Last accessed 20 Feb 2022

  77. VARJO Homepage (2018) https://varjo.com/products/vr-3/. Last accessed 18 Feb 2022

  78. vom Lehn D, Heath C (2003) Displacing the object: mobile technologies and interpretive resources. In: Proceedings of the ICHIM03, International cultural heritage informatics meeting, Paris, France, 8–12 September 2003, pp 2–15. École du Louvre, Paris, France

    Google Scholar 

  79. Wang J, Erkoyuncu J, Roy R (2018) A conceptual design for smell based augmented reality: case study in maintenance diagnosis. Procedia CIRP 78:109–114

    Article  Google Scholar 

  80. Watson F (2021) The new curator: exhibiting architecture and design. Routledge, Oxon & New York

    Book  Google Scholar 

  81. Zane M (2019) Tecnologie 4.0 per il “Sistema Cultura”. Polo Tecnologico Lucchese, Online presentation

    Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Engineering, University of Campania “Luigi Vanvitelli”, Aversa (CE), Italy

    Mario Buono, Sonia Capece, Camelia Chivăran, Salvatore Gerbino, Giovanna Giugliano, Alessandro Greco, Elena Laudante, Maria Laura Nappi & Ciro Scognamiglio

Authors
  1. Mario Buono
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sonia Capece
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Camelia Chivăran
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Salvatore Gerbino
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giovanna Giugliano
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Alessandro Greco
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Elena Laudante
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Maria Laura Nappi
    View author publications

    You can also search for this author in PubMed Google Scholar

  9. Ciro Scognamiglio
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Mario Buono .

Editor information

Editors and Affiliations

  1. School of Design, Polytechnic Institute of Cávado and Ave/ID+, Barcelos, Portugal

    Nuno Martins

  2. Institute of Social Sciences, University of Minho/CECS, Braga, Portugal

    Daniel Brandão

  3. University of Beira Interior/Labcom, Covilhã, Portugal

    Francisco Paiva

Rights and permissions

Reprints and permissions

Copyright information

© 2023 The Author(s), under exclusive license to Springer Nature Switzerland AG

About this chapter

Check for updates. Verify currency and authenticity via CrossMark

Cite this chapter

Buono, M. et al. (2023). Multisensory Fruition Between Cultural Heritage and Digital Transformation. In: Martins, N., Brandão, D., Paiva, F. (eds) Perspectives on Design and Digital Communication III. Springer Series in Design and Innovation , vol 24. Springer, Cham. https://doi.org/10.1007/978-3-031-06809-6_21

Download citation

  • DOI: https://doi.org/10.1007/978-3-031-06809-6_21

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-031-06808-9

  • Online ISBN: 978-3-031-06809-6

  • eBook Packages: EngineeringEngineering (R0)

Publish with us

Policies and ethics

Search

Navigation