Tangible data souvenirs as a bridge between a physical museum visit and online digital experience
- 1.7k Downloads
This paper presents the design, implementation, use and evaluation of a tangible data souvenir for an interactive museum exhibition. We define a data souvenir as the materialisation of the personal visiting experience: a data souvenir is dynamically created on the basis of data recorded throughout the visit and therefore captures and represents the experience as lived. The souvenir provides visitors with a memento of their visit and acts as a gateway to further online content. A step further is to enable visitors to contribute, in other words the data souvenir can become a means to collect visitor-generated content. We discuss the rationale behind the use of a data souvenir, the design process and resulting artefacts, and the implementation of both the data souvenir and online content system. Finally, we examine the installation of the data souvenirs as part of a long-lasting exhibition: the use of this souvenir by visitors has been logged over 7 months and issues around the gathering of user-generated content in such a way are discussed.
KeywordsTangible interaction Data souvenir Museums User-generated content
Museums have begun to focus on the visitor experience as a process that is not limited to the time spent in the museum itself. Indeed, as Falk and Dierking state: “The museum experience begins long before the visitor arrives and continues long after the visit” [10, page 284]. While the pre-visit is focussed on providing information, e.g. about both the collection and practical issues around the visit, the post-visit aims at establishing a long-lasting relationship that can foster additional visits and word-of-mouth promotion . To keep visitors engaged, museums have started to experiment with new media channels to encourage visitor participation, such as the use of social media as a means for visitors’ active contribution [7, 11, 16, 29]. The intent of sustaining a long-term connection with visitors via digital media is, however, disconnected from the physical experience of visiting an exhibition or an historical place. Examples of online experiences include creating a personal collection of artworks from the museum digital collection (“Make your own imagined museum” by the Tate1), engaging in a creative activity and sharing the result (“Design your wig” by the V&A2) or contributing personal digital items to an online exhibition (“VanGoYourself”, which reuses content from the Europeana repository3). As a matter of fact, the material collection and the online presence are often managed by different departments with the result of offering two distinct and separate experiences to visitors. By combining principles from ubiquitous computing and tangible interaction, it is possible to close the gap currently existing between the exhibition floor and the online services and design visitor experiences that take both aspects into account . The digital and the material can become components for the design of a holistic visitor experience that crosses the digital–material boundary. The challenge is in weaving the digital and the material to create seamless immersive and novel visitors’ experiences.
In this paper, we explore the value of personalised tangible data souvenirs as a bridge between the physical, personal experience of the visit and the digital online experience of staying engaged with the museum. We define personalised tangible data souvenirs in the context of a museum experience as specific material representations of individual visiting paths: the visit is dynamically recorded by logging information such as where the visitor is at particular points in time and what exhibit he/she is attending to. These data are then processed to create a tangible embodiment of this personal experience. The data are the digital shadow of the physical experience, and the tangible data souvenir can be used to access a personalised online space that displays the visit against the whole exhibition and enables visitor contribution. By creating a personalised data souvenir, it becomes possible for museums to present visitors with a physical memento of their visit while offering them the possibility to further interact with the museum and its content, revisit their experience or contribute their stories. Such interaction can also provide a useful opportunity for the museum to gather visitor-generated content and thus continuously enrich the physical exhibition through novel digital material.
This paper is organised as follows: the next section discusses research relevant to the topic of this paper. This is followed by the description of the Atlantic Wall exhibition and the visitor experience. We then describe the system architecture and how it connects the interaction onsite and online. Next is the design process of the data souvenir and the challenges of proposing a solution viable for museums that have very low maintenance and high impact, such as the printing of a personalised postcard. Following this, we discuss the personalised website (created by processing the data collected during the visit) that enables visitor contributions. Finally, we present the results of 7 months of the data souvenir being used in an exhibition. We conclude the paper with reflections and guidelines.
2 Related work
This research lies at the intersection between museum studies, new forms of digital fabrication, personalisation and ubiquitous computing. Although much research has been carried out in each area in recent years, e.g. the many forms of digital fabrication, this work has been going on independently and their combination in a novel and unique museum experience has not yet been pursued. In an attempt to bring together the different strands, here we discuss how the different components can contribute to the creation of personal tangible data souvenirs as part of the museum visit.
Museums are nowadays considered an example of leisure activity pursued not necessarily for educational goals: they offer a peaceful environment for those in need of recharging and often are a must-see destination in the tourist’s agenda . Visitors have different needs and even the same person can look at the same exhibit many times, each time in a different way and with different expectations . A number of scholars in museum studies (e.g. [8, 24, 32, 35]) see value in revisiting the information-centric approach of cultural heritage in favour of one that enables visitors to be in direct contact with objects and places. Making visitors feel emotions, challenging their beliefs with difficult questions and enabling personal meaning making are new goals for curators. Instead of offering visitors a definitive pre-packed curator-led interpretation to absorb and learn, more forward-looking museums offer multiple, possibly conflicting, voices and leave the act of interpretation to the visitors, while acknowledging that their different personal backgrounds, expectations and needs change the way they engage with heritage holdings . The premise that information is not the only or most important factor impacts on the way in which designers should think about digital interaction with heritage. Factors such as physical engagement and supporting the social setting are principles that interaction designers should consider .
Issues with technology in museums were noted as early as 1992: visitors enjoyed interactive multimedia, but they did not have the time or patience for the kind and amount of details provided . The focus should be on how the information is received rather than how it is delivered . Twenty years later, we see the story repeated: a study of tabletop interaction in a museum showed 50% of visitors did not touch the table, only 17% had more than one-touch interaction and only a few conversations around the table focussed on the topic of the exhibition . The situation is not that different with mobile guides (PDAs initially, smartphones now): mobile devices extend the time visitors devote to interaction with technology, but time might be spent in understanding how the device itself works and not in visiting and interacting with the heritage . Mobile guides focus the visitor’s attention on the screen in their hand to the point, in some cases, of ignoring the exhibits  or choosing what to look at on the basis of what is on the screen  instead of what is of personal interest. Enabling and supporting visitors’ choice is key for actual engagement and enjoyment. Advancements in ubiquitous computing have the potential to mitigate some of the issues with mobile technology, for example by reducing the number of items accessible through the phone at each point in time during the visit to those exhibits that are in the immediate vicinity [4, 5]. However, radically different solutions are possible. As in the case of the Atlantic Wall exhibition discussed in this paper, ubiquitous computing can be implemented in a completely transparent way: by concealing technology within the environment, the experience is not affected by possible issues with the device.
An exhibition or a museum can make a lasting impression on the visitor and buying souvenirs is a common way to mark and remember a special experience. A large body of evidence supports this, particularly in relation to tourism [2, 12, 13, 21]. While the most common experience is to buy a souvenir after the visit, there is evidence to suggest that the souvenir should instead be an integral part of the visit itself, it should be constructed during the visit in such a way that it becomes the embodiment of the personal experience . Digital manufacturing has opened new opportunities for creating artefacts as part of a visit. For instance,  experimented with the digital making of self-designed/self-assembled souvenirs in the context of an extended experience of a single art installation. Their findings show different attitudes to the making and the souvenir depending on how intensely the visitor experiences the exhibit: the making could be the focus of the experience, a way of reflecting and making sense of the artwork, or a way of capturing the experience into a memento . This interesting experiment, however, cannot be applied to a real museum setting, as it is impossible to have personnel available for a one-to-one making session. In addition, the reflective activity was designed around a single art piece everyone experienced; in a museum each visitor follows a personal path and experiences different things with the result that no two visits are the same, even for people visiting together.
To be able to automatically create a personal souvenir of a museum visit, it is necessary to collect data about the visit itself, via sensor logs, and to give meaningful form to that personal data set. A unique example is a summary of the visit just concluded, which is automatically generated on the basis of the visit logs . A personalised summary is a reminder of the actual visit, but does not have the physical qualities of a souvenir, that of being a beautiful, physical object kept as a memento of an experience.
Experiments with the materialisation of personal data into beautiful objects have so far looked into data from sport  or craft  activities or the monitoring of email use . These materialisations are an abstraction of the activity, and they need to be explained to be properly interpreted; they are a secret code into personal performance over time. For example in , the record of a single physical activity is engraved with a specific line pattern that captures the frequency of a specific motion; multiple activities over time create different lines and contribute to the unique aesthetic of the personal bracelet.
The use of digital technology to fabricate personalised objects does not change the passive nature of objects created exclusively to be looked at and function as reflective  or motivational  pieces. Digital technology can take the fabrication much further and make the physical object an entry point for a further personalised digital service that makes use of the onsite visit log to extend the experience online in the form of a post-visit environment offered by the museum to visitors. Museums have long acknowledged the importance of a long-term connection and communication with visitors, but the focus so far has been on specific activities for school visits and informal learning [20, 33]. We see much potential in extending this approach to all visitors and enabling museums to start a long-term relationship with visitors, many of whom are returning visitors [9, 25].
To summarise, from a visitor’s point of view a souvenir of a museum visit should hold a clear connection to the exhibition or collection and should represent somehow the personal journey. From a museum point of view, the creation of a souvenir should be low cost and maintenance-free. So far research has not tackled any of these issues. Furthermore, a souvenir is seen as a passive object, a reminder of the past. A personalised souvenir can extend the interaction into the future by offering new ways for museums to connect with visitors, e.g. by matching the visit with additional curated online content or by enabling visitors to contribute to a growing collection of visitor-generated content. In other words, the personalised tangible souvenir becomes the means for a long-term visitor–museum interaction that connects the physical and the digital.
3 The Hague and the Atlantic Wall
The tangible personalised data souvenir in this paper was part of the design of the exhibition “The Hague and the Atlantic Wall: War in the City of Peace” which ran from April to October 2015 at MUSEON in the city of The Hague, in The Netherlands. The exhibition was conceived as a stand-alone setting to which the technology was added as an enrichment. In other words, it was the intention of the exhibition curators that visitors would be able to enjoy and appreciate the exhibition without using any technology at all. The topic was expected to appeal a large range of visitors; in particular, the museum expected a higher number of elderly than usual and it was therefore key to care for all attitudes and abilities.
The Atlantic Wall was a set of defensive lines and placements that were built by the German forces during WWII along the coast of the Atlantic Ocean and North Sea, from the French/Spanish border to Norway. The wall consisted of a 5000 km long chain of bunkers, anti-tank walls, cliffs and other barriers and was aimed at preventing an Allied attack on the Reich’s Western frontiers. The presence of these fortifications affected several countries and cities and their residents.
The exhibition focused specifically on the Atlantic Wall in The Hague. In this coastal city, the construction of the Atlantic Wall was rather different from the rest of the defensive line, both because The Hague was the seat of the administration of the occupied Netherlands and because of the presence of a fishing port, meaning it needed additional protection. As the Allied forces could break through the coastal defence lines and reach The Hague from inland, a second defence line was created through the city itself. Thousands of buildings were demolished to give way to an anti-tank ditch and an anti-tank wall. Tens of thousands of people had to leave their homes and be relocated to other parts of the Netherlands. Some parts of the city were no longer accessible to the inhabitants without special permits or were completely closed off to civilians.
To enrich the visit experience, a set of personal stories were prepared by the curators and recorded using actors in order to provide affective content to complement the factual, more traditional textual descriptions. The intention was to offer a richer variety of personal accounts than generally available, going beyond the presentation of facts and more into the personal and affective recounting of dramatic events. Playback of the personal stories was triggered by smart replicas; reproductions of original exhibition objects augmented with digital technology (in this case, NFC tags). Each replica represented a single perspective on the story of the Atlantic Wall: that of a Civilian displaced from their home, a Civil Servant (Official) unwilling to be the instrument of the implementation of the occupiers’ plan, or an occupying German soldier who felt himself a protector of the Dutch population against potential invaders.
The list of replica objects and their corresponding perspective and language
The visitor was free to move around the exhibition visiting cases in any order they wished. When they decided to end their visit, they would go to the souvenir printing station. Here, the replica ended the visit session, triggering the system to process the log data and generate a data souvenir: a personalised card on which the visit is represented. Beside the souvenir station was an interactive tabletop displaying the online map to invite visitors to explore the stories contributed by other visitors. In this way, the online visitor contributions were part of the exhibition itself. It was also expected that, by seeing other visitors’ content, visitors were encouraged to consider contributing. The possibility of allowing visitors to contribute while still at the museum was considered at the design phase. Given the sensitive topic, the curators decided to moderate the content before its publication on the map; therefore, a dynamic upload of personal stories was not appropriate and the tabletop enables viewing but not uploading. The personalised souvenir, a postcard, printed at the end of the visit, contained all the necessary information to go online, revisit the experience, get further material available in the exhibition and contribute content in the form of personal and family memories, as described below.
The postcard has a unique code printed on the top right corner (Fig. 9). Using this passcode and the website address provided on the data souvenir, the visitor could elect to go online to continue the interaction with the exhibition and to add their own content to this map. The online post-visit experience was designed around an interactive map of the city of The Hague; places in the exhibition were marked on the map, and colour was used to show whether the place had been visited in the exhibition or whether instead it was new content to the visitor. Standard map place markers were used to show visitors’ contributions; clicking on the place marker would display the content.
4 System architecture
5 Tangible data souvenir
The design brief was to create a souvenir that fit with the theme of the exhibition, while being easily produced in the thousands with minimal maintenance and also offering layers of information to the visitor. This included a representation of some aspects of their visit, the connection between the displays within the exhibition and the city of The Hague and access to an online post-visit experience where the visitors could find curated content as well as visitor-generated content, such as personal and family memories.
The background graphics use the visual metaphor of crossing lines representing the Atlantic Wall (in orange) and the lives of the people around it (in blue), as they connect with or intersect with the wall. The design draws some aesthetic influences from aerial images from the archive of the city to give cohesion as the exhibition features much content based around maps and aerial photographs. The colours, orange and blue, also feature prominently in the exhibition design (Fig. 1).
Finally, it is important to notice that the card gives access to visit information held by the museum without the need to leave any personal data such as name or email address. Visit logs are anonymous and linked only to the unique passcode on the postcard. If you have your postcard, then your visit and the extra content is accessible to you. Both curators and visitors who are becoming more aware of the concerns around properly managing sensitive personal data appreciated this design feature.
6 Deployment within the exhibition
The Atlantic Wall exhibition was opened to visitors from April to October 2015. During this time, we held a number of different evaluations to assess different aspects of the visitor experience . Relevant to this paper are a set of naturalistic observations and the analysis of the logs recorded through the use of the replicas within the exhibition and the online access via the postcard.
These observations derive from a naturalistic approach and visitors were therefore observed but not approached. For a period of time, museum staff were present on the exhibition floor to offer explanations and support: when visitors were shown the printing station and it was explained how the postcard could be used, the feedback collected was very positive. Visitors appreciated the gift of a souvenir as a memento of their visit. The fact that the card was personalised was not always automatically understood, but visitors in a group who followed different paths were observed comparing cards, indicating that a personalised souvenir can be a good way to invite visitors to reflect on their visit, an important step in the trajectory of experience . This observation brings the question of whether the personalisation mechanisms of the system should be explained or made more evident. For example, should we include some explanation on the card itself or, better yet, at the printing point. Also, should the stamps on the card be shown at the cases that they correspond to, so as to make the connection more obvious? What we can state is that the card was appreciated for the very high quality of the print and the interesting design. There have been no reports from museum staff of cards being left behind in the museum, indicating a high interest by the visitors in taking the souvenirs away with them.
Another source of feedback was the analysis of the logs automatically recorded by the system during the visit and then the online access and use. In the 7 months, the exhibition was open a total of 14,853 visitors used the replicas in the interactive parts of the Atlantic Wall exhibition. Of these visitors, 1557 (~10%) printed their data souvenir. The fact that not every visitor that used the replicas printed the souvenir can be explained by the observations: many returned the replica at the start so overlooked the printing station, many did not go through all the exhibition so missed to walk by the printer, and many noted the printing but decided not to use it. This last behaviour is somewhat surprising given the positive feedback collected by the museum staff when the postcard was specifically discussed; we can therefore only speculate that possibly this is due to the very unfamiliar situation of print-your-own-souvenir that could be completely removed if a different dynamic was implemented, e.g. a member of staff collecting the replica, printing the postcard and handing it out to the visitors.
As the souvenir was also intended to enable access to the online system for gathering personal contributions, we also monitored the use of the passcodes. It should be noted that, while the needed information to access the content online was printed on the postcard, the instructions on how to proceed were not. This information was given in the form of an animation (Fig. 4) displayed at the printing station. We believe this had a negative impact on the use of the online system as many visitors may not have paid attention to the video or may have forgotten what the code on the postcard was for. Indeed, although the information on how to go online was on the postcard (see Figs. 4, 9), it was in a small print and not fully explained and therefore difficult to decode or remember.
Of the 1557 visitors who printed the card, only 39 (~2.5%) logged into the online post-visit exhibition, contributing overall 62 content points to the map (Fig. 4, last frame). The majority of the user content points added were created towards the centre of The Hague and were textual with only a few supported by old photographs. The location of the user content points does not particularly map to the locations in the exhibition. However, one area, the Statenkwartier, which was almost completely demolished in order to build additional Atlantic Wall defences, showed a high concentration of visitor contributions. As the visitor contribution was minimal with respect to the curators’ expectations, time was spent in understanding why people were not willing to contribute. Staff from Museon have reported that visitors were very happy to share stories and memories with them on the exhibition floor, but were reluctant to go online, even if museum staff offered to help. The reason why willingness to share stories did not translate into active contribution could be explained in many ways: (1) the visitors who had personal and family memories to share were elderly or ageing and may not feel familiar enough with technology to go online and contribute; (2) poignant memories need a listening human being; (3) instructions on how to get online were given in the video when the card was printed (Fig. 4), key information was on the card but perhaps was not clear enough so people did not know/remember how to do it; and (4) when a visitor has left the exhibition, the interest has passed and the effort to contribute when at home is too high. The last two points can be addressed: a new card with a new background and clearer instructions could be designed. To enable visitors to add content while at the exhibition itself (the option to contribute content at the interactive tabletop was discarded at design time by the curators as they wanted to check each visitor contribution before it was displayed at the exhibition), the museum added cards and a box for people to write and leave their contributions in paper form (Fig. 12 bottom right); the museum personnel would then upload the contents of the cards on the system on behalf of the visitors.
7 Guidelines and conclusion
A positive finding from this deployment is that visitors who generate their own data souvenir take time to look at them and keep them. They do not seem to leave them behind or dump them at the museum. This is inline with our expectations based on the research into souvenirs and memories. The feedback collected on the exhibition floor also shows that the postcards are seen as being something worth keeping. A second guideline then is that high quality printing and beautiful design can add value and encourage visitors to keep the gift.
A further guideline is to design for reliability. Discussions with curators and technical staff from Museon highlighted the importance of a reliable, low maintenance system. Previous experiences with printers and other such systems on the museum floor had been quite negative, so that they were seen as more trouble than they were worth. Much work was put into producing a system that was reliable enough for deployment in the wild. This included the use of commercial grade thermal printers, capable of producing 5000 postcards before needing to be loaded with more card stock and that did not need to be loaded with any other media such as ink or toner. Reliability is also a key issue for visitors, an unreliable system, will provide a poor experience for the visitor and can lead to frustration. Finally, the printing was almost instantaneous, so there was no delay between depositing the replicas and collecting the postcard.
To conclude, our exploration of the automatic generation of a tangible personalised souvenir created on the basis of logged data was very positive and opened a range of possible further research actions. Curators were keen for visitors to take away a memento of the exhibition. Visitors were fond of the cards and took them home with them. The logging of the visit enabled dynamic content creation and many more visualisations could be designed for both the souvenir and the online experience. The key issue is how to increase the number of people that go online, although this point needs much more field research as it is not at all clear if the under use is due to lack of information on how-to or lack of interest by visitors.
The research described in this paper was conducted as part of the meSch project, Material Encounters with Digital Cultural Heritage. meSch (2013–2017) receives funding from the European Community’s Seventh Framework Programme, “ICT for access to cultural resources” (ICT Call 9: FP7-ICT-2011-9) under the Grant Agreement 600851.
- 1.Aipperspach R, Hooker B, Woodruff A (2011) Data Souvenirs: environmental psychology and reflective design. IJHCS 69(5):338–349Google Scholar
- 3.Benford S, Giannachi G, Koleva B, Rodden T (2009) From interaction to trajectories: designing coherent journeys through user experiences. In: Proceedings of the SIGCHI conference on human factors in computing systems (CHI ‘09). ACM, New York, pp 709–718Google Scholar
- 6.Ciolfi L (2013) The collaborative work of heritage: open challenges for CSCW. In: Proceedings of European conference on computer supported cooperative work—ECSCW 2013. Springer, London, pp 83–101Google Scholar
- 9.Falk JH (2009) Identity and the museum visitor experience. Left coast Press, Walnut CreekGoogle Scholar
- 10.Falk JH, Dierking LD (2013) Museum experience revisited. Left Coast Press, Walnut CreekGoogle Scholar
- 11.Giaccardi E (2012) (ed) Heritage and social media: understanding heritage in a participatory culture. Routledge, LondonGoogle Scholar
- 15.Hornecker E (2008) “I don’t understand it either but it’s cool”—visitor interactions with a multi-touch table in a museum. In: Proceedings of IEEE Tabletop, pp 121–128Google Scholar
- 16.Kidd J (2013) Museums in the New Mediascape. Ashgate, FarnhamGoogle Scholar
- 17.Lee M-H, Cha S, Nam T-J (2015) Patina engraver: visualizing activity logs as patina in fashionable trackers. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI ‘15). ACM, New York, pp 1173–1182Google Scholar
- 18.Marshall MT, Dulake N, Ciolfi L, Duranti D, Kockelkorn H, Petrelli D (2016) Using tangible smart replicas as controls for an interactive museum exhibition. In: Proceedings of ACM tangible, embedded and embodied interactions TEI16. ACM Press, New York, pp 159–167Google Scholar
- 20.Murawski M (2014) Student learning in museums: what do we know? Art museum teaching. https://artmuseumteaching.com/2014/11/19/student-learning-in-museums-what-do-we-know/. Accessed 20 July 2016
- 22.Nissen B, Bowers J (2015) Data-things: digital fabrication situated within participatory data translation activities. In: Proceedings of the 33rd annual ACM conference on human factors in computing systems (CHI ‘15). ACM, New York, pp 2467–2476Google Scholar
- 23.Nissen B, Bowers J, Wright P, Hook J, Newell C (2014) Volvelles, domes and wristbands: embedding digital fabrication within a visitor’s trajectory of engagement. In: Proceedings of the 2014 conference on designing interactive systems (DIS ‘14). ACM, New York, pp 825–834Google Scholar
- 25.Petrelli D, De Angeli A, Convertino G (1999) A user-centered approach to user modelling. In: Proceedings of the 7th international conference on user modeling UM’99, pp 255–264Google Scholar
- 27.Petrelli D, Dulake N, Marshall MT, Pisetti A, Not E (2016) Voices from the war: design as a means of understanding the experience of visiting heritage. In: Proceedings of the 34th annual ACM conference on human factors in computing systems (CHI ‘16). ACM, New York, pp 1033–1044Google Scholar
- 29.Simon N (2010) The participatory museum. Santa Cruz, Museum 2.0Google Scholar
- 30.Stock O, Zancanaro M, Busetta P, Callaway C, Krüger A, Kruppa M, Kuflik T, Not E, Rocchi C (2007) Adaptive, intelligent presentation of information for the museum visitor in PEACH. UMUAI 17(3):257–304Google Scholar
- 32.Taylor B (2010) Reconsidering digital surrogates. In: Dudley S (ed) Museum materialities. Routledge, London, pp 175–184Google Scholar
- 34.vom Lehn D, Heath C (2003) Displacing the object: mobile technology and interpretive resources. In: Proceedings of museum and the web—MW03. http://www.archimuse.com/publishing/ichim03/088C.pdf. Accessed 20 July 2016
- 35.Wehner K, Sear M (2010) Engaging the material world. In: Dudley S (ed) Museum materialities. Routledge, London, pp 143–161Google Scholar
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.