Jonathan Swift: Augmented Reality Application for Trinity Library’s Long Room
Abstract
This demo paper describes a project that engages cutting-edge free viewpoint video (FVV) techniques for developing content for an augmented reality prototype. The article traces the evolutionary process from concept, through narrative development, to completed AR prototypes for the HoloLens and handheld mobile devices. It concludes with some reflections on the affordances of the various hardware formats and posits future directions for the research.
Notes
Acknowledgments
Principle Investigator: Aljosa Smolic; Director/Producer: Néill O’Dwyer; Technical Team: Jan Ondřej, Rafael Pagés, Konstantinos Amplianitis; Script: Jane Maxell and Néill O’Dwyer; Actor: Jonathan White; Make-up artist: Roisín Condon; Costume designer: Sara Ben-Abdallah; Costume supplied by the Abbey Theatre Costume Department. This publication has emanated from research conducted with the financial support of Science Foundation Ireland (SFI) under the Grant Number 15/RP/2776.
References and Notes
- 1.The Trinity College Long Room is a Unesco World Heritage Site, which accommodates in excess of one million visitors per annumGoogle Scholar
- 2.Azuma, R.T.: A survey of augmented reality. Presence Teleop. Virt. Environ. 6(4), 355–385 (1997). https://doi.org/10.1162/pres.1997.6.4.355CrossRefGoogle Scholar
- 3.Library staff remark on the tendency of visitors to stroll through the Long Room taking in general, sweeping vistas, ultimately overlooking fine details and archival treasuresGoogle Scholar
- 4.Sommerauer, P., Müller, O.: Augmented reality in informal learning environments: a field experiment in a mathematics exhibition. Comput. Educ. 79, 59–68 (2014). https://doi.org/10.1016/j.compedu.2014.07.013CrossRefGoogle Scholar
- 5.The core research team of behind this production have since spun out into an innovative start-up company, entitled Volograms <https://volograms.com>
- 6.Smolic, A., et al.: 3D video and free viewpoint video-technologies, applications and MPEG standards. In: IEEE International Conference on Multimedia and Expo 2006, pp. 2161–2164 (2006)Google Scholar
- 7.Kutulakos, K.N., Seitz, S.M.: A theory of shape by space carving. In: The Proceedings of the Seventh IEEE International Conference on Computer Vision 1999, vol. 1, pp. 307–314 (1999)Google Scholar
- 8.Schönberger, J.L., et al.: Pixelwise view selection for unstructured multi-view stereo. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9907, pp. 501–518. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46487-9_31CrossRefGoogle Scholar
- 9.O’Dwyer, N., et al.: Samuel Beckett in Virtual Reality: Exploring narrative using free viewpoint video. Leonardo JA System. MIT Press, Cambridge (2018) Google Scholar
- 10.Pagés, R., et al.: Seamless, static multi-texturing of 3D meshes. Comput. Graph. Forum 34(1), 228–238 (2015). https://doi.org/10.1111/cgf.12508CrossRefGoogle Scholar
- 11.Pagés, R., et al.: Affordable content creation for free-viewpoint video and VR/AR applications. J. Vis. Commun. Image Represent. (2018). For a complete description of the technical pipeline see https://doi.org/10.1016/j.jvcir.2018.03.012CrossRefGoogle Scholar
- 12.See prototype test video here: https://youtu.be/TcVz0iTAa8g
- 13.It is intended that the demo at ICIDS will afford an opportunity for garnering such dataGoogle Scholar
- 14.Vainstein, N., et al.: Towards using mobile, head-worn displays in cultural heritage: user requirements and a research agenda. In: Proceedings of the 21st International Conference on Intelligent User Interfaces-IUI 2016, pp. 327–331. ACM Press, Sonoma (2016). https://doi.org/10.1145/2856767.2856802