Abstract
The influence of the visual properties of a built space or landscape on the behaviors of people within them and the manipulation of these visual properties to cue or constrain behaviors are subjects of long-standing archaeological interest. Advances in cognitive neurosciences and a suite of improved computational modeling tools, combined with the proliferation of detailed 3D models of archaeological complexes and landscapes, offer an opportunity for new approaches to these topics based on models of low-level perceptual cues and visual attention. The approach described here takes aim at the question of where people will look, rather than simply what is visible, with the goal of investigating the intentions of designers of spaces and visual aspects of the experience of a place. In simple terms, our approach involves placing detailed 3D models of built spaces or landscapes into a digital environment. An individual then virtually walks through the space and what is visible at each moment is recorded in the form of a video stream, which may be broken down into a sequence of scenes. This set of scenes is then analyzed using software that calculates and maps the visual saliency of each scene and the path of focuses of attention (FOAs) over time. This set of saliency maps, raw images, and FOA paths provide the basis for further interpretation. This paper presents an initial experiment to illustrate the approach, carried out in the eastern passage at Knowth, one of the main mounds in the Brú na Bóinne in Ireland.
Similar content being viewed by others
References
Albright, T. D., & Stoner, G. R. (2002). Contextual influences on visual processing. Annual Review of Neuroscience, 25(1), 339–379.
Ashley, M. (2012). An archaeology of vision: seeing present and past in Çatalhöyük. In R. Tringham & M. Stevanović (Eds.), Last house on the hill: bach area reports from Çatalhöyük. Turkey: University of New Mexico Press.
Asteriadis, S., Karpouzis, K., & Kollias, S. (2014). Visual focus of attention in non-calibrated environments using gaze estimation. International Journal of Computer Vision, 107(3), 293–316.
Baluch, F., & Itti, L. (2015). Mining videos for features that drive attention. In Multimedia data mining and analytics (pp. 311–326). Springer International Publishing.
Bender, B. (1993). Cognitive archaeology and cultural materialism. Cambridge Archaeological Journal, 3(2), 257–260.
Bender, B. (1999). Subverting the Western Gaze: mapping alternative worlds. The archaeology and anthropology of landscape: shaping your landscape, 31–45.
Bender, B. (2001). Landscapes on-the-move. Journal of Social Archaeology, 1(1), 75–89.
Bender, B., Hamilton, S., Tilley, C. Y., & Anderson, E. (2007). Stone worlds: narrative and reflexivity in landscape archaeology. Left Coast Press.
Bernardini, W., Barnash, A., Kumler, M., & Wong, M. (2013). Quantifying visual prominence in social landscapes. Journal of Archaeological Science, 40(11), 3946–3954.
Bertemes, F., & Biehl, P. F. (2001). The archaeology of cult and religion: an introduction. The Archaeology of Cult and Religion, 13, 11–24.
Bjur, H., & Frizell, B. S. (2009). Via Tiburtina: space, movement and artefacts in the urban landscape. Svenska institutet i Rom.
Borji, A., & Itti, L. (2013). State-of-the-art in visual attention modeling. IEEE Transactions on Pattern Analysis and Machine Intelligence, 35(1), 185–207.
Borji, A., & Itti, L. (2015). Cat2000: A large scale fixation dataset for boosting saliency research. arXiv preprint arXiv:1505.03581.
Borji, A., Sihite, D. N., & Itti, L. (2013). Quantitative analysis of human-model agreement in visual saliency modeling: a comparative study. IEEE Transactions on Image Processing, 22(1), 55–69.
Bosch, M. (2016). How do you even develop a 4d game? http://marctenbosch.com/news/2015/12/how-do-you-even-develop-a-4d-game/.
Brück, J. (2005). Experiencing the past? The development of a phenomenological archaeology in British prehistory. Archaeological dialogues, 12(01), 45–72.
Cabeza, R., Daselaar, S. M., Dolcos, F., Prince, S. E., Budde, M., & Nyberg, L. (2004). Task-independent and task-specific age effects on brain activity during working memory, visual attention and episodic retrieval. Cerebral Cortex, 14(4), 364–375.
Chrysanthi, A., Murrieta-Flores, P., & Papadopoulos, C. (2012). Thinking beyond the tool. Archaeological computing and the interpretive process (Vol. 2344). Archaeopress.
Chum, M. and Wolfe J. ( 2001) ‘Visual attention’. In: E. B. Goldstein (ed.): Blackwell Handbook of Perception, Handbooks of Experimental Psychology. Blackwell, 272–310.
Cleere, H. (2015). The archaeological and industrial Heritage at Risk: some examples from the World Heritage List. Heritage at Risk, 233–237.
Dickinson, S., & Pizlo, Z. (2015). Shape perception in human and computer vision. Springer.
Edmonds, M. (1999). Ancestral geographies of the Neolithic: landscape, monuments, and memory. London: Routledge.
Eogan, G. (1986). Knowth and the passage-tombs of Ireland. Thames & Hudson.
Eogan, G. (1998). Knowth before Knowth. Antiquity, 72(275), 162–172.
Eogan, G., Roche, H., McCormick, F., Murray, E., & Byrne, F. J. (2008). Excavations at Knowth. Royal Irish Academy.
Ervin, S., & Steinitz, C. (2003). Landscape visibility computation: necessary, but not sufficient. Environment and Planning B: Planning and Design, 30(5), 757–766.
Eve, S. (2012) Augmenting phenomenology: using augmented reality to aid archaeological phenomenology in the landscape. Journal of Archaeological Method and Theory 19, no. 4 (December 1, 2012): 582–600.
Eve, S. (2014). Dead men’s eyes: embodied GIS, mixed reality and landscape archaeology (Doctoral dissertation, UCL (University College London)).
Fredrick, D. (1995). Beyond the atrium to Ariadne: erotic painting and visual pleasure in the Roman house. Classical Antiquity, 14(2), 266–288.
Frieman, C., & Gillings, M. (2007). Seeing is perceiving? World Archaeology, 39(1), 4–16.
Fry, G. L., Skar, B., Jerpåsen, G., Bakkestuen, V., & Erikstad, L. (2004). Locating archaeological sites in the landscape: a hierarchical approach based on landscape indicators. Landscape and Urban Planning, 67(1), 97–107.
Gillings, M. (2009). Visual affordance, landscape, and the megaliths of Alderney. Oxford Journal of Archaeology, 28(4), 335–356.
Gillings, M., & Wheatley, D. (2001). Seeing is not believing: unresolved issues in archaeological visibility analysis.
Gosden, C. (2001). Making sense: archaeology and aesthetics. World Archaeology, 33(2), 163–167.
Hamilakis, Y., Pluciennik, M., & Tarlow, S. (2002). Thinking through the body. New York and London: Archaeologies of corporeality.
Hatfield, G., & Allred, S. (2012). Visual experience: sensation, cognition, and constancy. Oxford University Press.
Herrmann, J. (2014). Introduction to special issue: digital domains. Advances in Archaeological Practice, 2(3), 145–146.
Hodgson, D. (2011). The first appearance of symmetry in the human lineage: where perception meets art. Symmetry, 3(1), 37–53.
Hollands, M. A., Patla, A. E., & Vickers, J. N. (2002). “Look where you’re going!”: gaze behaviour associated with maintaining and changing the direction of locomotion. Experimental Brain Research, 143(2), 221–230.
Howes, D. (2005). Architecture of the senses. Sense of the City, Montréal, Centre Canadien d’Architecture, Lars Müller Publishers.
Ingold, T. (2000). The perception of the environment: essays on livelihood, dwelling and skill. Psychology Press.
Itti, L., & Koch, C. (2000). A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Research, 40, 1489–1506.
Itti, L., & Koch, C. (2001). Computational modelling of visual attention. Nature Reviews Neuroscience, 2, 194–203.
Itti, L., Koch, C., & Niebur, E. (1998). A model of saliency-based visual attention for rapid scene analysis. IEEE Transactions on Pattern Analysis and Machine Intelligence, 20, 1254–1259.
Johnson, M. H. (2012). Phenomenological approaches in landscape archaeology. Annual Review of Anthropology, 41, 269–284.
Julesz, B. (1981). Textons, the elements of texture perception, and their interactions. Nature, 290, 91–97.
Julien, L., & Riche, N. (2016). Toward 3D visual saliency modeling. In From human attention to computational attention Springer New York, 305–330.
Lake, M. W., & Woodman, P. E. (2003). Visibility studies in archaeology: a review and case study. Environment and Planning B: Planning and Design, 30(5), 689–707.
Legendre, P. (1993). Spatial autocorrelation: trouble or new paradigm? Ecology, 74(6), 1659–1673.
Li, Y., Sawada, T., Shi, Y., Steinman, R. M., & Pizlo, Z. (2013). Symmetry is the sine qua non of shape. In Shape perception in human and computer vision Springer London, 21–40.
Llobera, M. (2003) Extending GIS-based visual analysis: the concept of visualscapes. International Journal of Geographical Information Science, 17(1), 25-48.
Llobera M. (2005) The nature of everyday experience: examples on the study of visual space. In Unwin, D. and Fisher, P. (eds.), Re–presenting GIS 171–195. London: Wiley & Sons
Llobera, M. (2006). What you see is what you get?. Digital archaeology: bridging method and theory, 148.
Llobera, M. (2007). Reconstructing visual landscapes. World Archaeology, 39(1), 51–69.
Llobera, M. (2011). Archaeological visualization: towards an archaeological information science (AISc). Journal of Archaeological Method and Theory, 18(3), 193–223.
Llobera, M. (2012). Life on a pixel: challenges in the development of digital methods within an “interpretive” landscape archaeology framework. Journal of Archaeological Method and Theory, 19(4), 495–509.
Lock, G. R. (2003). Using computers in archaeology: towards virtual pasts. Psychology Press.
Lock, G., Kormann, M., & Pouncett, J. (2014). Visibility and movement: towards a GIS-based integrated approach. Computational approaches to the study of movement in archaeology: theory, practice and interpretation of factors and effects of long term landscape formation and transformation, 23–42.
McNamara, A., Mania, K., Koulieris, G. A., & Itti, L. (2014). Attention-aware rendering, mobile graphics and games. In SIGGRAPH Courses.
Miller, H. J. (2004). Tobler’s first law and spatial analysis. Annals of the Association of American Geographers, 94(2), 284–289.
Mlekuz, D. (2004). Listening to landscapes: modelling past soundscapes in GIS. Internet Archaeology, 16.
Molyneaux, B. L. (2013). The cultural life of images: visual representation in archaeology. Routledge.
Paliou, E. (2011). The communicative potential of Theran murals in Late Bronze Age Akrotiri: applying viewshed analysis in 3D townscapes. Oxford Journal of Archaeology, 30(3), 247–272.
Paliou, E. (2013). 10 reconsidering the concept of visualscape: recent advances in three-dimensional visibility analysis. Computational approaches to archaeological spaces, 60, 243-264.
Paliou, E., Wheatley, D., & Earl, G. (2011). Three-dimensional visibility analysis of architectural spaces: iconography and visibility of the wall paintings of Xeste 3 (Late Bronze Age Akrotiri). Journal of Archaeological Science, 38(2), 375–386.
Parks, D., Borji, A., & Itti, L. (2015). Augmented saliency model using automatic 3d head pose detection and learned gaze following in natural scenes. Vision Research, 116, 113–126.
Pashler, H. (Ed.). (2016). Attention. Psychology Press.
Patla, A. E., & Vickers, J. N. (1997). Where and when do we look as we approach and step over an obstacle in the travel path? Neuroreport, 8(17), 3661–3665.
Petersen, S. E., & Posner, M. I. (2012). The attention system of the human brain: 20 years after. Annual Review of Neuroscience, 35, 73-89.
Pizlo, Zygmunt. (2010) 3D shape: its unique place in visual perception. Mit Press.
Pollini, J. (2012). From republic to empire: rhetoric, religion, and power in the visual culture of ancient Rome, 48. University of Oklahoma Press.
Renfrew, C. (2007). The archaeology of ritual, of cult, and of religion. The archaeology of ritual, 109–122.
Scoresby, J., & Shelton, B. E. (2011). Visual perspectives within educational computer games: effects on presence and flow within virtual immersive learning environments. Instructional Science, 39(3), 227–254.
Siagian, C., & Itti, L. (2007). Rapid biologically-inspired scene classification using features shared with visual attention. IEEE Transactions on Pattern Analysis and Machine Intelligence, 29(2), 300–312.
Steuer, J. (1992). Defining virtual reality: dimensions determining telepresence. Journal of Communication, 42(4), 73–93.
Sui, D. Z. (2004). Tobler’s first law of geography: a big idea for a small world? Annals of the Association of American Geographers, 94(2), 269–277.
Taube, J. S., Valerio, S., & Yoder, R. M. (2013). Is navigation in virtual reality with FMRI really navigation? Journal of Cognitive Neuroscience, 25(7), 1008–1019.
Thalmann, D., Lee, J., & Thalmann, N. M. (2016). An evaluation of spatial presence, social presence, and interactions with various 3D displays. In Proceedings of the 29th International Conference on Computer Animation and Social Agents, ACM, 197–204.
Thomas, J. (1990). Monuments from the inside: the case of the Irish megalithic tombs. World Archaeology, 22(2), 168–178.
Thomas, J. (2001). Archaeologies of place and landscape. Archaeological theory today, 165–186.
Thomas, J. (2008). Archaeology, landscape, and dwelling. Handbook of landscape archaeology, 300–306.
Tilley, C. (1994). A phenomenology of landscape: places, paths, and monuments. Oxford: Berg.
Tilley, C. (2008). Phenomenological approaches to landscape archaeology. Handbook of landscape archaeology, 271–276.
Tobler, W. (2004). On the first law of geography: a reply. Annals of the Association of American Geographers, 94(2), 304–310.
Tschan, A. Raczkowski, W. and Latalowa, M. (2000) Perception and viewsheds: are they mutually inclusive? In Lock, G. (ed) Beyond the map: archaeology and spatial technologies. Amsterdam: IOS Press.
Van Dyke, R. M., & Alcock, S. E. (2003). Archaeologies of memory: an introduction. Archaeologies of memory, 1–13.
Wallace-Hadrill, A. (1988). The social structure of the Roman house. Papers of the British School at Rome, 56, 43–97.
Wallace-Hadrill, A. (2008). Housing the dead: the tomb as house in Roman Italy. Commemorating the dead: texts and artifacts in context. New York: Walter de Gruyter, 39–77.
Wheatley, D., & Gillings, M. (2000). Vision, perception and GIS: developing enriched approaches to the study of archaeological visibility. NATO ASI SERIES A: LIFE SCIENCES, 321, 1–27.
Wickstead, H. (2009). The Uber archaeologist art, GIS and the male gaze revisited. Journal of Social Archaeology, 9(2), 249–271.
Wolf J. (2007) Guided search 4.0: current progress with a model of visual search. In Gray W. (ed) Integrated models of cognitive systems.Oxford:Oxford University Press, 99–119.
Wynn, T. (2002). Archaeology and cognitive evolution. Behavioral and Brain Sciences, 25(03), 389–402.
Xu, J., Yang, Z., & Tsien, J. Z. (2010). Emergence of visual saliency from natural scenes via context-mediated probability distributions coding. PloS One, 5(12), e15796.
Yarbus, A. L. (1967) Eye movements and vision, New York: Plenum. (Originally published in Russian 1962).
Zhang, L., Tong, M. H., Marks, T. K., Shan, H., & Cottrell, G. W. (2008). SUN: a Bayesian framework for saliency using natural statistics. Journal of Vision, 8(7), 32–32.
Acknowledgements
A version of this work was first presented at the Digital Domains conference at Dartmouth in 2013 (Herrmann 2014). The author is grateful to Dr. Jason Herrmann, who organized this conference, for the opportunity to present the idea and the method. The author is also grateful to three reviewers, whose comments helped to improve the manuscript.
Author information
Authors and Affiliations
Corresponding author
Ethics declarations
Funding
The authors declare that there are no funding sources that must be acknowledged for this work.
Conflict of Interest
The authors declare that they have no conflict of interest.
Rights and permissions
About this article
Cite this article
Opitz, R. An Experiment in Using Visual Attention Metrics to Think About Experience and Design Choices in Past Places. J Archaeol Method Theory 24, 1203–1226 (2017). https://doi.org/10.1007/s10816-016-9310-2
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10816-016-9310-2