Abstract
Human-like gaze control is needed for robots to be companions of humans. For human-like gaze control, much research has been progressing to identify factors that affect human gaze. The conventional approaches to discover factors that affect human gaze is based on their hypotheses. They presented gaze control algorithm based on hypotheses and verified through experiments. However, since the algorithms were originated from the hypotheses, they were prone to be biased to the hypotheses. This paper derives the factors that affect human gaze based on observation of real human’s scanpaths, not hypothesis. From the recorded scanpaths, fixation maps are produced using the Gaussian distribution. The earth mover’s distance (EMD) is used to measure similarity among fixation maps, and the fixation map with minimal difference is selected in each test image. The selected fixation maps are used to derive the factors that affect human gaze. The derived factors are center, salient regions, human, depth, objects, scene schema information, and they are shown with examples.
This is a preview of subscription content, log in via an institution.
Buying options
Tax calculation will be finalised at checkout
Purchases are for personal use only
Learn about institutional subscriptionsPreview
Unable to display preview. Download preview PDF.
References
Itti, L., Koch, C.: A saliency-based search mechanism for overt and covert shifts of visual attention. Vision Res. 40(10), 1489–1506 (2000), doi:10.1016/S0042-6989(99)00163-7
Cerf, M., Harel, J., Einhäuser, W., Koch, C.: Predicting human gaze using low-level saliency combined with face detection. Adv. Neur. In. 20, 241–248 (2008)
Ruesch, J., Lopes, M., Bernardino, A., et al.: Multimodal saliency-based bottom-up attention a framework for humanoid robot iCub. Papers presented at the IEEE Conf Robotics and Automation, Pasadena, CA, USA, pp. 962–967 (May 2008)
Wooding, D.S.: Eye movement of large populations: II. Deriving regions of interest, coverage, and similarity using fixation maps. Behav. Res. Meth. Instr. 34(4), 518–528 (2002), doi:10.3758/BF03195481
Privitera, C.M., Stark, L.W.: Algorithms for defining visual regions-of-interest: Comparison with eye fixations. IEEE Trans. Pattern Anal. Mach. Intell. 22(9), 970–982 (2000), doi:10.1109/34.877520
Yarbus, A.L.: Eye movement and Vision. Academy of Sciences of the USSR, Moscow. English edition: Haigh B. Eye movement and Vision (trans: Haigh B). Plenum Press, New York (1967)
Rubner, Y., Tomasi, C., Guibas, L.J.: The earth mover’s distance as a metric for image retrieval. Int. J. Comput. Vision 40(2), 99–121 (2000), doi:10.1023/A:1026543900054
Pele, O., Werman, M.: A linear time histogram metric for improved SIFT matching. In: Forsyth, D., Torr, P., Zisserman, A. (eds.) ECCV 2008, Part III. LNCS, vol. 5304, pp. 495–508. Springer, Heidelberg (2008)
Pele, O., Werman, M.: Fast and robust earth mover’s distances. Papers presented at the Int Conf on Computer Vision, Kyoto, Japan, pp. 460–467 (October 2009)
Judd, T., Durand, F., Torralba, A.: A benchmark of computational models of saliency to predict human fixations. MIT Tech. Report (2012)
Judd, T., Ehinger, K., Durand, F., Torralba, A.: Learning to predict where humans look. Paper presented at the Int Conf on Computer Vision, Kyoto, Japan, pp. 2106–2113 (October 2009)
Zhang, L., Tong, M.H., Marks, T.K., et al.: SUN: A Bayesian framework for saliency using natural statistics. J. Vision 8(7), 1–20 (2008), doi:10.1167/8.7.32
Talter, B.W.: The central fixation bias in scene viewing: Selecting an optimal viewing position independently of motor biases and image feature distribution. J. Vision 7(14), 1–17 (2007), doi:10.1167/7.14
Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Hum. Neurobiol. 4, 219–227 (1985), doi:10.1007/978-94-009-3833-5_5
Summerfield, C., Egner, T.: Expectation (and attention) in visual cognition. Trends Cogn. Sci. 13(9), 403–409 (2009), doi:10.1016/j.tics.2009.06.003
Author information
Authors and Affiliations
Corresponding author
Editor information
Editors and Affiliations
Rights and permissions
Copyright information
© 2014 Springer International Publishing Switzerland
About this chapter
Cite this chapter
Yoo, BS., Kim, JH. (2014). Scanpaths Analysis with Fixation Maps to Provide Factors for Natural Gaze Control. In: Kim, JH., Matson, E., Myung, H., Xu, P., Karray, F. (eds) Robot Intelligence Technology and Applications 2. Advances in Intelligent Systems and Computing, vol 274. Springer, Cham. https://doi.org/10.1007/978-3-319-05582-4_31
Download citation
DOI: https://doi.org/10.1007/978-3-319-05582-4_31
Publisher Name: Springer, Cham
Print ISBN: 978-3-319-05581-7
Online ISBN: 978-3-319-05582-4
eBook Packages: EngineeringEngineering (R0)