Predicting Eyes’ Fixations in Movie Videos: Visual Saliency Experiments on a New Eye-Tracking Database
In this paper we describe the newly created eye tracking annotated database Eye-Tracking Movie Database ETMD and give some preliminary experimental results on this dataset using our new visual saliency frontend. We have developed a database with eye-tracking human annotation that comprises video clips from Hollywood movies, which are longer in duration than the existing databases’ videos and include more complex semantics. Our proposed visual saliency frontend is based on both low-level features, such as intensity, color and spatio-temporal energy, and face detection results and provides a single saliency volume map. The described new eye-tracking database can become useful in many applications while our computational frontend shows to be promising as it gave good results on predicting the eye’s fixation according to certain metrics.
KeywordsEye-tracking Database Visual Saliency Spatio-Temporal Visual Frontend 3D Gabor Filters Lab Color Space
Unable to display preview. Download preview PDF.
- 2.Evangelopoulos, G., Zlatintsi, A., Potamianos, A., Maragos, P., Rapantzikos, K., Skoumas, G., Avrithis, Y.: Multimodal saliency and fusion for movie summarization based on aural, visual, textual attention. IEEE Trans. on Multimedia 15(7) (2013)Google Scholar
- 4.Koch, C., Ullman, S.: Shifts in selective visual attention: towards the underlying neural circuitry. Human Neurobiology 4(4), 219–227 (1985)Google Scholar
- 7.Poynton, C.: Digital Video and HD: Algorithms and Interfaces, 2nd edn. Morgan Kaufmann (2012)Google Scholar
- 13.Wyszecki, G., Stiles, W.S.: Color Science, 2nd edn. J. Wiley & Sons, NY (1982)Google Scholar
- 14.Gabor, D.: Theory of Communication. IEE Journal (London) 93, 429–457 (1946)Google Scholar
- 17.Green, D.M., Swets, J.A.: Signal detection theory and psychophysics. Wiley, New York (1966)Google Scholar