D-FLIP: Dynamic and Flexible Interactive PhotoShow

  • Chi Thanh Vi
  • Kazuki Takashima
  • Hitomi Yokoyama
  • Gengdai Liu
  • Yuichi Itoh
  • Sriram Subramanian
  • Yoshifumi Kitamura
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8253)


We propose D-FLIP, a novel algorithm that dynamically displays a set of digital photos using different principles for organizing them. A variety of requirements for photo arrangements can be flexibly replaced or added through the interaction and the results are continuously and dynamically displayed. D-FLIP uses an approach based on combinatorial optimization and emergent computation, where geometric parameters such as location, size, and photo angle are considered to be functions of time; dynamically determined by local relationships among adjacent photos at every time instance. As a consequence, the global layout of all photos is automatically varied. We first present examples of photograph behaviors that demonstrate the algorithm and then investigate users’ task engagement using EEG in the context of story preparation and telling. The result shows that D-FLIP requires less task engagement and mental efforts in order to support storytelling.


Dynamic PhotoShow Emergent Computing EEG 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Kirk, D., Sellen, A., Rother, C., Wood, K.: Understanding photowork. In: CHI (2006)Google Scholar
  2. 2.
    Bederson, B.B.: PhotoMesa: a zoomable image browser using quantum treemaps and bubblemaps. In: UIST (2001)Google Scholar
  3. 3.
    Dachselt, R., Frisch, M., Weiland, M.: FacetZoom: a continuous multi-scale widget for navigating hierarchical metadata. In: CHI (2008)Google Scholar
  4. 4.
    Graham, A., Garcia-Molina, H., Paepcke, A., Winograd, T.: Time as essence for photo browsing through personal digital libraries. In: JCDL (2002)Google Scholar
  5. 5.
    Ahern, S., Naaman, M., Nair, R., Yang, J.H.-I.: World explorer: visualizing aggregate data from unstructured text in geo-referenced collections. In: JCDL (2007)Google Scholar
  6. 6.
    Gomi, A., Itoh, T.: A personal photograph browser for life log analysis based on location, time, and person. In: SAC (2011)Google Scholar
  7. 7.
    Brivio, P., Tarini, M., Cignoni, P.: Browsing Large Image Datasets through Voronoi Diagrams. IEEE Trans. Vis. Comput. Graph. 16(6) (2010)CrossRefGoogle Scholar
  8. 8.
    Itoh, T., Yamaguchi, Y., Ikehata, Y., Kajinaga, Y.: Hierarchical data visualization using a fast rectangle-packing algorithm. IEEE TVCG 10(3) (2004)CrossRefGoogle Scholar
  9. 9.
    Gomi, A., Miyazaki, R., Itoh, T., Jia, L.: CAT: A Hierarchical Image Browser Using a Rectangle Packing Technique. In: Book CAT: A Hierarchical Image Browser Using a Rectangle Packing Technique (2008)Google Scholar
  10. 10.
    Rother, C., Bordeaux, L., Hamadi, Y., Blake, A.: AutoCollage. SIGGRAPH (2006)Google Scholar
  11. 11.
    Wang, J., Quan, L., Sun, J., Tang, X., Shum, H.-Y.: Picture Collage. In: CVPR (2006)Google Scholar
  12. 12.
    Rother, C., Kumar, S., Kolmogorov, V., Blake, A.: Digital Tapestry. In: CVPR (2005)Google Scholar
  13. 13.
    Kim, S., Yoon, M., Whang, S.M., Tversky, B., Morrison, J.B.: The effect of animation on comprehension and interest. JCAL 23(3) (2007)CrossRefGoogle Scholar
  14. 14.
    Rieber, L.P.: Animation, incidental learning, and continuing motivation. Journal of Educational Psychology 83(3) (1991)CrossRefGoogle Scholar
  15. 15.
    Kintsch, W.: Learning from text, levels of comprehension, or: Why anyone would read a story anyway. Poetics 9 (1980)CrossRefGoogle Scholar
  16. 16.
    Vi, C., Subramanian, S.: Detecting error-related negativity for interaction design. In: CHI (2012)Google Scholar
  17. 17.
    Hagemann, D., Hewig, J., Walter, C., Schankin, A., Danner, D., Naumann, E.: Positive evidence for Eysenck’s arousal hypothesis: A combined EEG and MRI study with multiple measurement occasions. J. of Personality and Individual Differences (2009)Google Scholar
  18. 18.
    Berka, C., Levendowski, D.J., Lumicao, M.N., Yau, A., Davis, G., Zivkovic, V.T., Olmstead, R.E., Tremoulet, P.D., Craven, P.L.: EEG Correlates of Task Engagement and Mental Workload in Vigilance, Learning, and Memory Tasks. ACEM 78(5) (2007)Google Scholar
  19. 19.
    Matthews, G., Campbell, S.E., Falconer, S., Joyner, L.A., Huggins, J., Gilliland, K., Grier, R., Warm, J.S.: ‘Fundamental Dimensions of Subjective State in Performance Settings: Task Engagement, Distress, and Worry’. Emotion 2(4) (2002)CrossRefGoogle Scholar
  20. 20.
    Berka, C., Levendowski, D.J., Olmstead, R.E., Popovic, M.V., Cvetinovic, M., Petrovic, M.M., Davis, G., Lumicao, M.N., Westbrook, P.: Real-time Analysis of EEG Indices of Alertness, Cognition, and Memory with a Wireless EEG Headset. IJHCI 17(2) (2004)Google Scholar
  21. 21.
    Pope, A.T., Bogart, E.H., Bartolome, D.S.: Biocybernetic system evaluates indices of operator engagement in automated task. Biological Psychology 40 (1995)CrossRefGoogle Scholar
  22. 22.
    Rodden, K., Wood, K.R.: How do people manage their digital photographs? In: CHI 2003 (2003)Google Scholar
  23. 23.
    Anderson, E.W., Potter, K.C., Matzen, L.E., Shepherd, J.F., Preston, G.A., Silva, C.T.: A user study of visualization effectiveness using EEG and cognitive load. In: EuroVis (2011)Google Scholar
  24. 24.
    Ames, M.G., Manguy, L.: PhotoArcs: ludic tools for sharing photographs. In: MM (2006)Google Scholar
  25. 25.
    Ekandem, J.I., Davis, T.A., Alvarez, I., James, M.T., Gilbert, J.E.: Evaluating the ergonomics of BCI devices for research and experimentation. Ergonomics 55(5) (2012)Google Scholar
  26. 26.
    Lee, J.C., Tan, D.S.: Using a low-cost electroencephalograph for task classification in HCI research. In: UIST (2006)Google Scholar
  27. 27.
    Horikawa, T., Tamaki, M., Miyawaki, Y., Kamitani, Y.: Neural Decoding of Visual Imagery During Sleep. Science (2013)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2013

Authors and Affiliations

  • Chi Thanh Vi
    • 1
  • Kazuki Takashima
    • 2
  • Hitomi Yokoyama
    • 2
  • Gengdai Liu
    • 3
  • Yuichi Itoh
    • 4
  • Sriram Subramanian
    • 1
  • Yoshifumi Kitamura
    • 2
  1. 1.University of BristolUK
  2. 2.Tohoku UniversityJapan
  3. 3.OLM Digital Inc.Japan
  4. 4.Osaka UniversityJapan

Personalised recommendations