Shadow Cooking: Situated Guidance for a Fluid Cooking Experience

  • Ayaka Sato
  • Keita Watanabe
  • Jun Rekimoto
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8515)


Cooking is one of the most popular activities at home; however, preparing a new dish by reading a recipe is not a trivial task. People might lose their current position in the recipe, misunderstand the required amount of ingredients, and generally become confused by the step that should be followed next. Shadow Cooking guides users with situated, step-by-step information projected on a kitchen counter. It consists of a depth camera and a projector, which are installed above the kitchen counter. Shadow Cooking instructs the user on the steps to follow by projecting information directly onto the utensils and ingredients. The system also integrates a digital kitchen scale with the recipe such that the user is automatically prompted with the required weight based on the ingredient currently being measured. In addition, we have connected the system with remote locations in order to enable a user to communicate with other cooks easily.


Accessibility of Smart Environments cooking AR kitchen measuring 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Ju, W., Hurwitz, R., Judd, T., Lee, B.: Counteractive: An Interactive Cookbook for the Kitchen Counter. In: Proc. CHI EA 2001, pp. 269–270 (2011)Google Scholar
  2. 2.
    Suzuki, Y., Morioka, S., Ueda, H.: Cooking Support with Information Projection onto Ingredient. In: Proc. APCHI 2012, pp. 193–198. ACM Press (2012)Google Scholar
  3. 3.
    Ikeda, S., Asghar, Z., Hyry, J., Pulli, P., Pitkanen, A., Kato, H.: Remote assistance using visual prompts for demented elderly in cooking. In: In Proc. ISABEL 2011, pp. 1–5. ACM Press (2011)Google Scholar
  4. 4.
    Uriu, D., Namai, M., Tokuhisa, S., Kashiwagi, S., Inami, M., Okude, N.: Experience “panavi”: challenge to master professional culinary arts. In: Proc. CHI 2012, pp. 1445–1446. ACM Press (2012)Google Scholar
  5. 5.
    Mennicken, S., Karrer, T., Russell, P., Borchers, J.: First-person cooking: a dual-perspective interactive kitchen counter. In: CHI EA 2010, pp. 3403–3408 (2010)Google Scholar
  6. 6.
    Siio, I., Mima, N., Frank, I., Ono, T., Weintraub, H.: Making recipes in the kitchen of the future. In: Proc. CHI EA 2001, pp. 1554–1554. ACM Press (2004)Google Scholar
  7. 7.
    Hamaoka, R., Okabe, J., Ide, I., Satoh, S., Sakai, S., Tanaka, H.: Cooking navi: assistant for daily cooking in kitchen. In: Proc. ACM Multimedia, pp. 371–374 (2005)Google Scholar
  8. 8.
    Doman, K., Kuai, C.Y., Takahashi, T., Ide, I., Murase, H.: Video CooKing: Towards the synthesis of multimedia cooking recipes. In: Lee, K.-T., Tsai, W.-H., Liao, H.-Y.M., Chen, T., Hsieh, J.-W., Tseng, C.-C. (eds.) MMM 2011 Part II. LNCS, vol. 6524, pp. 135–145. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  9. 9.
    Chi, P.-Y.P., Chen, J.-H., Chu, H.-H., Lo, J.-L.: Enabling calorie-aware cooking in a smart kitchen. In: Oinas-Kukkonen, H., Hasle, P., Harjumaa, M., Segerståhl, K., Øhrstrøm, P. (eds.) PERSUASIVE 2008. LNCS, vol. 5033, pp. 116–127. Springer, Heidelberg (2008)CrossRefGoogle Scholar
  10. 10.
    Hooper, C.J., Preston, A., Balaam, M., Seedhouse, P., Jackson, D., Pham, C., Ladha, C., Ladha, K., Plötz, T., Olivier, P.: The French Kitchen: Task-Based Learning in an Instrumented Kitchen. In: Proc. UbiComp 2012, pp. 193–202. ACM Press (2012)Google Scholar
  11. 11.
    Lei, J., Ren, X., Fox, D.: Fine-grained kitchen activity recognition using RGB-D. In: Proc. UbiComp 2012, pp. 208–211. AMC Press (2012)Google Scholar
  12. 12.
    Ziola, R., Grampurohit, S., Nate, L., Fogarty, J., Harrison, B.: OASIS: Creating Smart Objects with Dynamic Digital Behavior. In: Interacting with Smart Objects, Workshop at ACM IUI (2011)Google Scholar
  13. 13.
    Watanabe, K., Sato, A., Matsuda, S., Inami, M., Igarashi, T.: Smoon: A Spoon with Automatic Capacity Adjustment. In: VRIC 2012 Proceedings, Laval Virtual 2012 France (2012)Google Scholar
  14. 14.
    Kita, Y., Rekimoto, J.: Thermal Visualization on Cooking. In: Proceedings of the 23rd International Conference on Artificial Reality and Telexistence (2013)Google Scholar
  15. 15.
    Sato, A., Tsukada, K., Siio, I.: CookTab: smart cutting board for creating recipe with real-time feedback. In: Proc. of UbiComp 2012, pp. 543–544. ACM Press (2012)Google Scholar

Copyright information

© Springer International Publishing Switzerland 2014

Authors and Affiliations

  • Ayaka Sato
    • 1
  • Keita Watanabe
    • 2
  • Jun Rekimoto
    • 1
    • 3
  1. 1.The University of TokyoBunkyo-kuJapan
  2. 2.Meiji UniversityNakano-kuJapan
  3. 3.Sony Computer Science LaboratoriesShinagawa-kuJapan

Personalised recommendations