A Ubiquitous Computing Platform for Virtualizing Collective Human Eyesight and Hearing Capabilities

  • Risa KimuraEmail author
  • Tatsuo Nakajima
Conference paper
Part of the Advances in Intelligent Systems and Computing book series (AISC, volume 1006)


Ubiquitous computing technologies have dramatically changed our daily lifestyles. A mobile phone that contains powerful computational and sensing capabilities allows us to access information anytime, anywhere. In the near future, we will wear mobile phones as glasses and clothing, and the wearable devices will be used to enhance our bodies’ capabilities. In particular, the camera and microphone contained in such a device can be used as alternative eyes and ears for developing novel types of services. This study investigates the feasibility of sharing other people’s body parts, particularly their eyes and ears, to build novel services. A platform that would enable a user to adopt anyone else’s seeing and hearing capabilities would offer novel sharing economy services that would go beyond the traditional services that share people’s belongings and would instead share the human body’s capabilities. We have developed a prototype implementation of the platform, and we present the results of preliminary user studies to investigate the feasibility of our approach.


Virtual reality Sharing economy Gaze-based gesture 


  1. 1.
    Hamari, J., Sjöklint, M., Ukkonen, A.: The sharing economy: why people participate in collaborative consumption. J. Assoc. Inf. Sci. Technol. 67(9), 2047–2059 (2016)CrossRefGoogle Scholar
  2. 2.
    Hase, A.: Beatless. Kadokawa Publishing, Tokyo (2012)Google Scholar
  3. 3.
    Ikeuchi, K., Otsuka, T., Yoshii, A., Sakamoto, M., Nakajima, T.: KinecDrone: enhancing somatic sensation to fly in the sky with Kinect and AR.Drone. In: Proceedings of the 5th Augmented Human International Conference (2014). Article 53Google Scholar
  4. 4.
    Ishizawa, F., Sakamoto, M., Nakajima, T.: Extracting intermediate-level design knowledge for speculating digital–physical hybrid alternate reality experiences. Multimedia Tools Appl. 77(16), 21329–21370 (2018)CrossRefGoogle Scholar
  5. 5.
    Kasahara, S., Rekimoto, J.: JackIn: integrating first-person view with out-of-body vision generation for human-human augmentation. In: Proceedings of the 5th Augmented Human International Conference (2014). Article No. 46Google Scholar
  6. 6.
    Kimura, R., Nakajima, T.: Sharing collective human’s eyesights towards reflective thinking. In: Proceedings of the 17th International Conference on Mobile and Ubiquitous Multimedia, pp. 341–349 (2018)Google Scholar
  7. 7.
    Kilteni, C., Maselli, A., Kording, K.P., Slater, M.: Over my fake body: body ownership illusions for studying the multisensory basis of own-body perception. Front. Hum. Neurosci. 9, 141 (2015)Google Scholar
  8. 8.
    Liu, Y., Alexandrova, T., Nakajima, T.: Using stranger as sensors: temporal and geo sensitive question answering via social media. In: Proceedings of the 22nd International Conference on World Wide Web, pp. 803–814 (2013)Google Scholar
  9. 9.
    Tsui, K.M., Desai, M., Yanco, H.A., Uhlik, C.: Exploring use cases for telepresence robots. In: Proceedings of the 6th International Conference on Human-Robot Interaction (HRI 2011), pp. 11–18 (2011)Google Scholar
  10. 10.
    Weinschenk, S.: 100 Things Every Designer Needs to Know About People. New Riders Press (2011)Google Scholar

Copyright information

© Springer Nature Switzerland AG 2020

Authors and Affiliations

  1. 1.Waseda UniversityTokyoJapan

Personalised recommendations