Mixed Library — Bridging Real and Virtual Libraries

  • Denis GračaninEmail author
  • Andrew Ciambrone
  • Reza Tasooji
  • Mohamed Handosa
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10280)


New technologies, especially mixed reality devices, such as Microsoft HoloLens, are blurring the difference between the real and virtual worlds. These developments provide an exciting opportunity to re-define virtual library while maintaining utility and effectiveness. Developing a mixed library system requires identifying the set of services to be supported by the system and identifying well-defined service protocols. We describe a mixed reality based system, a prototype mixed library, that provides a variety of affordances to support embodied interactions and improve the user experience. By leveraging embodiment and context awareness, a mixed reality based user interface can provide many ways to aid a user. We use Microsoft HoloLens device to augment the user’s experience in the real library and to provide a rich set of affordances for embodied and social interactions. In addition, the user can also access services of the virtual library when not in the real library.


Mixed reality Augmented reality Library User interface Virtual library 



This work was supported in part by a grant from Virginia Tech Institute for Creativity, Arts, and Technology (ICAT).


  1. 1.
    16x9onglobal: 3D printing: Make anything you want (2017). Last accessed 10 Feb 2017
  2. 2.
    Barakonyi, I., Schmalstieg, D.: Augmented reality agents for user interface adaptation. Comput. Anim. Virtual Worlds 19(1), 23–35 (2008)CrossRefGoogle Scholar
  3. 3.
    Bimber, O., Raskar, R.: Spatial Augmented Reality: Merging Real and Virtual Worlds. A K Peters, Wellesley (2005)CrossRefGoogle Scholar
  4. 4.
    Corporation, M.: Microsoft HoloLens. (2017). Last accessed 10 Feb 2017
  5. 5.
    Cubillo, J., Martín, S., Castro, M., Diaz, G., Colmenar, A., Botički, I.: A learning environment for augmented reality mobile learning. In: 2014 IEEE Frontiers in Education Conference (FIE) Proceedings, pp. 1–8, October 2014Google Scholar
  6. 6.
    DAQRI: ARToolkit. (2016). Last accessed 10 Feb 2016
  7. 7.
    Davis, M.M., Gabbard, J.L., Bowman, D.A., Gracanin, D.: Depth-based 3D gesture multi-level radial menu for virtual object manipulation. In: Proceedings of the 2016 IEEE Virtual Reality Conference, pp. 169–170 (2016)Google Scholar
  8. 8.
    Dourish, P.: Where the Action Is: The Foundations of Embodied Interaction. The MIT Press, Cambridge (2001)Google Scholar
  9. 9.
    Dunleavy, M., Dede, C., Mitchell, R.: Affordances and limitations of immersive participatory augmented reality simulations for teaching and learning. J. Sci. Educ. Technol. 18(1), 7–22 (2009)CrossRefGoogle Scholar
  10. 10.
    Gračanin, D., Zhou, Y., DaSilva, L.: Quality of service for networked virtual environments. IEEE Commun. Mag. 42(4), 42–48 (2004)CrossRefGoogle Scholar
  11. 11.
    Hantono, B.S., Nugroho, L.E., Santosa, P.I.: Review of augmented reality agent in education. In: Proceedings of the 6th International Annual Engineering Seminar (InAES), pp. 150–153, August 2016Google Scholar
  12. 12.
    Kim, J.S., Gračanin, D., Quek, F.: Sensor-fusion walking-in-place interaction technique using mobile devices. In: Proceedings of the IEEE Virtual Reality Conference (VR), pp. 39–42, 5–8 March 2012Google Scholar
  13. 13.
    Kim, J.S., Gračanin, D., Yang, T., Quek, F.: Action-transferred design approach for navigation techniques in 3D virtual environments. ACM Trans. Comput.-Human Interact. 22(6), 30:1–30:42 (2015)CrossRefGoogle Scholar
  14. 14.
    Matcha, W., Awang Rambli, D.R.: Preliminary investigation on the use of augmented reality in collaborative learning. In: Abd Manaf, A., Sahibuddin, S., Ahmad, R., Mohd Daud, S., El-Qawasmeh, E. (eds.) ICIEIS 2011. CCIS, vol. 254, pp. 189–198. Springer, Heidelberg (2011). doi: 10.1007/978-3-642-25483-3_15 CrossRefGoogle Scholar
  15. 15.
    Mulligan, G., Gračanin, D.: A comparison of SOAP and REST implementations of a service based interaction independence middleware framework. In: Rossettii, M., Hill, R., Johansson, B., Dunkin, A., Ingalls, R. (eds.) Proceedings of the Winter Simulation Conference, pp. 1423–1432, 13–16 December 2009Google Scholar
  16. 16.
    Noh, Z., Sunar, M.S., Pan, Z.: A review on augmented reality for virtual heritage system. In: Chang, M., Kuo, R., Kinshuk, Chen, G.-D., Hirose, M. (eds.) Edutainment 2009. LNCS, vol. 5670, pp. 50–61. Springer, Heidelberg (2009). doi: 10.1007/978-3-642-03364-3_7
  17. 17.
    Oh, S., Byun, Y.C.: The design and implementation of augmented reality learning systems. In: Proceedings of the 2012 IEEE/ACIS 11th International Conference on Computer and Information Science, pp. 651–654. IEEE Computer Society, Washington, DC (2012)Google Scholar
  18. 18.
    PTC Inc.: Vuforia. (2017). Last accessed 10 Feb 2017
  19. 19.
    Underwood, J., Kimmel, S., Forest, D., Dickinson, G.: Culturally relevant booktalking: using a mixed reality simulation with preservice school librarians. Sch. Libr. Worldwide 21(1), 91–107 (2015)Google Scholar
  20. 20.
    Wilson, M.: Six views of embodied cognition. Psychon. Bull. Rev. 9(4), 625–636 (2002)CrossRefGoogle Scholar
  21. 21.
    Zhou, F., Duh, H.B.L., Billinghurst, M.: Trends in augmented reality tracking, interaction and display: a review of ten years of ISMAR. In: Proceedings of the 7th IEEE/ACM International Symposium on Mixed and Augmented Reality, pp. 193–202, September 2008Google Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Denis Gračanin
    • 1
    Email author
  • Andrew Ciambrone
    • 1
  • Reza Tasooji
    • 1
  • Mohamed Handosa
    • 1
  1. 1.Department of Computer ScienceVirginia TechBlacksburgUSA

Personalised recommendations