Interactive Lecture System Based on Mixed Reality with Transparent Display

  • Yulong Xi
  • Seoungjae Cho
  • Simon Fong
  • Byong kwon Lee
  • Kyhyun Um
  • Kyungeun ChoEmail author
Conference paper
Part of the Lecture Notes in Electrical Engineering book series (LNEE, volume 393)


This paper proposes the interactive lecture system based on mixed reality using a transparent display that enables interaction with the users watching the display. This system unlike existing remote video lectures, will allow students to participate progressively in the lectures by enabling the interaction between the instructor and students. Furthermore, this system also improves the reality in such a way that, during the visualization of the real-time video lectures on the transparent display, it seems that the instructor is in the same place with the students. This paper experiments and implements the proposed system based on the transparent display, 2D camera, and 3D sensors.


Transparent display Remote lecture Interactive lecture Natural user interface 



This research was supported by the MSIP (Ministry of Science, ICT and Future Planning), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2016-H8501-16-1014) supervised by the IITP (Institute for Information and communications Technology Promotion).


  1. 1.
    Su CW, Liao CC, Chen MY (2016) Color transparent display using polymer-dispersed liquid crystal. Display Technol J 12(1):31–34CrossRefGoogle Scholar
  2. 2.
    Sharma A, Liu L, Maes P (2013) Glassified: an augmented ruler based on a transparent display for real-time interactions with paper. In: Proceedings of the adjunct publication of the 26th annual ACM symposium on user interface software and technology, pp 21–22Google Scholar
  3. 3.
    Moon B, Yoo S (2014) A study on the evaluation of UX elements for users’ selective. Arch Design Res 27(2):183–197Google Scholar
  4. 4.
    Hariharan BSP, Uma G (2014) Gesture recognition using Kinect in a virtual classroom environment. In: Proceedings of 2014 4th international conference on digital information and communication technology and it’s applications (DICTAP), pp 118–124Google Scholar
  5. 5.
    Inoue A, Schlittenhart I (2012) Intelligent autopilot for remote classroom: A cloud based solution. In: Proceedings of 2012 joint 6th international conference on soft computing and intelligent systems (SCIS) and 13th international symposium on advanced intelligent systems (ISIS), pp 1414–1419Google Scholar
  6. 6.
    Sharma S, Chen W (2014) Multi-user VR classroom with 3D interaction and real-time motion detection. In: Proceedings of 2014 international conference on computational science and computational intelligence (CSCI), 2:187–192Google Scholar
  7. 7.
    Anand S, Jayahari KR, Bijlani K, Vijayan V, Chatterjee S (2014) Pedagogy-based design of live virtual classroom for large-scale training. In: Proceedings of 2014 IEEE 6th international conference on technology for education (T4E), pp 195–201Google Scholar

Copyright information

© Springer Science+Business Media Singapore 2016

Authors and Affiliations

  • Yulong Xi
    • 1
  • Seoungjae Cho
    • 1
  • Simon Fong
    • 2
  • Byong kwon Lee
    • 1
  • Kyhyun Um
    • 1
  • Kyungeun Cho
    • 1
    Email author
  1. 1.Department of Multimedia EngineeringDongguk University-SeoulJung-GuKorea
  2. 2.Department of Computer and Information ScienceUniversity of MacauTaipaChina

Personalised recommendations