Intelligent Augmented Reality Tutoring for Physical Tasks with Medical Professionals

  • Mohammed A. Almiyad
  • Luke Oakden-Rayner
  • Amali WeerasingheEmail author
  • Mark Billinghurst
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 10331)


Percutaneous radiology procedures often require the repeated use of medical radiation in the form of computed tomography (CT) scanning, to demonstrate the position of the needle in the underlying tissues. The angle of the insertion and the distance travelled by the needle inside the patient play a major role in successful procedures, and must be estimated by the practitioner and confirmed periodically by the use of the scanner. Junior radiology trainees, who are already highly trained professionals, currently learn this task “on-the-job” by performing the procedures on real patients with varying levels of guidance. Therefore, we present a novel Augmented Reality (AR)-based system that provides multiple layers of intuitive and adaptive feedback to assist junior radiologists in achieving competency in image-guided procedures.


Intelligent tutoring system Augmented reality Percutaneous radiology 


  1. 1.
    Abe, Y., Sato, S., Kato, K., Hyakumachi, T., Yanagibashi, Y., Ito, M., Abumi, K.: A novel 3D guidance system using augmented reality for percutaneous vertebroplasty: technical note. J. Neurosurg. Spine 19(4), 492–501 (2013)CrossRefGoogle Scholar
  2. 2.
    Ashab, H.A.D., Lessoway, V.A., Khallaghi, S., Cheng, A., Rohling, R., Abolmaesumi, P.: An augmented reality system for epidural anesthesia (area): prepuncture identification of vertebrae. IEEE Trans. Biomed. Eng. 60(9), 2636–2644 (2013)CrossRefGoogle Scholar
  3. 3.
    Azuma, R.T.: A survey of augmented reality. Presence Teleoperators Virtual Environ. 6(4), 355–385 (1997)CrossRefGoogle Scholar
  4. 4.
    Barsom, E., Graafland, M., Schijven, M.: Systematic review on the effectiveness of augmented reality applications in medical training. Surg. Endosc. 30(10), 4174–4183 (2016)CrossRefGoogle Scholar
  5. 5.
    LaViola, J., Williamson, B., Brooks, C., Veazanchin, S., Sottilare, R., Garrity, P.: Using augmented reality to tutor military tasks in the wild. In: Interservice/Industry Training, Simulation, and Education Conferernce (I/ITSEC), Orlando, FL, USA, pp. 1–10 (2015)Google Scholar
  6. 6.
    Rosenthal, M., State, A., Lee, J., Hirota, G., Ackerman, J., Keller, K., Pisano, E.D., Jiroutek, M., Muller, K., Fuchs, H.: Augmented reality guidance for needle biopsies: an initial randomized, controlled trial in phantoms. Med. Image Anal. 6(3), 313–320 (2002)CrossRefzbMATHGoogle Scholar
  7. 7.
    VanLehn, K.: The relative effectiveness of human tutoring, intelligent tutoring systems, and other tutoring systems. Educ. Psychol. 46(4), 197–221 (2011)CrossRefGoogle Scholar
  8. 8.
    Westerfield, G., Mitrovic, A., Billinghurst, M.: Intelligent augmented reality training for motherboard assembly. Int. J. Artif. Intell. Educ. 25(1), 157–172 (2015)CrossRefGoogle Scholar

Copyright information

© Springer International Publishing AG 2017

Authors and Affiliations

  • Mohammed A. Almiyad
    • 1
  • Luke Oakden-Rayner
    • 2
  • Amali Weerasinghe
    • 1
    Email author
  • Mark Billinghurst
    • 3
  1. 1.Department of Computer ScienceUniversity of AdelaideAdelaideAustralia
  2. 2.Department of RadiologyRoyal Adelaide HospitalAdelaideAustralia
  3. 3.Department of Computer ScienceUniversity of South AustraliaAdelaideAustralia

Personalised recommendations