Skip to main content
Log in

Comparative Efficacy of New Interfaces for Intra-procedural Imaging Review: the Microsoft Kinect, Hillcrest Labs Loop Pointer, and the Apple iPad

  • Published:
Journal of Digital Imaging Aims and scope Submit manuscript

Abstract

We adapted and evaluated the Microsoft Kinect (touchless interface), Hillcrest Labs Loop Pointer (gyroscopic mouse), and the Apple iPad (multi-touch tablet) for intra-procedural imaging review efficacy in a simulation using MIM Software DICOM viewers. Using each device, 29 radiologists executed five basic interactions to complete the overall task of measuring an 8.1-cm hepatic lesion: scroll, window, zoom, pan, and measure. For each interaction, participants assessed the devices on a 3-point subjective scale (3 = highest usability score). The five individual scores were summed to calculate a subjective composite usability score (max 15 points). Overall task time to completion was recorded. Each user also assessed each device for its potential to jeopardize a sterile field. The composite usability scores were as follows: Kinect 9.9 (out of 15.0; SD = 2.8), Loop Pointer 12.9 (SD = 13.5), and iPad 13.5 (SD = 1.8). Mean task completion times were as follows: Kinect 156.7 s (SD = 86.5), Loop Pointer 51.5 s (SD = 30.6), and iPad 41.1 s (SD = 25.3). The mean hepatic lesion measurements were as follows: Kinect was 7.3 cm (SD = 0.9), Loop Pointer 7.8 cm (SD = 1.1), and iPad 8.2 cm (SD = 1.2). The mean deviations from true hepatic lesion measurement were as follows: Kinect 1.0 cm and for both the Loop Pointer and iPad, 0.9 cm (SD = 0.7). The Kinect had the least and iPad had the most subjective concern for compromising the sterile field. A new intra-operative imaging review interface may be near. Most surveyed foresee these devices as useful in procedures, and most do not anticipate problems with a sterile field. An ideal device would combine iPad’s usability and accuracy with the Kinect’s touchless aspect.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3
Fig. 4
Fig. 5
Fig. 6
Fig. 7

Similar content being viewed by others

References

  1. Johnson R, O’Hara K, Sellen A, Cousins C, Criminisi A: Exploring the potential for touchless interaction in image-guided interventional radiology. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, 2011

  2. Graetzel C, Fong T, Grange S, Baur C: A non-contact mouse for surgeon-computer interaction. Technol Health Care 12(3):245–257, 2004

    Google Scholar 

  3. Kipshagen T, Graw M, Tronnier V, Bonsanto M, Hofmann UG: Touch- and marker-free interaction with medical software. In: Dössel O, Schlegel W Eds. World Congress on Medical Physics and Biomedical Engineering. Springer, Berlin Heidelberg, 2009, pp 75–78. doi:10.1007/978-3-642-03906-5_21. September 7–12, 2009, Munich, Germany, vol 25/6. IFMBE Proceedings

    Google Scholar 

  4. Soutschek S, Penne J, Hornegger J, Kornhuber J: {3D Gesture-Based Scene Navigation in Medical Imaging Applications Using Time-Of-Flight Cameras}. In: Computer Society Conference on Computer Vision O (ed) {2008 I.E. Computer Society Conference on Computer Vision and Pattern Recognition}, Anchorage, AK, 2008.

  5. Wachs J, Stern H, Edan Y, Gillam M, Feied C, Smith M, Handler J: A Real-Time Hand Gesture Interface for Medical Visualization Applications. In: Tiwari A, Roy R, Knowles J, Avineri E, Dahal K Eds. Applications of Soft Computing, vol 36. Advances in Intelligent and Soft Computing. Springer, Berlin Heidelberg, 2006, pp 153–162. doi:10.1007/978-3-540-36266-1_15

    Google Scholar 

  6. Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, Smith M: A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc 15(3):321–323, 2008

    Article  PubMed Central  PubMed  Google Scholar 

  7. Padoy NHG: Gesture based surgical manipulation of a da Vinci robot using a Kinect. The John Hopkins University, Baltimore, 2011. Accessed 5/13/2013

    Google Scholar 

  8. Ruppert GCAPH, Moares TF, Ruppert GCAPH, Moares TF, Silva JV: Gesture Interface using Kinect for Medical Imaging Visualization in Surgeries. Renato Archer Center for Information Technology, Campinas, 2011. Accessed 5/13/2013

    Google Scholar 

  9. Tan JUJ, Link K: Kinect Sensor Allows Surgeons to Manipulate 3D CT Images in Midair. Wake Forest University School of Medicine, Winston-Salem, 2011. Accessed 5/13/2013

    Google Scholar 

  10. Hartmann B, Benson M, Junger A, Quinzio L, Rohrig R, Fengler B, Farber UW, Wille B, Hempelmann G: Computer keyboard and mouse as a reservoir of pathogens in an intensive care unit. J Clin Monit Comput 18(1):7–12, 2004

    Article  PubMed  Google Scholar 

  11. Ebert LC, Hatch G, Ampanozi G, Thali MJ, Ross S: You can’t touch this: touch-free navigation through radiological images. Surg Innov 19(3):301–307, 2012

    Article  PubMed  Google Scholar 

  12. Tani BS, Maia RS, von Wangenheim A: A Gesture Interface for Radiological Workstations. In: Computer-Based Medical Systems, 2007. CBMS ’07. Twentieth IEEE International Symposium on, pp 27-32. doi:10.1109/cbms.2007.6, 2007.

  13. Murphy AD, Belcher HJA: Novel method for sterile intra-operative iPad use. J Plast Reconstr Aesthet Surg 65(3):403–404, 2012. doi:10.1016/j.bjps.2011.08.037

    Article  CAS  PubMed  Google Scholar 

  14. Soehngen E, Rahmah NN, Kakizawa Y, Horiuchi T, Fujii Y, Kiuchi T, Hongo K: Operation-microscope-mounted touch display tablet computer for intraoperative imaging visualization. World Neurosurg 77(2):381–383, 2012

    Article  PubMed  Google Scholar 

  15. Weiss DL, Siddiqui KM, Scopelliti J: Radiologist assessment of PACS user interface devices. J Am Coll Radiol 3(4):265–273, 2006

    Article  PubMed  Google Scholar 

  16. Eguchi T, Takasuna K, Kitazawa A, Fukuzawa Y, Sakaue Y, Yoshida K, Matsubara M: Three-dimensional imaging navigation during a lung segmentectomy using an iPad. Eur J Cardiothorac Surg 41(4):893–897, 2012

    Article  PubMed  Google Scholar 

  17. Volonte F, Robert JH, Ratib O, Triponez F: A lung segmentectomy performed with 3D reconstruction images available on the operating table with an iPad. Interact Cardiovasc Thorac Surg 12(6):1066–1068, 2011

    Article  PubMed  Google Scholar 

  18. Hotker AM, Pitton MB, Mildenberger P, Duber C: Speech and motion control for interventional radiology: requirements and feasibility. Int J Comput Assist Radiol Surg 13:13, 2013

    Google Scholar 

  19. Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV: Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol 30(5):687–691, 2012

    Article  PubMed  Google Scholar 

Download references

Conflict of Interest

No funding was provided for this project.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Cherng Chao.

Electronic Supplementary Material

Below is the link to the electronic supplementary material.

ESM 1

(WMV 6,857 kb)

Rights and permissions

Reprints and permissions

About this article

Cite this article

Chao, C., Tan, J., Castillo, E.M. et al. Comparative Efficacy of New Interfaces for Intra-procedural Imaging Review: the Microsoft Kinect, Hillcrest Labs Loop Pointer, and the Apple iPad. J Digit Imaging 27, 463–469 (2014). https://doi.org/10.1007/s10278-014-9687-y

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10278-014-9687-y

Keywords

Navigation