Abstract
We adapted and evaluated the Microsoft Kinect (touchless interface), Hillcrest Labs Loop Pointer (gyroscopic mouse), and the Apple iPad (multi-touch tablet) for intra-procedural imaging review efficacy in a simulation using MIM Software DICOM viewers. Using each device, 29 radiologists executed five basic interactions to complete the overall task of measuring an 8.1-cm hepatic lesion: scroll, window, zoom, pan, and measure. For each interaction, participants assessed the devices on a 3-point subjective scale (3 = highest usability score). The five individual scores were summed to calculate a subjective composite usability score (max 15 points). Overall task time to completion was recorded. Each user also assessed each device for its potential to jeopardize a sterile field. The composite usability scores were as follows: Kinect 9.9 (out of 15.0; SD = 2.8), Loop Pointer 12.9 (SD = 13.5), and iPad 13.5 (SD = 1.8). Mean task completion times were as follows: Kinect 156.7 s (SD = 86.5), Loop Pointer 51.5 s (SD = 30.6), and iPad 41.1 s (SD = 25.3). The mean hepatic lesion measurements were as follows: Kinect was 7.3 cm (SD = 0.9), Loop Pointer 7.8 cm (SD = 1.1), and iPad 8.2 cm (SD = 1.2). The mean deviations from true hepatic lesion measurement were as follows: Kinect 1.0 cm and for both the Loop Pointer and iPad, 0.9 cm (SD = 0.7). The Kinect had the least and iPad had the most subjective concern for compromising the sterile field. A new intra-operative imaging review interface may be near. Most surveyed foresee these devices as useful in procedures, and most do not anticipate problems with a sterile field. An ideal device would combine iPad’s usability and accuracy with the Kinect’s touchless aspect.
Similar content being viewed by others
References
Johnson R, O’Hara K, Sellen A, Cousins C, Criminisi A: Exploring the potential for touchless interaction in image-guided interventional radiology. Paper presented at the Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Vancouver, 2011
Graetzel C, Fong T, Grange S, Baur C: A non-contact mouse for surgeon-computer interaction. Technol Health Care 12(3):245–257, 2004
Kipshagen T, Graw M, Tronnier V, Bonsanto M, Hofmann UG: Touch- and marker-free interaction with medical software. In: Dössel O, Schlegel W Eds. World Congress on Medical Physics and Biomedical Engineering. Springer, Berlin Heidelberg, 2009, pp 75–78. doi:10.1007/978-3-642-03906-5_21. September 7–12, 2009, Munich, Germany, vol 25/6. IFMBE Proceedings
Soutschek S, Penne J, Hornegger J, Kornhuber J: {3D Gesture-Based Scene Navigation in Medical Imaging Applications Using Time-Of-Flight Cameras}. In: Computer Society Conference on Computer Vision O (ed) {2008 I.E. Computer Society Conference on Computer Vision and Pattern Recognition}, Anchorage, AK, 2008.
Wachs J, Stern H, Edan Y, Gillam M, Feied C, Smith M, Handler J: A Real-Time Hand Gesture Interface for Medical Visualization Applications. In: Tiwari A, Roy R, Knowles J, Avineri E, Dahal K Eds. Applications of Soft Computing, vol 36. Advances in Intelligent and Soft Computing. Springer, Berlin Heidelberg, 2006, pp 153–162. doi:10.1007/978-3-540-36266-1_15
Wachs JP, Stern HI, Edan Y, Gillam M, Handler J, Feied C, Smith M: A gesture-based tool for sterile browsing of radiology images. J Am Med Inform Assoc 15(3):321–323, 2008
Padoy NHG: Gesture based surgical manipulation of a da Vinci robot using a Kinect. The John Hopkins University, Baltimore, 2011. Accessed 5/13/2013
Ruppert GCAPH, Moares TF, Ruppert GCAPH, Moares TF, Silva JV: Gesture Interface using Kinect for Medical Imaging Visualization in Surgeries. Renato Archer Center for Information Technology, Campinas, 2011. Accessed 5/13/2013
Tan JUJ, Link K: Kinect Sensor Allows Surgeons to Manipulate 3D CT Images in Midair. Wake Forest University School of Medicine, Winston-Salem, 2011. Accessed 5/13/2013
Hartmann B, Benson M, Junger A, Quinzio L, Rohrig R, Fengler B, Farber UW, Wille B, Hempelmann G: Computer keyboard and mouse as a reservoir of pathogens in an intensive care unit. J Clin Monit Comput 18(1):7–12, 2004
Ebert LC, Hatch G, Ampanozi G, Thali MJ, Ross S: You can’t touch this: touch-free navigation through radiological images. Surg Innov 19(3):301–307, 2012
Tani BS, Maia RS, von Wangenheim A: A Gesture Interface for Radiological Workstations. In: Computer-Based Medical Systems, 2007. CBMS ’07. Twentieth IEEE International Symposium on, pp 27-32. doi:10.1109/cbms.2007.6, 2007.
Murphy AD, Belcher HJA: Novel method for sterile intra-operative iPad use. J Plast Reconstr Aesthet Surg 65(3):403–404, 2012. doi:10.1016/j.bjps.2011.08.037
Soehngen E, Rahmah NN, Kakizawa Y, Horiuchi T, Fujii Y, Kiuchi T, Hongo K: Operation-microscope-mounted touch display tablet computer for intraoperative imaging visualization. World Neurosurg 77(2):381–383, 2012
Weiss DL, Siddiqui KM, Scopelliti J: Radiologist assessment of PACS user interface devices. J Am Coll Radiol 3(4):265–273, 2006
Eguchi T, Takasuna K, Kitazawa A, Fukuzawa Y, Sakaue Y, Yoshida K, Matsubara M: Three-dimensional imaging navigation during a lung segmentectomy using an iPad. Eur J Cardiothorac Surg 41(4):893–897, 2012
Volonte F, Robert JH, Ratib O, Triponez F: A lung segmentectomy performed with 3D reconstruction images available on the operating table with an iPad. Interact Cardiovasc Thorac Surg 12(6):1066–1068, 2011
Hotker AM, Pitton MB, Mildenberger P, Duber C: Speech and motion control for interventional radiology: requirements and feasibility. Int J Comput Assist Radiol Surg 13:13, 2013
Ruppert GC, Reis LO, Amorim PH, de Moraes TF, da Silva JV: Touchless gesture user interface for interactive image visualization in urological surgery. World J Urol 30(5):687–691, 2012
Conflict of Interest
No funding was provided for this project.
Author information
Authors and Affiliations
Corresponding author
Electronic Supplementary Material
Below is the link to the electronic supplementary material.
ESM 1
(WMV 6,857 kb)
Rights and permissions
About this article
Cite this article
Chao, C., Tan, J., Castillo, E.M. et al. Comparative Efficacy of New Interfaces for Intra-procedural Imaging Review: the Microsoft Kinect, Hillcrest Labs Loop Pointer, and the Apple iPad. J Digit Imaging 27, 463–469 (2014). https://doi.org/10.1007/s10278-014-9687-y
Published:
Issue Date:
DOI: https://doi.org/10.1007/s10278-014-9687-y