Asynchronous Telemedicine Diagnosis of Musculoskeletal Injuries through a Prototype Interface in Virtual Reality Environment

  • Soheeb Khan
  • Vassilis Charissis
  • David Harrison
  • Sophia Sakellariou
  • Warren Chan
Conference paper
Part of the Lecture Notes in Computer Science book series (LNCS, volume 8022)


Telehealth provides a much needed option for remote diagnosis and monitoring of various pathologies and patients. Remote provision of health care can offer a two fold support for the medical system and the patients. Primarily it could serve isolated locations and secondly it could monitor a large number of outpatient cases directly on their homes instead of the hospital premises. However in specific cases direct communication and visual data acquisition can be a major obstacle. To this end we have developed a prototype system that could enable the medical practitioners to have real-time diagnosis through 3D captured visual and motion data. This data are recreated in a Virtual Reality environment in the hospital facilities offering a unique system for remote diagnosis. This paper presents the design considerations and development process of the system and discusses the preliminary results from the system evaluation. The paper concludes with a tentative plan of future work which aims to offer the medical practitioners and the patient with a complete interface which can acquire gait data and thus analyse a large variety of musculoskeletal pathologies.


Virtual Reality HCI 3D Visualization Asynchronous Diagnosis Telemedicine Motion Capture 


Unable to display preview. Download preview PDF.

Unable to display preview. Download preview PDF.


  1. 1.
    Bower, P., Cartwright, M., Hirani, S., Barlow, J., Hendy, J., Knapp, M., Henderson, C., Rogers, A., Sanders, C., Bardsley, M., Steventon, A., Fitzpatrick, R., Doll, H., Newman, S.: A comprehensive evaluation of the impact of telemonitoring in patients with long-term conditions and social care needs: protocol for the whole systems demonstrator cluster randomised trial. Studies in BMC Health Services Research 11, 184 (2011)CrossRefGoogle Scholar
  2. 2.
    Blank, E., Lappan, C., Belmont, P.J., Machen, M.S., Ficke, J., Pope, R., Owens, B.D.: Early Analysis of the United States Army’s Telemedicine Orthopaedic Consultation Program. Studies in Journal of Surgical Orthopaedic Advances 20, 50–55 (2011)Google Scholar
  3. 3.
    Syst Kuo, C.H., Liu, L.: Development of a Web-Based Telemedicine System for Remote ENT Diagnoses. In: Studies in 2010 IEEE International Conference on System Science and Engineering (ICSSE), pp. 565–570 (2010)Google Scholar
  4. 4.
    Sakellariou, S., Charissis, V., Grant, S., Turner, J., Kelly, D., Christomanos, C.: Virtual Reality as Knowledge Enhancement Tool for Musculoskeletal Pathology. In: Shumaker, R. (ed.) Virtual and Mixed Reality, Part II, HCII 2011. LNCS, vol. 6774, pp. 54–63. Springer, Heidelberg (2011)CrossRefGoogle Scholar
  5. 5.
    Stone, E.E., Skubic, M.: Passive In-Home Measurement of Stride-to-Stride Gait Variability Comparing Vision and Kinect Sensing. In: IEEE EMBS, Massachusetts USA (2011)Google Scholar
  6. 6.
    Mitchell, G., Clarke, A.: Capturing and Visualising Playground Games and Performance: A Wii and Kinect based motion capture system. In: The Proceedings of the 2011 International Conference on Electronic Visualisation and the Arts (EVA 2011), pp. 218–225. British Computer Society, UK (2011)Google Scholar
  7. 7.
    Charissis, V., Ward, B.M., Naef, M., Rowley, D., Brady, L., Anderson, P.: An Enquiry into VR Interface Design for Medical Training: VR Augmented Anatomy Tutorials for Breast Cancer. In: McDowall, I.E., Dolinsky, M. (eds.) Proceedings of the: International Annual Symposium of IS&T/SPIE, The Engineering Reality of Virtual Reality, San Jose, California, vol. 6804, pp. 19–28 (2008) ISBN: 9780819469762Google Scholar
  8. 8.
    Desloover, K., Wong, P., Swings, L., Callewaert, B., Vandenneucker, H., Leardini, A.: Range of motion and repeatability of knee kinematics for 11 clinically relevant motor tasks. Studies in Gait & Posture 32, 597–602 (2010)CrossRefGoogle Scholar
  9. 9.
    Foxlin, E., Harrington, M., Pfeifer, G.: Constellation: A wide range wireless motion-tracking system for augmented Reality and Virtual set applications. In: Studies in Proceedings of Siggraph 1998 Computer Graphics Proceedings. ACM SIGGRAPH Conference Series (1998)Google Scholar
  10. 10.
    Zhou, H., Hu, H.: Human motion tracking for rehabilitation—A survey. Studies in Biomedical Signal Processing and Control, Elsevier LTD 3, 1–18 (2008); Perry, J., Burnfield, J.M.: Gait Cycle. In: Gait Analysis Normal and Pathological Function, vol. 2, pp. 3–19. Slack Incorporated (2010)Google Scholar
  11. 11.
    Noonan, D., Mountney, P., Elson, D., Darzi, Yang, G.: A Stereoscopic Fibroscope for Camera Motion and 3D Depth Recovery During Minimally Invasive Surgery. In: Proc. ICRA 2009, pp. 4463–4468 (2009)Google Scholar
  12. 12.
    Zöllner, M., Huber, S., Jetter, H., Reiterer, H.: NAVI – A Proof-of-Concept of a Mobile Navigational Aid for Visually Impaired Based on the Microsoft Kinect. Studies in University of Konstanz, Germany (2012)Google Scholar
  13. 13.
    Dutta, T.: Evaluation of the Kinect sensor for 3-D kinematic measurement in the workplace. Studies in Applied Ergonomics, 1–5 (2011), doi:10.1016Google Scholar
  14. 14.
    Stone, E.E., Skubic, M.: Passive In-Home Measurement of Stride-to-Stride Gait Variability Comparing Vision and Kinect Sensing. IEEE EMBS, Boston (2011)Google Scholar
  15. 15.
    Henry, P., et al.: RGB-D mapping: Using Kinect-style depth cameras for dense 3D modeling of indoor environments. The International Journal of Robotics Research, SAGE Journals (2012), doi:10.1177/0278364911434148Google Scholar
  16. 16.
    Izadi, S., et al.: KinectFusion: real-time 3D reconstruction and interaction using a moving depth camera. In: Proc. of 24th UIST annual ACM symposium on User Interface Software and Technology, pp. 559–568 (2011)Google Scholar

Copyright information

© Springer-Verlag Berlin Heidelberg 2013

Authors and Affiliations

  • Soheeb Khan
    • 1
  • Vassilis Charissis
    • 1
  • David Harrison
    • 1
  • Sophia Sakellariou
    • 2
  • Warren Chan
    • 1
  1. 1.School of Engineering and Built Environment, Department of Computer, Communications and Interactive SystemsGlasgow Caledonian UniversityGlasgowUK
  2. 2.Department of RadiologyRoyal InfirmaryGlasgowUK

Personalised recommendations