Skip to main content

Advertisement

SpringerLink
Log in

Analysis of the inter- and intra-observer agreement in radiographic evaluation of wrist fractures using the multimedia messaging service

  • Original Article
  • Published:
HAND

Abstract

Background

Orthopaedic surgeons are often asked to evaluate X-rays of patients admitted to the Accident and Emergency Department with the suspicion of a wrist fracture or, in the case of an evident fracture, to decide the correct treatment. The aim of this study was to evaluate the feasibility of a correct interpretation of the images of injured wrists on the screen of a last generation mobile phone, in order to evaluate if the specialist could make the right diagnosis and choose the correct treatment.

Methods

Five orthopaedic and one hand surgeons have evaluate the X-rays of 67 patients who sustained an injury to their wrist. In the case of fracture, they were asked to classify it according to the AO and Mayo classification systems. The evaluation of the images was accomplished through the PACS and using a mobile phone, at a different time. In order to check the inter- and intra-observer reliability, the same pattern was followed after a few months.

Results

The mobile phone showed basically the same agreement between the observers highlighting the worsening of the inter- and intra-observer reliability with the increment of the variables considered by a classification system.

Conclusions

The present paper confirms that a last generation mobile phone can already be used in the clinical practise of orthopaedic surgeons on call who could use it as a useful device in remote or poorly served areas for a rapid and economic consultation

Level of Evidence

The level of evidence of this case is economic and decision analysis, level 2

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  1. Abboud JA, Bozentka DJ, Beredjiklian PK. Telemedicine consultation for patients with upper extremity disorders is reliable. Clin Orthop Relat Res. 2005;435:250–7.

    Article  PubMed  Google Scholar 

  2. Andersen DJ, Blair WF, Steyers Jr CM, Adams B, El-Khouri GY, Brandser E. Classification of distal radius fractures: an analysis of interobserver reliability and intraobserver reproducibility. J Hand Surg. 1996;21-A(4):574–82.

    Google Scholar 

  3. Archbold HA, Guha AR, Shyamsundar S, McBride SJ, Charlwood P, Wray R. The use of multi-media messaging in the referral of musculoskeletal limb injuries to a tertiary trauma unit using: a 1-month evaluation. Injury. 2005;36(4):560–6.

    Article  PubMed  CAS  Google Scholar 

  4. Baruffaldi F, Gualdrini G, Toni A. Comparison of asynchronous and realtime teleconsulting for orthopaedic second opinion. J Telemed Telecare. 2002;8:297–301.

    Article  PubMed  CAS  Google Scholar 

  5. Bashshur R (1980) Technology serves the people: The story of a cooperative telemedicine project by NASA, the Indian Health Service and the Papago people. Superintendent of Documents, US Government Printing Office, Washington, D.C.

  6. Bashshur RL, Armstrong PA, Youssef ZI. Telemedicine: exploration in the use of telecommunications in health care. Springfield: Charles C. Thomas; 1975.

    Google Scholar 

  7. Bashshur R, Lovett J. Assessment of telemedicine: results of the initial experience. Aviat Space Environ Med. 1977;48(1):65–70.

    PubMed  CAS  Google Scholar 

  8. Bowns IR, Collins K, Walters SJ, McDonagh AJ. Telemedicine in dermatology: a randomised controlled trial. Health Technol Assess. 2006;10(43):1–39. iii-iv, ix-xi.

    Google Scholar 

  9. Chandhanayingyong C, Tangtrakulwanich B, Kiriratnikom T. Teleconsultation for emergency orthopaedic patients using the multimedia messaging service via mobile phones. J Telemed Telecare. 2007;13(4):193–6.

    Article  PubMed  Google Scholar 

  10. Cohen J. A coefficient of agreement for nominal scales. Educ Psychol Meas. 1960;20(1):37–46.

    Article  Google Scholar 

  11. Cole JR, Memphis TN, Bindra Randip R, Evanoff BA, Gilula LA, Yamaguchi K, et al. Radiographic evaluation of osseous displacement following intra-articular fractures of the distal radius: reliability of plain radiography versus computed tomography. The J Hand Surg. 1997;22(5):792–800.

    Article  CAS  Google Scholar 

  12. Cooney WP. Fractures of the distal radius: a modern treatment based classification. Orthop Clin N Am. 1993;24:211–6.

    CAS  Google Scholar 

  13. Fleiss JL. Measuring nominal scale agreement among many raters. Psychol Bull. 1971;76(5):378–82.

    Article  Google Scholar 

  14. Fleiss JL, Cohen J. The equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas. 1973;33:613–9.

    Article  Google Scholar 

  15. Flinkkila T, Nikkola-Sitto A, Kaarela O, Paakko E, Raatikainen T. Poor interobserver reliability of AO classification of fractures of the distal radius. Additional computed tomography is of minor value. J Bone Joint Surg (Br). 1998;4:670–2.

    Article  Google Scholar 

  16. Foote DR. Satellite communication for rural health care in Alaska. J Commun. 1977;27(4):173–82.

    Article  PubMed  CAS  Google Scholar 

  17. Hartvigsen G, Johansen MA, Hasvold P, Bellika JG, Arsand E, Arild E, et al. Challenges in telemedicine and eHealth: lessons learned from 20 years with telemedicine in Tromsø. Stud Health Technol Inf. 2007;129(Pt 1):82–6.

    Google Scholar 

  18. Hoffmann T, Russell T. Pre-admission orthopaedic occupational therapy home visits conducted using the Internet. J Telemed Telecare. 2008;14(2):83–7.

    Article  PubMed  Google Scholar 

  19. Hsieh CH, Jeng SF, Chen CY, Yin JW, Yang JC, Tsai HH, et al. Teleconsultation with the mobile camera–phone in remote evaluation of replantation potential. J Trauma. 2005;58(6):1208–12.

    Article  PubMed  Google Scholar 

  20. Hsieh CH, Tsai HH, Yin JW, Chen CY, Yang JC, Jeng SF. Teleconsultation with the mobile camera–phone in digital soft-tissue injury: a feasibility study. Plast Reconstr Surg. 2004;114(7):1776–82.

    Article  PubMed  Google Scholar 

  21. Jin WJ, Jiang LS, Shen L, Lu H, Cui YM, Zhou Q, et al. The interobserver reliability of the Cooney classification of distal radius fractures between experienced orthopaedic surgeons. J Hand Surg. 2007;32E(5):509–11.

    Google Scholar 

  22. Katz HP, Kaltsounis D, Halloran L, Mondor M. Patient safety and telephone medicine: some lessons from closed claim case review. J Gen Intern Med. 2008;23(5):517–22.

    Article  PubMed  Google Scholar 

  23. Kim DK, Yoo SK, Kim SH. Instant wireless transmission of radiological images using a personal digital assistant phone for emergency teleconsultation. J Telemed Telecare. 2005;11 Suppl 2:S58–61.

    Article  PubMed  Google Scholar 

  24. Kreder HJ, Hanel DP, McKee M, Jupiter J, McGillivary G, Swiontkowski MF. Consistency of AO fracture classification for the distal radius. J Bone Joint Surg [Br]. 1996;78-B:726–31.

    Google Scholar 

  25. Labiris G, Papadopoulis G, Lentaris G, Kafentzis M, Drakakis A. Internet based counseling to remote orthopedic patients. Acta Orthop Scand. 2004;75:366–7.

    Article  PubMed  CAS  Google Scholar 

  26. Lam TK, Preketes A, Gates R. Mobile phone photo messaging assisted communication in the assessment of hand trauma. ANZ J Surg. 2004;74:598–602.

    Article  PubMed  Google Scholar 

  27. Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–74.

    Article  PubMed  CAS  Google Scholar 

  28. Mann T, Colven R. A picture is worth more than a thousand words: enhancement of a pre-exam telephone consultation in dermatology with digital images. Acad Med. 2002;77(7):742–3.

    Article  PubMed  Google Scholar 

  29. Mendes de Oliveira Filho O, Dias Belangero W, Mendes Teles JB. Fraturas do radio distal: avaliacao das classificacoes. Rev Assoc Med Bras. 2004;50(1):55–61.

    Article  Google Scholar 

  30. Moumoulidis I, Mani N, Patel H, Leong P. A novel use of photo messaging in the assessment of nasal fractures. J Telemed Telecare. 2007;13(8):387–90.

    Article  PubMed  Google Scholar 

  31. Muller ME, Nazarian S, Koch P. Classification AO des Factures. Paris: Springer; 1987.

    Book  Google Scholar 

  32. Murphy RL, Bird KT. Telediagnosis: a new community health resource: observations on the feasibility of telediagnosis based on 1000 patient transcactions. Am J Public Health. 1974;64(2):113–9.

    Article  PubMed  Google Scholar 

  33. Naqvi SGA, Reynolds T, Kitsis C. Interobserver reliability and intraobserver reproducibility for distal radius fractures. J Hand Surg. 2009;00-E(4):1–3.

    Google Scholar 

  34. Ng WH, Wang E, Ng I. Multimedia Messaging Service teleradiology in the provision of emergency neurosurgery services. Surg Neurol. 2007;67(4):338–41.

    Article  PubMed  Google Scholar 

  35. Oskam J, Kingma J, Klasen HJ. Interrater reliability for the basic categories of the AO/ASIF’S system as a frame of reference for classifying distal radial fractures. Percept Motor Skills. 2001;92:589–94.

    Article  PubMed  CAS  Google Scholar 

  36. Ploegmakers JJW, Mader K, Pennig D, Verheyen CCPM. Four distal radial fracture classification systems tested amongst a large panel of Dutch trauma surgeons. Injury. 2007;38:1268–72.

    Article  PubMed  Google Scholar 

  37. Raikin SM, Bley LA, Leb RB. Emerging technology: remote analysis of traumatic musculoskeletal radiographs transmitted by electronic mail. J Orthop Trauma. 1999;13(7):516–9.

    Article  PubMed  CAS  Google Scholar 

  38. Ricci WM, Borrelli J. Teleradiology in orthopaedic surgery: impact on clinical decision making for acute fracture management. J Orthop Trauma. 2002;16(1):1–6.

    Article  PubMed  Google Scholar 

  39. Tangtrakulwanich B, Kwunpiroj W, Chongsuvivatwong V, Geater AF, Kiatsiriroj N. Teleconsultation with digital camera images is useful for fracture care. Clin Orthop Relat Res. 2006;449:308–12.

    PubMed  Google Scholar 

  40. Tsai HH, Pong YP, Liang CC, Lin PY, Hsieh CH. Teleconsultation by using the mobile camera phone for remote management of the extremity wound: a pilot study. Ann Plast Surg. 2004;53(6):584–7.

    Article  PubMed  Google Scholar 

  41. Vladzymyrskyy AV. Our experience with telemedicine in traumatology and orthopedics. Ulus Travma Acil Cerrahi Derg. 2004;10(3):189–91.

    PubMed  Google Scholar 

  42. Vuolio S, Winblad I, Ohinmaa A, Haukipuro K. Videoconferencing for orthopaedic outpatient. One year follow-up. J Telemed Telecare. 2003;9:8–11.

    Article  PubMed  Google Scholar 

  43. Yamada M, Watarai H, Andou T, Sakal N. Emergency image transfer system through a mobile telephone in Japan: technical note. Neurosurgery. 2003;52:986–90.

    Article  PubMed  Google Scholar 

Download references

Author information

Authors and Affiliations

  1. Department of Traumatology and Orthopaedics, James Paget University Hospital, Gorleston on Sea, UK

    Andrea Ferrero

  2. Department of Traumatology and Orthopaedics, ORBV, Bellinzona, Switzerland

    Guido Garavaglia, Roland Gehri, Ferruccio Maenza & Gianfranco John Petri

  3. Department of Traumatology and Orthopaedics, Hand Surgery Unit, Bellinzona, Switzerland

    Cesare Fusetti

Authors
  1. Andrea Ferrero
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Guido Garavaglia
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Roland Gehri
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Ferruccio Maenza
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Gianfranco John Petri
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Cesare Fusetti
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Andrea Ferrero.

About this article

Cite this article

Ferrero, A., Garavaglia, G., Gehri, R. et al. Analysis of the inter- and intra-observer agreement in radiographic evaluation of wrist fractures using the multimedia messaging service. HAND 6, 384–389 (2011). https://doi.org/10.1007/s11552-011-9362-4

Download citation

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11552-011-9362-4

Keywords

Search

Navigation