Journal of Digital Imaging

, Volume 30, Issue 5, pp 547–554 | Cite as

Online Studies on Variation in Orthopedic Surgery: Computed Tomography in MPEG4 Versus DICOM Format

  • Jos J. Mellema
  • Wouter H. Mallee
  • Thierry G. Guitton
  • C. Niek van Dijk
  • David Ring
  • Job N. Doornberg
  • Science of Variation Group & Traumaplatform Study Collaborative
Article
First Online:
  • 405 Downloads

Abstract

The purpose of this study was to compare the observer participation and satisfaction as well as interobserver reliability between two online platforms, Science of Variation Group (SOVG) and Traumaplatform Study Collaborative, for the evaluation of complex tibial plateau fractures using computed tomography in MPEG4 and DICOM format. A total of 143 observers started with the online evaluation of 15 complex tibial plateau fractures via either the SOVG or Traumaplatform Study Collaborative websites using MPEG4 videos or a DICOM viewer, respectively. Observers were asked to indicate the absence or presence of four tibial plateau fracture characteristics and to rate their satisfaction with the evaluation as provided by the respective online platforms. The observer participation rate was significantly higher in the SOVG (MPEG4 video) group compared to that in the Traumaplatform Study Collaborative (DICOM viewer) group (75 and 43%, respectively; P < 0.001). The median observer satisfaction with the online evaluation was seven (range, 0–10) using MPEG4 video compared to six (range, 1–9) using DICOM viewer (P = 0.11). The interobserver reliability for recognition of fracture characteristics in complex tibial plateau fractures was higher for the evaluation using MPEG4 video. In conclusion, observer participation and interobserver reliability for the characterization of tibial plateau fractures was greater with MPEG4 videos than with a standard DICOM viewer, while there was no difference in observer satisfaction. Future reliability studies should account for the method of delivering images.

Keywords

Variation Orthopedic surgery Tibial plateau fractures Computed tomography MPEG DICOM 
This is a preview of subscription content, log in to check access.

Notes

Acknowledgement

The authors acknowledge the Science of Variation Group and Traumaplatform Study Collaborative:

Babis, G.C.; Jeray, K.J.; Prayson, M.J.; Pesantez, R.; Acacio, R.; Verbeek, D.O.; Melvanki, P.; Kreis, B.E.; Mehta, S.; Meylaerts, S.; Wojtek, S.; Yeap, E.J.; Haapasalo, H.; Kristan, A.; Coles, C.; Marsh, J.L.; Mormino, M.; Menon, M.; Tyllianakis, M.; Schandelmaier, P.; Jenkinson, R.J.; Neuhaus, V.; Shahriar, C.M.H.; Belangero, W.D.; Kannan, S.G.; Leonidovich, G.M.; Davenport, J.H.; Kabir, K.; Althausen, P.L.; Weil, Y.; Toom, A.; Sa da Costa, D.; Lijoi, F.; Koukoulias, N.E.; Manidakis, N.; Van den Bogaert, M.; Patczai, B.; Grauls, A.; Kurup, H.; van den Bekerom, M.P.; Lansdaal, J.R.; Vale, M.; Ousema, P.; Barquet, A.; Cross, B.J.; Broekhuyse, H.; Haverkamp, D.; Merchant, M.; Harvey, E.; Stojkovska Pemovska, E.; Frihagen, F.; Seibert, F.J.; Garnavos, C.; van der Heide, H.; Villamizar, H.A.; Harris, I.; Borris, L.C.; Brink, O.; Brink, P.R.G.; Choudhari, P.; Swiontkowski, M.; Mittlmeier, T.; Tosounidis, T.; van Rensen, I.; Martinelli, N.; Park, D.H.; Lasanianos, N.; Vide, J.; Engvall, A.; Zura, R.D.; Jubel, A.; Kawaguchi, A; Goost, H.; Bishop, J.; Mica, L.; Pirpiris, M.; van Helden, S.H.; Bouaicha, S.; Schepers, T.; Havliček, T.; and Giordano, V.

Compliance with Ethical Standards

Conflict of Interest

Each author certifies that he or she has no commercial associations (e.g., consultancies, stock ownership, equity interest, patent/licensing arrangements) that might pose a conflict of interest in connection with the submitted article.

Ethical Review Committee

The Institutional Review Board of our institution approved this study under protocol #2009P001019/MGH.

The Location Where the Work Was Performed

The work was performed at the Hand and Upper Extremity Service, Department of Orthopedic Surgery, Massachusetts General Hospital, Harvard Medical School, Boston, Massachusetts, USA and Department of Orthopedic Surgery, Academic Medical Center, University of Amsterdam, Amsterdam, The Netherlands.

References

  1. 1.
    Bruinsma WE, Guitton T, Ring D: Radiographic loss of contact between radial head fracture fragments is moderately reliable. Clinical orthopaedics and related research, 2014Google Scholar
  2. 2.
    Bruinsma WE, Guitton TG, Warner JJ, Ring D: Interobserver reliability of classification and characterization of proximal humeral fractures: a comparison of two and three-dimensional CT. The Journal of bone and joint surgery American volume 95:1600–1604, 2013CrossRefPubMedGoogle Scholar
  3. 3.
    Buijze GA, Guitton TG, van Dijk CN, Ring D: Training improves interobserver reliability for the diagnosis of scaphoid fracture displacement. Clinical orthopaedics and related research 470:2029–2034, 2012CrossRefPubMedPubMedCentralGoogle Scholar
  4. 4.
    Buijze GA, Wijffels MM, Guitton TG, Grewal R, van Dijk CN, Ring D: Interobserver reliability of computed tomography to diagnose scaphoid waist fracture union. The Journal of hand surgery 37:250–254, 2012CrossRefPubMedGoogle Scholar
  5. 5.
    Doornberg JN, Guitton TG, Ring D: Diagnosis of elbow fracture patterns on radiographs: interobserver reliability and diagnostic accuracy. Clinical orthopaedics and related research 471:1373–1378, 2013CrossRefPubMedGoogle Scholar
  6. 6.
    Gradl G, Neuhaus V, Fuchsberger T, Guitton TG, Prommersberger KJ, Ring D: Radiographic diagnosis of scapholunate dissociation among intra-articular fractures of the distal radius: interobserver reliability. The Journal of hand surgery, 2013Google Scholar
  7. 7.
    Tosti R, Ilyas AM, Mellema JJ, Guitton TG, Ring D: Interobserver variability in the treatment of little finger metacarpal neck fractures. The Journal of hand surgery 39:1722–1727, 2014CrossRefPubMedGoogle Scholar
  8. 8.
    Wijffels MM, Guitton TG, Ring D: Inter-observer variation in the diagnosis of coronal articular fracture lines in the lunate facet of the distal radius. Hand (New York, NY) 7:271–275, 2012CrossRefGoogle Scholar
  9. 9.
    Neuhaus V, et al.: Scapula fractures: interobserver reliability of classification and treatment. Journal of orthopaedic trauma 28:124–129, 2014CrossRefPubMedGoogle Scholar
  10. 10.
    van Kollenburg JA, Vrahas MS, Smith RM, Guitton TG, Ring D: Diagnosis of union of distal tibia fractures: accuracy and interobserver reliability. Injury 44:1073–1075, 2013CrossRefPubMedGoogle Scholar
  11. 11.
    Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Tibial plateau fracture characteristics: reliability and diagnostic accuracy. Journal of orthopaedic trauma 30:e144–151, 2016CrossRefPubMedGoogle Scholar
  12. 12.
    Mallee WH, Mellema JJ, Guitton TG, Goslings JC, Ring D, Doornberg JN: 6-week radiographs unsuitable for diagnosis of suspected scaphoid fractures. Archives of orthopaedic and trauma surgery 136:771–778, 2016CrossRefPubMedPubMedCentralGoogle Scholar
  13. 13.
    Mellema JJ, Doornberg JN, Molenaars RJ, Ring D, Kloen P: Interobserver reliability of the Schatzker and Luo classification systems for tibial plateau fractures. Injury 47:944–949, 2016CrossRefPubMedGoogle Scholar
  14. 14.
    Walter SD, Eliasziw M, Donner A: Sample size and optimal designs for reliability studies. Statistics in medicine 17:101–110, 1998CrossRefPubMedGoogle Scholar
  15. 15.
    Brorson S, Bagger J, Sylvest A, Hrobjartsson A: Improved interobserver variation after training of doctors in the Neer system. A randomised trial. The Journal of bone and joint surgery British volume 84:950–954, 2002CrossRefPubMedGoogle Scholar
  16. 16.
    Brunner A, Heeren N, Albrecht F, Hahn M, Ulmar B, Babst R: Effect of three-dimensional computed tomography reconstructions on reliability. Foot & ankle international 33:727–733, 2012CrossRefGoogle Scholar
  17. 17.
    Bishop JY, Jones GL, Rerko MA, Donaldson C: 3-D CT is the most reliable imaging modality when quantifying glenoid bone loss. Clinical orthopaedics and related research 471:1251–1256, 2013CrossRefPubMedGoogle Scholar
  18. 18.
    Doornberg J, Lindenhovius A, Kloen P, van Dijk CN, Zurakowski D, Ring D: Two and three-dimensional computed tomography for the classification and management of distal humeral fractures. Evaluation of reliability and diagnostic accuracy. The Journal of bone and joint surgery American volume 88:1795–1801, 2006PubMedGoogle Scholar
  19. 19.
    Lindenhovius A, Karanicolas PJ, Bhandari M, van Dijk N, Ring D: Interobserver reliability of coronoid fracture classification: two-dimensional versus three-dimensional computed tomography. The Journal of hand surgery 34:1640–1646, 2009CrossRefPubMedGoogle Scholar
  20. 20.
    Guitton TG, Ring D: Interobserver reliability of radial head fracture classification: two-dimensional compared with three-dimensional CT. The Journal of bone and joint surgery American volume 93:2015–2021, 2011CrossRefPubMedGoogle Scholar
  21. 21.
    Siegel S, Castellan JN: Nonparametric statistics for the behavioral sciences, New York: McGraw-Hill, 1988Google Scholar
  22. 22.
    Landis JR, Koch GG: An application of hierarchical kappa-type statistics in the assessment of majority agreement among multiple observers. Biometrics 33:363–374, 1977CrossRefPubMedGoogle Scholar
  23. 23.
    Berkes MB, et al.: The impact of three-dimensional CT imaging on intraobserver and interobserver reliability of proximal humeral fracture classifications and treatment recommendations. The Journal of bone and joint surgery American volume 96:1281–1286, 2014CrossRefPubMedGoogle Scholar
  24. 24.
    Laoutliev B, Havsteen I, Bech BH, Narvestad E, Christensen H, Christensen A: Interobserver agreement in fusion status assessment after instrumental desis of the lower lumbar spine using 64-slice multidetector computed tomography: impact of observer experience. European spine journal : official publication of the European Spine Society, the European Spinal Deformity Society, and the European Section of the Cervical Spine Research Society 21:2085–2090, 2012CrossRefGoogle Scholar

Copyright information

© Society for Imaging Informatics in Medicine 2017

Authors and Affiliations

  • Jos J. Mellema
    • 1
  • Wouter H. Mallee
    • 2
  • Thierry G. Guitton
    • 2
  • C. Niek van Dijk
    • 2
  • David Ring
    • 3
  • Job N. Doornberg
    • 2
  • Science of Variation Group & Traumaplatform Study Collaborative
  1. 1.Hand and Upper Extremity Service, Department of Orthopedic Surgery, Massachusetts General HospitalHarvard Medical SchoolBostonUSA
  2. 2.Department of Orthopedic Surgery, Academic Medical CenterUniversity of AmsterdamAmsterdamThe Netherlands
  3. 3.Department of Surgery and Perioperative Care, Dell Medical SchoolThe University of Texas at AustinAustinUSA

Personalised recommendations