Avoid common mistakes on your manuscript.
Dear Editor,
I was interested to read the paper by Rostaminia and colleagues published in December 2013 [1]. The authors aimed to assess the interrater agreement/reliability of 3D endovaginal ultrasound for scoring levator ani deficiency (LAD). As the authors pointed out, all correlation coefficients at individual sites as well as overall scores were positive at >0.63 and significant at <0.0001 [1]. My question is why the authors did not use the well-known intraclass correlation coefficient (ICC), agreement type and not consistency, or weighted kappa in case of qualitative variables to assess reliability [2–5]. As the authors pointed out in their conclusion, 3D endovaginal ultrasound for assessing levator ani muscle deficiency had excellent agreement between raters. Clinically, 0.6 correlation coefficient means moderate and not excellent reliability; moreover, statistically significant results have nothing to do with the clinical importance of the findings. The authors also concluded that this level of concordance supports the validity of 3D endovaginal ultrasound technique and scoring method. It is important to mention that reliability (precision) and validity (accuracy) are two completely different methodological issues being assess by different statistical tests and should not be confused with each other [2–5]. Therefore, such misinterpretations and misconceptions should really be avoided by clinicians; otherwise, we will face patient mismanagement in our routine clinical practices [3–5].
References
Rostaminia G, Manonai J, Leclaire E, Omoumi F, Marchiorlatti M, Quiroz LH, Shobeiri SA (2013) Interrater reliability of assessing levator ani deficiency with 360° 3D endovaginal ultrasound. Int Urogynecol J. doi:10.1007/s00192-013-2286-5 (erratum: DOI 10.1007/s00192-014-2336-7)
Lawrence I, Kuei Lin A (1989) Concordance correlation coefficient to evaluate reproducibility. Biometrics 45:255–268
Jeckel JF, Katz DL, Elmore JG, Wild DMG (2007) Epidemiology, Biostatistics and Preventive Medicine, 3rd edn. SAUNDERS, Elsevier, Philadelphia
Rothman KJ, Greenland S, Lash TL (2008) Modern Epidemiology, 3rd edn. Lippincott Williams & Wilkins, Baltimore
Szklo M, Nieto FJ (2007) Epidemiology Beyond the Basics, 2nd edn. Jones and Bartlett Publisher, Manhattan
Conflicts of interest
None.
Author information
Authors and Affiliations
Corresponding author
Additional information
A reply to this comment is available at doi 10.1007/s00192-014-2351-8.
Rights and permissions
About this article
Cite this article
Sabour, S. Interrater reliability of assessing levator ani deficiency with 360° 3D endovaginal ultrasound: mistake and misinterpretation in reliability analysis. Int Urogynecol J 25, 707 (2014). https://doi.org/10.1007/s00192-014-2350-9
Published:
Issue Date:
DOI: https://doi.org/10.1007/s00192-014-2350-9