Abstract
Purpose
The purpose of the study was to examine the reliability and validity of a single lateral condyle-capsule distance (LCCD) measurement while saving on economic costs and clinical resources.
Methods
A longitudinal test–retest design was used to assess the reliability and validity of single-examiner measures over 72 TMJ sonographic analyses. Intraclass correlation coefficients (ICC) and a Bland–Altman plot were used to study reliability and validity, comparing the first measurement of the LCCD to the mean of 3 measurements taken one week later by the same examiner.
Results
ICC show intraobserver reliability of 0.981, 95% confidence intervals (CI) of 0.969 to 0.988. The mean difference between the ultrasound measurements is 0.019 mm (95% CI 0.0005–0.0383) with a standard deviation of 0.080 mm, demonstrating robust validity. The 95% Limits of Agreement (LoA) are − 0.138 for the lower limit and 0.177 for the upper. Mean relative error is 0.009 mm.
Conclusion
Intraobserver reliability of a trained examiner is very high in the single measurement of the LCCD and validity is significant compared to more complex methods. The risk of bias is low since the mean of three LCCD measurements is calculated as opposed to recording only one single measurement.
Similar content being viewed by others
Avoid common mistakes on your manuscript.
Introduction
Temporomandibular disorders (TMD) are defined as a group of painful conditions affecting the bony structure and soft tissue of the orofacial region. The most common signs and symptoms include separate muscle or joint pain (or a combination of both), limitations to jaw opening, temporomandibular joint noises (e.g., clicking, crepitus, grating, popping), and headache [1,2,3].
TMD is a serious public health problem affecting 5–12% of the population. It is the second most common musculoskeletal condition after chronic low back pain with a high economic impact—up to $4 billion in the USA [4]. Cross-sectional studies show that women are 1.5–2 times more likely to suffer from TMD than men. The symptoms of TMD in women are presented as more frequent and more severe than those of men [5].
TMD includes intra-articular (e.g., congenital, or developmental disorders, disc derangement disorders, degenerative joint disorders, infection, neoplasia, hypomobility, hypermobility, and trauma) and extra-articular disorders (myalgia, local myalgia, myofascial pain syndromes, myositis, and myospasm) caused by multiple biologic, environmental, social, and psychological factors [2, 6].
The diagnosis of TMD is based on both clinical and physical examination supported by specialized radiological imaging [4, 7, 8]. Currently, magnetic resonance imaging (MRI) is considered the gold standard for the evaluation of the temporomandibular joint and its adjacent structures. This diagnostic method provides detailed information about the position and morphology of the articular disc, the mandibular bone structure, the adjacent soft tissues, as well as possible joint effusions [9,10,11,12]. It also allows for dynamic assessment of the translational movement of the mandible. There are, however, limitations to this method, such as low availability and accessibility. The imaging process takes a long time, is costly and may cause discomfort to the patient [12, 13].
In the last twenty years, ultrasonography (US) has been used as a new method for diagnosing TMD. It has the advantage of being non-invasive and less expensive than any other previously used technique. However, some authors found it difficult to observe the articular disc in their examinations and tried to describe indirect echographic signs to determine the disc position. Certain researchers described the distance between the most lateral point of the mandibular condyle and the most lateral point of the articular capsule: the lateral condyle-capsule distance (LCCD) as a possible objective estimation of the disc position [14,15,16]. Hayashi et al. [16] determined the LCCD in 18 Japanese children and compared their results against magnetic resonance imaging (MR) and helical computerized tomography scans (CT), showing a sensitivity of 83%, a specificity of 96%, and an accuracy of 92% for identifying disc displacement when the LCCD was ≥ 4 mm. This measurement was recommended when assessing lateral disc displacement as it shows good intra-observer reliability (ICC = 0.83) measured in the longitudinal axis and in a closed-mouth position [15]. Recent research supports the use of LCCD on the transverse plane and in a closed-mouth position, as it shows an area below the receiver operating characteristic curve of 0.671 (p-value = 0.028) and an accuracy of 71.4 using MR imaging as gold-standard [14].
In the studies mentioned above, the researchers took three measurements to improve the statistical power of their ultrasonographic measurements. However, in the daily clinical setting, i.e., outside this field of research, this procedure is a waste of time and resources in the diagnosis of TMD. Because clinical resources are limited, it is advisable to ensure the optimization of effort, energy, and economic cost. The main purpose of the study was to prove the reliability and validity of a single LCCD measurement instead of a 3-measurement approach to optimize time, economic cost, and effort in a clinical setting. The STARD guidelines for diagnostic accuracy studies have been followed [17].
Material and methods
Study design
Following the solution \(n= \frac{2{({Z}_{\alpha }+ {Z}_{\beta })}^{2}*{S}^{2}}{{d}^{2}}\); where \({Z}_{\alpha }\) = Z risk α-value, \({Z}_{\beta }\) = Z risk β-value, \({S}^{2}\) is the variance of the differences, and \(d\) = minimum value to be detected, we assume a 95% confidence level, power of 90%, an accuracy of 0.5 mm in the measurement, and a standard deviation of 0.45 mm [15], resulting in a sample size equal to 17 temporomandibular joints (TMJ), n = 20 adjusting for a 15% loss. A non-probability sampling method was used since the recruitment of volunteers took place at the Faculty of Health Sciences over a three-month period. The number of volunteers exceeded the required sample size. The study design was based on a test–retest analysis, where the first measurement of the LCCD was compared to the mean of three measurements taken later by the same examiner.
Participants
Thirty-six adult participants, 12 men and 24 women aged between 19 and 54 years old, students and employees from the Camilo José Cela University (Madrid, Spain), were recruited. Participants were excluded if they presented neurological diseases; rheumatic diseases (rheumatoid arthritis, ankylosing spondylitis, etc.). They were also excluded if they had received physiotherapy treatment 15 days before their participation; prescribed pharmacological treatment with either analgesic, non-steroidal anti-inflammatory drugs, muscle relaxants (or any combinations of the above), for 48–72 h prior to the start of the study. Those participants that reported orofacial pain unrelated to TMD or any other underlying medical condition such as fracture, tumor, or trauma were also excluded.
The study was approved by the Institutional Ethics Committee of Camilo José Cela University (code number 09-22-UEMDTT) in accordance with the guidelines for the Helsinki Declaration. All sample subjects read and signed the written informed consent before participating in the study.
Test methods
One examiner evaluated 72 TMJ of 36 Caucasian subjects who met the inclusion criteria. TMJ were assessed in a sitting position, in a closed mouth position and a neutral head and neck position. The examiner positioned the probe on an axial plane, running parallel to the Camper line (the line intersecting the ala of the nose and de tragus of the ear), perpendicular to the zygomatic arch, and parallel to the mandible ramus (Fig. 1). The probe was tilted to get the best view of the mandibular condyle and the TMJ. The dynamic movement of the TMJ was assessed in axial and coronal planes in closed-mouth and maximal open-mouth positions. Once the best image in the axial plane was obtained on the screen, it was recorded. All images were acquired with an Alpinion eCube i8 (Anyang-si, Gyeonggi-do, Ltd., Korea) with a 4 cm width linear transducer E8-PB-L3-12 T (frequency bandwidth 3–12 MHz) In the first round, the observer took one single LCCD measurement of the right and left joints as described by authors [14,15,16]. In a second round, one week later, the examiner evaluated the same 32 TMJ, but took three measurements of the LCCD, ensuring equal examination conditions. Each time he recorded the distance, he separated the probe from the subject's skin and restarted the process. For the study, researchers calculated the mean of these 3 measurements and compared them with the single measurement taken in the first round.
Data analysis
Reliability
Intraobserver reliability was calculated using a two-way mixed effects model, absolute agreement type, and single measure of intraclass correlation coefficients (ICC) (2,1), as proposed by Shrout and Fleiss [18]. This method allows for the confidence and reliability of the single observer to measure the same anatomical landmark. ICC values were considered using the Portney and Watkins classification, where a 0.50–0.75 value was judged moderate, a value ≥ 0.75 was classified as good, and ≥ 0.90 was considered excellent [19].
Validity
A Bland–Altman plot was designed to analyze the agreement between the two measurements [20]. This method permits a graphic form to evaluate a measurement against its gold standard, observing how much the differences deviate from the average when comparing different measurements. In this case, no gold standard exists, but we show how far the single measurement in the TMJ is from the 3-measurement average. These authors contemplated a Limits of Agreement (LoA) as the mean difference ± 1.96 standard deviations of the difference, which would include 95% of the measurements taken with the analyzed method. The Bland–Altman plot calculates the bias between methods and the degree of variability through the scatter of measures with respect to the bias line.
The significance level was set at p ≤ 0.05. All statistical analyses were performed using the SPSS package (IBM SPSS Statistics for Macintosh, Version 25.0. Armonk, NY, US: IBM Corp.)
Results
Means and standard deviations were calculated for all the measures carried out. The single-measure showed 1.55 ± 0.42 mm, whereas measures 1 and 3 showed 1.57 ± 0.42, and measure 2 was 1.56 ± 0.41 mm. The 3-measurements average was 1.57 ± 0.41, with a standard error equal to 0.049. The difference between the single-measure and the 3-measurements average was 0.019 ± 0.08 mm. The descriptive data of analysis are resumed in Table 1.
The Kolmogorov–Smirnov test revealed a non-normal distribution of the differences (p < 0.001), but the Q-Q plot and the histogram showed a moderate kurtosis and skewness that allowed the assumption of normal distribution (Fig. 2).
Therefore, a two-way mixed model ICC(2,1) and Bland–Altman plot were used to study the intraobserver reliability and the validity of the single measurement against the 3-measurement average.
Reliability
The calculated ICC(2,1) between the single-measure and the 3-measurements average shows intraobserver reliability of 0.981, and 95% confidence intervals (CI) of 0.969 to 0.988, in keeping with Portney and Watkins [19], authors who rate that value as excellent.
Validity
There is a mean difference between the sonographic measurements of 0.019 mm (95% CI from 0.0005–0.0383), with a standard deviation of 0.080 mm (Fig. 3). The 95% LoA, calculated as bias ± (1.96 * standard deviation of the difference), were − 0.138 for the lower and 0.177 for the upper limit. The mean relative error was 0.009 mm.
Discussion
This study was designed to test the reliability and validity of a single LCCD measurement against a 3-measurement approach to save time, economic cost, and effort in a clinical setting. Our results indicate a high level of coincidence between one single measurement and the calculated mean of three measurements.
Clinical relevance
The use of US for TMD is being studied widely. There is a clear disagreement among authors on how US can contribute to disc visualization and this disagreement is clearly explained in corresponding studies. Some authors argue that US technology can visualize the condition and position of the disc [21,22,23,24,25,26], while others describe the difficulty of US to clearly see the disc and determine its location, using other items to estimate TMD [14,15,16, 27].
In the authors’ opinion, disc visualization with US is poor. Only a small part can be observed and only in some patients. So, it may be more effective to focus the US examination on indirect signs of disc damage or disc displacement, as the LCCD measurement does. In this sense, the review of Kundu et al. concludes that US offers an acceptable level of sensitivity in the diagnosis of disc derangement [27], similar to Talmaceanu et al. [28] who report a sensitivity of 93.1%, a specificity of 87.88%, and accuracy of 90.32% compared to MRI as gold-standard when assessing the joint disc displacement. In a similar study, Jank et al. [29] found 92% sensitivity, specificity, and accuracy comparing disc displacement between MRI and high-resolution US in 200 temporomandibular joints in a closed-mouth position. However, certain authors emphasize the greater specificity of US for sensitivity in assessing TMJ disc location, which impacts the positive and negative predictive values of the diagnosis, and they criticize the LCCD as a landmark of anterolateral displacement because it requires anatomical changes, like joint capsule enlargement or joint effusion [25].
In our opinion, dynamic US exploration is what adds value to the TMJ assessment, not only because of the scope of measurements to be taken, but also because of the movement we can see in the dynamic exploration, assessing condylar erosions, articular effusion, and even feeling the “click” of the disc displacement while we explore in a closed and open-mouth position.
Measurement accuracy
The bias between US methods is 0.019 mm, as shown in the Bland–Altman plot. Despite being statistically significant, it does not seem to have an impact on the diagnosis of pathology associated with disc joint displacement, since authors determine greater LCCD measurements when assessing TMD. Hence, the presence of joint effusion is considered when LCCD is more than 2 or 3 mm [27]. Moreover, the sensitivity and specificity of US versus MRI vary significantly for each 0.10 mm cut-off value [30]. These researchers point out the importance of reliable interobserver data since a difference of as little as 0.2 mm in the capsular distension measurement could impact on either true or false positive rates. As stated earlier, Hayashi et al. comment on internal joint derangement when the LCCD is ≥ 3–4 mm (depending on the population studied), but they do not observe a cut-off value below 1 mm, probably due to the technology used at the time [16].
More current values of Çakır-Özkan et al. [14] equally show a cut-off value of 1 mm. Even considering the reported minimum cut-off value, the limits of agreement of this study are below 0.2 mm in absolute values, indicating that future measurements using this single sonographic method will fall within − 0.138 and 0.177 mm in the 3-measurements method.
The US equipment used in this study is like any equipment used for musculoskeletal (MSK) imaging in clinical settings. The examiner had no previous experience in TMJ US, but had more than ten years of experience in MSK US. The examiner carried out a pilot study with 20 TMJ as training for this study. It is important to understand TMJ anatomy and US technique for this exploration, but after this knowledge is acquired, the exploration technique is not difficult.
Intraobserver reliability
The LCCD measurement has good intra-observer reliability, as Elias et al. show in a study of 30 TMJ [15]. Their ICC values were 0.83 both for longitudinal and transversal scans in the closed-mouth position. In our study, the ICC values were higher, perhaps due to an improvement in device technology. The review of Kundu et al. does not reflect statistical values regarding US measuring reliability, as it shows intra-observer and inter-observer percentages for the detection of the disc position, ranging between 87 and 93% for the former and between 82 and 90% for the latter [27]. Despite obtaining high values, we do not consider percentages a good indication of reliability in a study since it does not consider certain biases, such as agreement by chance.
Limitations
The main limitation of this study is the use of a single observer, which does not allow for the analysis of inter-rater reliability or for the estimation of method validity from another observer. The second potential source of error relies on the absence of comparison between US measurements and any other technique, although TMJ measuring has been widely studied alongside MRI and TC imaging with reliable results [14, 16, 26, 31].
Moreover, during the period between measurements, some TMJ changes may have occurred, and the status of the joint at the time of the second US examination could have been slightly different from those visualized at the time of the first trial.
Conclusions
The intra-observer reliability of a trained examiner is remarkably high in the measurement of the LCCD, conveniently respecting the anatomical landmarks. Moreover, the risk of bias is very low in the measurement when comparing the mean of three LCCD measurements as opposed to a single measurement, which makes the technique valid for use in a clinical setting, while saving on resources, economic cost, and effort.
Data availability
The sample data is available upon contact with the authors.
References
Flores HF, Ottone NE, Fuentes R (2017) Analysis of the morphometric characteristics of the cervical spine and its association with the development of temporomandibular disorders. Cranio J Craniomandib Pract 35:79–85
Gauer RL, Semidey MJ (2015) Diagnosis and treatment of temporomandibular disorders. Am Fam Physician 91:378–386
Ohrbach R, Dworkin SF (2016) The evolution of TMD diagnosis: past, present, future. J Dent Res 95:1093–1101
Schiffman E, Ohrbach R, Truelove E et al (2014) Diagnostic criteria for temporomandibular disorders (DC/TMD) for clinical and research applications: recommendations of the international RDC/TMD consortium network* and orofacial pain special interest group†. J Oral Facial Pain Headache 28:6–27
Plesh O, Adams SH, Gansky SA (2011) Racial/ethnic and gender prevalences in reported common pains in a national sample. J Orofac Pain 25:25–31
Oral K, Bal Küçük B, Ebeoğlu B, Dinçer S (2009) Etiology of temporomandibular disorder pain. Agri Agri Algoloji Derneginin Yayin Organidir J Turk Soc Algol 21:89–94
Dworkin SF, LeResche L (1992) Research diagnostic criteria for temporomandibular disorders: review, criteria, examinations and specifications, critique. J Craniomandib Disord Facial Oral Pain 6:301–355
Talmaceanu D, Lenghel LM, Bolog N, Hedesiu M, Buduru S, Rotar H, Baciut M, Baciut G (2018) Imaging modalities for temporomandibular joint disorders: an update. Med Pharm Rep 91:280–287
Manfredini D, Bucci MB, Nardini LG (2007) The diagnostic process for temporomandibular disorders. Stomatologija 9:35–39
Balaban E, Yılmaz O, Tımarcıoğlu G, Bahran U, Candirli C, Koşucu P (2021) Preoperative and postoperative assessment of temporal and masseter muscle size with magnetic resonance imaging in patients undergoing unilateral temporomandibular joint surgery. J Cranio-Maxillo-fac Surg Off Publ Eur Assoc Cranio-Maxillo-fac Surg 49:705–710
Willenbrock D, Lutz R, Wuest W, Heiss R, Uder M, Behrends T, Wurm M, Kesting M, Wiesmueller M (2022) Imaging temporomandibular disorders: reliability of a novel MRI-based scoring system. J Cranio-Maxillofac Surg 50:230–236
Liu S, Xu L, Lu S, Mao M, Liu L, Cai B (2023) Diagnostic performance of magnetic resonance imaging for degenerative temporomandibular joint disease. J Oral Rehabil 50:24–30
Matsuda S, Yoshimura Y, Lin Y (1994) Magnetic resonance imaging assessment of the temporomandibular joint in disk displacement. Int J Oral Maxillofac Surg 23:266–270
Çakır-Özkan N, Sarıkaya B, Erkorkmaz Ü, Aktürk Y (2010) Ultrasonographic evaluation of disc displacement of the temporomandibular joint compared with magnetic resonance imaging. J Oral Maxillofac Surg 68:1075–1080
Elias FM, Birman EG, Matsuda CK, de Oliveira IRS, Jorge WA (2006) Ultrasonographic findings in normal temporomandibular joints. Braz Oral Res 20:25–32
Hayashi T, Ito J, Koyama J, Yamada K (2001) The accuracy of sonography for evaluation of internal derangement of the temporomandibular joint in asymptomatic elementary school children: comparison with MR and CT. Am J Neuroradiol 22:728–734
Cohen JF, Korevaar DA, Altman DG et al (2016) STARD 2015 guidelines for reporting diagnostic accuracy studies: explanation and elaboration. BMJ Open 6:e012799
Shrout PE, Fleiss JL (1979) Intraclass correlations: uses in assessing rater reliability. Psychol Bull 86:420–428
Portney LG, Watkins MP (2009) Foundations of clinical research: applications to practice. Pearson/Prentice Hall Upper Saddle River, NJ
Bland JM, Altman DG (1999) Measuring agreement in method comparison studies. Stat Methods Med Res 8:135–160
Emshoff R, Bertram S, Rudisch A, Gaßner R (1997) The diagnostic value of ultrasonography to determine the temporomandibular joint disk position. Oral Surg Oral Med Oral Pathol Oral Radiol Endodontol 84:688–696
Jank S, Rudisch A, Bodner G, Brandlmaier I, Gerhard S, Emshoff R (2001) High-resolution ultrasonography of the TMJ: helpful diagnostic approach for patients with TMJ disorders ? J Cranio-Maxillo-fac Surg Off Publ Eur Assoc Cranio-Maxillo-fac Surg 29:366–371
Klatkiewicz T, Gawriołek K, Pobudek Radzikowska M, Czajka-Jakubowska A (2018) Ultrasonography in the diagnosis of temporomandibular disorders: a meta-analysis. Med Sci Monit Int Med J Exp Clin Res 24:812–817
Landes CA, Goral WA, Sader R, Mack MG (2006) 3-D sonography for diagnosis of disk dislocation of the temporomandibular joint compared with MRI. Ultrasound Med Biol 32:633–639
Manfredini D, Guarda-Nardini L (2009) Ultrasonography of the temporomandibular joint: a literature review. Int J Oral Maxillofac Surg 38:1229–1236
Talmaceanu D, Lenghel LM, Bolog N, Buduru S, Leucuta D, Rotar H (2020) High-resolution ultrasound imaging compared to magnetic resonance imaging for temporomandibular joint disorders: an in vivo study. Eur J Radiol 132:109291
Kundu H, Basavaraj P, Kote S, Ashish S, Shilp S (2013) Assessment of TMJ disorders using ultrasonography as a diagnostic tool: a review. J Clin Diagn Res. https://doi.org/10.7860/JCDR/2013/6678.3874
Talmaceanu D, Lenghel LM, Bolog N, Popa Stanila R, Buduru S, Leucuta DC, Rotar H, Baciut M, Baciut G (2018) High-resolution ultrasonography in assessing temporomandibular joint disc position. Med Ultrason 1:64
Jank S, Emshoff R, Norer B, Missmann M, Nicasi A, Strobl H, Gassner R, Rudisch A, Bodner G (2005) Diagnostic quality of dynamic high-resolution ultrasonography of the TMJ—a pilot study. Int J Oral Maxillofac Surg 34:132–137
Manfredini D, Tognini F, Melchiorre D, Zampa V, Bosco M (2003) Ultrasound assessment of increased capsular width as a predictor of temporomandibular joint effusion. Dentomaxillofacial Radiol 32:359–364
Landes C, Walendzik H, Klein C (2000) Sonography of the temporomandibular joint from 60 examinations and comparison with MRI and axiography. J Cranio-Maxillo-fac Surg Off Publ Eur Assoc Cranio-Maxillo-fac Surg 28:352–361
Funding
Funding for open access charge: Universidade de Vigo/CISUG, provided thanks to the CRUE-CSIC agreement with Springer Nature. The authors declare that no funds, grants, or other support were received during the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
Conceptualization, investigation, resources, data curation, and writing—original draft: RDD; methodology, formal analysis, writing—original draft, and supervision: OCV; review and editing: FM; investigation, resources, data curation, and writing—original draft: TFR.
Corresponding author
Ethics declarations
Conflict of interest
The authors declare that they have no conflict of interest.
Ethical approval
The study was approved by the Research Ethics Committee of Camilo José Cela University, Madrid, Spain. Code number 09-22-UEMDTT.
Consent to participate
All procedures followed were in accordance with the ethical standards of the responsible committee on human experimentation (institutional and national) and with the Helsinki Declaration of 1975, as revised in 2008. Informed consent was obtained from all patients for being included in the study.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/.
About this article
Cite this article
Delgado-Delgado, R., Conde-Vázquez, O., Fall, F.M. et al. Intraobserver reliability and validity of a single ultrasonic measurement of the lateral condyle-capsule distance in the temporomandibular joint. J Ultrasound (2023). https://doi.org/10.1007/s40477-023-00818-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1007/s40477-023-00818-z