The results after anterior cruciate ligament reconstruction (ACLR) are evaluated by laxity measures, functional tests, and patients’ perception by patient-reported outcome measures (PROMs). It is not known, if one of these evaluation instruments is representative or if outcome scores from all must be reported to obtain a full evaluation of the condition. The aim was to study the correlations between these three types of outcomes 1 year after primary ACLR.
All adult patients (range 18–45 years) who had an ACLR between 1.1.2019 and 31.12.2021 were offered 1-year follow-up by an independent observer. Preoperative information about knee laxity and peroperative information about the condition of menisci and cartilage were registered. At 1-year follow-up clinical and instrumented knee stability and function assessed by four different hop tests were registered. Patients completed four PROMs (the Subjective International Knee Documentation Committee (IKDC) score, the Knee Numeric-Entity Evaluation Score (KNEES-ACL), the Knee injury and Osteoarthritis Outcome Score (KOOS) and the Lysholm score) and Tegner activity scale and answered anchor questions regarding satisfaction and willingness to repeat the operation.
A total of 190 adults attended the 1-year follow-up and 151 had all assessments. There were only a few positive and weak correlations between performance tests and PROMS and between clinical measurements and PROMS (r = 0.00–0.38), and the majority were of negligible strength. Tegner score had in general the highest correlation (low to moderate). The highest correlation was 0.53 (moderate) between the anchor question about patient satisfaction and Lysholm/IKDC scores. There was no difference in the correlations depending on meniscal condition.
In ACLR patients there was no clinically relevant correlation between scores obtained by PROMs, a battery of functional performance tests and instrumented laxity of the knee at 1-year follow-up. Therefore, one type of outcome cannot represent the others. This is an argument for always to include and report all three types of outcomes, and conclusions based on one type of outcome may not be sufficient.
Level of evidence
The results after anterior cruciate ligament reconstruction (ACLR) can be evaluated by scores from patient-reported outcome measures (PROMs), measures of activity level, clinical and instrumented joint laxity, muscle strength, balance, and functional tests [6, 28].
PROM scores are often regarded as the most important outcomes in clinical settings [10, 27], as they are assumed to express the patients’ subjective description of the condition . Dynamic performance tests can be used to assess when it is safe to return to sport [14, 15], and clinical and instrumented laxity measures can indicate whether the intention to obtain a normal mechanical knee laxity has been reached .
Functional tests are time-consuming and relatively complex to perform, [14, 15, 17, 22, 23], which may be the reason why they are rarely reported in the literature . Examples of suggested criteria for return to sport are a limb symmetry index (LSI) > 90% on isokinetic and hop tests, and subjective IKDC scores within the 15th percentile of healthy subjects .
Optimally, function should be positively related to knee laxity, and patients with a good function should show high PROM scores. In that case, one type of outcome could be representative of all, but there are only two studies on whether such correlations exist. One tested the correlation between the limb symmetry index for the one-leg vertical jump test against the subjective IKDC scores (r = 0.26), Tegner score (r = 0.64) and the ACL-RSI (Return to Sport after Injury) scale scores (r = 0.61) nine months after ACLR in younger, adult male athletes . The other found that in children who had an ACLR 1 year earlier there were no clinically important correlations between scores obtained by Pedi-IKDC and KOOS-Child, laxity measures, knee muscle strength and four functional performance tests .
Many musculoskeletal randomized clinical trials report PROM scores as the primary or only outcome, and several important healthcare strategies are based on PROM outcomes. The prerequisite for this is that PROM scores are representative of the outcome of the treatment, even though this is a philosophically/politically point of view and not scientifically based . Therefore, it is of interest to analyse whether this is a reasonable prerequisite for patients treated with ACL reconstruction. It was hypothesized that with an adequate PROM and functional and clinical/instrumented measures obtained by highly experienced and independent observers there would be strong correlations between the different types of measure and that it is sufficient to report only one as representative for them all. The purpose of this study was to evaluate the correlations between three outcomes that are generally regarded as important in relation to these patients: four functional performance tests, clinical and instrumented knee laxity, and PROM scores. The analyses were performed 1 year after ACLR in a consecutive, prospective series of patients.
Materials and method
The 1-year follow-up has been part of the standard program offered to patients after ACLR at the section for sports traumatology, department of orthopedic surgery at Copenhagen University Hospital Bispebjerg since 2007, and the regional ethical committee stated that ethical permission was not required for this study (ref. nr. F-23055524). The patients gave written consent to have their data registered, and permission to store data for this study was obtained. The study was performed according to the STROBE checklist for cohort studies.
Between January 1, 2019, and December 31, 2021, 190 patients had a primary ACLR (patients with revision ACLR, multiple ligament injuries or pathology of the contralateral knee (including ACLR) were not included). Of these, 151 attended the 1-year follow-up, and they were included in this study (Fig. 1). Meniscal pathology or cartilage defects was not an exclusion criteria. All patients were seen by a physical therapist before discharge after the operation and were given a standard rehabilitation program. Almost all patients attended supervised rehabilitation, either free of charge in a municipal physiotherapy clinic (typically for three months) or with a physical therapist affiliated with a sports club or to a private clinic. Braces were not used, except in cases with meniscal refixation, in which case full weight bearing was allowed but with flexion restricted to 40° for 2 weeks and to 90° for the subsequent 2 weeks.
For all ACLRs, the drill tunnels were positioned at the anatomical insertion sites of ACL. Drilling of the femoral tunnel was through the anteromedial portal, inside-out, and of the tibial portal outside-in. Standard grafts were doubled hamstring tendons, and they were fixed by EndoButton (Smith & Nephew) on the femur and by Intrafix with a sheath (DePuy) on tibia. Patellar tendon grafts and quadriceps tendon grafts were fixed with Peek screws (Arthrex), and iliotibal tract grafts were fixed with TightRope (Arthrex) at tibia and a peek screw on femur. The grafts that had been used are listed in Table 1. Meniscal lesions were either resected or repaired using FastFix (Smith & Nephew) (Table 2). In this cohort two patients had cartilage defects (one patient with a defect in the medial femoral cartilage and one in the lateral femoral cartilage), and both were left untouched.
Information was prospectively registered: Preoperative data on gender, age, results of manual Lachman, drawer- and pivot shift tests, instrumented stability by Rolimeter in 30° of knee flexion, and results of the dial test and MCL/LCL stability tests—all stability tests were performed in both knees. There was peroperative information on concomitant injuries and their treatment. The 1-year follow-up was performed by a physical therapist (one of three) with special experience in knee ligament injury and functional testing. Lachman-, drawer- and pivot shift tests and instrumented stability measurements were performed.
Laxity was measured in mm by the Rolimeter as described by Ganko  with the knee in 30° flexion and the patient in the supine position. With the patient fully relaxed, the tibia was pulled anteriorly as far as possible with maximal power. The measurement was performed three times, and the last result was registered. Lachman stability was tested as described in , anterior and posterior drawer as in , pivot shift as in , side-stability as in  and dial test as in .
Patient-reported outcome measures (PROMs)
At 1-year follow-up, patients completed four patient-reported outcome measures (PROMs): the Lysholm score, the Subjective IKDC score, the Knee Numeric-Entity Evaluation Score (KNEES-ACL) and the Knee injury and Osteoarthritis Outcome Score (KOOS). Activity was assessed by the Tegner Score. Anchor questions were answered: satisfaction with the ACLR, indicated on a 3-point scale (very satisfied, satisfied, not satisfied), and whether the patient would prefer the same treatment if the postoperative result had been known preoperatively (on a 3-point scale: yes, perhaps, no).
The IKDC questionnaire was published in 2001  and it was intended for patients with a variety of knee conditions. It was developed by experts without the involvement of patients, and therefore it has no proven content validity [12, 13]. KOOS was published in 1998  and it was intended for patients with knee injury and osteoarthritis. It is an aggregation of The Western Ontario and McMaster Universities’ Arthritis Index (WOMAC) , consisting of 3 domains with 33 items, plus two domains with 9 items developed through interviews with patients with ACL injury or meniscal conditions. WOMAC was developed for patients with end-stage osteoarthritis of the hip or knee and with the involvement of such patients. KOOS has no proven content validity for patients with ACL injury [12, 13]. Also, it has a low degree of construct validity (measurement properties) for patients with ACL injury when evaluated with item response theory models [4, 13, 19]. The Lysholm score was published in 1982 and updated in 1985, and it intended to evaluate knee ligament surgery . It was developed without patient involvement and has no proven content validity . KNEES-ACL was published in 2013 and intended for patients with ACL injury . It was developed by involvement of patients with ACL injury and has good content validity [12, 13]. Construct validity evaluated with item response theory models is good .
Functional performance tests
All tests were conducted 1 year after the operation by a group of trained physiotherapists who had not been involved in the patients’ surgery. The test battery included single leg hop test (SH), triple hop test (TH), 6-m timed hop test (6 m-timed) and cross-over hop test (COH), as described by Noyes et al. . The intra- and inter-rater reliability of these tests is moderate to excellent . The test procedures are described in detail by Warming et al. .
After 5 min of warming up, typically on an exercise bike, followed by 2 min of stretching, the patients made three practice trials prior to each test with adequate rest periods between trials to minimize the effects of fatigue. The practice trials allowed the patients to familiarize themselves with the tests and minimized the learning effects. The best trial score of three jumps was utilized for data analysis, indicating the patient’s maximal performance. All tests had to be performed without losing balance and with a secure landing.
During the single-leg hop the patients stood on one limb, hopped as far forward as possible, and landed on the same limb. The distance was recorded with a tape measure, fixed to the floor. As the subject landed, an investigator recorded the distance from the starting position to the heel strike. Each limb was tested three times. To calculate the limb symmetry index, the best result for the involved limb was divided by the best result for the non-involved limb, and the result was multiplied by 100. A similar procedure was conducted with the triple hop test (to jump as far as possible on a single leg three consecutive times), and the longest distance for each leg was used to calculate limb symmetry.
The single-leg timed hop test was performed over a distance of 6 m with the patients jumping as fast as possible on a single leg. The patients were encouraged to use large, forceful one-legged hopping motions to propel their body forward. The best time of three attempts was chosen for each limb and used for limb symmetry calculation.
The single-leg cross-over triple hop for distance test was performed on a test ground with a 15-cm broad, 6 m long marking strip on the floor. Each patient hopped three consecutive times on one foot, crossing the marking strip during each hop. Each subject was encouraged to jump as far forward as possible during each hop. The total hop distance was measured for each of the three trials, and the best result was used for the calculation of limb symmetry.
After the calculation of the limb symmetry indexes for each of the four hop tests, a composite symmetry index was calculated for the individual patients as the mean of the four indexes.
A comparison was evaluated through Pearson correlations and a 95% confidence interval (CI) computed based on Fisher’s z-transformation. The KOOS and KNEES-ACL domain scores were calculated as raw scores. The strength of the correlations was interpreted as: 0.00–0.30 negligible, 0.30–0.50 low, 0.50–0.70 moderate, 0.70–0.90 high and 0.90–1.00 very high. With α = 0.05, β = 0.20 and the lowest correlation we regarded as relevant being 0.25 (high in the negligible category and meaning that 6.25% of the changes in one outcome can explain changes in the other outcome) we needed 123 patients in the study .
Calculations were performed in SAS.
To evaluate whether the presence of meniscal injury affected the correlations, the two groups [no meniscal pathology (n = 77) and meniscal pathology (n = 74)] were also analysed separately.
All 151 patients were included in the analysis. There were 65 (43%) women and 86 (57%) men. The mean age was 31 years (18–45 years). Spearman correlations calculated between the PROM score (the Lysholm score, IKDC-score, and each domain score in KNEES-ACL and KOOS), Tegner score, Rolimeter measures (injured side minus un-injured side) and the two anchor questions against each of the four hop tests are reported in the supplementary material S1 as tables and plots. Tegner score had in general the highest correlation (low to moderate), while most other correlations were negligible or low. The three analyses in which there was at least one correlation > 0.30 (except for Tegner score) are shown graphically in Figs. 2, 3 and 4. The highest correlation was 0.53 (moderate) between patient satisfaction and Lysholm and IKDC scores. Overall, PROMs correlated best with satisfaction.
Table 3 shows the median (with a range in parentheses) correlations for each variable compared to PROM/Tegner scores in, respectively, all patients, in patients with meniscal injury and in patients without meniscal injury. There was no difference in the correlations depending on meniscal pathology.
This study showed that PROM scores do not correlate with functional or stability tests at 1-year follow-up after ACLR. Therefore, one outcome is not representative for the condition, and the study hypothesis was rejected. The low correlations demonstrated in the current study are comparable to what has been found in children with ACL injury . In a group of 75 athletes who were tested in relation to return to sport 9 months after ACLR there was a negligible correlation between limb symmetry index of single leg vertical jump height and IKDC score (r = 0.26) . However, there were low to moderate correlations between vertical jump height and Tegner activity scale, the ACL-RSI scale  (r = 0.61–0.64), and functional and strength tests (r = 0.30–0.57) , and these coefficients are slightly higher than the values found in the current study. The differences can be caused by a higher proportion of athletes in the cohort , as not all patients in our cohort were involved in organized sports, and patients in the current study were tested 3 months later with substantially more comprehensive correlation analyses.
The current study demonstrated a very low correlation between clinical assessment of laxity with the Rolimeter and functional tests, PROM scores and satisfaction with surgery, and the degree of laxity is therefore not a sufficient outcome in itself. Obviously, it can be used to evaluate technical aspects after ACLR but not function or subjective perception of the result.
The interpretation of Pearson’s rho relies on the validity of the outcomes that are tested. As KOOS, IKDC and the Lysholm score have doubtful content validity , it can be expected that any correlation with scores from these PROMs are quite low. However, KNEES-ACL has good content and construct validity [12, 13], and the functional hop tests and Rolimeter measurements have good reliability, so based on the negligible and low correlations demonstrated in the current study it can be concluded that the different measures express various aspects of outcome.
It is a general understanding that PROM scores are the most important outcomes in clinical trials and a valuable basis for the development of treatment strategies. An example of this is the KANON study  on acute ACL injuries. It found no difference in KOOS scores between two strategies: ACLR or physiotherapy and optional ACLR, but there was a significant difference in knee stability between the two groups and an insignificant difference in Tegner score and return to sports in favor of ACLR at 2-year follow-up. It was concluded that ACLR was not superior to physiotherapy and optional ACLR, but the results from the current study show that this cannot be characterized as a correct interpretation of the results.
This study relates to correlations one year after ACLR in a mixed group of patients, and correlations may be different in other cohorts, e.g., in elite athletes or at shorter or longer follow-up. There are no longitudinal studies in the literature with sufficient data to describe the changes in the three types of outcomes with time or in different cohorts.
It is a strength of this study that it includes a prospective, consecutive cohort of unselected patients who have been treated with ACLR, that outcome data were produced by independent observers with practical experience in relation to the various tests, and that it uses scores from a PROM with content and construct validity for patients with ACL-injury. It is a limitation in relation to generalize from the results of the study that it is restricted to 1-year follow-up.
Do the results of this study indicate that it is always necessary to include all three types of outcomes in relation to follow-up after ACLR? It depends on the purpose of follow-up. The majority of published manuscripts on the outcome after ACLR are series, and high precision of the outcome is in most cases not essential. In contrast, studies that compare groups require outcomes with high precision, in particular if the aim is to decide which treatment is superior, and it is suggested that all three outcomes are included in such studies. If only one or two are reported, the limitations caused by this should be discussed—a study that only reports PROM scores cannot conclude on stability and function.
There was no clinically relevant correlation between scores obtained by PROMs, a battery of functional performance tests and instrumented laxity of the knee at 1-year follow-up after ACLR, meaning that the various modalities represent different aspects of outcome and that one type of outcome cannot represent all. This is an argument for always to include and report all three types of outcomes. Conclusions based on one type of outcome may not be sufficient.
Anonymised data will be available upon reasonable request.
Barber-Westin SD, Noyes FR (2011) Factors used to determine return to unrestricted sports activities after anterior cruciate ligament reconstruction. Arthroscopy 27(12):1697–1705
Bellamy N, Buchanan WW (1986) A preliminary evaluation of the dimensionality and clinical importance of pain and disability in osteoarthritis of the hip and knee. Clin Rheumatol 5(2):231–241
Comins J, Brodersen J, Krogsgaard M, Beyer N (2008) Rasch analysis of the Knee injury and Osteoarthritis Outcome Score (KOOS): a statistical re-evaluation. Scand J Med Sci Sports 18(3):336–345
Comins JD, Krogsgaard MR, Brodersen J (2013) Development of the Knee Numeric-Entity Evaluation Score (KNEES-ACL): a condition-specific questionnaire. Scand J Med Sci Sports 23(5):e293-301
Engelen-van Melick N, van Cingel RE, Tijssen MP, Nijhuis-van der Sanden MW (2013) Assessment of functional performance after anterior cruciate ligament reconstruction: a systematic review of measurement procedures. Knee Surg Sports Traumatol Arthrosc 21(4):869–879
Frobell RB, Roos EM, Roos HP, Ranstam J, Lohmander LS (2010) A randomized trial of treatment for acute anterior cruciate ligament tears. N Engl J Med 363(4):331–342
Galway HR, MacIntosh DL (1980) The lateral pivot shift: a symptom and sign of anterior cruciate ligament insufficiency. Clin Orthop Relat Res 147:45–50
Ganko A, Engebretsen L, Ozer H (2000) The rolimeter: a new arthrometer compared with the KT-1000. Knee Surg Sports Traumatol Arthrosc 8(1):36–39. https://doi.org/10.1007/s001670050008
Godlee F (2012) Outcomes that matter to patients. BMJ 344:e318
Gokeler A, Welling W, Zaffagnini S, Seil R, Padua D (2017) Development of a test battery to enhance safe return to sports after anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc 25(1):192–199
Hansen CF, Jensen J, Odgaard A, Siersma V, Comins JD, Brodersen J, Krogsgaard MR (2022) Four of five frequently used orthopedic PROMs possess inadequate content validity: a COSMIN evaluation of the mHHS, HAGOS, IKDC-SKF, KOOS and KNEES-ACL. Knee Surg Sports Traumatol Arthrosc 30(11):3602–3615
Hansen CF, Jensen J, Siersma V, Brodersen J, Comins JD, Krogsgaard MR (2021) A catalogue of PROMs in sports science: Quality assessment of PROM development and validation. Scand J Med Sci Sports 31(5):991–998
Herbst E, Hoser C, Hildebrandt C, Raschner C, Hepperger C, Pointner H, Fink C (2015) Functional assessments for decision-making regarding return to sports following ACL reconstruction. Part II: clinical application of a new test battery. Knee Surg Sports Traumatol Arthrosc 23(5):1283–1291
Hildebrandt C, Müller L, Zisch B, Huber R, Fink C, Raschner C (2015) Functional assessments for decision-making regarding return to sports following ACL reconstruction. Part I: development of a new test battery. Knee Surg Sports Traumatol Arthrosc 23(5):1273–1281
Hulley SB, Cummings SR, Browner WS, Grady D, Newman TB (2013) Designing clinical research: an epidemiologic approach, 4th edn. Lippincott Williams & Wilkins, Philadelphia, p 79 (Appendix 6C)
Irrgang JJ, Anderson AF, Boland AL, Harner CD, Kurosaka M, Neyret P, Richmond JC, Shelborne KD (2001) Development and validation of the international knee documentation committee subjective knee form. Am J Sports Med 29(5):600–613
Jang SH, Kim JG, Ha JK, Wang BG, Yang SJ (2014) Functional performance tests as indicators of returning to sports after anterior cruciate ligament reconstruction. Knee 21(1):95–101
Johnsen MB, Eitzen I, Moksnes H, Risberg MA (2015) Inter- and intrarater reliability of four single-legged hop tests and isokinetic muscle torque measurements in children. Knee Surg Sports Traumatol Arthrosc 23(7):1907–1916
Krogsgaard MR, Brodersen J, Christensen KB, Siersma V, Jensen J, Hansen CF, Engebretsen L, Visnes H, Forssblad M, Comins JD (2021) How to translate and locally adapt a PROM Assessment of cross-cultural differential item functioning. Scand J Med Sci Sports 31(5):999–1008
Krogsgaard MR, Brodersen J, Christensen KB, Siersma V, Kreiner S, Jensen J, Hansen CF, Comins JD (2021) What is a PROM and why do we need it? Scand J Med Sci Sports 31(5):967–971
Lee DW, Yang SJ, Cho SI, Lee JH, Kim JG (2018) Single-leg vertical jump test as a functional test after anterior cruciate ligament reconstruction. Knee 25(6):1016–1026
Lephart SM, Kocher MS, Harner CD, Fu FH (1993) Quadriceps strength and functional capacity after anterior cruciate ligament reconstruction. Patellar tendon autograft versus allograft. Am J Sports Med 21(5):738–743
Lephart SM, Perrin DH, Fu FH, Gieck JH, McCue FC, Irrgang JJ (1992) Relationship between selected physical characteristics and functional capacity in the anterior cruciate ligament-insufficient athlete. J Orthop Sports Phys Ther 16(4):174–181
Lubowitz JH, Bernardini BJ, Reid JB 3rd (2008) Current concepts review: comprehensive physical examination for instability of the knee. Am J Sports Med 36(6):577–594
Marshall JL, Wang JB, Furman W, Girgis FG, Warren R (1975) The anterior drawer sign: what is it? J Sports Med 3(4):152–158
Noyes FR, Barber SD, Mangine RE (1991) Abnormal lower limb symmetry determined by function hop tests after anterior cruciate ligament rupture. Am J Sports Med 19(5):513–518
Patrick DL, Burke LB, Powers JH, Scott JA, Rock EP, Dawisha S, O’Neill R, Kennedy DL (2007) Patient-reported outcomes to support medical product labeling claims: FDA perspective. Value Health 10(Suppl 2):S125-137
Petersen W, Taheri P, Forkel P, Zantop T (2014) Return to play following ACL reconstruction: a systematic review about strength deficits. Arch Orthop Trauma Surg 134(10):1417–1428
Roos EM, Roos HP, Lohmander LS, Ekdahl C, Beynnon BD (1998) Knee Injury and Osteoarthritis Outcome Score (KOOS)–development of a self-administered outcome measure. J Orthop Sports Phys Ther 28(2):88–96
Tegner Y, Lysholm J (1985) Rating systems in the evaluation of knee ligament injuries. Clin Orthop Relat Res 198:43–49
Torg JS, Conrad W, Kalen V (1976) Clinical diagnosis of anterior cruciate ligament instability in the athlete. Am J Sports Med 4(2):84–93
Warming S, Alkjaer T, Herzog RB, Lundgaard-Nielsen M, Zebis MK (2021) Reference data for hop tests used in pediatric ACL injury rehabilitation: a cross-sectional study of healthy children. Scand J Med Sci Sports 31(9):1832–1839
Warming S, Herzog RB, Lundgaard-Nielsen M, Rathcke MW, Krogsgaard MR (2023) No correlation between performance tests, clinical measurements and data from patient-reported outcome measures (PROM) in children reconstructed for anterior cruciate ligament injury. Knee Surg Sports Traumatol Arthrosc 31(6):2386–2393
Webster KE, Feller JA, Lambros C (2008) Development and preliminary validation of a scale to measure the psychological impact of returning to sport following anterior cruciate ligament reconstruction surgery. Phys Ther Sport 9(1):9–15
Open access funding provided by Royal Library, Copenhagen University Library. This research received no specific grant from any funding. agency in the public, commercial, or not-for-profit sectors.
Conflict of interest
All authors declare no conflicts of interest.
This study was performed according to the STROBE checklist for cohort studies. Ethical permission was not required for this study. Permission to register data for this study was obtained.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Below is the link to the electronic supplementary material.
About this article
Cite this article
Al-Gburi, M., Kristiansen, J.B., Christensen, K.B. et al. Functional performance tests, clinical measurements, and patient-reported outcome measures do not correlate as outcomes 1 year after anterior cruciate ligament reconstruction. Knee Surg Sports Traumatol Arthrosc (2023). https://doi.org/10.1007/s00167-023-07648-w