Estimates of success in patients with sciatica due to lumbar disc herniation depend upon outcome measure

Abstract

The objectives were to estimate the cut-off points for success on different sciatica outcome measures and to determine the success rate after an episode of sciatica by using these cut-offs. A 12-month multicenter observational study was conducted on 466 patients with sciatica and lumbar disc herniation. The cut-off values were estimated by ROC curve analyses using Completely recovered or Much better on a 7-point global change scale as external criterion for success. The cut-off values (references in brackets) at 12 months were leg pain VAS 17.5 (0–100), back pain VAS 22.5 (0–100), Sciatica Bothersomeness Index 6.5 (0–24), Maine-Seattle Back Questionnaire 4.5 (0–12), and the SF-36 subscales bodily pain 51.5, and physical functioning 81.7 (0–100, higher values indicate better health). In conclusion, the success rates at 12 months varied from 49 to 58% depending on the measure used. The proposed cut-offs may facilitate the comparison of success rates across studies.

Introduction

Sciatica, defined as nerve root pain—or radicular pain in the leg below the knee, is most commonly caused by lumbar disc herniation. The natural course of sciatica is often described as favourable, and it is presumed that the symptoms of the majority of patients improve [11, 18, 22]. A recent 1-year follow-up study of patients with sciatica randomised to early surgery or to prolonged conservative treatment found recovery rates of 95% for both groups [17]. On the other hand, in the SPORT study, only 44.7% of the patients who did not undergo surgery and 77.1% of the surgically treated patients were satisfied with their symptoms after 1 year [23]. These divergent results on sciatica patients are challenging [4], and the different outcomes available make it difficult to compare the results of published studies. Primary patient-reported outcomes commonly used in clinical studies on sciatica are patient-rated global change [1, 8, 14, 17, 23], leg pain [15, 17, 22], back pain [22], Medical Outcomes Study Short Form 36 (SF-36) bodily pain and physical functioning [23], North American Spine Society (NASS) neurogenic symptoms score (NSS) [20], Oswestry Disability Index (ODI) [23] and the Roland Morris disability questionnaire (RMDQ) [17, 22]. Few studies have used sciatica-specific outcomes such as the Sciatica Bothersomeness and Frequency Indices, and then only as secondary outcomes [1, 17, 23].

Clinical findings and imaging have shown little relevance for change of symptoms in patients with sciatica. Therefore, patient’s self-reports are important. The minimum clinically important difference (MCID) represents the smallest improvement or change in score based on an external anchoring question about the patient’s percieved improvement [5, 13]. However, although there is a large improvement on a measure, the patient might not have had a good outcome or success. A cut-off differing between success and non-success makes it possible to estimate the rate of patients with a good outcome. As long as no consensus exists on the definition of success, there is no agreement on the cut-off values for success for various outcome measures of sciatica. A 7-point Likert scale has been used as a recovery scale (complete or nearly complete disappearance of sciatica symptoms) [17] and as a global perceived effect scale (completely recovered and much improved) [12] in patients with sciatica.

The aims of this study were to estimate the cut-off points for success on different outcome measures and to determine the success rate after an episode of sciatica using the outcome cut-off values.

Materials and methods

Design

We conducted a prospective multicentre observational study of patients with sciatica. The sample size was calculated based on an expectation that surgical treatment would be necessary for 30% of the patients and that 70% of those who were surgically treated and 50% of those who were not surgically treated would experience a good outcome [1]. Power analysis indicated a sample size on 300 patients requiring 90% power with a two-sided exact Fisher test of 5% significance level. Taking loss-to-follow-up into consideration we ended up with a study sample of 400 patients. The study protocol was approved by the Regional Committee for Medical Research Ethics and The Ombudsmann for Privacy in Research at the Norwegian Social Science Data Services.

Patients

Patients were recruited from specialty back clinics at four hospitals in southeast Norway (Sykehuset Østfold, Sørlandet Sykehus, Oslo Universitetssykehus Ullevål and Sykehuset Innlandet). Patients were referred to the specialty back clinics from the primary health care service. Assessment and treatment were conducted as usual in the back clinics. A physician or physiotherapist informed consecutive eligible patients about the study. Inclusion criteria were age ≥18 years and radiating pain below the knee level, and/or paresis and a disc herniation at the corresponding level and side according to magnetic resonance imaging (MRI) or computed tomography (CT). Exclusion criteria were prior surgery at the same disc level, fracture, infection, malignancy, pregnancy, and lack of fluency in Norwegian. All patients signed an informed consent form after receiving oral and written information.

Procedure

At the first visit, a questionnaire on sociodemographic factors (age, gender, education length, smoking status and work status) was completed. Patients also reported their history of previous sciatica and the duration of relevant sciatica episodes. A clinical examination was carried out by trained physiotherapists or physicians at the departments of rheumatology, physical medicine and rehabilitation, or orthopaedics.

The assessment included motor function of the muscles of the knee, leg and toe, the Trendelenburg test, sensory loss in the leg, reflexes of the Achilles tendon and patella (all deemed abnormal if reduced) and the straight leg raising test (deemed abnormal if <60°). Number of tender-points were recorded. Standardisation of testing procedures was done in meetings with the participating centres.

A follow-up questionnaire and a prepaid envelope were sent to the patients after 3, 6 and 12 months. The date was recorded for patients who underwent back surgery. A study nurse sent a reminder after 2 weeks if no reply was obtained.

Measures

Leg pain and low back pain were measured using the visual analogue scale (VAS) 0–100. The Sciatica Bothersomeness Index (SBI), which is a composite score of four questions (each score ranging from 0–6) that include elements of leg pain and sensory and motor disturbances, was used [7, 16]. Total score ranges from 0 to 24 and higher scores indicate worse symptoms. The Maine-Seattle Back Questionnaire (MSBQ) [2, 7] which was developed from the RMDQ and modified for sciatica patients, was used to measure functional status. The scale is composed of 12 items and the score ranges from 0 to 12, higher scores indicating greater disability. The MSBQ mainly assesses disability, but also includes questions about pain. The Norwegian versions of the SBI and the MSBQ were recently validated [7]. The bodily pain and physical functioning subscales of SF-36 [21] are parts of a generic quality of life questionnaire in widespread use, including studies on sciatica [1, 23, 24]. Scores range from 0 to 100 and higher values indicate better health.

The follow-up questionnaires included a 7-item global change scale for leg and back pain with the following categories: Completely recovered, Much better, Better, A little better, No change, A little worse and Much worse. Patients were categorised as success if they responded with Completely recovered or Much better. Satisfaction to spend the rest of life in the current state was registered using a 5-item Likert scale with the wording Very satisfied, A little satisfied, Neither satisfied nor not, A little dissatisfied, and Very Dissatisfied.

Statistical analyses

Baseline and follow-up comparisons between groups were analysed using an independent t-test for continuous data and χ² for categorical data. Floor or ceiling effects were defined as >15% of scores in the lowest or highest parts of the scales, respectively [19].

A receiver operating characteristic (ROC) curve was obtained by plotting every possible cut-off score’s sensitivity on the y-axis against 1-specificity on the x-axis. Sensitivity was defined as the proportion of patients who were correctly classified in the success group (Completely recovered or Much better). Specificity was defined as the proportion of patients who were correctly classified in the non-success group. The value on the curve closest to the upper left corner shows the highest sensitivity and specificity and was considered the best cut-off score for distinguishing between success and non-success. The area under the ROC curve (AUC) reflects the scoring system’s ability in differentiating between success and non-success. An AUC value >0.70 was considered satisfactory [19].

McNemar’s test was used when comparing sensitivity of two diagnostic measures where the cut-off point was set to specificity 80% for each measure.

The Statistical Package for Social Sciences Version 17.0 (SPSS Inc., Chicago, IL) was used for data analysis.

Results

Four hundred sixty-six patients were included in the study; 268 (57.5%) were men. The mean age was 43.6 ± 11.5 years. Patient characteristics are presented in Table 1. Fifty-seven (12.2%) patients, six of whom underwent surgery, were lost to follow-up at 1 year. At baseline these patients were significantly younger, had a higher leg pain score and more often tested positive on the straight leg raising test than patients who completed the study (Table 1).

Table 1 Baseline characteristics for 409 patients with complete data and 57 non-responders at the 1-year follow-up

Patients were classified as acute if duration of current sciatica episode was less than 3 months and chronic if duration was 3 months and more. The acute patients (n = 192, 41.4%) represented more males, higher score on SBI, lower scores on SF-36 bodily pain and physical functioning, and higher frequency of reduced motor function, sensory loss and reflex depletion at the clinical examination. Baseline leg pain intensity score was >90 in 100 patients. The SF-36 bodily pain had a ceiling effect as 99 (21.2%) patients reported a score of 0 (the worst degree of pain).

The 3-, 6- and 12-month questionnaires were answered by 434 (93.1%), 423 (90.8%) and 409 (87.8%) patients, respectively. Mean leg pain score decreased from 63.2 ± 28.2 at baseline to 26.7 ± 28.8 at 12 months. Over the same period, the mean SBI score decreased from 14.2 ± 5.0 to 7.2 ± 6.1 and the MSBQ score decreased from 8.1 ± 2.6 to 4.2 ± 3.4. Those who worked full time were 93 (20.0%) at baseline, 183 (42.4%) at 3 months, 220 (52.0%) at 6 months and 250 (61.1%) at 12 months.

By the 12-month follow-up, 126 patients had received surgical treatment. Patients selected for surgery were younger, had more frequently positive straight leg raising test and reported significantly more pain and disability at baseline than those who did not undergo surgery. At 12 months, the surgically treated patients had significantly better outcomes in terms of leg pain (P = 0.001) and SBI (P < 0.001) than non-surgically treated patients, whereas outcomes such as back pain, MSBQ and SF-36 bodily pain and physical functioning scores did not differ between surgically and non-surgically treated patients (Fig. 1).

Fig. 1

Time course for scores for leg pain (VAS), back pain (VAS), Sciatica Bothersomeness Index, Maine-Seattle Back Questionnaire, SF-36 bodily pain and SF-36 physical functioning (means with 95% CIs) in patients treated without surgery (n = 289) (circles), surgery within 3 months of registration (n = 98) (squares) and surgery between 3 and 12 months of registration (n = 28) (multi symbols)

Table 2 presents the mean scores for the outcome variables at 12 months according to the global change scale. All outcome scores increased correspondingly with the categories in the global change scale, except the items No change, A little worse and Much worse for SBI and VAS in leg and back. Using the global change scale 222 (54.4%) of the patients reported success; 83 were of the surgically treated group (69.2%) and 139 were of the non-surgically treated group (48.3%). Overall, 188 (46.1%) of the patients indicated they were satisfied to spend the rest of their lives in their current state; 72 were of the surgically treated group (60.0%) and 116 were of the non-surgically treated group (40.4%).

Table 2 Mean (SD) scores at 12 months for leg pain (VAS), back pain (VAS), Sciatica Bothersomeness Index (SBI), Maine-Seattle Back Questionnaire (MSBQ), SF-36 bodily pain, SF-36 physical functioning registered at every category of the 7-point global change scale

The ROC analyses showed a high AUC (0.76–0.89) for leg and back pain scores, SBI, MSBQ and the SF-36 bodily pain and physical functioning scores at 3, 6 and 12 months. Similar results were observed using satisfied to spend the rest of life in the current state as an external criterion (AUC 0.74–0.87). Cut-off points with the highest sensitivity and specificity that distinguished between patients with and without success of sciatica at 12 months were 17.5 for leg pain score, 22.5 for back pain score, 6.5 for SBI score and 4.5 for MSBQ score at 12 months. The cut-off points for the SF-36 bodily pain and physical functioning scores at 12 months were 51.5 and 81.7, respectively. Table 3 presents the cut-off values at 3 and 12 months for the total cohort and for the subgroups of gender, duration of symptoms and surgical status. The proportion of patients achieving success according to the calculated cut-off values at 12 months varied from 49% (SF-36 bodily pain) to 58% (MSBQ) (Fig. 2).

Table 3 Cut-off values with sensitivity and specificity using “Completely recovered or Much better” as external criterion

Fig. 2

Per cent of patients achieving success according to calculated cut-off values for back and leg pain VAS, Sciatica Bothersomeness Index (SBI), Maine-Seattle Back Questionnaire (MSBQ), and SF-36 bodily pain (bp) and physical functioning (pf)

With a fixed specificity on 80%, the sensitivity for the outcome measures varied from 69% (leg pain VAS) to 86% (MSBQ). The MSBQ showed a significantly higher sensitivity (86%) with the locked specificity at 80% compared with all the other outcome measures (P ≤ 0.013). There were no significant differences in sensitivity comparing leg and back pain scores, SBI and the SF-36 bodily pain and physical functioning scores where each measure’s cut-off point was set to specificity 80%.

Discussion

The main finding of this sciatic cohort study was that the success rates among the different outcome measures at 1 year varied from 49 to 58%. This indicates that success rates cannot be used for comparison between studies unless the success criterion is exactly defined.

We used a strict definition of success using Completely recovered or Much better as the success criterion. In the non-success group, there were patients with both deterioration and some improvement of the symptoms. After 1 year, 112 (27.5%) patients reported their condition as Better or A little better, but only 14 (12.5%) of them were satisfied with their symptoms.

The ROC cut-off was constructed using the 12-month absolute score for each variable and Completely recovered or Much better as the external criterion. When the same external criterion was used for the 12-month change scores, the results were similar (AUC 0.72–0.87). We decided to use cut-off values for the absolute follow-up scores in stead of change scores in order to enhance feasibility. Cut-off values of follow-up scores can easily be used in clinical practice as a guideline for evaluating outcome of sciatica.

In the ROC-cut-off analyses all outcomes showed satisfactory ability to discriminate between success and non-success. However, the scores for the MSBQ at 12 months had the highest AUCs and a significantly higher sensitivity when specificity was locked at 80% and might be the most preferable score in evaluating pain and function during sciatica. Over time, the SBI and the MSBQ showed the most stable cut-off points.

Patients selected for surgery had a higher baseline score and a more rapid decline in symptoms than those who did not undergo surgery. However, the outcomes at 1-year follow-up were similar, which is in agreement with the Cochrane Review and other observational studies [1, 6, 23].

The global change scores correspond to the results of the MLSS study [1]. This shows that many patients still experience pain and disability after 1 year.

Definition of recovery in terms of a cut-off point enables comparison of results between studies. To our knowledge, two previous studies proposed a defined score for evaluating recovery from sciatica. Both studies used composite scores and presented strict definitions. One study defined recovery from sciatica as ODI ≤20 + VAS pain ≤15 + muscle strength 5/5 [3], and another used the definition absence of sciatic leg pain 0/10 + RMDQ ≤ 3 [9]. Low back pain recovery has in other studies been defined using cut-off points, but there is lack of consistency among the measures [10].

There are limitations to the study. Number and characteristics of eligible patients who did not enter the study were not registered. Clinical examination was carried out by different physiotherapists and physicians; this might give an assessment error. The ODI and the RMDQ were not used for comparison with the sciatica specific questionnaires.

In conclusion, using the cut-off scores which best discriminated the patients with and without success at 1 year, the success rates varied from 49 to 58% depending on the measure used.