Skip to main content

Advertisement

Log in

A novel use of the Spine Tango registry to evaluate selection bias in patient recruitment into clinical studies: an analysis of patients participating in the Lumbar Spinal Stenosis Outcome Study (LSOS)

  • Original Article
  • Published:
European Spine Journal Aims and scope Submit manuscript

Abstract

Purpose

Patients enrolled in clinical studies typically represent a sub-set of all who are eligible, and selection bias may compromise the generalizability of the findings. Using Registry data, we evaluated whether surgical patients recruited by one of the referring centres into the Lumbar Spinal Stenosis Outcome Study (LSOS; a large-scale, multicentre prospective observational study to determine the probability of clinical benefit after surgery) differed in any significant way from those who were eligible but not enrolled.

Methods

Data were extracted for all patients with lumbar spinal stenosis registered in our in-house database (interfaced to Eurospine’s Spine Tango Registry) from 2011 to 2013. Patient records and imaging were evaluated in relation to the admission criteria for LSOS to identify those who would have been eligible for participation but were not enrolled (non-LSOS). The Tango surgery data and Core Outcome Measures Index (COMI) data at baseline and 3 and 12 months after surgery were analysed to evaluate the factors associated with LSOS enrolment or not.

Results

514 potentially eligible patients were identified, of which 94 (18%) were enrolled into LSOS (range 2–48% for the 6 spine surgeons involved in recruiting patients) and 420 (82%) were not; the vast majority of the latter were due to non-referral to the study by the surgeon, with only 5% actually refusing participation. There was no significant difference in gender, age, BMI, smoking status, or ASA score between the two groups (p ≥ 0.18). Baseline COMI was significantly (p = 0.002) worse in the non-LSOS group (7.4 ± 1.9) than the LSOS group (6.7 ± 1.9). There were no significant group differences in any Tango surgery parameters (additional spine patholothegies, operation time, blood loss, complications, etc.) although significantly more patients in the non-LSOS group had a fusion procedure (38 vs 18% in LSOS; p = 0.0004). Postoperatively, neither the COMI nor its subdomain scores differed significantly between the groups (p > 0.05). Multiple logistic regression revealed that worse baseline COMI (p = 0.021), surgeon (p = 0.003), and having fusion (p = 0.014) predicted non-enrolment in LSOS.

Conclusion

A high proportion of eligible patients were not enrolled in the study. Non-enrolment was explained in part by the specific surgeon, worse baseline COMI status, and having a fusion. The findings may reflect a tendency of the referring surgeon not to overburden more disabled patients and those undergoing more extensive surgery with the commitments of a study. Beyond these factors, non-enrolment appeared to be somewhat arbitrary, and was likely related to surgeon forgetfulness, time constraints, and administrative errors. Researchers should be aware of potential selection bias in their clinical studies, measure it (where possible) and discuss its implications for the interpretation of the study’s findings.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Fig. 1
Fig. 2
Fig. 3

Similar content being viewed by others

References

  1. Hunninghake DB, Darby CA, Probstfield JL (1987) Recruitment experience in clinical trials: literature summary and annotated bibliography. Control Clin Trials 8:6S–30S

    Article  CAS  PubMed  Google Scholar 

  2. Abraham NS, Young JM, Solomon MJ (2006) A systematic review of reasons for nonentry of eligible patients into surgical randomized controlled trials. Surgery 139:469–483. doi:10.1016/j.surg.2005.08.014

    Article  PubMed  Google Scholar 

  3. Buckley B, Murphy AW, Byrne M, Glynn L (2007) Selection bias resulting from the requirement for prior consent in observational research: a community cohort of people with ischaemic heart disease. Heart 93:1116–1120. doi:10.1136/hrt.2006.111591

    Article  PubMed  PubMed Central  Google Scholar 

  4. Black N (1996) Why we need observational studies to evaluate the effectiveness of health care. BMJ 312:1215–1218

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  5. Steurer J, Nydegger A, Held U, Brunner F, Hodler J, Porchet F, Min K, Mannion AF, Michel B (2010) LumbSten: the lumbar spinal stenosis outcome study. BMC Musculoskelet Disord 11:254. doi:10.1186/1471-2474-11-254

    Article  PubMed  PubMed Central  Google Scholar 

  6. Ulrich NH, Burgstaller JM, Brunner F, Porchet F, Farshad M, Pichierri G, Steurer J, Held U, Group LS (2016) The impact of incidental durotomy on the outcome of decompression surgery in degenerative lumbar spinal canal stenosis: analysis of the Lumbar Spinal Outcome Study (LSOS) data-a Swiss prospective multi-center cohort study. BMC Musculoskelet Disord 17:170. doi:10.1186/s12891-016-1022-y

    Article  PubMed  PubMed Central  Google Scholar 

  7. Burgstaller JM, Held U, Brunner F, Porchet F, Farshad M, Steurer J, Ulrich NH, Group LS (2016) The impact of obesity on the outcome of decompression surgery in degenerative lumbar spinal canal stenosis: analysis of the Lumbar Spinal Outcome Study (LSOS): a Swiss Prospective Multicenter Cohort study. Spine (Phila Pa 1976) 41:82–89. doi:10.1097/BRS.0000000000001128

    Article  Google Scholar 

  8. Fekete T, Woernle C, Mannion AF, Held U, Min K, Kleinstuck F, Ulrich N, Haschtmann D, Becker HJ, Porchet F, Theiler R, Steurer J, Group LW (2015) The effect of epidural steroid injection on postoperative outcome in patients from the Lumbar Spinal Stenosis Outcome study. Spine (Phila Pa 1976) 40:1303–1310. doi:10.1097/BRS.0000000000000969

    Article  Google Scholar 

  9. Ulrich NH, Kleinstuck F, Woernle CM, Antoniadis A, Winklhofer S, Burgstaller JM, Farshad M, Oberle J, Porchet F, Min K, LumbSten Research C (2015) Clinical outcome in lumbar decompression surgery for spinal canal stenosis in the aged population: a prospective Swiss multicenter cohort study. Spine (Phila Pa 1976) 40:415–422. doi:10.1097/BRS.0000000000000765

    Article  Google Scholar 

  10. Mannion AF, Fekete TF, Wertli MM, Mattle M, Nauer S, Kleinstuck FS, Jeszenszky D, Haschtmann D, Becker HJ, Porchet F, Lumbar Spinal Stenosis Outcome Study G (2015) Could less be more when assessing patient-rated outcome in spinal stenosis? Spine (Phila Pa 1976) 40:710–718. doi:10.1097/BRS.0000000000000751

    Article  Google Scholar 

  11. EUROSPINE (2016) http://www.eurospine.org/spine-tango.htm. Accessed 4 July 2016

  12. Mannion AF, Porchet F, Kleinstück F, Lattig F, Jeszenszky D, Bartanusz V, Dvorak J, Grob D (2009) The quality of spine surgery from the patient’s perspective: Part 1. The Core Outcome Measures Index (COMI) in clinical practice. Eur Spine J 18:367–373

    Article  PubMed  PubMed Central  Google Scholar 

  13. Grob D, Mannion AF (2009) The patient’s perspective on complications after spine surgery. Eur Spine J 18:380–385

    Article  PubMed  PubMed Central  Google Scholar 

  14. Heinemann S, Thuring S, Wedeken S, Schafer T, Scheidt-Nave C, Ketterer M, Himmel W (2011) A clinical trial alert tool to recruit large patient samples and assess selection bias in general practice research. BMC Med Res Methodol 11:16. doi:10.1186/1471-2288-11-16

    Article  PubMed  PubMed Central  Google Scholar 

  15. Fletcher B, Gheorghe A, Moore D, Wilson S, Damery S (2012) Improving the recruitment activity of clinicians in randomised controlled trials: a systematic review. BMJ Open 2:e000496. doi:10.1136/bmjopen-2011-000496

    Article  PubMed  PubMed Central  Google Scholar 

  16. Page MJ, French SD, McKenzie JE, O’Connor DA, Green SE (2011) Recruitment difficulties in a primary care cluster randomised trial: investigating factors contributing to general practitioners’ recruitment of patients. BMC Med Res Methodol 11:35. doi:10.1186/1471-2288-11-35

    Article  PubMed  PubMed Central  Google Scholar 

  17. Richards DA, Ross S, Robens S, Borglin G (2014) The DiReCT study - improving recruitment into clinical trials: a mixed methods study investigating the ethical acceptability, feasibility and recruitment yield of the cohort multiple randomised controlled trials design. Trials 15:398. doi:10.1186/1745-6215-15-398

    Article  PubMed  PubMed Central  Google Scholar 

  18. Howard L, de Salis I, Tomlin Z, Thornicroft G, Donovan J (2009) Why is recruitment to trials difficult? An investigation into recruitment difficulties in an RCT of supported employment in patients with severe mental illness. Contemp Clin Trials 30:40–46. doi:10.1016/j.cct.2008.07.007

    Article  PubMed  PubMed Central  Google Scholar 

  19. McDonald AM, Knight RC, Campbell MK, Entwistle VA, Grant AM, Cook JA, Elbourne DR, Francis D, Garcia J, Roberts I, Snowdon C (2006) What influences recruitment to randomised controlled trials? A review of trials funded by two UK funding agencies. Trials 7:9. doi:10.1186/1745-6215-7-9

    Article  PubMed  PubMed Central  Google Scholar 

  20. Steffens D, Maher CG, Ferreira ML, Hancock MJ, Pereira LS, Williams CM, Latimer J (2015) Influence of clinician characteristics and operational factors on recruitment of participants with low back pain: an observational study. J Manipulative Physiol Ther 38:151–158. doi:10.1016/j.jmpt.2014.10.016

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

This study was supported by the Schulthess Klinik Research Funds. The LSOS study itself is supported by the Pfizer-Foundation for geriatrics and research in geriatrics and the Helmut Horten Foundation. We would like to thank Dave O’Riordan, Gordana Balaban, and Kirsten Clift for their management of the patient questionnaire data and Spine Tango Surgery forms.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to H.-J. Becker.

Ethics declarations

Conflict of interest

All authors declare that they have no conflict of interest.

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Becker, HJ., Nauer, S., Porchet, F. et al. A novel use of the Spine Tango registry to evaluate selection bias in patient recruitment into clinical studies: an analysis of patients participating in the Lumbar Spinal Stenosis Outcome Study (LSOS). Eur Spine J 26, 441–449 (2017). https://doi.org/10.1007/s00586-016-4850-4

Download citation

  • Received:

  • Revised:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00586-016-4850-4

Keywords

Navigation