Skip to main content

Advertisement

SpringerLink
Log in

High recall bias in retrospective assessment of the pediatric International Knee Documentation Committee Questionnaire (Pedi-IKDC) in children with knee pathologies

  • KNEE
  • Published:
Knee Surgery, Sports Traumatology, Arthroscopy Aims and scope

Abstract

Purpose

The increasing incidence of knee injuries among children is well known by sports physicians. Papers dealing with this topic have often collected patient-reported outcomes measures (PROMs) in a retrospective manner; this limitation could lead to a misinterpretation of the results, because pediatric patients might not remember their preoperative conditions adequately. This study aims to evaluate the reliability and the reproducibility of the IKDC pediatric score when administered retrospectively at a 12-month follow-up.

Methods

From September 2018 and June 2019, all patients aged 7–18 scheduled for surgery due to different knee pathologies in a single center were considered eligible. Parents were contacted by phone for consent. An open-source platform was implemented to collect the responses: two surveys were created (Q1, Q2). They included general information and the Pedi-IKDC score. Q1 was completed prospectively, while Q2 was completed 12 months after surgery. The two questionnaires were identical, and patients were carefully advised to complete Q2 recalling their health status before surgery. ICC and the concordance correlation coefficient (ρc) were used to assess the reproducibility between the prospective and recalled scores.

Results

Sixty-six patients responded to Q1 and Q2, and the mean age was 12.9 ± 2.2 years at Q1 and 14.1 ± 2.2 years at Q2. The mean time between Q1 and Q2 was 14.1 ± 2.1 months. Between prospective-IKDC and recall-IKDC, the ICC coefficient was "poor” at 0.32 (CI 0.09 to 0.5) and the ρc was “poor” at 0.4 (CI 0.29 to 0.51). Mean prospective-IKDC was 76.8 ± 23.52 mean recalled-IKDC was 60.4 ± 11.5 (P < 0.0001), while mean difference was -16.3 ± 2.09.

Simple linear regression models showed that Δ-IKDC is independently associated with age at Q1 (R2 = 0.2676; P0.0001)  and prospective-IKDC (R2 = 0.653; P < 0.0001).

Conclusions

Retrospective collection of the Pedi-IKDC score is not reliable and has high recall bias. This should be avoided in children with knee conditions.

Level of evidence

III.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Ahern S, Ruseckaite R, Ackerman IN (2017) Collecting patient-reported outcome measures. Intern Med J 47(12):1454–1457

    Article  PubMed  Google Scholar 

  2. Aleem IS, Duncan J, Ahmed AM, Zarrabian M, Eck J, Rhee J, Clarke M, Currier BL, Nassr A (2017) Do lumbar decompression and fusion patients recall their preoperative status?: A cohort study of recall bias in patient-reported outcomes. Spine 42(2):128–134

    Article  PubMed  Google Scholar 

  3. Allahabadi S, Feeley SE, Lansdown DA, Pandya NK, Feeley BT (2021) Influential articles on pediatric and adolescent anterior cruciate ligament injuries: a bibliometric analysis. Orthop J Sports Med 9(6):23259671211010772

    Article  PubMed  PubMed Central  Google Scholar 

  4. Brusalis CM, Lakomkin N, Suryavanshi JR, Cruz AI Jr, Green DW, Jones KJ, Fabricant PD (2017) Clinical outcome reporting in youth ACL literature is widely variable. Orthop J Sports Med 5(8):2325967117724431

    Article  PubMed  PubMed Central  Google Scholar 

  5. Bryant D, Norman G, Stratford P, Marx RG, Walter SD, Guyatt G (2006) Patients undergoing knee surgery provided accurate ratings of preoperative quality of life and function 2 weeks after surgery. J Clin Epidemiol 59(9):984–993

    Article  PubMed  Google Scholar 

  6. Buckle C, Wainwright AM (2018) A systematic review of long-term patient reported outcomes for the treatment of anterior cruciate ligament injuries in the skeletally immature. J Child Orthop 12(3):251–261

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  7. Dietvorst M, Reijman M, van Groningen B, van der Steen MC, Janssen RPA (2019) PROMs in paediatric knee ligament injury: use the Pedi-IKDC and avoid using adult PROMs. Knee Surg Sports Traumatol Arthrosc 27(6):1965–1973

    Article  CAS  PubMed  Google Scholar 

  8. Fabricant PD, Brusalis CM, Schachne JM, Matava MJ, PLUTO Study Group (2020) Which metrics are being used to evaluate children and adolescents after acl reconstruction? A systematic review. Arthrosc Sports Med Rehabil 2(4):e417–e428

    Article  PubMed  PubMed Central  Google Scholar 

  9. Fury MS, Paschos NK, Fabricant PD, Anderson CN, Busch MT, Chambers HG, PLUTO Study Group et al (2021) Assessment of skeletal maturity and postoperative growth disturbance after anterior cruciate ligament reconstruction in skeletally immature patients: a systematic review. Am J Sports Med 13:3635465211008656

    Google Scholar 

  10. Gotlin MJ, Kingery MT, Baron SL, McCafferty J, Jazrawi LM, Meislin RJ (2020) Recall bias in retrospective assessment of preoperative patient-reported American shoulder and elbow surgeons scores in arthroscopic rotator cuff repair surgery. Am J Sports Med 48(6):1471–1475

    Article  PubMed  Google Scholar 

  11. Grassi A, Macchiarola L, Casali M, Cucurnia I, Zaffagnini S (2019) Common scales and checklists in sports medicine research. In: Musahl et al (eds) Basic methods handbook for clinical orthopaedic research, A practical guide and case based research approach. Springer, Heidelberg, pp 437–470

    Chapter  Google Scholar 

  12. Hope D, French J, Pizzari T, Hoy G, Barwood S (2019) Patients undergoing shoulder stabilization procedures do not accurately recall their preoperative symptoms at short- to midterm follow-up. Orthop J Sports Med 7(6):2325967119851084

    Article  PubMed  PubMed Central  Google Scholar 

  13. YaA I, Eltsin AG, Mininkov DS (2021) Validation and cultural adaptation of the Russian version of the Pedi-IKDC questionnaire. Pediatric Traumatol, Orthop Reconstr Surg 9(2):143–151

    Article  Google Scholar 

  14. Iversen MD, von Heideken J, Farmer E, Rihm J, Heyworth BE, Kocher MS (2016) Validity and comprehensibility of physical activity scales for children with sport injuries. J Pediatr Orthop 36(3):278–283

    Article  PubMed  Google Scholar 

  15. Jacobsen JS, Knudsen P, Fynbo C, Rolving N, Warming S (2016) Reproducibility and responsiveness of a Danish Pedi-IKDC subjective knee form for children with knee disorders. Scand J Med Sci Sports 26(12):1408–1414

    Article  CAS  PubMed  Google Scholar 

  16. Jensen J, Hansen CF, Brodersen J, Comins JD, Krogsgaard MR (2021) Are PROMs used adequately in sports research? An analysis of 54 randomized controlled trials with PROMs as endpoint. Scand J Med Sci Sports 31(5):982–990

    Article  PubMed  Google Scholar 

  17. Kocher MS, Smith JT, Iversen MD, Brustowicz K, Ogunwole O, Andersen J, Yoo WJ, McFeely ED, Anderson AF, Zurakowski D (2011) Reliability, validity, and responsiveness of a modified International Knee Documentation Committee Subjective Knee Form (Pedi-IKDC) in children with knee disorders. Am J Sports Med 39(5):933–939

    Article  PubMed  Google Scholar 

  18. Krogsgaard MR, Brodersen J, Jensen J, Hansen CF, Comins JD (2021) Potential problems in the use of patient reported outcome measures (PROMs) and reporting of PROM data in sports science. Scand J Med Sci Sports 31(6):1249–1258

    Article  PubMed  Google Scholar 

  19. Kwong E, Neuburger J, Black N (2018) Agreement between retrospectively and contemporaneously collected patient-reported outcome measures (PROMs) in hip and knee replacement patients. Qual Life Res 27(7):1845–1854

    Article  PubMed  PubMed Central  Google Scholar 

  20. Lin LI-K (2000) A note on the concordance correlation coefficient. Biometrics 56:324–325

    Article  Google Scholar 

  21. Lingard EA, Wright EA, Sledge CB, Kinemax Outcomes Group (2001) Pitfalls of using patient recall to derive preoperative status in outcome studies of total knee arthroplasty. J Bone Joint Surg Am 83(8):1149–1156

    Article  CAS  PubMed  Google Scholar 

  22. Longo UG, Salvatore G, Ruzzini L, Risi Ambrogioni L, de Girolamo L, Viganò M, Facchini F, Cella E, Candela V, Ciccozzi M, Denaro V (2021) Trends of anterior cruciate ligament reconstruction in children and young adolescents in Italy show a constant increase in the last 15 years. Knee Surg Sports Traumatol Arthrosc 29(6):1728–1733

    Article  PubMed  Google Scholar 

  23. Lowe JT, Li X, Fasulo SM, Testa EJ, Jawa A (2017) Patients recall worse preoperative pain after shoulder arthroplasty than originally reported: a study of recall accuracy using the American shoulder and elbow surgeons score. J Shoulder Elbow Surg 26(3):506–511

    Article  PubMed  Google Scholar 

  24. Macchiarola L, Grassi A, Di Paolo S, Pizza N, Trisolino G, Stallone S, Stilli S, Zaffagnini S (2020) The Italian cross-cultural adaptations of the paediatric International Knee Documentation Committee score and the hospital for special surgery paediatric functional activity brief scale are reliable instruments in paediatric population. Knee Surg Sports Traumatol Arthrosc 28(8):2657–2662

    Article  PubMed  Google Scholar 

  25. Marsh J, Bryant D, MacDonald SJ (2009) Older patients can accurately recall their preoperative health status 6 weeks following total hip arthroplasty. J Bone Joint Surg Am 91(12):2827–2837

    Article  PubMed  Google Scholar 

  26. McGraw KO, Wong SP (1996) Forming inferences about some intraclass correlation coefficients. Psychol Methods 1:30–46

    Article  Google Scholar 

  27. Mellor X, Buczek MJ, Adams AJ, Lawrence JTR, Ganley TJ, Shah AS (2020) Collection of common knee patient-reported outcome instruments by automated mobile phone text messaging in pediatric sports medicine. J Pediatr Orthop 40(2):e91–e95

    Article  PubMed  Google Scholar 

  28. Moksnes H, Engebretsen L, Seil R (2016) The ESSKA paediatric anterior cruciate ligament monitoring initiative. Knee Surg Sports Traumatol Arthrosc 24(3):680–687

    Article  PubMed  Google Scholar 

  29. Mouton C, Moksnes H, Janssen R, Fink C, Zaffagnini S, Monllau JC, Ekås G, Engebretsen L, Seil R (2021) Preliminary experience of an international orthopaedic registry: the ESSKA paediatric anterior cruciate ligament initiative (PAMI) registry. J Exp Orthop 8(1):45

    Article  PubMed  PubMed Central  Google Scholar 

  30. Muehlhausen W, Doll H, Quadri N, Fordham B, O’Donohoe P, Dogar N, Wild DJ (2015) Equivalence of electronic and paper administration of patient-reported outcome measures: a systematic review and meta-analysis of studies conducted between 2007 and 2013. Health Qual Life Outcomes 13:167

    Article  PubMed  PubMed Central  Google Scholar 

  31. Murphy MT, Vardi R, Journeaux SF, Whitehouse SL (2015) A patient’s recollection of preoperative status is not accurate one year after arthroplasty of the hip or knee. Bone Joint J 97(B8):1070–1075

    Article  PubMed  Google Scholar 

  32. Noel M, Rabbitts JA, Tai GG, Palermo TM (2015) Remembering pain after surgery: a longitudinal examination of the role of pain catastrophizing in children’s and parents’ recall. Pain 156(5):800–808

    Article  PubMed  PubMed Central  Google Scholar 

  33. Nogaro MC, Abram SGF, Alvand A, Bottomley N, Jackson WFM, Price A (2020) Paediatric and adolescent anterior cruciate ligament reconstruction surgery. Bone Joint J 102(B2):239–245

    Article  PubMed  Google Scholar 

  34. Oak SR, O’Rourke C, Strnad G, Andrish JT, Parker RD, Saluan P, Jones MH, Stegmeier NA, Spindler KP (2015) Statistical comparison of the pediatric versus adult IKDC subjective knee evaluation form in adolescents. Am J Sports Med 43(9):2216–2221

    Article  PubMed  Google Scholar 

  35. Pierce TP, Issa K, Festa A, Scillia AJ, McInerney VK (2017) Pediatric anterior cruciate ligament reconstruction: a systematic review of transphyseal versus physeal-sparing techniques. Am J Sports Med 45(2):488–494

    Article  PubMed  Google Scholar 

  36. Randsborg PH, Adamec D, Cepeda NA, Ling DI (2021) Two-year Recall bias after ACL reconstruction is affected by clinical result. JB JS 6(1):e2000164 (Open access)

    Google Scholar 

  37. Rasmussen CDN, Holtermann A, Jørgensen MB (2018) Recall bias in low back pain among workers: effects of recall period and individual and work-related factors. Spine 43(12):E727–E733

    Article  PubMed  Google Scholar 

  38. Sabatino MJ, Gans CV, Zynda AJ, Chung JS, Miller SM, Wilson PL, Jo CH, Ellis HB (2019) An electronic patient-reported outcomes measurement system in paediatric orthopaedics. J Child Orthop 13(4):431–437

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  39. Self MM, Williams AE, Czyzewski DI, Weidler EM, Shulman RJ (2015) Agreement between prospective diary data and retrospective questionnaire report of abdominal pain and stooling symptoms in children with irritable bowel syndrome. Neurogastroenterol Motil 27(8):1110–1119

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  40. Stepan JG, London DA, Boyer MI, Calfee RP (2013) Accuracy of patient recall of hand and elbow disability on the QuickDASH questionnaire over a two-year period. J Bone Joint Surg Am 95(22):e176

    Article  PubMed  PubMed Central  Google Scholar 

  41. van den Brink M, Bandell-Hoekstra EN, Abu-Saad HH (2001) The occurrence of recall bias in pediatric headache: a comparison of questionnaire and diary data. Headache 41(1):11–20

    Article  PubMed  Google Scholar 

  42. van der Velden CA, van der Steen MC, Leenders J, van Douveren FQMP, Janssen RPA, Reijman M (2019) Pedi-IKDC or KOOS-child: which questionnaire should be used in children with knee disorders? BMC Musculoskelet Disord 20(1):240

    Article  PubMed  PubMed Central  Google Scholar 

  43. Weitz FK, Sillanpää PJ, Mattila VM (2020) The incidence of paediatric ACL injury is increasing in Finland. Knee Surg Sports Traumatol Arthrosc 28(2):363–368

    Article  PubMed  Google Scholar 

  44. Yeoman TFM, Clement ND, Macdonald D, Moran M (2018) Recall of preoperative oxford hip and knee scores 1 year after arthroplasty is an alternative and reliable technique when used for a cohort of patients. Bone Joint Res 7(5):351–356

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  45. Zebis MK, Warming S, Pedersen MB, Kraft MH, Magnusson SP, Rathcke M, Krogsgaard M, Døssing S, Alkjær T (2019) Outcome measures after acl injury in pediatric patients: a scoping review. Orthop J Sports Med 7(7):2325967119861803

    Article  PubMed  PubMed Central  Google Scholar 

  46. Zonneveld LN, McGrath PJ, Reid GJ, Sorbi MJ (1997) Accuracy of children’s pain memories. Pain 71(3):297–302

    Article  CAS  PubMed  Google Scholar 

Download references

Acknowledgements

This manuscript is dedicated to the memory of Dr. Stefano Stilli.

Funding

No funding was received for this work.

Author information

Authors and Affiliations

  1. Clinica Ortopedica E Traumatologica II, IRCCS Istituto Ortopedico Rizzoli, Via Pupilli 1, 40136, Bologna, BO, Italy

    Luca Macchiarola, Massimo Pirone, Alberto Grassi, Nicola Pizza & Stefano Zaffagnini

  2. Dipartimento Di Medicina Clinica E Sperimentale, Università Degli Studi Di Foggia, Foggia, FG, Italy

    Luca Macchiarola

  3. U.O. Ortopedia Pediatrica, IRCCS Istituto Ortopedico Rizzoli, Via Pupilli 1, 40136, Bologna, BO, Italy

    Giovanni Trisolino & Stefano Stilli

Authors
  1. Luca Macchiarola
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Massimo Pirone
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Alberto Grassi
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Nicola Pizza
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Giovanni Trisolino
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Stefano Stilli
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Stefano Zaffagnini
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Luca Macchiarola.

Ethics declarations

Conflict of interest

The authors declare that they have no conflict of interest.

Additional information

Publisher's Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Below is the link to the electronic supplementary material.

Supplementary file1 (PDF 473 KB)

Rights and permissions

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Macchiarola, L., Pirone, M., Grassi, A. et al. High recall bias in retrospective assessment of the pediatric International Knee Documentation Committee Questionnaire (Pedi-IKDC) in children with knee pathologies. Knee Surg Sports Traumatol Arthrosc 30, 3361–3366 (2022). https://doi.org/10.1007/s00167-022-06922-7

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s00167-022-06922-7

Keywords

Search

Navigation