Abstract
We assessed inter-observer agreement on a new comprehensive health status classification system for pre-school children (CHSCS-PS). Prospective assessments of children aged 2–4.9 years at the time of diagnosis of neuroblastoma (stages 3–4, excluding 4S) or Wilms’ tumor (stages II–V) were collected independently from a parent and nurse by self-report during therapy. Responses were used to determine functional status on 10 health domains, as well as an overall disability score. Inter-observer agreement was evaluated by a kappa statistic for agreement about levels within individual domains, and by an intraclass correlation coefficient (ICC) for agreement of overall disability scores. Twenty-four parent/nurse pairs of assessments were collected. Agreement was almost perfect for mobility and self-care, substantial for emotion and pain, and slight for speech. There was high percent agreement for vision, hearing, dexterity, learning and remembering, and thinking and problem solving, but insufficient variability in responses to calculate a kappa statistic. The ICC for overall disability scores between observers was 0.86, indicating strong agreement. Given the need for, and paucity of, instruments for the measurement of health-related quality of life in very young children, these results strongly support further evaluation of the CHSCS-PS.
Similar content being viewed by others
References
A.S. Bradlyn A.K. Ritchey C.V. Harris et al. (1996) ArticleTitleQuality of life research in pediatric oncology Cancer 78 1333–1339
J.W. Varni E.R. Katz M. Seid D.J. Quiggins A. Friedman-Bender (1998) ArticleTitleThe pediatric cancer quality of life inventory-32 (PCQL-32): I. Reliability and validity Cancer 82 1184–1196 Occurrence Handle10.1002/(SICI)1097-0142(19980315)82:6<1184::AID-CNCR25>3.0.CO;2-1
J.G. Trudel M. Rivard P.L. Dobkin J.M. Leclerc P. Robaey (1998) ArticleTitlePsychometric properties of the Health Utilities Index Mark 2 system in paediatric oncology patients. Qual Life Res 7 421–432 Occurrence Handle10.1023/A:1008857920624
Feeny D, Furlong W, Mulhern RK, Barr RD, Hudson MM. A framework for assessing health-related quality of life among children with cancer. Int J Cancer 1999; Suppl 12: 2–9
M. Fekkes N.C.M. Theunissen E. Brugman et al. (2000) ArticleTitleDevelopment and psychometric evaluation of the TAPQOL: A health-related quality of life instrument for 1–5-year-old children. Qual Life Res 9 961–972 Occurrence Handle10.1023/A:1008981603178
Ries LAG, Smith MA, Gurney JG, et al. Cancer Incidence and Survival among Children and Adolescents: United States SEER Program 1975–1995. Bethesda, MD, National Cancer Institute, SEER Program. NIH Pub. No. 99-4649, 1999.
S. Saigal P. Rosenbaum L. Hoult (1998) Conceptual and methodological issues in assessing health-related quality of life in children and adolescents Illustration from studies of extremely low birthweight survivors D Drotar (Eds) Measuring Health-Related Quality of Life in Children and Adolescents: Implications for Research and Practice Lawrence Erlbaum Associates Inc. Mahwah, NJ 151–169
Saigal S, Rosenbaum P, Feeny D, Furlong W. Multi-attribute health status classification system for pre-school children: Final Report to The Medical Research Council of Canada for Grant No. MA 12956. Hamilton, ON, McMaster University, 2000.
R.D. Barr D. Chalmers S. De Pauw W. Furlong S. Weitzman D. Feeny (2000) ArticleTitleHealth-related quality of life in survivors of Wilms’ tumor and advanced neuroblastoma: A cross-sectional study. J Clin Oncol 18 3280–3287
R.D. Barr A. Gonzalez M. Longchong et al. (2001) ArticleTitleHealth status and health-related quality of life in survivors of cancer in childhood in Latin America: A MISPHO feasibility study. Int J Oncol 19 413–421
R.D. Barr T. Simpson A. Whitton B. Rush W. Furlong D.H. Feeny (1999) ArticleTitleHealth-related quality of life in survivors of tumours of the central nervous system in childhood – a preference-based approach to measurement in a cross-sectional study. Eur J Cancer 35 248–255 Occurrence Handle10.1016/S0959-8049(98)00366-9
R.D. Barr C. Petrie W. Furlong M. Rothney D. Feeny (1997) ArticleTitleHealth-related quality of life during post-induction chemotherapy in children with acute lymphoblastic leukemia in remission: An influence of corticosteroid therapy. Int J Oncol 11 333–339
B. Stoskopf S. Saigal P. Rosenbaum L. Hoult W. Furlong D. Feeny (1998) ArticleTitleDevelopment of a pre-school health status classification system Paed Child Health 3 49C
S. Saigal B. Stoskopf P. Rosenbaum L. Hoult W. Furlong D. Feeny (1998) ArticleTitleDevelopment of a multiattribute pre-school health status classification system Pediatr Res 43 228A
L.G. Portney M.P. Watkins (1993) Statistical Measures of Reliability. Foundations of Clinical Research Applications to Practice Appleton & Lange Norwich, Connecticut 496–519
G.M. Brodeur J. Pritchard F. Berthold et al. (1993) ArticleTitleRevisions of the international criteria for neuroblastoma diagnosis, staging, and response to treatment. J Clin Oncol 11 1466–1477 Occurrence Handle1:STN:280:ByyA38bkvVw%3D Occurrence Handle8336186
J.L. Fleiss J. Cohen (1973) ArticleTitleThe equivalence of weighted kappa and the intraclass correlation coefficient as measures of reliability. Educ Psychol Meas 33 613–619
J.R. Landis G.G. Koch (1977) ArticleTitleThe measurement of observer agreement for categorical data. Biometrics 33 159–174 Occurrence Handle1:STN:280:CSiC3srhvFI%3D Occurrence Handle843571
Juniper EF, Guyatt GH, Jaeschke R. How to develop and validate a new health-related quality of life instrument. In: Bert Spilker. Quality of Life and Pharmacoeconomics in Clinical Trials, 2nd ed. Philadelphia, PA: Lippincott-Raven Publishers, 1996, pp. 49–56
D.L. Streiner G.R. Norman (1995) Reliability. Health Measurement Scales: A Practical Guide to their Development and Use EditionNumber2 Oxford University Press Oxford 104–126
W.J. Furlong D.H. Feeny G.W. Torrance R.D. Barr (2001) ArticleTitleThe Health Utilities Index (HUI®) system for assessing health-related quality of life in clinical studies. Ann Med 33 375–384 Occurrence Handle1:STN:280:DC%2BD3MvksFWqtA%3D%3D Occurrence Handle11491197
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Nathan, P., Furlong, W., Horsman, J. et al. Inter-observer agreement of a comprehensive health status classification system for pre-school children among patients with Wilms’ tumor or advanced. Qual Life Res 13, 1707–1714 (2004). https://doi.org/10.1007/s11136-004-7624-0
Accepted:
Issue Date:
DOI: https://doi.org/10.1007/s11136-004-7624-0