Advertisement

Quality of Life Research

, Volume 24, Issue 8, pp 1921–1937 | Cite as

Item-level informant discrepancies between children and their parents on the PROMIS® pediatric scales

  • James W. Varni
  • David Thissen
  • Brian D. Stucky
  • Yang Liu
  • Brooke Magnus
  • Jason He
  • Esi Morgan DeWitt
  • Debra E. Irwin
  • Jin-Shei Lai
  • Dagmar Amtmann
  • Darren A. DeWalt
Article

Abstract

Objective

The study objective was to describe the individual item-level discrepancies between children ages 8–17 years and their parents for the PROMIS® pediatric scales. Contextual effects on item-level informant discrepancies for the pediatric pain interference items were further analyzed conditional on whether the child, the parent, or anyone else in the household experienced chronic pain.

Methods

Parallel pediatric self-report and parent proxy-report items were completed by approximately 300 parent–child dyads depending on form assignment and individual nonresponse. Agreement between parent and child responses to individual items was measured using the polychoric correlation coefficient and weighted κ. The Chi-square test of symmetry was utilized for a comparison of the pattern of parent–child item discrepancies on the response scales, and the differences between the child and parent responses on the 1–5 item response scale are summarized .

Results

A continuum of higher item-level parent–child discrepancies was demonstrated starting with peer relationships, anger, anxiety, and depressive symptoms, followed by progressively lower parent–child discrepancies for energy, fatigue, asthma impact, pain interference, upper extremity, and mobility items. Parent–child discrepancies for pain interference items were lower in the context of chronic pain either in the child or in the parent.

Conclusions

Parent–child item-level discrepancies were lower for more objective or visible items than for items measuring internal states or less observable items measuring latent variables such as peer relationships and fatigue. Future research should focus on the child and parent characteristics that influence domain-specific item-level discrepancies, and under what conditions item-level parent–child discrepancies predict child health outcomes.

Keywords

PROMIS Patient-reported outcomes Pediatrics Informant discrepancies Item response theory Pain 

Abbreviations

PROMIS

Patient-Reported Outcomes Measurement Information System

HRQOL

Health-related quality of life

PROs

Patient-reported outcomes

NIH

National Institutes of Health

IRT

Item response theory

CAT

Computerized adaptive testing

Notes

Acknowledgments

This work was funded by the National Institutes of Health through the NIH Roadmap for Medical Research, Grant U01AR052181. Information on the Patient-Reported Outcomes Measurement Information System (PROMIS®) can be found at http://nihroadmap.nih.gov/ and http://www.nihPROMIS.org.

References

  1. 1.
    Ader, D. N. (2007). Developing the Patient-Reported Outcomes Measurement Information System (PROMIS). Medical Care, 45(Suppl 1), S1–S2.CrossRefGoogle Scholar
  2. 2.
    Reeve, B. B., Hays, R. D., Bjorner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., et al. (2007). Psychometric evaluation and calibration of health-related quality of life item banks: Plans for the patient-report outcomes measurement information system (PROMIS). Medical Care, 45(Suppl 1), S22–S31.PubMedCrossRefGoogle Scholar
  3. 3.
    Irwin, D. E., Stucky, B. D., Thissen, D., DeWitt, E. M., Lai, J. S., Yeatts, K., et al. (2010). Sampling plan and patient characteristics of the PROMIS pediatrics large-scale survey. Quality of Life Research, 19, 585–594.PubMedCentralPubMedCrossRefGoogle Scholar
  4. 4.
    Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2010). An item response analysis of the pediatric PROMIS anxiety and depressive symptoms scales. Quality of Life Research, 19, 595–607.PubMedCentralPubMedCrossRefGoogle Scholar
  5. 5.
    Varni, J. W., Stucky, B. D., Thissen, D., DeWitt, E. M., Irwin, D. E., Lai, J. S., et al. (2010). PROMIS Pediatric Pain Interference Scale: An item response theory analysis of the pediatric pain item bank. Journal of Pain, 11, 1109–1119.PubMedCentralPubMedCrossRefGoogle Scholar
  6. 6.
    DeWitt, E. M., Stucky, B. D., Thissen, D., Irwin, D. E., Langer, M., Varni, J. W., et al. (2011). Construction of the eight-item patient-reported outcomes measurement information system pediatric physical function scales: Built using item response theory. Journal of Clinical Epidemiology, 64, 794–804.PubMedCentralPubMedCrossRefGoogle Scholar
  7. 7.
    Irwin, D. E., Stucky, B. D., Langer, M. M., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2012). PROMIS Pediatric Anger Scale: An item response theory analysis. Quality of Life Research, 21, 697–706.PubMedCentralPubMedCrossRefGoogle Scholar
  8. 8.
    DeWalt, D. A., Thissen, D., Stucky, B. D., Langer, M. M., DeWitt, E. M., Irwin, D. E., et al. (2013). PROMIS Pediatric Peer Relationships Scale: Development of a peer relationships item bank as part of social health measurement. Health Psychology, 32, 1093–1103.PubMedCrossRefGoogle Scholar
  9. 9.
    Lai, J. S., Stucky, B. D., Thissen, D., Varni, J. W., DeWitt, E. M., Irwin, D. E., et al. (2013). Development and psychometric properties of the PROMIS® pediatric fatigue item banks. Quality of Life Research, 22, 2417–2427.PubMedCrossRefGoogle Scholar
  10. 10.
    Varni, J. W., Magnus, B., Stucky, B. D., Liu, Y., Quinn, H., Thissen, D., et al. (2014). Psychometric properties of the PROMIS® pediatric scales: Precision, stability, and comparison of different scoring and administration options. Quality of Life Research, 23, 1233–1243.PubMedCentralPubMedCrossRefGoogle Scholar
  11. 11.
    Yeatts, K., Stucky, B. D., Thissen, D., Irwin, D. E., Varni, J. W., DeWitt, E. M., et al. (2010). Construction of the Pediatric Asthma Impact Scale (PAIS) for the Patient-Reported Outcomes Measurement Information System (PROMIS). Journal of Asthma, 47, 295–302.PubMedCentralPubMedCrossRefGoogle Scholar
  12. 12.
    Thissen, D., Varni, J. W., Stucky, B. D., Liu, Y., Irwin, D. E., & DeWalt, D. A. (2011). Using the PedsQL™ 3.0 Asthma Module to obtain scores comparable with those of the PROMIS Pediatric Asthma Impact Scale (PAIS). Quality of Life Research, 20, 1497–1505.PubMedCentralPubMedCrossRefGoogle Scholar
  13. 13.
    Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). How young can children reliably and validly self-report their health-related quality of life? An analysis of 8,591 children across age subgroups with the PedsQL™ 4.0 Generic Core Scales. Health and Quality of Life Outcomes, 5(1), 1–13.PubMedCentralPubMedCrossRefGoogle Scholar
  14. 14.
    Varni, J. W., Limbers, C. A., & Burwinkle, T. M. (2007). Parent proxy-report of their children’s health-related quality of life: An analysis of 13,878 parents’ reliability and validity across age subgroups using the PedsQL™ 4.0 Generic Core Scales. Health and Quality of Life Outcomes, 5(2), 1–10.PubMedCentralPubMedCrossRefGoogle Scholar
  15. 15.
    Irwin, D. E., Gross, H. E., Stucky, B. D., Thissen, D., DeWitt, E. M., Lai, J. S., et al. (2012). Development of six PROMIS pediatrics parent proxy-report item banks. Health and Quality of Life Outcomes, 10(22), 1–13.Google Scholar
  16. 16.
    Varni, J. W., Thissen, D., Stucky, B. D., Liu, Y., Gorder, H., Irwin, D. E., et al. (2012). PROMIS® parent proxy report scales: An item response theory analysis of the parent proxy report item banks. Quality of Life Research, 21, 1223–1240.PubMedCentralPubMedCrossRefGoogle Scholar
  17. 17.
    Varni, J. W., Thissen, D., Stucky, B. D., Liu, Y., Magnus, B., Quinn, H., et al. (2014). PROMIS® parent proxy report scales for children ages 5–7 years: An item response theory analysis of differential item functioning across age groups. Quality of Life Research, 23, 349–361.PubMedCentralPubMedCrossRefGoogle Scholar
  18. 18.
    Sprangers, M. A. G., & Aaronson, N. K. (1992). The role of health care providers and significant others in evaluating the quality of life of patients with chronic disease: A review. Journal of Clinical Epidemiology, 45, 743–760.PubMedCrossRefGoogle Scholar
  19. 19.
    Achenbach, T. M., McConaughy, S. H., & Howell, C. T. (1987). Child/adolescent behavioral and emotional problems: Implications of cross-informant correlations for situational specificity. Psychological Bulletin, 101, 213–232.PubMedCrossRefGoogle Scholar
  20. 20.
    Varni, J. W., Katz, E. R., Colegrove, R., & Dolgin, M. (1995). Adjustment of children with newly diagnosed cancer: Cross-informant variance. Journal of Psychosocial Oncology, 13, 23–38.CrossRefGoogle Scholar
  21. 21.
    De Los Reyes, A. (2011). Introduction to the special section: More than measurement error: Discovering meaning behind informant discrepancies in clinical assessments of children and adolescents. Journal of Clinical Child & Adolescent Psychology, 40, 1–9.CrossRefGoogle Scholar
  22. 22.
    Upton, P., Lawford, J., & Eiser, C. (2008). Parent-child agreement across child health-related quality of life instruments: A review of the literature. Quality of Life Research, 17, 895–913.PubMedCrossRefGoogle Scholar
  23. 23.
    Eiser, C., & Varni, J. W. (2013). Health related quality of life and symptom reporting: Similarities and differences between children and their parents. European Journal of Pediatrics, 172, 1299–1304.PubMedCrossRefGoogle Scholar
  24. 24.
    Maurizi, L. K., Gershoff, E. T., & Aber, J. L. (2012). Item-level discordance in parent and adolescent reports of parenting behavior and its implications for adolescents’ mental health and relationships with their parents. Journal of Youth and Adolescence, 41, 1035–1052.PubMedCrossRefGoogle Scholar
  25. 25.
    Drasgow, F. (1986). Polychoric and polyserial correlations. In S. Kotz & N. L. Johnson (Eds.), Encyclopedia of statistical sciences (Vol. 7, pp. 68–74). New York: Wiley.Google Scholar
  26. 26.
    Cohen, J. (1960). A coefficient of agreement for nominal scales. Educational and Psychological Measurement, 20, 37–46.CrossRefGoogle Scholar
  27. 27.
    Cicchetti, D. V., & Allison, T. (1971). A new procedure for assessing reliability of scoring EEG sleep recordings. American Journal of EEG Technology, 11, 101–109.Google Scholar
  28. 28.
    SAS. (2008). SAS/STAT ® 9.2 user’s guide. Cary, NC: SAS Institute Inc.Google Scholar
  29. 29.
    Bowker, A. H. (1948). Bowker’s test for symmetry. Journal of the American Statistical Association, 43, 572–574.PubMedCrossRefGoogle Scholar
  30. 30.
    Rescorla, L. A., Ginzburg, S., Achenbach, T. M., Ivanova, M. Y., Almqvist, F., Begovac, I., et al. (2013). Cross-informant agreement between parent-reported and adolescent self-reported problems in 25 societies. Journal of Clinical Child and Adolescent Psychology, 42, 262–273.PubMedCrossRefGoogle Scholar
  31. 31.
    De Los Reyes, A., Goodman, K. L., Kliewer, W., & Reid-Quinones, K. (2008). Whose depression relates to discrepancies? Testing relations between informant characteristics and informant discrepancies from both informants’ perspectives. Psychological Assessment, 20, 139–149.PubMedCrossRefGoogle Scholar
  32. 32.
    Campo, J. V., Comer, D. M., Jansen-McWilliams, L., Gardner, W., & Kelleher, K. J. (2002). Recurrent pain, emotional distress, and health service use in childhood. Journal of Pediatrics, 141, 76–83.PubMedCrossRefGoogle Scholar
  33. 33.
    Janicke, D. M., Finney, J. W., & Riley, A. W. (2001). Children’s health care use: A prospective investigation of factors related to care-seeking. Medical Care, 39, 990–1001.PubMedCrossRefGoogle Scholar
  34. 34.
    Varni, J. W., & Setoguchi, Y. (1992). Screening for behavioral and emotional problems in children and adolescents with congenital or acquired limb deficiencies. American Journal of Diseases of Children, 146, 103–107.PubMedGoogle Scholar
  35. 35.
    Varni, J. W., Burwinkle, T. M., & Lane, M. M. (2005). Health-related quality of life measurement in pediatric clinical practice: An appraisal and precept for future research and application. Health and Quality of Life Outcomes, 3(34), 1–9.Google Scholar
  36. 36.
    Varni, J. W., Bendo, C. B., Denham, J., Shulman, R. J., Self, M. M., Neigut, D. A., et al. (2014). PedsQL™ gastrointestinal symptoms module: Feasibility, reliability, and validity. Journal of Pediatric Gastroenterology and Nutrition, 59, 347–355.PubMedCrossRefGoogle Scholar
  37. 37.
    Yeh, M., & Weisz, J. R. (2001). Why are we here at the clinic? Parent-child (dis)agreement on referral problems at outpatient treatment entry. Journal of Consulting and Clinical Psychology, 69, 1018–1025.PubMedCrossRefGoogle Scholar
  38. 38.
    Hawley, K. M., & Weisz, J. R. (2003). Child, parent, and therapist (dis)agreement on target problems in outpatient therapy: The therapist’s dilemma and its implications. Journal of Consulting and Clinical Psychology, 71, 62–70.PubMedCrossRefGoogle Scholar

Copyright information

© Springer International Publishing Switzerland 2015

Authors and Affiliations

  • James W. Varni
    • 1
    • 2
  • David Thissen
    • 3
  • Brian D. Stucky
    • 4
  • Yang Liu
    • 3
  • Brooke Magnus
    • 3
  • Jason He
    • 3
  • Esi Morgan DeWitt
    • 5
  • Debra E. Irwin
    • 6
  • Jin-Shei Lai
    • 7
  • Dagmar Amtmann
    • 8
  • Darren A. DeWalt
    • 9
  1. 1.Department of Pediatrics, College of MedicineTexas A&M UniversityCollege StationUSA
  2. 2.Department of Landscape Architecture and Urban Planning, College of ArchitectureTexas A&M UniversityCollege StationUSA
  3. 3.Department of PsychologyUniversity of North Carolina at Chapel HillChapel HillUSA
  4. 4.RAND CorporationSanta MonicaUSA
  5. 5.Department of Pediatrics, Division of RheumatologyCincinnati Children’s Hospital Medical CenterCincinnatiUSA
  6. 6.Department of EpidemiologyUniversity of North Carolina at Chapel HillChapel HillUSA
  7. 7.Department of Medical Social SciencesNorthwestern University Feinberg School of MedicineChicagoUSA
  8. 8.Department of Rehabilitation MedicineUniversity of WashingtonSeattleUSA
  9. 9.Division of General Medicine and Clinical Epidemiology, Cecil G. Sheps Center for Health Services ResearchUniversity of North Carolina at Chapel HillChapel HillUSA

Personalised recommendations