Skip to main content

Advertisement

SpringerLink
Log in

Establishing construct validity for the thyroid-specific patient reported outcome measure (ThyPRO): an initial examination

  • Published:
Quality of Life Research Aims and scope Submit manuscript

Abstract

Objective

To establish a reliable and valid scale structure of a patient-reported outcome measuring thyroid-specific quality of life.

Methods

The 98-item ThyPRO questionnaire was administered to patients with benign thyroid diseases at two university hospitals. Multi-trait scaling was performed, evaluating lack of convergent validity (item-own scale polyserial correlation <0.40) or lack of discriminant validity (item-other scale correlation higher than item-own scale correlation) of the hypothesized scale structure. Analyses were repeated in clinical and sociodemographic subgroups and with Pearson correlations. Reliability was estimated by Cronbach’s α, both conventionally and with polychoric correlations.

Results

In total, 904 patients (69%) responded. Initial multitrait scaling analysis identified 25 scaling errors. Twelve items were omitted from the scale structure, and a re-analysis showed complete convergent validity and only two instances of lack of discriminant validity. Pearson correlations yielded similar results. Across all subgroups, convergent validity was complete, and discriminant validity was found in 99.2% of tests. Lack of discriminant validity was mainly between physical symptoms and psychological and disease-impact scales. Cronbach’s α was acceptable (>0.70, >0.80 with polychoric correlations) for all 13 scales.

Conclusion

A reliable scale structure displaying complete convergent and almost complete discriminant validity was established in general analyses and in distinct clinical subgroups of patients with benign thyroid diseases.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Log in via an institution

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Fig. 1
Fig. 2

Similar content being viewed by others

References

  1. Watt, T., Groenvold, M., Rasmussen, A. K., Bonnema, S. J., Hegedüs, L., Bjorner, J. B., et al. (2006). Quality of life in patients with benign thyroid disorders. A review. European Journal of Endocrinology, 154, 501–510. doi:10.1530/eje.1.02124.

    Article  PubMed  CAS  Google Scholar 

  2. Fahrenfort, J. J., Wilterdink, A. M., & van der Veen, E. A. (2000). Long-term residual complaints and psychosocial sequelae after remission of hyperthyroidism. Psychoneuroendocrinology, 25(2), 201–211. doi:10.1016/S0306-4530(99)00050-5.

    Article  PubMed  CAS  Google Scholar 

  3. Terwee, C. B., Gerding, M. N., Dekker, F. W., Prummel, M. F., & Wiersinga, W. M. (1998). Development of a disease specific quality of life questionnaire for patients with Graves’ ophthalmopathy: The GO-QOL. The British Journal of Ophthalmology, 82(7), 773–779. doi:10.1136/bjo.82.7.773.

    Article  PubMed  CAS  Google Scholar 

  4. Terwee, C. B., Gerding, M. N., Dekker, F. W., Prummel, M. F., van der Pol, J. P., & Wiersinga, W. M. (1999). Test–retest reliability of the GO-QOL: A disease-specific quality of life questionnaire for patients with Graves’ ophthalmopathy. Journal of Clinical Epidemiology, 52(9), 875–884. doi:10.1016/S0895-4356(99)00069-4.

    Article  PubMed  CAS  Google Scholar 

  5. Terwee, C. B., Dekker, F. W., Mourits, M. P., Gerding, M. N., Baldeschi, L., Kalmann, R., et al. (2001). Interpretation and validity of changes in scores on the Graves’ ophthalmopathy quality of life questionnaire (GO-QOL) after different treatments. Clinical Endocrinology, 54(3), 391–398. doi:10.1046/j.1365-2265.2001.01241.x.

    Article  PubMed  CAS  Google Scholar 

  6. Tehrani, M., Krummenauer, F., Mann, W. J., Pitz, S., Dick, H. B., & Kahaly, G. J. (2004). Disease-specific assessment of quality of life after decompression surgery for Graves’ ophthalmopathy. European Journal of Ophthalmology, 14(3), 193–199.

    PubMed  CAS  Google Scholar 

  7. Jaeschke, R., Guyatt, G., Gerstein, H., Patterson, C., Molloy, W., Cook, D., et al. (1996). Does treatment with L-thyroxine influence health status in middle-aged and older adults with subclinical hypothyroidism? Journal of General Internal Medicine, 11(12), 744–749. doi:10.1007/BF02598988.

    Article  PubMed  CAS  Google Scholar 

  8. Jaeschke, R., Guyatt, G., Cook, D., Harper, S., & Gerstein, H. C. (1994). Spectrum of quality of life impairment in hypothyroidism. Quality of Life Research, 3(5), 323–327. doi:10.1007/BF00451724.

    Article  PubMed  CAS  Google Scholar 

  9. Saravanan, P., Chau, W. F., Roberts, N., Vedhara, K., Greenwood, R., & Dayan, C. M. (2002). Psychological well-being in patients on ‘adequate’ doses of l-thyroxine: results of a large, controlled community-based questionnaire study. Clinical Endocrinology, 57(5), 577–585. doi:10.1046/j.1365-2265.2002.01654.x.

    Article  PubMed  CAS  Google Scholar 

  10. McMillan, C. V., Bradley, C., Woodcock, A., Razvi, S., & Weaver, J. U. (2004). Design of new questionnaires to measure quality of life and treatment satisfaction in hypothyroidism. Thyroid, 14(11), 916–925. doi:10.1089/thy.2004.14.916.

    Article  PubMed  CAS  Google Scholar 

  11. Nunnally, J. C., & Bernstein, I. (1994). Psychometric theory (3rd ed.). New York: McGraw-Hill.

    Google Scholar 

  12. Fayers, P. M., & Machin, D. (2000). Quality of life: Assessment, analysis and interpretation. Chichester: John Wiley and Sons.

    Google Scholar 

  13. Hays, R. D., Hayashi, T., Carson, S., et al. (1988). User’s guide for the multitrait analysis program (MAP). USA: Rand Corporation.

    Google Scholar 

  14. Ware, J. E., Jr, Harris, W. J., Gandek, B., et al. (1997). MAP-R for Windows: Multitrait/multi-item analysis program—revised user’s guide. Boston: Health Assessment Lab.

    Google Scholar 

  15. Campbell, D. T., & Fiske, D. W. (1959). Convergent and discriminant validation by the multitrait-multimethod matrix. Psychological Bulletin, 56(2), 81–105. doi:10.1037/h0046016.

    Article  PubMed  CAS  Google Scholar 

  16. Watt, T., Hegedus, L., Rasmussen, A. K., Groenvold, M., Bonnema, S. J., Bjorner, J. B., et al. (2007). Which domains of thyroid-related quality of life are most relevant? Patients and clinicians provide complementary perspectives. Thyroid, 17(7), 647–654. doi:10.1089/thy.2007.0069.

    Article  PubMed  Google Scholar 

  17. Mullin, P. A., Lohr, K. N., Bresnahan, B. W., & McNulty, P. (2000). Applying cognitive design principles to formatting HRQOL instruments. Quality of Life Research, 9(1), 13–27. doi:10.1023/A:1008923301313.

    Article  PubMed  CAS  Google Scholar 

  18. Watt, T., Rasmussen, A. K., Groenvold, M., Bjorner, J. B., Watt, S. H., Bonnema, S. J., et al. (2008). Improving a newly developed patient-reported outcome for thyroid patients, using cognitive interviewing. Quality of Life Research, 17, 1009–1017. (Online publication ahead of print).

    Article  PubMed  Google Scholar 

  19. Bjorner, J. B., Damsgaard, M. T., Watt, T., & Groenvold, M. (1998). Tests of data quality, scaling assumptions, and reliability of the Danish SF-36. Journal of Clinical Epidemiology, 51(11), 1001–1011. doi:10.1016/S0895-4356(98)00092-4.

    Article  PubMed  CAS  Google Scholar 

  20. Olsson, U., Drasgow, F., & Dorans, N. J. (1982). The polyserial correlation-coefficient. Psychometrika, 47(3), 337–347. doi:10.1007/BF02294164.

    Article  Google Scholar 

  21. Flora, D. B., & Curran, P. J. (2004). An empirical evaluation of alternative methods of estimation for confirmatory factor analysis with ordinal data. Psychological Methods, 9(4), 466–491. doi:10.1037/1082-989X.9.4.466.

    Article  PubMed  Google Scholar 

  22. Millsap, R. E., & Yun-Tein, J. (2004). Assessing factorial invariance in ordered-categorical measures. Multivariate Behavioral Research, 39, 479–515. doi:10.1207/S15327906MBR3903_4.

    Article  Google Scholar 

  23. Drasgow, J. (1986). Polychoric and polyserial correlations. In S. Kotz, N. L. Johnson, & C. B. Read (Eds.), Encyclopedia of statistical sciences. New York: John Wiley and Sons.

    Google Scholar 

  24. Muthen, B. (1984). A general structural equation model with dichotomous, ordered categorical, and continuous latent variable indicators. Psychometrika, 49(1), 115–132. doi:10.1007/BF02294210.

    Article  Google Scholar 

  25. Cronbach, L. J. (1951). Coefficient alpha and the internal structure of tests. Psychometrika, 16, 297–334. doi:10.1007/BF02310555.

    Article  Google Scholar 

  26. Zumbo, B. D., Gadermann, A. M., & Zeisser, C. (2007). Ordinal versions of coefficients alpha and theta for Likert rating scales. Journal of Modern Applied Statistical Methods; JMASM, 6, 21–29.

    Google Scholar 

  27. Fayers, P. M., Hand, D. J., Bjordal, K., & Groenvold, M. (1997). Causal indicators in quality of life research. Quality of Life Research, 6(5), 393–406. doi:10.1023/A:1018491512095.

    Article  PubMed  CAS  Google Scholar 

  28. Fayers, P. M., & Machin, D. (2007). Quality of life: Assessment, analysis and interpretation (2nd ed.). Chichester: John Wiley and Sons.

    Google Scholar 

  29. Abraham-Nordling, M., Torring, O., Hamberger, B., Lundell, G., Tallstedt, L., Calissendorff, J., et al. (2005). Graves’ disease: A long-term quality-of-life follow up of patients randomized to treatment with antithyroid drugs, radioiodine, or surgery. Thyroid, 15(11), 1279–1286. doi:10.1089/thy.2005.15.1279.

    Article  PubMed  CAS  Google Scholar 

  30. Abraham, P., Avenell, A., Watson, W. A., et al. (2004). Antithyroid drug regimen for treating Graves’ hyperthyroidism (Cochrane Review). The Cochrane Library, Issue 3. Chichester, UK: John Wiley & Sons, Ltd.

    Google Scholar 

  31. Joffe, R. T., Brimacombe, M., Levitt, A. J., & Stagnaro-Green, A. (2007). Treatment of clinical hypothyroidism with thyroxine and triiodothyronine: A literature review and metaanalysis. Psychosomatics, 48(5), 379–384. doi:10.1176/appi.psy.48.5.379.

    Article  PubMed  CAS  Google Scholar 

  32. Watt, T., Feldt-Rasmussen, U., Rasmussen, A. K., Hegedus, L., Bonnema, S. J., Gronvold, M., et al. (2008). Measurement of health-related quality of life in thyroid patients. Ugeskrift for Laeger, 170(10), 850–852.

    PubMed  Google Scholar 

  33. van der Linden, W. J., & Hambleton, R. K. (1997). Handbook of modern item response theory. Berlin: Springer.

    Google Scholar 

  34. Edelen, M. O., & Reeve, B. B. (2007). Applying item response theory (IRT) modeling to questionnaire development, evaluation, and refinement. Quality of Life Research, 16(Suppl 1), 5–18. doi:10.1007/s11136-007-9198-0.

    Article  PubMed  Google Scholar 

  35. Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., & Norman, G. R. (2002). Methods to explain the clinical significance of health status measures. Mayo Clinic Proceedings, 77(4), 371–383. doi:10.4065/77.4.371.

    Article  PubMed  Google Scholar 

  36. Crosby, R. D., Kolotkin, R. L., & Williams, G. R. (2004). An integrated method to determine meaningful changes in health-related quality of life. Journal of Clinical Epidemiology, 57(11), 1153–1160. doi:10.1016/j.jclinepi.2004.04.004.

    Article  PubMed  Google Scholar 

  37. Osoba, D., Rodrigues, G., Myles, J., Zee, B., & Pater, J. (1998). Interpreting the significance of changes in health-related quality-of-life scores. Journal of Clinical Oncology, 16(1), 139–144.

    PubMed  CAS  Google Scholar 

  38. Juniper, E. F., Guyatt, G. H., Willan, A., & Griffith, L. E. (1994). Determining a minimal important change in a disease-specific Quality of Life Questionnaire. Journal of Clinical Epidemiology, 47(1), 81–87. doi:10.1016/0895-4356(94)90036-1.

    Article  PubMed  CAS  Google Scholar 

  39. Terwee, C. B., Dekker, F. W., Wiersinga, W. M., Prummel, M. F., & Bossuyt, P. M. (2003). On assessing responsiveness of health-related quality of life instruments: Guidelines for instrument evaluation. Quality of Life Research, 12(4), 349–362. doi:10.1023/A:1023499322593.

    Article  PubMed  CAS  Google Scholar 

  40. Fayers, P. M., & Hand, D. J. (1997). Factor analysis, causal indicators and quality of life. Quality of Life Research, 6(2), 139–150. doi:10.1023/A:1026490117121.

    Article  PubMed  CAS  Google Scholar 

  41. Muthen, B. (1989). Multiple-group structural modelling with non-normal continuous variables. The British Journal of Mathematical and Statistical Psychology, 42, 55–62.

    Google Scholar 

  42. Wilson, I. B., & Cleary, P. D. (1995). Linking clinical variables with health-related quality of life. A conceptual model of patient outcomes. Journal of the American Medical Association, 273(1), 59–65. doi:10.1001/jama.273.1.59.

    Article  PubMed  CAS  Google Scholar 

  43. Sousa, K. H., & Kwok, O. M. (2006). Putting Wilson and Cleary to the test: Analysis of a HRQOL conceptual model using structural equation modeling. Quality of Life Research, 15(4), 725–737. doi:10.1007/s11136-005-3975-4.

    Article  PubMed  Google Scholar 

Download references

Acknowledgements

We wish to express our gratitude to the staffs and colleagues at Rigshospitalet Endocrinological Department PE 2131 and 5201 and Odense University Hospital, Department of Endocrinology and Metabolism. Special thanks go to our research assistants Sara Hope Watt and Alexandra Hegedüs. This study has been supported by grants from the Danish Medical Research Council, Agnes and Knut Mørk’s Foundation, Aase and Ejnar Danielsen’s Foundation, Else and Mogens Wedell-Wedellsborg’s Foundation, the Genzyme Corporation, the Novo Nordisk Foundation and the Danish Thyroid Foundation.

Author information

Authors and Affiliations

  1. Department of Endocrinology, Copenhagen University Hospital Rigshospitalet, Blegdamsvej 9, 2100, Copenhagen Ø, Denmark

    Torquil Watt, Åse Krogh Rasmussen & Ulla Feldt-Rasmussen

  2. Institute of Public Health, University of Copenhagen, Copenhagen, Denmark

    Torquil Watt, Jakob Bue Bjorner & Mogens Groenvold

  3. National Research Centre for the Working Environment, Copenhagen, Denmark

    Jakob Bue Bjorner

  4. Department of Palliative Medicine, Bispebjerg Hospital, Odense University Hospital, Odense, Denmark

    Mogens Groenvold

  5. Department of Endocrinology and Metabolism, Odense University Hospital, Odense, Denmark

    Steen Joop Bonnema & Laszlo Hegedüs

Authors
  1. Torquil Watt
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Jakob Bue Bjorner
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Mogens Groenvold
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Åse Krogh Rasmussen
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Steen Joop Bonnema
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Laszlo Hegedüs
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Ulla Feldt-Rasmussen
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Torquil Watt.

Additional information

Researchers who want to use the ThyPRO may contact the first author (T.Watt@rh.dk).

Rights and permissions

Reprints and permissions

About this article

Cite this article

Watt, T., Bjorner, J.B., Groenvold, M. et al. Establishing construct validity for the thyroid-specific patient reported outcome measure (ThyPRO): an initial examination. Qual Life Res 18, 483–496 (2009). https://doi.org/10.1007/s11136-009-9460-8

Download citation

  • Received:

  • Accepted:

  • Published:

  • Issue Date:

  • DOI: https://doi.org/10.1007/s11136-009-9460-8

Keywords

Search

Navigation