Abstract
Content validity, the extent to which a measurement reflects the specific intended domain of content, is a basic type of validity for a valid measurement. It was usually examined qualitatively and relied on experts’ subjective judgments, not on respondents’ responses. Therefore, the purpose of this study was to introduce and demonstrate how to use quantitative methods to examine the content validity for a certain measurement from respondents’ viewpoint with quantitative methods. In the current study, content validity of the WHOQOL-BREF was examined with quantitative methods among 102 undergraduate students and 128 community adults. They were asked to rate the appropriateness of each item with the four domains of the WHOQOL-BREF respectively and also asked to sort the items into the four domains. Then, three quantitative methods on examining content validity were applied to analyze the rating and sorting data, including (1) proportion of substantive agreement, (2) substantive validity, and (3) ANOVA approach. These results were used to compare with the original content structure of the WHOQOL-BREF, to see if the original structure is consistent with the structure of subjects’ judgments. The results showed that the content structure gained from appropriateness rating and item sorting was not totally consistent with the original content structure of the WHOQOL-BREF. Among 24 items, 12 items did not have adequate content validity. More discussion on these items and the issue of content validity were further provided.
This is a preview of subscription content, log in via an institution to check access.
Similar content being viewed by others
References
Anderson, J. C., & Gerbing, D. W. (1991). Predicting the performance of measures in a confirmatory factor analysis with a pretest assessment of their substantive validities. The Journal of Applied Psychology, 76, 732–740.
Berlim, M. T., Pavanello, D. P., Caldieraro, M. A., & Fleck, M. P. (2005). Reliability and validity of the WHOQOL BREF in a sample of Brazilian outpatients with major depression. Quality of Life Research, 14, 561–564.
Gregory, R. J. (2000). Psychological testing: History, principles, and applications (3rd ed.). Needham Heights: Allyn and Bacon.
Hinkin, T. R., & Tracey, J. B. (1999). An analysis of variance approach to content validation. Organizational Research Methods, 2, 175–186.
Hsiao, Y. Y., Wu, C. H., & Yao, G. (2005). Examining the convergent and discriminant validity of the WHOQOL-BREF using the multitrait-multimethod (MTMM) approach. Poster presented at 12th Annual Conference International Society for Quality of Life Research, San Francisco, CA, USA.
Izutsu, T., Tsutsumi, A., Islam, A., Matsuo, Y., Yamada, H. S., Kurita, H., et al. (2005). Validity and reliability of the Bangla version of WHOQOL-BREF on an adolescent population in Bangladesh. Quality of Life Research, 14, 1783–1789.
Lennon, R. T. (1956). Assumptions underlying the use of content validity. Educational and Psychological Measurement, 16, 294–304.
Skevington, S. M., Lotfy, M., O’Connell, K., & WHOQOL Group. (2003). The World Health Organization’s WHOQOL-BREF quality of life assessment: psychometric properties and results of the international field trial. A report from the WHOQOL group. Quality of Life Research, 13, 299–310.
The WHOQOL Group. (1994). The development of the World Health Organization Quality of Life Assessment Instrument (WHOQOL). In J. Orley, & W. Kuyken (Eds.), Quality of life assessment: International perspectives (pp. 41–57). Berlin: Springer.
The WHOQOL-Taiwan Group. (2001). The user’s manual of the development of the WHOQOL-BREF Taiwan version (1st ed.). Taipei: Institute of Occupational Medicine and Industrial Hygiene, College of Public Health, National Taiwan University.
Trompenaars, F. J., Masthoff, E. D., Van Heck G. L., Hodiamont P. P., & De Vries J. (2005). Content validity, construct validity, and reliability of the WHOQOL-BREF in a population of Dutch adult psychiatric outpatients. Quality of Life Research, 14, 151–160.
Wang, W. C., Yao, G., Tsai, Y. J., Wang, J. D., & Hsieh, C. L. (2006). Validating, improving reliability, and estimating correlation of the four subscales in the WHOQOL-BREF using multidimensional Rasch analysis. Quality of Life Research, 15, 607–620.
Yao, G., Chung, C. W., Yu, C. F., & Wang J. D. (2002). Development and verification of reliability and validity of the WHOQOL-BREF Taiwan version. Journal of the Formosan Medical Association, 101, 342–351.
Yao, G., Lin, M. R., & Wang, J. D. (2000). A comparative study on scale descriptor selection: Heterogeneous group vs. homogeneous group. Chinese Journal of Psychology, 41, 141–153.
Acknowledgment
This study was supported by National Science Council (NSC 94-2413-H-002-018-NSC 95-2413-H-002-002) and National Health Research Institute (NHRI-EX95-9204PP, NHRI-EX96-9204PP)
Author information
Authors and Affiliations
Corresponding author
Rights and permissions
About this article
Cite this article
Yao, G., Wu, Ch. & Yang, Ct. Examining the content validity of the WHOQOL-BREF from respondents’ perspective by quantitative methods. Soc Indic Res 85, 483–498 (2008). https://doi.org/10.1007/s11205-007-9112-8
Received:
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11205-007-9112-8