Abstract
Purpose
To evaluate two psychometric properties of SF-36, namely unidimensionality and reliability.
Methods
The data are from three cohorts in the HALCyon collaborative research programme into healthy ageing: Aberdeen Birth Cohort 1936 (n = 428), Hertfordshire Ageing Study (n = 358) and Hertfordshire Cohort Study (n = 3,216). The Mokken scaling model was applied to each sub-scale of SF-36 to evaluate unidimensionality as indicated by scalability. The lower bound for internal consistency reliability was determined by Cronbach’s alpha.
Results
All six sub-scales of SF-36, with the exception of general health (GH) and mental health (MH), demonstrated strong scalability (0.5 ≤ H < 1). The results were consistent across all 3 cohorts. Both GH and MH showed medium scalability (0.4 ≤ H <0.55), although individual items ‘sick easier..’, ‘as healthy as..’ and ‘expect to get worse’ of the GH sub-scale and ‘nervous’, ‘happy’ in the MH sub-scale had low scalability (H < 0.4) in the oldest cohort (aged 73–83). Cronbach’s alphas for all sub-scales were between 0.70 and 0.92.
Conclusions
The unidimensionality and reliability of the sub-scales of SF-36 are sufficient to make this a useful measure of health-related quality of life in older people. Caution is needed when interpreting the results for GH and MH in the oldest cohort due to the poor unidimensionality.
Avoid common mistakes on your manuscript.
Introduction
The Medical Outcomes Study (MOS) Short-Form General Health Survey (SF-36) is a self-reported multidimensional measure of general health status or quality of life [1]. It produces eight scales of health status: physical functioning (PF), role limitation caused by physical health problems (RP), bodily pain (BP), general health perceptions (GH), vitality (VT) for energy levels and fatigue, social functioning (SF), role limitation because of emotional problems (RE) and mental health (MH). Lower scores on these scales reflect poorer health. The number of items in each sub-scale varies from two (SF and BP) to ten (PF), and therefore, sub-scales such as SF may exhibit more measurement errors than those with more items. Nevertheless, the SF-36 has been tested for use in the United Kingdom [2] and shown considerable evidence for construct validity and reliability of the scores.
The suitability of SF-36 for use in older people is the subject of ongoing discussion due to the relatively poor levels of item response, including the inability to compete SF-36 with increasing age and the relevance of the items to older people [2–4]. Limited research has been done on variations of the psychometric properties of the scores in older people. For instance, if a scale is found to have hierarchical properties, then this indicates that items are ordered relative to one another along the latent trait being measured [5]. This property can also be interpreted as measuring the extent to which items in the scale are measuring the same trait or property (unidimensionality). Researchers have sometimes inappropriately used Cronbach’s alphas to represent unidimensionality [6, 7] when it is known that alpha can take a high value even when the set of items measures several unrelated latent constructs [8, 9]. A non-parametric item response model, known as Mokken scaling, can provide a useful alternative to determine whether hierarchical scales exist in the collection of items and hence obtain a measure of ‘unidimensionality’ [10]. A detailed description of hierarchical properties and the assumptions underlying of Mokken scaling is provided elsewhere [5, 11].
The other characteristic of interest is whether the measurements are precise or internally consistent (reliability). This measures the variation of the test results if the test is repeated under comparable circumstances. Data from the Dutch National Study have been used to examine these properties, but this was for a wide age range of adults using a Dutch version of the scale [11].
HALCyon–Healthy Ageing across the Life Course—is a collaborative research programme using data from up to nine UK narrow age range cohorts to examine how factors across the life course influence healthy ageing in older people. We used data from three of these cohorts to evaluate the unidimensionality and internal consistency (reliability) of the SF-36 sub-scales.
Methods
This study uses data from the Hertfordshire Ageing Study, the Hertfordshire Cohort Study and the Aberdeen Birth Cohort 1936 [12–14] .
The Hertfordshire Ageing Study (HAS)
From 1911 to 1948, details of each birth in Hertfordshire, United Kingdom including birthweight, was recorded by the attending midwife and held in central registers. The National Health Service Central Register was used to trace singleton infants born to married mothers. Those still living in Hertfordshire who had been born between 1920 and 1930 were invited to take part in research into life course influences on ageing [12]. Of 1,428 people invited to participate in the initial study in 1994–1995, 824 (58%) agreed to a home interview and 717 attended a clinic for further assessments. In 2003–2005, a follow-up study was carried out when the participants were aged between 72 and 83 years. In total, 359 men and women (60% of those surviving) were interviewed, during which 349 completed the SF-36.
The Hertfordshire Cohort Study (HCS)
In 1998–2004, men and women born in Hertfordshire between 1931 and 1939 and still living in the county were recruited to a new, larger cohort study in order to evaluate interactions between the genome, the intrauterine and early postnatal environment, and adult diet and lifestyle in the aetiology of chronic disorders in later life [13]. Of 6,099 men and women approached, 3,225 (53%) agreed to be interviewed at home. As part of the interview, 3,215 people completed the SF-36.
The Aberdeen Birth Cohort 1936 (ABC)
On 4 June, 1947, as part of the Scottish Mental Survey, all children born in 1936 who attended school in Scotland sat a test of mental ability, a version of the Moray House Test No. 12. Records of these tests on the 70,805 children who took part were preserved. In 1999–2001, 567 of these people who were living in the Aberdeen area were invited to take part in a study of life course influences on cognitive ageing [14]. Of the 506 (89%) who took part, 429 completed the SF-36.
Statistical methods
The Mokken scaling model, a non-parametric model, was applied to each sub-scale of SF-36 in order to evaluate unidimensionality. The extent to which a set of items is scalable is given by the Loevinger’s coefficient (H), which is a measure of how well the set of items meet the hierarchical criteria of Mokken scales. H will be calculated for individual items in terms of the number of items that violate hierarchical assumptions relative to other items, and an overall H can be calculated for a set of items. The lower bound for reliability was determined by Cronbach’s alpha [11]. Mokken scaling was performed using the module MSP in STATA 10.
Results
Table 1 presents summary statistics of each of the three British cohorts. HAS participants were, on average, 10 years older than the other two cohorts. Compared with the youngest cohort, ABC 1936, HAS participants scored lower on six of the eight sub-scales of the SF-36.
The scalability and reliability coefficients of the sub-scales of SF-36 are given in Table 2. Using established guidelines for interpretation, a Mokken scale of 0.4 ≤ H < 0.5 indicating medium scalability and 0.5 ≤ H < 1 strong scalability [5, 11], then all sub-scales of all cohorts have strong scalability (H > 0.6), with the exception of the GH and MH sub-scales (H < 0.5) in the Hertfordshire cohorts.
In terms of internal consistency (reliability), the Cronbach’s alphas fall between 0.7 and 0.8 for all sub-scales, except for PF (0.92) and RP where they are between 0.90 and 0.92.
Table 3 presents the scalability and reliability of the individual items of SF-36. With the exception of the items in the general health and mental health sub-scales of the oldest cohort (HAS), items in the other sub-scales and for the other cohorts have an H coefficient of greater than 0.4. In particular, across all the cohorts, items in RP, BP and RE exhibited an H coefficient of greater than 0.7. As for the overall results, the Cronbach’s alphas fall between 0.7 and 0.8 for all sub-scales, except for PF (greater than 0.9) and RP (between 0.8 and 0.9) and some items in the GH sub-scale (less than 0.7) especially for the oldest cohort (HAS).
Discussion
To our knowledge, this is the first report of these psychometric properties of SF-36 using data specifically obtained from older people. We found that with the exception of the GH and MH, which showed medium scalability, all other sub-scales demonstrate strong scalability. The results are consistent across all the three cohorts, providing evidence that items in each of the eight sub-scales have measured the same trait or property. There was no evidence of regional differences between Hertfordshire and Aberdeen in terms of unidimensionality.
Individual items ‘I seem to get sick a little easier than other people’, ‘I’m as healthy as anyone I know’ and ‘I expect my health to get worse’ of the general health sub-scale and the ‘have you been a very nervous person’, ‘have you been a happy person’ of the mental health sub-scale have low scalability in the oldest cohort. These items may be modified or removed from the sub-scales for the older population as they may have difficulty in responding to or endorsing these items.
In terms of reliability, the Cronbach’s alphas are high enough for research purposes (between 0.7 and 0.8) for all sub-scales, while for physical functioning (0.92) and role limitation caused by physical health problems (0.90, 0.92) they reach levels high enough for clinical application (decisions about individuals). These results broadly concur with those found from a study using a Dutch language version of SF-36 [11], with the exception that we have also found the reliability of the role physical sub-scale to be high enough for clinical application.
Conclusion
The consistency of our findings across three cohorts supports the usefulness of all the sub-scales for research purposes and suggests that the sub-scales physical functioning and role limitation caused by physical health problems could also be used for clinical purposes. Our results suggest that caution is needed when interpreting results for sub-scales with poor unidimensionality. There is some scope, therefore, for modification of items in the general health and mental health sub-scales of SF-36 for older populations (aged 73+).
References
Ware, J. E., Snow, K. K., Kosinski, M., & Gandek, B. (1993). SF-36 Health survey manual and interpretation guide. Boston: The Health Institute, New England Medical Center.
Brazier, J. E., Harper, R., Jones, N. M., et al. (1992). Validating the SF-36 health survey questionnaire: new outcome measure for primary care. BMJ, 305, 160–164.
Hayes, V., Morris, J., Wolfe, C., & Morgan, M. (1995). The SF-36 health survey questionnaire: is it suitable for use with older adults? Age and Ageing, 24, 120–125.
Parker, S. G., Bechinger-English, D., Jagger, C., Spiers, N., & Lindesay, J. (2006). Factors affecting completion of the SF-36 in older people. Age and Ageing, 35, 376–381.
Watson, R., Deary, I. J., & Shipley, B. (2008). A hierarchy of distress: Mokken scaling of the GHQ-30. Psychological Medicine, 38, 575–579.
McDonald, R. P. (1981). The dimensionality of tests and items. British Journal of Mathematical and Statistical Psychology, 34, 100–117.
Hattie, J. (1985). Methodology review: Assessing unidimensionality of tests and items. Applied Psychological Measurement, 9, 139–164.
Schmitt, N. (1996). Uses and abuses of coefficient alpha. Psychological Assessment, 8, 350–353.
Zinbarg, R., Revelle, W., Yovel, I., & Li, W. (2006). Estimating generalizability to a universe of indicators that all have an attribute in common: A comparison of estimators for omega. Applied Psychological Measurement, 30, 121–144.
Mokken, R. J., & Lewis, C. (1982). Rejoinder to the Mokken scale: A critical discussion. Applied Psychological Measurement, 6, 417–430.
van der Heijden, P. G., van Buuren, S., Fekkes, M., Radder, J., & Verrips, E. (2003). Unidimensionality and reliability under Mokken scaling of the Dutch language version of the SF-36. Quality of Life Research, 12, 189–198.
Syddall, H. E., Simmonds, S. J., Martin, H. J., et al. (2010). Cohort profile: The hertfordshire ageing study (HAS). International Journal of Epidemiology, 39, 36–43.
Syddall, H. E., Aihie, S. A., Dennison, E. M., Martin, H. J., Barker, D. J., & Cooper, C. (2005). Cohort profile: the hertfordshire cohort study. Int J Epidemiology, 34, 1234–1242.
Deary, I. J., Whiteman, M. C., Starr, J. M., Whalley, L. J., & Fox, H. C. (2004). The impact of childhood intelligence on later life: following up the Scottish mental surveys of 1932 and 1947. Journal of Personality and Social Psychology, 86, 130–147.
Acknowledgments
The HALCyon collaborative research programme is funded by the New Dynamics of Ageing (NDA) programme, a joint seven-year initiative of five UK Research Councils. Follow-up of the Aberdeen Birth Cohort 1936 was supported by a Wellcome Trust career development award to Professor L Whalley. The Hertfordshire Cohort Study was funded by the Medical Research Council, the British Heart Foundation, Arthritis Research Campaign, the National Osteoporosis Society, Wellcome Trust and the University of Southampton. The Hertfordshire Ageing Study was funded by the Medical Research Council and the University of Southampton.
Author information
Authors and Affiliations
Consortia
Corresponding author
Rights and permissions
Open Access This is an open access article distributed under the terms of the Creative Commons Attribution Noncommercial License ( https://creativecommons.org/licenses/by-nc/2.0 ), which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.
About this article
Cite this article
Mishra, G.D., Gale, C.R., Sayer, A.A. et al. How useful are the SF-36 sub-scales in older people? Mokken scaling of data from the HALCyon programme. Qual Life Res 20, 1005–1010 (2011). https://doi.org/10.1007/s11136-010-9838-7
Accepted:
Published:
Issue Date:
DOI: https://doi.org/10.1007/s11136-010-9838-7