Development of a self-report measure of capability wellbeing for adults: the ICECAP-A
- First Online:
- Cite this article as:
- Al-Janabi, H., N Flynn, T. & Coast, J. Qual Life Res (2012) 21: 167. doi:10.1007/s11136-011-9927-2
- 2.3k Downloads
The benefits of health and social care are not confined to patient health alone and therefore broader measures of wellbeing may be useful for economic evaluation. This paper reports the development of a simple measure of capability wellbeing for adults (ICECAP-A).
In-depth, informant-led, interviews to identify the attributes of capability wellbeing were conducted with 36 adults in the UK. Eighteen semi-structured, repeat interviews were carried out to develop a capability-based descriptive system for the measure. Informants were purposively selected to ensure variation in socio-economic status, age, sex, ethnicity and health. Data analysis was carried out inductively and iteratively alongside interviews, and findings were used to shape the questions in later interviews.
Five over-arching attributes of capability wellbeing were identified for the measure: “stability”, “attachment”, “achievement”, “autonomy” and “enjoyment”. One item, with four response categories, was developed for each attribute for the ICECAP-A descriptive system.
The ICECAP-A capability measure represents a departure from traditional health economics outcome measures, by treating health status as an influence over broader attributes of capability wellbeing. Further work is required to value and validate the attributes and test the sensitivity of the ICECAP-A to healthcare interventions.
KeywordsCapability approachHealth economicsOutcome measurementQuality of lifeQualitative research
ICEpop CAPability measure for adults
Investigating choice experiments for the preferences of older people
Systematic comparison of the costs and benefits of healthcare interventions through economic evaluation is now a routine element of the healthcare decision-making process . In healthcare, standard welfare economics, which would require benefits to be valued in monetary terms, is generally eschewed in favour of measuring the value of healthcare in terms of its contribution to health status and length of life. Length and quality of life can be combined to generate quality adjusted life years (QALYs) [2, 3]. Although QALYs have the advantage of measuring health benefits from interventions across a diverse range of clinical areas on a common scale, there is increasing concern that the health status measures that underpin QALYs are not sufficiently sensitive or appropriate to the objectives in a number of areas of healthcare, such as mental health , social care  and public health  and for certain groups, such as older people , those near death  and carers . Healthcare policy in these areas may be geared towards helping individuals maintain independence, dignity, comfort or social interaction [10, 11], and these benefits may be neglected by solely using measures of health gain. A simple generic measure of wellbeing, which goes beyond health, may therefore be useful for comparing the benefits of a diverse range of health and social care policies.
Previous work has developed constructs of wellbeing, referred to as psychological wellbeing and based on the psychological literature, finding domains of self-acceptance, positive relations with others, autonomy, environmental mastery, purpose in life and self-growth to be important . Another prominent conception of wellbeing, subjective wellbeing , focuses on measuring and identifying determinants of happiness.
The capability approach is an alternative framework for conceptualising wellbeing for public policy that defines wellbeing in terms of what an individual can ‘do’ and ‘be’ in their life . The approach advocates assessing capability (what an individual can do) rather than functioning (what they actually do) to avoid imposing a particular idea of what a good life constitutes and to reflect the importance of freedom to choose [15, 16]. The paper refers to this notion from this point on as ‘capability wellbeing’. Whilst the capability approach was pioneered in human development research, focusing on basic capabilities such as being able to have shelter and being able to be nourished, there is recognition that measuring more complex capabilities can be useful for public policy [14, 17]. In operationalising the approach, a key challenge is to identify an appropriate set of capabilities and determine how these can be measured to assess outcomes for individuals. Previous work in this area has involved attempts by philosophers to generate lists of capabilities, for example Nussbaum’s list of 10 central human capabilities [18, 19], but these do not reflect the deliberative approach advocated by Sen [16, 19]. An approach focused more on obtaining information about important capabilities from members of the public has previously resulted in the development of a measure of capability wellbeing for older people (the ICECAP-O), which resulted in a measure with five attributes (attachment, security, role, enjoyment, control) . There is no, however, such measure available for the entire adult population, which would be the preferred option for use in economic evaluation.
If, like QALYs, such a measure is to be useful for economic evaluation, there are a number of constraints on the development of the measure . First, there is a need for the measure to be valued using a method whereby the relative importance of different attributes (dimensions) can be ascertained. Such valuation exercises can only cope with relatively small numbers of attributes and levels of those attributes (response categories) within an instrument. Second, there is a need for the measure to cover the entire wellbeing ‘space’ such that all levels of wellbeing from full wellbeing to no wellbeing can be captured.
This paper reports a qualitative study to elicit concepts and develop items for a capability wellbeing measure for the general adult population for use in economic evaluation (ICECAP-A: The ICEpop CAPability measure for Adults). The study aimed to explore, using in-depth interviews, what was important to individuals in their lives to determine a set of conceptual attributes for the capability wellbeing measure (phase 1) (The terminology of “attributes” is used to retain consistency with previous work ). It also aimed to establish meaningful lay terminology for the measure (phase 2). Subsequent work will report the valuation and psychometric testing of the measure.
Informants were selected for interview from four electoral wards in England. Wards were chosen to maximise the socio-economic diversity of the sample (with one ward from each quartile of the national index of multiple deprivation scores ) and to ensure ethnic diversity and representation from both urban and rural areas. A short invitation letter and screening questionnaire were sent to randomly selected individuals within these wards (n = 150 for all wards except the most deprived, where n = 350). For the first phase of interviews, individuals who responded were purposively sampled on the basis of their age, sex, self-perceived health and ethnicity. Younger age groups were less well represented, so three individuals aged under 30 were identified using the ‘snowball’ technique . For the second phase, a sub-sample of informants from the first phase was re-interviewed. Interviewing for both phases continued until saturation  was achieved. Written consent was taken from all informants, and the study protocol was approved by the University of Birmingham’s Life and Health Sciences Ethical Review Committee (ERN_08-93).
Interview conduct for phase 1
In-depth interviews  predominantly in informants’ own homes were used to explore what was important to individuals in their lives. Other people were not present during the interview. Each interview began with a set of straightforward background questions to find out about the informant’s living arrangements, health, family and work. These ‘content mapping’  questions helped to provide the context for the rest of the interview. The questions also led naturally into ‘content mining’ questions to find out more about what informants valued in their lives. If, for example, the informant mentioned the presence of a health problem at the beginning of the interview, this response could be probed in terms of how it affected their life. A topic schedule (see Appendix) was used to ensure that issues such as friendships, religion, social activities, finances and politics were introduced later in the interviews if they did not arise naturally. As the understanding of the underlying attributes of capability wellbeing developed, later interviews tended to pursue fewer issues in more depth and explored the issues that less clearly fitted the emerging attributes of capability wellbeing. All interviews were conducted by HA, except one interview conducted by JC for an informant who wanted a same-sex interviewer.
Interview conduct for phase 2
Data management and analysis
Interviews were digitally recorded and fully transcribed. Analysis was conducted iteratively and inductively, with transcripts being organised into batches of five to eight for analysis. The importance of iterative data collection and analysis for establishing content validity is outlined elsewhere . Each transcript was coded in the ATLAS.ti qualitative data analysis package with codes initially reflecting the set of issues covered in the interviews (see ‘prompts’ in the Appendix) and the emerging understanding about how each of these issues affected capability wellbeing. For subsequent batches of interviews in phase one, the codes used reflected less the specific influences on wellbeing (e.g. work) and more the concepts that could be influenced by multiple factors (e.g. stress). This changing coding framework was used to ensure interview data were organised into themes that represented what was ultimately important in individuals’ lives rather than the external prompts introduced during the discussion. Descriptive accounts, incorporating quotes from interviews and interpretative narrative, were produced for each batch of interviews using the coding framework for phase 1 or phase 2, as appropriate, to organise the quotes. Constant comparative analytic methods  were used to compare extracts across informants, and then to compare these new data to the properties of emerging themes. These themes were developed by the authors and discussed with members of an external advisory group and the study informants prior to further analysis.
Verbatim quotes from informants have been selected to be illustrative of how informants’ accounts were linked to emerging themes. Ellipses (…) are used to denote missing speech; ‘umm’, ‘err’ and repeats of words, which do not add to meaning, are removed without the use of ellipsis. Square brackets are used to clarify informants’ meaning.
Characteristics of study informants
Interviewed for phase one (n = 36)
Interviewed for phase two (n = 18)
Health (self reported)
Deprived inner city
Moderately deprived rural
Moderately affluent suburban
Phase 1: the conceptual attributes of the measure
Following the 36 interviews in phase one, five conceptual attributes of capability wellbeing were developed; the meaning of, and key influences on, each attribute is described below.
The capability to have ‘stability’ was affected by a broad range of factors. Poor health (as above), unemployment and crime (and the threat of each of these) were important negative influences. Positive influences included consistent friendships and family groups, guaranteed work, secure finances, home ownership and a strong belief system:
…my health broke down again … which came as a shock… I had to give up work immediately …and it cast a long shadow because it’s always there in the background, you never know when it might jump on you. So you live with uncertainty. [Female, 78]
…whatever religion you are, when you feel horrible inside, you feel sad inside you quickly go back to your God and say “oh God, help me” don’t you? Everybody does that. [Female, 55]
Attachment was strongly related to the presence of a partner, close family and good friends. Poor health and bereavement within the family were cited by a number of informants as factors in bringing them closer to other family members. The notion of feeling supported was not always related to the amount of practical and emotional input received, with (cap)ability to call on support being noted:
At ante-natal classes …six of us really gelled and just became the closest of friends. It was like we’d known each other for years and years and years. … we see each other all of the time and we help each other out which is great. [Female, 32]
I’m not saying I don’t like having them [friends] round in case they’re needed, but whether I would ask for it [help] is slightly different. [Male, 62]
Home ownership, self-employment and, more generally, an individual’s freedom to control their working environment were associated with greater autonomy:
…our privacy, our independence of thought, all those kind of things make you who you are…[Female, 22]
On the other hand, poor health was an important limiting influence on autonomy, for example, through dependence on medication, through to poor health limiting an individual’s ability to carry out basic activities.
…the worst humiliation to me is to be told to stop doing something really. [Male, 86]
Individuals’ ability to achieve appeared to be strongly related to their opportunities to be successful at work, to have a family and to own things. For many individuals, achievement was related to outside interests, particularly voluntary work and sport:
As a Physics Teacher, to do 6 years without any promotion is pretty unusual really because they’re in such short supply. And I was beginning to feel left on the shelf. [Male, 28]
I do like playing …competitive sport… it’s got a bit of an edge …. I suppose through that there’s a bit of an achievement thing and it’s quite nice to be in a team or to be a captain for one of the teams [Male, 29]
A number of informants mentioned periods of their life when they were depressed, felt “down” or were in pain; these were periods of their life that were clearly not enjoyable:
It [TV programme] is wonderful…I’d recorded it over Christmas…And I just thought this is fantastic. So a great deal of pleasure… [Female, 60]
The capability for enjoyment was generated by the presence of families, friends, pets, leisure activities and the countryside in the informants’ lives. Key limiting factors on enjoyment included financial difficulties and poor health:
…obviously it’s [mother’s illness] been hard, it’s been upsetting…and visiting her now isn’t exactly a barrelful of laughs… I guess it’s saddening … [Female, 29]
[The chest infection] just made it miserable for a week or two, I couldn’t get out or about … [Male, 75]
Given that the intention with this work was to develop a measure of personal capability wellbeing that could be used in trials to measure the effectiveness of health and social care interventions, it was judged that issues about the type of world the informant wanted to live in lay outside what was being measured and are in fact are more akin to Sen’s notion of agency wellbeing (concerned with the objectives that a person has reason to promote, even if these do not contribute to their own personal wellbeing) . Issues categorised under this theme were therefore excluded from this measure of personal capability wellbeing, although the findings are being taken forward in other work.
…we’re just not learning anything… I listen to that Guantanamo thing, we’re not giving people a trial …if they’re wicked they should be punished, but everybody, I don’t care who they are or what they’ve done they must have a trial. [Female, 55]
Phase 2: the development of the descriptive system
Wording explored for conceptual attributes
Making own decisions
The final lay terms (conceptual attributes are in parentheses) for the attributes were those where misunderstanding by informants was avoided, and where the meanings informants derived from them were those most closely related to the original conceptual attribute: settled and secure (stability), love, friendship and support (attachment), independence (autonomy), achievement and progress (achievement) and enjoyment and pleasure (enjoyment).
This paper has described the development of a brief, capability wellbeing measure for the general adult population. The measure aims to capture individuals’ freedom to function in five key areas of their life, identified through in-depth interviews. Informants were sampled specifically to ensure wide representation and thus applicability of the final set of capabilities (and the wording). In contrast to much previous work to develop outcome measures for economic evaluation  (although in common with some recent studies [20, 28, 29]), qualitative methods have been used. This approach grounds the attributes in the values and terminology of the general population and ensures that a limited set of items can be generated to cover a broad range of concepts.
This study suggests a similar, yet not identical, list of attributes for adults in general to that for older adults . The attributes of “attachment”, “autonomy” and “enjoyment” are almost identical, albeit with some adjustment in wording, to three attributes in the ICECAP-O measure. The main differences for the ICECAP-A measure were in the “stability” and “achievement” attributes. “Stability” bears a strong similarity to the “security” attribute in ICECAP-O; however, the emphasis on “stability” is on the present (in terms of current feelings of comfort and continuity), as well as the future. Similarly, the “achievement” attribute in ICECAP-A goes beyond the “role” attribute in ICECAP-O, encompassing progressing and excelling in life, concepts that may not stem from having a role. In Nussbaum’s list of central human capabilities , there are three capabilities (“emotions”, “control” and “play”), which are close equivalents to the “attachment”, “autonomy” and “enjoyment” capabilities found in this study. Whilst there are no direct equivalents for “achievement” and “stability”, these issues are also touched on in Nussbaum’s list (e.g. Nussbaum’s concern for security against assault is likely to come into “feeling settled and secure”). The ICECAP-A attributes are also broadly similar to those proposed in the non-capabilities-based wellbeing literature. For example, the ICECAP-A attributes of “attachment” and “autonomy” in ICECAP-A are not dissimilar to Ryff’s  theory-derived dimensions of “positive relations with others” and “autonomy”. Ryff’s dimensions of “purpose in life” and “personal growth” are similar to “achievement” in ICECAP-A, whilst “self-acceptance” has links to “stability”.
The measures that are used in economic evaluation to generate QALYs typically focus on health-related quality of life. These tend to go beyond a strict biomedical definition of health , but there is no consensus on what exactly should be measured. Current measures, such as the EQ-5D  incorporate attributes right across the health spectrum, from specific impairments (pain) and disabilities (mobility) to the impact of poor health on participation in life (usual activities). This raises the concern that health effects may be double counted . Furthermore, health-related quality of life measures focus on selected aspects of participation in life; for example, the AQOL  directly considers the impact of poor health on relationships, whilst the EQ-5D does not. Full use of the capability approach in health economics entails going beyond health to consider an individual’s wellbeing in a broader sense . Focusing on what an individual can be and do in their life does not (conceptually at least) limit the possible ways in which healthcare interventions can impact on an individual’s life. Arguably, by treating health as an influence, it is also less susceptible to double counting both the impairment that health problems cause and the impact that this impairment has on an individual’s life.
In developing the measure, the ability to live in a good or “just” world was important to some respondents. However, it was rejected as a potential attribute for two reasons. First, such a capability is unlikely to be informative when evaluating the benefits of, for example, a new drug or surgical device in a UK context. Second, ‘living in a just world’ might be ‘too important’, in that by dominating all other attributes it cannot be quantitatively valued using proposed econometric techniques .
A key strength in the work is that it drew on both the capability approach and mainstream health economics approach to outcome development. This involved placing an emphasis on public participation in developing the content of the measure [19, 35] but with an end goal of generating a concise outcome measure that can be valued using econometric techniques to obtain a single index value . Furthermore, the iterative nature of the interviews helped ensure face validity and provide information as to respondents’ understanding of the terminology in an efficient manner.
Limitations to the work also need to be discussed. Although a diverse sample of informants was recruited, the three informants that were recruited through snowball sampling were friends of one informant and therefore there may have been less variation in the views of the younger age group in the sample. Furthermore, the sampling strategy excluded those individuals who were not on the electoral register, which will have meant that some individuals on the margins in society (in prisons and institutional care, for example) will have been excluded, as well as those who opted not to be on the electoral register. In common with other qualitative studies, one cannot be sure that different researchers would not come up with different attributes. However, the influence of a single researcher was minimised by the checking of findings with the broader research team and with informants themselves. In general, further testing of the measure’s reliability and validity will be important if it is to be a credible outcome measure for use in trials and economic evaluations. Preliminary work is underway to use tests of association with socio-economic variables  to explore construct validity and think-aloud interviews  to explore the completion processes for the measure. The latter will allow further investigation of the degree to which individuals think about their freedoms in life (rather than simply their functionings) when they respond to the questions. Finally, one concern is that because the measure focuses on an individual’s capability wellbeing in broader sense, the measure will be less sensitive than measures of generic health. This clearly merits consideration, but it is an issue that can only be explored through using the measure in a variety of health and social care settings.
In conclusion, this work has generated a measure to assess health and social care interventions in terms of their impact on an individual’s “capability to do and be the things that are deemed valuable in their life”. Further research will be conducted to generate index values for use with the measure using best-worst scaling . Work is also required to further assess the acceptability and appropriate application of the approach; such work could proceed through interviews with potential users of the measure and healthcare decision-makers. Potentially, however, the ICECAP-A measure provides a useful step forward in the development of measures of broader wellbeing for comparing the effectiveness and cost-effectiveness of the increasingly diverse array of health and social care interventions.
The authors would like to thank all the informants who participated in the study and Rhiannon Tudor-Edwards for comments on an earlier draft of the manuscript, presented to the Health Economists Study Group at the London School of Economics in January 2010. The authors would also like to thank the members of the external project advisory group (Richard Smith, Paul Anand, Cindy Billingham, Sarah Byford, Richard Holland, Will Hollingworth, Jeremy Horwood, Emily Lancsar, Paula Lorgelly, Emma McIntosh, Chris Salisbury) and the wider ICECAP-A project team (John Brazier, Stirling Bryan, Sam Clemens and Tim Peters) for their input into the work. This work was supported by the Medical Research Council [grant number G0701027].
This article is distributed under the terms of the Creative Commons Attribution Noncommercial License which permits any noncommercial use, distribution, and reproduction in any medium, provided the original author(s) and source are credited.