Background

Socio-economic variations in health, including variations in health according to wealth and income, have been widely reported [14]. However, interventions to overcome socio-economic variations in health have achieved little success[5, 6]. One potential method of improving the health of the most deprived groups is to increase their income. Despite a number of income supplementation experiments – particularly in the USA in the 1960s and 1970s – little investigation of the impact of these experiments on health has been performed[7].

State funded welfare programmes of financial benefits and benefits in kind for, amongst others, the unemployed, the elderly and the sick are common in developed countries. However, there is evidence of widespread under claiming of welfare benefits by those eligible for them, with take up of income related benefits in the UK around 80% in 2002[8]. Take up rates in the rest of Europe are around 40–80% with generally lower rates in the USA[9]. One method of exploring the health effects of income supplementation is, therefore, to measure the health effects of welfare benefit maximisation programmes[7].

Efforts to provide advice on claiming welfare benefits are increasingly being made in the UK[10]. In general, 'welfare rights advice' involves review of eligibility for welfare benefits and active assistance with claims for any benefits to which the client is found to be entitled. Active assistance includes help with completing forms, telephone calls, obtaining letters of support and references, and attendance in person at benefit tribunals. Welfare rights advisors are also often able to offer debt counselling and legal advice, or refer to other appropriate agencies. In the UK, where the majority of welfare rights advice programmes are based, advice is primarily offered through local government, Citizens Advice Bureaux (CAB – a voluntary organisation that "helps people resolve their legal, money and other problems by providing free information and advice"[11] from community locations) or primary care, with clients accessing the services either through self referral, referral from another agency, or a combination of both.

Welfare rights advice services delivered at, or through, primary care premises work within a holistic model of primary health care that "involves continuity of care, health promotion and education, integration of prevention with sick care, a concern for population as well as individual health, community involvement and the use of appropriate technology"[12]. In the UK, all individuals who have been legally resident for at least six months are entitled to be registered with a local primary care practice and receive free treatment there. As over 98% of the population is registered with a primary care practice[13], primary care provides a setting in which the great majority of the population can be accessed.

Given the increasing interest in this area, particularly in the UK, the funding that is now being committed to it by primary care organisations and local authorities, and the opportunity it offers to assess the impact of income supplementation on health, it is timely to bring together the available evidence on the impacts of welfare rights advice delivered in healthcare settings. Two previous reviews have focused on welfare rights advice in healthcare settings[14, 15]. However, neither of these took a systematic approach to literature searching and were primarily descriptions of the different programmes on offer, rather than an assessment of the impacts of these.

We performed a systematic review in order to answer the question: what are the health, social and financial impacts of welfare rights advice delivered in healthcare settings?

Methods

Search strategy

The following strategies were used (by JA) to find and access potentially relevant studies for consideration for inclusion in the review:

1. Searches of electronic databases: the keyword search "(welfare OR benefit OR social welfare OR citizen OR money OR assistance) AND (advice OR right OR prescrip$ OR counsel$)" was used to search the electronic databases listed in Box 1 (see Figure 1) (where $ = wildcard symbol). All available years of all databases were searched up to and including October 2004.

Figure 1
figure 1

Box 1. Electronic databases searched.

2. Hand searches of specific journals: the electronic contents pages of Health and Social Care in the Community (volumes 6–12, 1998–2004), and the Journal of Social Policy (volumes 26–33, 1997–2004) were scanned to identify relevant publications[16]. These journals were chosen because of their relevance to the subject area and the perception that substantial relevant work had been published in them.

3. Searches of internet search engine: searches were made of the internet search engine Google http://www.google.com using the same strategies as above. The first 100 results returned by each search strategy were scanned for relevance and those judged to be potentially relevant followed up.

4. Suggestions from experts and those working in the field: requests for help with accessing relevant literature were sent to relevant e-mail distribution lists (listed in Box 2 – see Figure 2), posted on the rightsnet.org.uk discussion forum and published in the 'trade magazines' Poverty and Welfare Rights Bulletin. 'Experts' – identified as such either by frequent publication in the area, or through personal contacts of the research team – were also contacted directly and asked for help with identifying relevant literature or providing further contacts[17].

Figure 2
figure 2

Box 2. Email distribution lists sent requests for information.

5. Searches of specific websites: the websites of a number of specific organisations that sponsor and conduct social policy research (listed in Box 3 – see Figure 3) were searched to identify publications of interest.

Figure 3
figure 3

Box 3. Websites hand searched for relevant publications.

6. Reference lists from relevant studies: the reference lists of all studies assessed to be relevant were scanned to identify other relevant work, as were the reference lists of previous reviews in this area[14, 15].

7. Science Citation Index and Social Science Citation Index: citation searches of the Science Citation Index and Social Science Citation Index were performed to identify all citations of studies identified as relevant.

8. Author searches: searches for other articles by all authors of articles included in the review were performed in Medline and Health Management Information Consortium (the two databases that provided the greatest number of relevant hits) for all available years up to and including October 2004.

Inclusion and exclusion criteria for studies included in the review

Studies were considered relevant and included in the review if they reported an evaluation of welfare rights advice in a healthcare setting in terms of health, social or financial outcomes. We defined 'welfare rights advice' as expert advice concerning entitlement to and claims for welfare benefits. 'Healthcare settings' were defined as health related buildings – including primary, secondary or tertiary care centres – or where clients were identified through primary, secondary or tertiary care patient lists.

A preliminary scoping review revealed that: there is substantial 'grey literature' in this area; the main study design used is uncontrolled before and after studies; and outcome variables studied vary widely. In order to provide an overview of the wide variety of impacts of welfare rights advice delivered in healthcare settings, we did not restrict our review to any particular outcomes, study design, methods, study population or place of publication (i.e. studies not published in peer reviewed journals were not necessarily excluded). Although searches were conducted in English, no a priori exclusions were made based on the language of publication. However, we did not identify any potentially relevant studies that were not written in English.

The process of determining whether studies should be included in the review was made by one reviewer (JA) in the majority of cases. The review team discussed any cases where doubt concerning inclusion remained after retrieval of reports.

Data abstraction

Data were abstracted from reports and papers ("studies") in the review using a structured proforma. Data collected included: descriptive details of interventions delivered and evaluations performed, and outcome data on all financial, social and health outcomes measured. Data abstraction from each report was performed independently by pairs of reviewers with information entered onto a Microsoft Access database for recording and analysis. In cases where reviewers were found to disagree about the data abstracted, reviewers met to discuss disagreements. If agreement could not be reached, the whole review team was asked to consider the issue and reach a consensus.

Where investigators reported data on the same outcome at a number of different follow up times, information from all follow ups was abstracted and reported. Where information on a number of different outcomes was reported from the same project, information on all outcomes reported was abstracted and the results presented to highlight that these are not independent findings. When we retrieved both an internal report and peer reviewed paper on the same project, both documents were scrutinised and if discrepancies were found, results reported in peer-reviewed journals were used in our assessment.

Assessment of study quality

As the majority of quantitative evaluations of welfare rights advice delivered in healthcare settings use a simple before and after design (6 of 8 studies that reported data on health and social outcomes employed a before and after design, all 29 studies that reported data on financial outcomes employed a before and after design), we felt it inappropriate to assess the quality of studies reported in terms of a formal scoring framework. Instead, we collected information on various aspects of methodology and report this in a descriptive analysis.

As with the quantitative evaluative work in this area, few qualitative studies, or components of studies, identified in the scoping review appeared to meet many of the quality standards for qualitative research that have been proposed[18, 19]. As before, we did not apply any formal framework for determining quality in qualitative work. Instead, information on various aspects of methodology were recorded and are reported descriptively

Analyses and reporting

Given the wide variety of studies that we anticipated including in the review, a formal meta-analysis was not planned and results are reported primarily in a narrative form according, as far as possible, to the schema proposed by Stroup et al (2000) – a checklist of topics that should be covered in meta-analyses of observational studies under the general headings of background, search strategy, methods, results, discussion and conclusions devised by an expert working group (The Meta-analysis Of Observational Studies in Epidemiology (MOOSE) Group)[20].

Ethics and research governance

This review of published and publicly available literature did not require ethical approval.

Results

Search results

Results of electronic database searches for articles, citation searches and author searches are reported in Table 1, Table 2 and Table 3 respectively. Numerous reports were identified by responders to the requests for information. Overall, 55 different studies, considered to meet the inclusion criteria, were included in the review and are summarised in Table 4. Where single reports contained data on two or more projects that differed substantially in design[21, 22], these different projects are reported as separate studies in the results. Table 5 lists those papers and reports retrieved but not included in the review with reasons for exclusion. Only one study included in the review was not UK based[23].

Table 1 results of electronic database searches
Table 2 results of citation searches
Table 3 results of author searches
Table 4 summary of interventions delivered and evaluations performed (studies included in the review)
Table 5 Papers, reports and book chapters retrieved but not included in the review with reasons for exclusion

Interventions delivered

Interventions delivered took a number of different forms. Some identification of who delivered the intervention was reported in 54 (98%) cases. In 30 (55%) instances all or some of the advice was delivered by employees of, or volunteers for, the CAB. In a further 22 (40%) studies all or some of the advice was delivered by welfare rights workers, officers and advisers – sometimes, but not always, explicitly identified as employees of local government.

The location where advice was delivered was reported in 54 (98%) cases. In 31 (57%) instances advice was delivered only in primary care premises such as general practice surgeries or health centres. In a further 16 (29%) cases advice was delivered in primary care premises along with one or more other locations, including clients' homes, hospitals and local CAB. Overall, 18 (33%) studies offered advice within clients' own homes – either exclusively or as an available option.

The referral system by which individuals gained access to the welfare rights advice was reported in 44 (80%) studies. In 32 (73%) studies referral could be from any member of the primary care team, a member of another relevant agency, via self referral from clients or via a combination of these modes. In 11 (25%) studies there were more formal eligibility criteria and invitational processes.

Criteria for who was eligible to receive the welfare rights advice given were reported in 31 (56%) studies. In 14 (45%) studies all patients registered at the general practice or practices participating in the project were eligible to receive advice. In a further 15 (48%) studies some sort of screening or sampling procedure was used to restrict eligibility to certain subgroups of the population – often those suffering from particular conditions or over a certain age. In two cases it was explicitly stated that welfare rights advice was only offered for a limited number of specified benefits (Attendance Allowance and Disability Living Allowance in both cases)[24, 25].

The size of the population eligible to receive the advice given was reported in 17 (31%) studies. Eligible populations ranged in size from 1690 to 313 510 with a median of 23 039.

Health and social outcomes – studies with a comparison or control group

Results from studies that reported the use of a comparison or control group are summarised in Table 6. Of the seven studies with a control or comparison group that reported non-financial outcomes, only one[23] randomly assigned individuals to the intervention or control group.

Table 6 health and social outcomes (validated measurement instruments), studies with a control or comparison group (studies included in the review)

Outcome measures used included the Short Form 36 (SF-36 – a general health scale)[26, 27], the Hospital Anxiety and Depression Scale (HADS – a questionnaire commonly used to screen for anxiety or depression)[28], the Measure Yourself Medical Outcome Profile scale (MYMOP – a patient generated wellbeing scale)[29], the Nottingham Health Profile (NHP – a quality of life scale)[30], and the Edinburgh Post-natal Depression Scale[31], as well as whether or not benefits had been applied for or received, and a variety of measures of use of health services. The size of intervention groups at follow up ranged from 13 to 303 with five studies reporting intervention group sizes at follow up of less than 70. Control or comparison group sizes at follow up ranged from 12 to 311 with five studies having control or comparison group sizes at follow up of less than 51. Follow up periods ranged from six to 12 months.

The majority of studies assessed the effect of the advice by comparing change in scores between baseline and follow up in the control or comparison group with the intervention group. Out of 72 separate comparisons reported, 11 (15%) were statistically significant at the 5% level including comparisons relating to SF36 vitality, SF36 mental health, SF36 bodily pain, SF36 role functioning emotional, SF36 mental health, NHP emotional reactions and the proportion of participants who had both applied for and received an award.

Health and social outcomes – before-and-after study design

The six studies that reported non-financial results using recognised measurement scales and a before-and-after study design are summarised in Table 7. These studies used four different outcome measures – the SF36, HADS, MYMOP and NHP. Sample sizes included in follow up ranged from 22 to 244 with five out of six studies completing follow up on less than 55 individuals. Reported follow up periods ranged from six to 12 months. Out of 59 separate statistical comparisons reported, 6 (10%) were found to be significant – SF36 vitality, SF36 role functioning emotional, SF36 mental health, SF36 general health, NHP pain and NHP emotional reactions. Three studies, including one with a follow up sample size of 244 at six months and 200 at 12 months, reported no statistically significant comparisons at all.

Table 7 Quantitative scalar health outcomes, before and after studies (studies included in the review)

Seven studies reported health and social results using in-house questionnaires with little evidence of validation. These are summarised in Table 8. These studies found consistently high levels of clients agreeing with statements concerning the positive impact of the advice on their health, quality of life and living situations.

Table 8 Quantitative non-scalar health and social outcomes, studies without a control or comparison group (studies included in the review)

Health and social outcomes – qualitative studies

Aspects of the qualitative investigations within studies included in the review are summarised in Table 9. The 14 studies that reported qualitative data collected information from a variety of individuals including those who received advice, advice givers and primary care staff. Sample sizes ranged from six to 41. In 12 of the 14 (86%) studies, data were collected via interviews with participants whilst questionnaires were relied on in two (14%) cases. Six of 12 (50%) studies that reported a rationale for participant selection, gave a theoretical reason for participant selection, rather than reporting that selection was random, opportunistic or just those who responded to a postal questionnaire. The analytical approach used for drawing results from the data was reported in 10 (71%) cases.

Table 9 Quality of qualitative studies (studies included in the review)

Some of the common themes identified in the qualitative results are listed in Box 4 (see Figure 4). Money gained as a result of the advice was commonly reported as being spent on healthier food, avoidance of debt, household bills, transport and socialising. A number of negative issues concerning the advice were raised, primarily by general practitioners. These included the suggestion that the health benefits of increased welfare benefits may be temporary or offset by ongoing, irreversible, health deterioration.

Figure 4
figure 4

Box 4. Common areas identified in qualitative work.

Financial outcomes

Data on either lump sums (generally back dated payments and arrears for the period between claim submission and claim approval) or recurring benefits or both gained as a result of the advice were reported in 28 cases (51%). Financial data from these studies are summarised in Table 10. Although a number of other studies reported some information on financial outcomes, this was often given as a combined figure of both lump sum payments and recurring benefits – making comparisons difficult. Furthermore, the specific benefits gained for clients was inconsistently reported and are not, therefore, reported here. The studies reporting analysable financial data gained a mean of £194 (US$353, €283) lump sum plus £832 (US$1514, €1215) per year in recurring benefits per client seen – a total of £1026 (US$1867, €1498) in the first year following the advice per client seen. As, the number of successful claimants was only reported in 17 (59%) cases where all other financial data were reported, we have not reported gains per successful claimant. As the number of successful claimants is likely to be less than the total number of clients seen, the actual financial benefit to those who successfully claimed is likely to be greater than the figures summarised here. Furthermore, a number of authors stated that their data did not include the outcomes of claims or appeals still pending at the time of reporting, making the definitive amount gained as a result of advice likely to be greater still.

Table 10 Quantitative financial outcomes (studies included in review where data provided)

Discussion

Summary of results

We found 55 studies reporting on the health, social and economic impact of welfare advice delivered in healthcare settings. The majority of these studies were grey literature, not published in peer reviewed journals, and were of limited scientific quality: full financial data were only reported in 50% of cases, less than 10% of studies used a control or comparison group to assess the impact of the advice, and qualitative approaches did not always reflect best practice. Only one study – based in the USA – included in the review was not UK based.

Amongst those studies included in the review, most welfare rights advice was delivered by CAB workers or local government welfare rights officers, most advice was delivered in primary care with around a third of studies offering advice in clients' homes. Few studies had restrictive eligibility criteria or referral procedures.

There was evidence that welfare rights advice delivered in healthcare settings leads to worthwhile financial benefits with a mean financial gain of £1026 per client seen in the year following advice amongst those studies reporting full financial data. This equates to around 9% of average individual gross income in the UK in 1999–2001[32]. However, this is by no means a precise estimate of typical gains: there was considerable variation in the gains reported and many studies identified that their data were incomplete with a number of claims still 'pending'.

Studies that included control or comparison groups tended to use non-specific measures of general health (e.g. SF36, NHP and HADS) and found few statistically significant differences between intervention and control or comparison groups. However, sample sizes were often small and follow up limited to a maximum of 12 months – likely to be too short a period to detect changes in health following changes in financial circumstances. Where statistically significant results were found, these tended to be in relation to measures of psychological or social, rather than physical, health. Qualitative methods were commonly used to assess both clients' and staff's perceptions of the impact of the advice. The advice was generally welcomed with extra money gained as a result of the advice commonly reported as being spent on household necessities and social activities.

Limitations of review methods

The majority of the studies included in this review were grey literature not published in peer reviewed journals and were accessed via requests for information sent to email distribution lists. Although often of limited scientific quality, we included these studies in our review as they often included legitimate data on financial benefits of the intervention and let us describe the current scope of welfare rights advice as far as possible. Because grey literature is not comprehensively indexed, it is hard to be sure that we accessed all that is available, despite our use of a systematic approach to both literature searching and data abstraction[17]. In particular, we collected very little information from non-UK settings, despite sending requests for information to a number of international distribution lists. Whilst welfare rights advice may be rare outside the UK, it is also possible that it is described differently in different contexts and that the vocabulary used in our requests for information had little meaning for those outside the UK. We did not conduct searches of non-English language electronic databases or place posts in other languages to international email distribution lists. These additional techniques may have revealed additional relevant work from outside the UK.

The variations and limitations of methods used by the studies included in this review meant that it was inappropriate to perform formal meta-analysis. Similarly, limitations in data availability prevented us from performing potentially interesting comparisons of the cost of providing welfare rights advice versus the financial benefits gained for clients. The interpretation of our findings and conclusions that can be drawn are, therefore, more subjective than might be the case in other systematic reviews. In order to confirm that we were using the best possible methods, we considered performing our review under the umbrella of one of the evidence and review collaborations. However, there was no obvious appropriate review group within the Cochrane Collaboration for this sort of work. The Campbell Collaboration supports systematic reviews of behavioural, social and educational interventions but were unwilling to consider inclusion of any uncontrolled studies in our review. Although this would undoubtedly have increased the overall quality of studies included, we felt it would have led to a review that was not representative of the evidence base – which is largely of poor scientific quality, as described here. This problem has been previously described[12].

Interpretation of results

Our review supports previous findings that the provision of welfare rights advice in healthcare settings is increasingly common in the UK[14, 15] – although as these are non-statutory services, coverage is inevitable patchy. However, there was also some evidence that similar programmes can be provided in other settings with one study from the USA included in the review[23]. Whilst we have found substantial evidence that welfare rights advice in healthcare settings leads to financial benefits, there is little evidence that the advice leads to measurable health and social benefits. This is primarily due to absence of good quality evidence, rather than evidence of absence of an effect.

Whilst some sort of evaluation of welfare rights advice programmes is commonplace, the scientific rigour of these evaluations appears to be limited. Many of these advice services appear to operate in conditions of limited resources. Although performing some sort of evaluation of their service is frequently a requirement of funding, additional resources to support such evaluation and the skills to conduct it rigorously are scarce.

Implications for policy, practice and research

There is now substantial evidence that welfare rights advice delivered in healthcare settings leads to financial benefits for clients – although typical levels cannot be precisely estimated. There is little need to conduct additional work to determine whether such advice has a financial effect, although further work is required to explore the characteristics of those most likely to benefit financially in order that such advice can be effectively targeted.

As there is little evidence either that welfare rights advice in healthcare settings does or does not have health and social effects, and this remains an intervention with theoretical potential to improve health, there is a need for further studies to examine these effects using robust methods. In particular, future work should: use randomised and controlled approaches; put careful consideration into the outcome measures to be used – general measures of health such as the SF36 may not be able to pick up subtle changes in psychological and social aspects of health; and make efforts to follow up participants over an appropriate time period – as the health and social effects of increased financial resources may take years, rather than months, to become apparent. There has been some discussion concerning the ethics of conducting randomised controlled trials of welfare rights advice interventions as it may be considered unethical to randomise some participants to a control group when there is good reason to believe that the intervention will lead to financial benefit for many participants[33]. However, if the control condition comprises 'usual care' and control group participants are free to seek out welfare rights advice from routine sources should they wish, it is not clear why such trials should necessarily be unethical.

There is also a need for evaluations of the effects of welfare rights advice in healthcare settings outside the UK. All welfare benefits systems are country specific and it can not be assumed that results for one country – such as the majority of those included in this review – are necessarily generalisable internationally. However, many of the conclusions of this review, in terms of how interventions are evaluated, will be applicable internationally.

Conclusion

This review has revealed the poor quality of many evaluations of welfare rights advice in healthcare settings. If firm conclusions about the health and social effects of such advice are to be drawn, future evaluative work should be well resourced and carried out by those with appropriate skills. Those funding such programmes should think carefully about the benefits of requiring evaluations to be performed without providing additional resources and skills – poor quality evaluations could be argued to be a waste of money.

This review confirms that there is a substantial under claiming of welfare benefits amongst those referred to welfare rights advice services and that such services can go some way to resolving under claiming. However, there is currently little evidence of adequate robustness and quality to indicate that such services lead to health improvements.