Background

With the increase in life expectancy and the prevalence of disabilities and comorbidity related to aging, nursing homes (NHs) now play an increasingly important role.

The quality of NHs has attracted a lot of interest in recent years and is one of the most challenging issues for policy-makers. In the NH sector, poor quality represents an issue of public concern and discussions are taking place to address it [14]. The quality of care in NHs is a multidimensional construct that is difficult to define and assess. According to Donabedian’s framework [5], quality is a function of three domains: structure, process, and outcome. Structure is defined by the attributes of the settings in which care is provided, process by the activities of the care-giving practitioners, and outcome by the change in the health status of the patient. Within these three domains, the quality of care can be measured by using the structure, process, and outcome quality indicators.

The use of structural and process indicators for quality management offers several advantages — they are generally easy to measure and interpret and the collected data are often routinely available. However, they might not reflect the level of the quality of care; structural and process indicators indicate the attributes of the NH and what is being done (or is supposed to be done), but they do not automatically translate into a higher quality of care or better outcomes. Therefore, they are ‘necessary but not sufficient’ characteristics and do not necessarily indicate the appropriateness of what is being done [6, 7]. Moreover, the NH context is complex and very little knowledge translation has been carried out to date [810]. Outcome indicators overcome these limitations and are considered to be more closely related to quality. However, they are influenced by the risk level of elderly patients—primarily due to their health status—as well as by the quality of the care process. For these reasons, outcome indicators have to be risk-adjusted [7, 11].

Moreover, in order for structural and process indicators to be valid for NHs in terms of other care settings, they must first demonstrate the ability to generate a better outcome [6]. Specifically, they should be associated with and influence the outcome indicator, for example in terms of variation over time.

These unresolved issues and limitations in the use and interpretation of quality indicators have led to difficulties in assessing the real influence of the structural and process indicators on the prediction of the outcome indicators. Difficulties have also arisen, in general, in the evaluation of the effectiveness of quality indicators and quality systems for improving the quality of care, health status, and quality of life in NHs [1215].

Malnutrition and unintentional weight loss in the NHs are major issues because of their high prevalence, serious health consequences, and related healthcare costs [1620]. Recent studies estimate that 20% of NH residents suffer from some form of malnutrition, the prevalence of which ranges between 1.5 and 66.5%, depending on the definition [17]. Moreover, malnutrition can influence the health status, leading to clinical complications such as impaired immune response, depression, pressure ulcers, falls, and even death [18].

The causes of malnutrition and weight loss in elderly people living in long-term care facilities can be classified as either individual (age, comorbidity) or organizational [21, 22]. For many elderly adults in NHs, aging is accompanied by a progressive physiological and medical decline, which leads to nutritional vulnerability. This in turn can create a progressive feeding dependency. Many organizational factors can negatively affect the assumption of nutritionally adequate diet for such people, thus increasing the likelihood of malnutrition and weight loss. Therefore, nutritional care (i.e. the substances, procedures, and setting involved in ensuring the proper intake and assimilation of nutrients) must be considered an important variable that should be measured from the perspective of quality management by using the related structural, process, and outcome indicators [12, 2226].

The aim of this review is to describe the state of the art with regard to:

  1. 1.

    the use of quality indicators of nutritional care in NHs;

  2. 2.

    the relationship between structural, process, and outcome indicators of nutritional care in NHs.

Methods

The literature search was carried out in four databases—Pubmed, Embase, Scopus, and Web of Science—and was completed with a manual search on the basis of the references given in the selected papers.

While performing the research, a temporal filter was applied in order to select papers published in the last 10 years. Databases were last accessed on 18 February 2016.

The search strategies used in each database are reported in Table 1.

Table 1 Search strategies of systematic review

Two reviewers independently selected papers based on the inclusion criteria. Disagreements were resolved through a consensus meeting in the presence of a third reviewer.

In order to be included, papers had to examine both care quality and nutritional care in the specific setting of NHs; moreover, they had to respond to the aims of this study, namely to describe the use of quality indicators of nutritional care in NHs and/or to assess the relationship between structural, process, and outcome indicators of nutritional care in NHs. All types of studies were included, with the exception of reviews, conference proceedings, editorials, and letters to the editor.

Papers published in languages other than English, Italian and Spanish were excluded.

Figure 1 summarizes the selection process of the articles.

Fig. 1
figure 1

Flow diagram of the study selection [58]

Results

From the database search, 1063 potentially relevant studies were obtained and screened for the presence of all inclusion criteria. Of the 63 studies selected on the basis of title and abstract, 44 were excluded: two because of language of publication, 11 for type of publication (four conference proceedings, three narrative reviews, three editorials, and one letter to the editor), 30 for outcomes (24 not concerning quality aspects, four not reporting quality indicators, and two not concerning nutritional aspects), and one for setting. Ultimately, 19 full-text articles were considered eligible for the final synthesis (Fig. 1).

Table 2 shows the main characteristics of each of the selected papers, including year of publication, country, setting, number of participants, type, and aim of the study. Most of the studies were conducted in the USA or Europe and adopted an observational cross-sectional design. One study [27] combined the Delphi method with an observational design. In two papers, the authors conducted a before/after analysis [28, 29].

Table 2 Main characteristics of selected studies

Seven studies only aimed to measure the prevalence of malnutrition/weight loss (as outcome indicator) and the use of structural or process indicators [20, 27, 3034]. Four others tried to assess both the prevalence of malnutrition and the relationship among the quality indicators [3538]. Five only assessed the relationship between indicators (without describing their prevalence/use) [3943], and three examined the effect of nutritional care interventions on outcome indicators [28, 29, 44].

With regard to the collection of information, the most commonly used instruments were the standardized Landelijke Prevalentiemeting Zorgproblemen (LPZ) questionnaire, the Minimum Data Set (MDS), and the Online Survey, Certification, and Reporting (OSCAR). LPZ is more widely used in European countries and aims to assess malnutrition prevalence. MDS and OSCAR are more common in the American context—the former predicts unplanned weight loss while the latter includes facility-reported data on residents’ characteristics. In some other studies [28, 35, 42, 44], ad hoc instruments were used. In one of them, the ad hoc instrument was improved on the basis of a literature analysis [35]. Hurtado et al. [41] used both standardized instruments and ad hoc questionnaire.

The selected papers show heterogeneity in the considered quality indicators, particularly the structural and process indicators. As regards the outcome indicators, the authors considered the risk of malnutrition (according to Malnutrition Universal Screening Tool), weight loss (according either to MDS or VPSRAC - Victorian Public Sector Residential Aged Care Services - definition), and malnutrition prevalence (according to LPZ questionnaire) (Table 3).

Table 3 Quality indicators of nutritional care reported in the selected papers

Of the19 selected papers, nine studies [29, 3540, 42, 44] examined the influence of structural and process indicators on the outcome indicators (Table 4).

Table 4 Relationship between structural, process and outcome indicators of nutritional care

In four of the studies [35, 39, 40, 43], an individual risk adjustment procedure was applied by using different variables and determining heterogeneity among the different studies. While five studies [29, 3538] showed a significant association between some structural or process indicators and the outcome indicators, said association was found for different structural and process indicators.

Discussion

In this review, we selected 19 papers in the aim of investigating the use of quality indicators of nutritional care in NHs. The selected papers assessed the quality of nutritional care in NHs in general by using several indicators, normally including a mixture of several structural, process, and outcome indicators. Most of the studies used standardized questionnaires or instruments to collect data on quality indicators, either routinely applied at a state level for mandatory reasons (MDS, Victorian Public Sector Residential Aged Care Services [VPSRACS]), or implemented as an annual measurement of malnutrition prevalence and structural quality indicators of nutritional care in the NHs that voluntarily decided to participate to the study (LPZ). As for the outcomes, different indicators were taken into account. However, weight loss was always included, although different combinations of time periods and cut-offs were considered for each instrument. It was evident that no consensus exists on the sets of indicators to be used, especially outcome indicators, even though only a few instruments were used to collect data. Nevertheless, according to our findings, the presence of nutritional screening and its inclusion in the care file, the availability and use of protocols on malnutrition prevention and treatment, mealtime assistance, and the use of nutritional treatment/supplements, all appear to be relevant indicators for nutritional care quality assessment. In any case, studies aimed at testing the reliability and validity of these indicators, as well as the outcome indicators, need to be developed in order to identify the best set of indicators for describing the quality of nutritional care in NHs. This is also in agreement with statements of other authors [45, 46].

Most of the papers aimed to describe the quality of nutritional care in NHs, at times also to compare the data in different geographical areas, settings, or time periods. However, they do not discuss the collected data in terms of good or poor quality with respect to a standard, with the exception of the paper by Hjaltadòttir et al. [27], in which the quality of care in Icelandic NHs was compared with the threshold values that had been determined in the same study. Thresholds for quality indicators could help guide and facilitate progress in the NHs’ quality of care, indicating the potentially poor or good quality of care and improvement goals [27]. Criteria and standards specify the expected outcome, and encourage the performer to progress towards fulfilling them. However, no internationally recognized comprehensive standards are available, although the laws and reforms of long-term care systems in many countries have also included aspects of quality assurance and improvement, such as the setting of minimum requirements as preconditions of licensing and contractual decisions for providers [2, 3]. The lack of internationally recognized standards can be attributed to the complexity of the context of long-term care and the fact that context and residents often differ considerably in the different NHs. Research on threshold values and standards for nutritional care should be encouraged, taking into account the specificity of the setting and the residents as well as the knowledge translation aspects [8].

The prevalence or risk of malnutrition is associated with aspects such as having a policy related to nutritional risk assessment (i.e. screening the subjects for malnutrition, weighing them, assessing and recording nutritional intake) or having suitable scales to weight the residents; when these aspects are present or used in NHs, the prevalence or risk of malnutrition is lower.

In two [36, 37] out of three [3638] articles that investigated the provision of a protein- and energy-enriched diet, or the use of oral nutritional supplementation in case of (expected) malnutrition, this factor was found to be related to malnutrition. Malnutrition is more prevalent in institutions implementing this indicator. Therefore, providing an enriched diet or oral nutritional supplementation seems to be more of an intervention treatment than a preventive one. This hypothesis and the role of screening for malnutrition are both confirmed by the results of the study by Meijers et al. [36]—the only one in which a trend evaluation of the outcome indicator is carried out. In fact, according to the authors, structural screening is the most important indicator of a decrease in the prevalence of malnutrition. In NHs with a higher prevalence of malnutrition, more residents receive oral nutritional supplementation. While the provision of oral nutritional supplementation is associated with a gradual decrease in the prevalence of malnutrition, this drop is more pronounced if the use is lower, probably due to the fact that the group receiving less oral nutritional supplementation is probably in better health [36].

On the other hand, quality indicators related to the staff (i.e. employment of dieticians, malnutrition specialists, person in charge of the malnutrition protocol, or a multidisciplinary malnutrition advisory team, the organization of courses on malnutrition, and staff turnover) do not seem to affect the outcome indicators, with the exception of the ‘presence of at least one nurse in the ward specialized in the area of malnutrition’ in one of the papers by Van Nie et al. [37] and ‘receiving at least [three] hours/day of nursing assistant care’ in the study by Dyck et al. [39]. Consequently, the presence of a staff member with competencies in nutritional aspects and specific education or training is related to malnutrition risk in just one study, where it only concerns the presence of nurses with specific competencies in the area of malnutrition. This result is in line with the results of two reviews regarding staffing and the various aspects of the quality of care in NHs [13, 47].

Regarding the relationship between indicators, we have also included risk adjustment to control individual risk in our assessment, in order to generalize the results for residents with different levels of disabilities and comorbidities. The need for individual risk adjustment in the assessment of quality of care in NHs has emerged simultaneously with the growing attention to quality in healthcare, but only a few authors have considered this factor to avoid a biased use of quality indicators [11, 48]. Individual risk adjustment has yielded better results in terms of validity and comparability, since NH residents are quite dissimilar [3, 7, 4954]. In our review, only four papers [35, 39, 40, 43] out of nine included risk adjustment, which could limit the comparability of the results. Risk adjustment should also be taken into account when identifying the thresholds for quality indicators in order to control the cut-off levels for individual risk.

Eight [3540, 42, 43] of the nine articles describe the results obtained through a cross-sectional or ecological approach. One cross-sectional study includes a sample at the time of ascertainment, selected without any reference to exposure or health outcome (disease status or other condition of interest, such as risk of a disease). Exposure is determined simultaneously with the health condition, and different exposure subpopulations are compared with respect to their health status to assess correlation or association between exposure and outcome. Such studies have difficulty determining the chronological order of events (i.e. the beginning of the exposure and the onset of a health condition). Due to this limitation, it is not possible to work out whether an association between exposure and outcome demonstrated in a cross-sectional study underlies a cause-effect relationship. The same issue occurs for ecological studies in which the association or the correlation between exposure and health outcome is assessed using groups rather than individuals (the unit of analysis is the group, and the analysis is conducted without considering the individual level) [55]. Cross-sectional, ecological and other descriptive studies are often the initial tentative approaches to new events or conditions for generating a hypothesis for causation (‘hypothesis-generating’ studies). The etiologic hypothesis has to be tested through cohort, case-control, or experimental studies [56, 57]. Therefore, considering the study design of almost all articles included in this review, it is not possible to fully understand the type of relationship (i.e. etiologic or not) between process or structural indicators and outcome indicators.

One article [29] in the sample includes a before-after observational study aimed at evaluating a quality improvement programme that is not described in detail. As a result, when reading the paper it is not possible to understand whether the implemented measures would be able to foresee aspects concerning specific structural or process indicators.

Conclusions

Our findings show that there is an open debate regarding the indicators that could be used to describe the quality of nutritional care in NHs. A consensus must be reached to define a set of indicators and a standard to improve the quality in NHs. For this purpose, studies aimed at testing the reliability and validity of the indicators are encouraged. Moreover, the relationships among structural, process, and outcome indicators are a matter of challenge. According to our results, while the prevalence or risk of malnutrition is associated with aspects such as having a policy related to nutritional risk assessment or having suitable scales to weigh the residents, these findings need to be confirmed. In conclusion, there are grounds for investigating this new theme by means of prospective longitudinal studies that also take the risk adjustment into account.