Background

There are numerous studies that explore the relationship between industrial sponsorship of biomedical research and published outcomes [1]. Several reviews have documented how trials funded by industry are more likely to report results in favour of the sponsor’s products [25]. These reviews focused on trials sponsored by the pharmaceutical industry. Few reviews have explored the impact of funding by the food industry on outcomes of research trials [6, 7]. A review by Nkansah et al. also found that majority of trials investigating the effects of calcium supplementation in healthy children were industry funded and all supported calcium supplementation, in favour of the sponsor [8]. Similarly, a review by Lesser et al. found that scientific nutrition related articles (intervention trials, observational studies and scientific reviews) on common consumed beverages (soft drinks, juice, milk) funded by the food industry, were more likely to be favourable to the sponsor than articles that did not have industry funding [6].

Reporting only positive outcomes in a research trial significantly reduces a sponsors’ financial risk. Pressure to show a food product causes favourable outcomes in a specific population, may result in biases in trial design (methodology) and reporting of outcomes in industry sponsored research. This type of bias in nutrition research could adversely affect public health. Results from nutrition research also influence policy formulation, professional dietary guidelines, design of public health interventions and regulation of food product health claims. In addition, findings from nutrition research often receive publicity from the media, which influences consumer behaviour [6].

More studies are needed to explore the relationship between the food industry and nutrition research [7]. There is little or no information available on the impact of funding by the food industry on trial outcomes and methodological quality of synbiotics, probiotics and prebiotics research in infants. There are no systematic reviews that have explored if sources of funding affects outcomes and methodological quality of randomized controlled trials (RCTs) conducted on infants given probiotics, prebiotics or synbiotics supplemented infant formula.

Probiotics are defined as “live microorganisms” which when administered in adequate amounts may confer a health benefit to the host [9]. The main probiotic organisms that are currently used worldwide belong to the genera Lactobacillus and Bifidobacteria and are found in the gastrointestinal microflora [9]. The probiotics preparations of interest for this review are those added to infant formulas. Prebiotics are non- digestible food ingredients that may benefit the host by selectively stimulating the growth and/or activity of one or a limited number of bacteria in the colon and improving the host’s health [1012]. The most widely studied prebiotics are galactooligosaccharides (GOS), inulin and fructooligosaccharide (FOS) [13, 14]. GOS, FOS and inulin are added to different foods as fat and sugar replacements to improve texture or for their functional benefits [10, 15, 16]. When probiotics and prebiotics are administered simultaneously, the combination is termed Synbiotics.

The aim of this review was to explore whether financial sponsorship by the food industry affects outcomes and methodological quality of trials on synbiotics, probiotics or prebiotics used in infants. Methodological quality may be compromised when insufficient information is provided regarding sequence generation, allocation concealment, blinding, bias introduced from other sources and incomplete outcome reporting.

Objective

The objective of this systematic review was to compare the methodological quality and outcomes of food industry sponsored trials versus non industry sponsored trials with regards to supplementation of synbiotics, probiotics and prebiotics in infant formula.

Hypothesis

The source of funding in research trials using probiotics, prebiotics or synbiotics supplemented formula in infants is associated with outcomes in favour of the sponsor’s products and authors’ conclusions.

Methods

Criteria for considering studies for this review

Types of studies

All randomized controlled trials (RCTs) conducted from 1980 to 2012 (irrespective of language) on synbiotics, probiotics, or prebiotics added to infant formula were included. Study participants were healthy full term infants (>37 weeks gestation or > 2.5 kg birth weight, 0–12 months old), preterm infants (born < 37 weeks gestation), low birth weight (<2.5 kg at birth) and extreme low birth weight infants (<1000 g at birth). Infants were fed either infant formula (preterm or full term formula), mixed feeds (breast milk with infant formula) with added synbiotics, probiotics or prebiotics or conventional infant formula with or without placebo. RCTs were excluded if they included infants with cardiac defects, pulmonary diseases, gastrointestinal diseases, major congenital abnormalities or chromosomal abnormalities. Commentaries, editorials, letters to the editor and studies that were not RCTs were excluded.

Types of outcome

The outcomes included: 1) Source of funding, 2) Methodological quality (Risk of bias), 3) Clinical outcomes in RCTs, 4) Conclusions (Overall study conclusions and conclusions on reported clinical outcomes) and 5) Association between source of funding and methodological quality, clinical outcomes and author’s conclusions.

Search methods for identification of studies

A literature search regardless of language was conducted on electronic databases including The Cochrane CENTRAL Register for Controlled Trials (2012), EMBASE (1980+), Scopus (1980 to 2012), EBSCO host (1960 to 2012), PUBMED / MEDLINE (1966 to 2012), OVID (1950 to 2012), SPORTDiscus (1960 to 2012), Web of Science (1970 to 2012), Science Direct (1950 to 2012), CINAHL (1980 to 2012), Science citation index (1970 to 2012), Latin American Caribbean Health Sciences literature (LILACS) (1965 to 2012), NLMGateway (1950–1966). RCTs published in non-English language journals were translated by independent translators who were familiar with the subject matter.

The search strategy used to search PUBMED for studies on full term infants is: (synbiotic* and probiotic* OR prebiotic*) AND (FOS or fructooligosaccharide or inulin or GOS or galactooligosaccharide) AND (infant formula* OR infant feeding OR formula OR formula milk) AND (infant* or baby or babies) NOT (preterm or premature or low birth weight babies or allergy or eczema) AND (randomized controlled trial* OR controlled clinical trial* OR random allocation*) Limits: Humans. This search strategy was modified to search other electronic databases and for studies on preterm infants.

A hand search was conducted on abstracts of major conference proceedings such as the Pediatric Academic Society meetings from 1990 (http://www.pas-meetings.org), cross checked references cited in RCTs and in recent reviews (published from 2003 to 2012) for additional RCTs not identified by electronic searches and speciality journals which were not included in any database such as Pediatrika and Chinese Journal of Microecology. To identify on-going and unpublished trials, experts in the field, manufacturers of infant formula containing probiotics and prebiotics were contacted. Web sites of companies that have conducted or were conducting RCTs on probiotics and prebiotics were searched.

Examples: Pfizer (http://www.pfizerpro.com/clinicaltrials), Chris Hansen Laboratory (http://www.chr-hansen.com/research_development/documentation.html). A search was conducted on prospective trial registries such as World Health Organization (WHO) International Clinical Trials Registry Platform Search Portal (http://www.who.int/trialsearch), Clinical Trials.gov register (http://www.clinicaltrials.gov), Current Controlled Trials metaRegister of Controlled Trials [mRCT] (http://www.controlled-trials.com/mrct) and http://www.clinicaltrialresults.org.

Selection of studies

One reviewer (MM) independently reviewed all abstracts, citations and identified potentially eligible RCTs. The full reports of eligible RCTs were retrieved by one reviewer (MM) and the pre-specified selection criteria applied independently by two reviewers (MM, ML) using a study eligibility form designed for this review. If more than one publication of a study existed, all reports of the study were grouped together under one name. Any disagreements between the reviewers were resolved through discussion. Unresolved disagreements were resolved by a third party (RB).

Data extraction and management

Two reviewers (MM, ML) independently extracted data using a pretested data extraction form that was designed for this review. The reviewers (MM, ML) cross checked data and resolved any differences through discussion. Unresolved disagreements were resolved by a third party (RB). One reviewer (MM) entered the data in SPSS version 19 and the other reviewer (AM) conducted quality control checks. The data obtained from each RCT included:

A) Source of funding or support of RCTs

The source of funding or support of the RCTs was defined and categorized as:

  1. 1)

    Industry included:

    • For – profit company, donation of study product by a for – profit company which manufactured the study product,

    • Not – for profit company that promoted the consumption of synbiotics, probiotics or prebiotics,

    • Mixed sources (for-profit company and other source).

  2. 2)

    Non – industry included:

    • Government: National, regional (provincial, county) government body with NO industry association.

    • Foundation / Philanthropies: examples include Rockefeller foundation, Bill and Melinda Gates foundation.

    • Institution: University, Research centres, teaching and academic hospitals.

    • Other source of funding.

  3. 3)

    None: No source of funding was disclosed in study report.

B) Assessment of methodological quality of evidence (Risk of bias)

Two reviewers (MM, ML) independently assessed the risk of bias of included RCTs as described in the Cochrane Handbook for Systematic Reviews for Interventions according to the following 6 components: 1) sequence generation; 2) allocation concealment; 3) blinding; 4) incomplete outcome data; 5) selective outcome reporting; and 6) other sources of bias [17]. Each domain was assessed as having either a low risk of bias, high risk of bias or unclear to permit judgment. Any disagreements regarding risk of bias were resolved through discussion between MM, ML and RB. The association between risk of bias (domains) and type of funding (industry, non – industry, none declared) was explored.

C) Assessment of clinical outcomes

The primary and secondary outcomes from each study report were evaluated and categorized as:

  1. 1.

    Positive: synbiotic, probiotic or prebiotic supplementation had a statistically significant effect, p < 0.05.

Examples of positive outcomes included: adequate growth (weight gain, length gain, head circumference), tolerance (no feeding problems), microflora (increase in colony forming units of bifidobacteria, lactobacillus, decrease in pathogens), decreased infections (decrease in frequency, incidence of infections).

  1. 2)

    Negative: synbiotic, probiotic or prebiotic supplementation had a statistically significant effect in an adverse event / negative outcome such as weight loss, diarrhoea, p < 0.05

  2. 3)

    Neutral: synbiotic, probiotic or prebiotic supplementation did not have a statistically significant effect, p > 0.05, no significant differences between study groups. Clinical outcomes included: growth parameters, gastrointestinal parameters (tolerance to feed, stool characteristics, microflora); immune response, infections and mortality.

D) Overall study conclusions and conclusions on reported outcomes

The authors’ overall study conclusion and conclusions on reported clinical outcomes were evaluated and categorized as:

  1. 1.

    Positive: The author’s conclusion preferred the sponsor’s products over control/placebo. Interpretation of data supported the sponsor’s products over control.

  2. 2.

    Negative: The sponsors’ products were not preferred over control / placebo. Interpretation of data did NOT support the sponsors’ products.

  3. 3.

    Neutral: The author’s conclusion was neutral to the sponsor’s products.

  4. 4.

    No clear conclusion was offered by author.

In this review, the “conclusions on reported outcomes” referred to the authors’ conclusions on individual reported RCTs outcomes. Examples include conclusions on weight gain, length gain, vomiting, necrotizing enterocolitis, sepsis.

Statistical Analysis

All the outcomes in this review were dichotomous and are described in frequencies and percentages. The association between source of funding (industry/non-industry/ none) and methodological quality (low/unclear/high risk of bias), clinical outcomes and author’s conclusions were assessed using both the Pearson’s Chi-square test and the Fisher’s exact test. A p-value of less than 0.05 was considered statistically significant. SPSS version 19 statistical software was used. A statistician (AM) was consulted throughout the review process.

Ethics

The Human Research Ethics Committee at Stellenbosch University, South Africa reviewed the protocol for this review, ruled that all data to be collected for this review was from the public domain and was therefore exempt from ethical approval.

Results

Results of the search and description of studies

Electronic search of available databases yielded 290 citations. After reading titles and abstracts, duplicate reports were removed, 226 articles were screened and 100 articles were excluded. A hand search yielded 6 more articles. Potentially relevant full text reports were retrieved, reviewed for eligibility and a further 56 RCTs were excluded. Studies that had multiple publications were considered as one trial. Sixty seven RCTs and three on-going RCTs were included in this review. (Table 1) The selection process is shown in Figure 1. Table 2 gives a list of 56 RCTs which were excluded for: use of exclusive breast or non-formula milk (8 RCTs), type of feed not clear (11 RCTs), probiotic administered in saline, water or other fluid (4 RCTs), no use of probiotic or prebiotic (6 RCTs), not RCT (12 studies), different inclusion criteria (10 studies), lack of suitable translator (2 RCTs), data presentation inappropriate (1 RCT) and out of date [published before1980] (2 RCTs). Three excluded RCTs were unpublished trials.

Table 1 Included studies and on-going studies
Figure 1
figure 1

Process of study selection.

Table 2 Table of 56 Excluded studies with reasons for exclusion

Characteristics of included studies

Table 1 lists included and on-going trials. Sixty seven RCTs were included, 45 (67.2%) on full term infants, 22 (32.8%) on preterm infants. All included RCTs were published trials. All trials were conducted on healthy full term or preterm infants and used standard (full term or preterm) infant formula (Table 3).

Table 3 Source of funding and study participants

Funding

Out of 67 trials, 40 (59.7%) were funded by food industry, 11 (16.4%) were funded by non-industry entities, and 16 (23.9%) did not specify their source of funding, 10 RCTs on preterm infants, 6 RCTs on full infants (Table 3).

Methodological quality (Risk of bias)

In this review, several domains were not adequately reported, particularly, the domains of sequence generation, allocation concealment and blinding. Out of 67 RCTs, 25 (37.3%) failed to report sequence generation, 35 (52.2%) failed to report allocation concealment and 36 (53.7%) did not report blinding. Majority of the RCTs were assessed as having a low risk of bias in the domains of incomplete outcome data 52 (77.6%), selective reporting 57(85.1%) and other bias 53 (79.1%) (Table 4).

Table 4 Methodological quality (Risk of bias)

Outcomes and study conclusions

In most RCTs, majority of outcomes were assessed as neutral, (intervention did not have a statistically significant effect, p > 0.05). A total of 49 (73.1%) of RCTs had a positive overall study conclusion in favour of the sponsors’ products, while 7 (10.4%) had negative¸ 7 (10.4%) had neutral conclusions and 4 (6%) had no clear conclusion. The included RCTs either did not provide any conclusion on their reported clinical outcomes or, they provided a positive conclusion for their reported outcome in-favour of the sponsors’ products. Few RCTS had either negative or neutral conclusions on their reported clinical outcomes (Table 5).

Table 5 Reported outcomes and conclusions

Association between source of funding (sponsor) and methodological quality of studies

There was no significant association between the source of funding and the domains of sequence generation (Chi – square p = 0.435, Fisher exact p = 0.465), allocation concealment (Chi – square p = 0.315, Fisher exact p = 0.338), blinding (Chi – square p = 0.395, Fisher exact p = 0.457) and selective reporting (Chi – square p = 0.224, Fisher exact p = 0.188) (Table 6).

Table 6 Association between Sponsor and methodological quality (risk of bias)

There was a significant association between funding and the domains of incomplete outcome data (Chi – square p = 0.023, Fisher exact p = 0.005) and free of other bias (Chi – square p = 0.033, Fisher exact p = 0.038) (Table 6). The association between source of funding and incomplete outcome data was such that industry-funded trials had significantly less missing data than non-industry funded trials. The association between source of funding and free of other bias (such as outcomes bias) was such that a significantly higher percentage of industry-funded trials were free of other bias compared to non-industry-funded trials.

Association between source of funding (sponsor) and clinical outcomes

There was no significant association between source of funding and reporting of clinical outcomes: Growth parameters, stool characteristics, microflora, infections (Tables 7, 8, 9, 10 and 11), immune parameters, adverse events and mortality (data not shown). There was a significant association between the source of funding and reporting of antibiotic use in formula fed infants (Chi-square p = 0.031, Fisher exact p = 0.039) such that industry funded trials were more likely to decrease the use of antibiotics than non-industry funded trials (Table 11).

Table 7 Association between Sponsor and clinical outcomes: Growth
Table 8 Association between Sponsor and clinical outcomes: Tolerance symptoms
Table 9 Association between sponsor and clinical outcomes: stool characteristics
Table 10 Association between sponsor and clinical outcomes: Microflora
Table 11 Association between sponsor and clinical outcomes: Necrotizing enterocolitis, sepsis and antibiotic use

Association between source of funding (sponsor) and overall study conclusion

There was no significant association between sources of funding and overall study conclusion (Chi-square p = 0.505, Fisher exact p = 0.373). Majority of RCTs, 49 (73.1%), had a positive study conclusion; 32 (47.8%) of these RCTs, were industry sponsored, 7 (10.4%) non- industry and 10 (14.9%) which did not declare their source of funding (Table 12). A sensitivity analysis was conducted with respect to combining industry sponsored studies with those that had not declared their source of funding. There was no change in the results. There was no significant association between source of funding and overall study conclusion (Chi-square p = 0.483, Fisher exact p = 0.425).

Table 12 Association between sponsor and OVERALL study conclusion

Association between source of funding (sponsor) and conclusion on reported clinical outcomes

There was a significant association between source of funding and conclusion on weight gain (Chi-square p = 0.037, Fisher exact p = 0.024) such that industry-funded trials were more likely to report positive conclusions on weight gain than non-industry-funded trials (Table 13). There was no significant association between source of funding and conclusion on other reported clinical outcomes (Tables 14, 15, 16 and 17).

Table 13 Association between sponsor and conclusion on reported outcome: Growth parameters
Table 14 Association between sponsor and conclusion on reported outcome: Tolerance symptoms
Table 15 Association between sponsor and conclusion on reported outcome: Stool characteristics
Table 16 Association between sponsor and conclusion on reported outcome: Microflora
Table 17 Association between sponsor and conclusion on reported outcome: Necrotising Enterocolitis Sepsis and antibiotic use

Discussion

This review revealed that majority of RCTs (from 1980 to 2012) on infants fed formula supplemented with probiotics, prebiotics or synbiotics are funded by the food industry. This is consistent with the trend that biomedical research is increasingly being funded by industry [1, 2] There was a trend that more RCTs on preterm infants failed to report their source of funding. The reason(s) for this trend needs to be explored further.

Cochrane guidelines were used to assess the risk of bias of included RCTs. The reporting of several domains was however suboptimal particularly sequence generation, allocation concealment and blinding domains. Considering completed data, there was no significant association between funding source and methodological quality of RCTs in the domains of sequence generation, allocation concealment, blinding and selective reporting. There was a significant association between funding and methodological quality of RCTs in the domains of incomplete outcome data and free of other bias. Industry funded trials had significantly less missing data than non-industry funded trials. A higher percentage of industry funded trials were free of other bias compared to non-industry funded trials. More industry sponsored trials had low risk of bias in 5 out of 6 domains, even though our results did not show a statistical significant association between funding and methodological quality in most domains. Our results confirm findings from previous reviews on infants given enteral feeds with probiotics, prebiotics and synbiotics [157159].

There was no significant association between funding source and clinical outcomes or majority of authors’ conclusions. There was a significant association between funding and conclusion on weight gain. Regardless of the reported clinical outcomes, nearly all RCTs in this review reported neutral results. That is supplementation with probiotics, prebiotics or synbiotics did not have a significant effect or there were no significant differences between study groups of infants given supplemented formula or placebo. Our findings confirm the results of two systematic reviews which found that supplementation with probiotics, prebiotics or synbiotics did not offer any distinct advantage over placebo [158, 159]. However, results of this review did not agree with two nutrition related reviews or reviews on pharmaceutical industry supported RCTs, which reported that industry sponsored RCTs had results and conclusions in favour of the sponsor [24, 6, 8, 160162]. Despite reporting neutral outcomes, authors from industry sponsored RCTs had a tendency to advocate for the consumption of the sponsors’ products. Similar findings were reported by Nestle, who reported that research investigators “who received company grants tended to publish results, give advice and prescribe in favour of the sponsor.” This applied to research that was supported by pharmaceutical and food industries [163].

Effects of sponsorship on overall study conclusion have been equally documented in biomedical literature. Reviews by Lessor and Nkansah reported positive conclusions in favour of the sponsor [6, 8]. Although no statistically significant association between funding and authors conclusion was found in this review, more than 70% of RCTs reported positive conclusions, 47.8% of these were industry sponsored. Often, these positive conclusions in the RCTs were not supported by the reported data as demonstrated by the neutral clinical outcomes. Our findings are consistent with those of previous reviews, which found that, results from RCTs may be accurate, but authors may distort the meaning of the results, present conclusions that are more favourable, and that were not supported by the data presented [2, 5, 163]. Even meta – analyses were not spared from this trend [2, 5, 163]. Despite overwhelming positive overall study conclusions, majority of RCTs did not have any conclusion on their reported clinical outcomes. The RCTs that reported any conclusion on their clinical outcomes, majority were positive in favour of the sponsors’ products.

Limitations

This review did not document the role of the sponsor in study design, data collection, and analysis. Few RCTs reported this. More detailed documentation and disclosure in RCT reports would help evaluate if there was an association between funding and reported outcomes or conclusions. Many RCTs had missing data especially on the domains of sequence generation, allocation concealment and blinding. Attempts were made to contact authors for missing information but none responded. The sample size (number of RCTs) was small and skewed towards industry.

Conclusion

This study assessed the impact of funding by the food industry on trial outcomes and methodological quality of synbiotics, probiotics and prebiotics research in infants. There was no significant association between source of funding and methodological quality of study in the domains of sequence generation, allocation concealment and blinding. Industry funded trials had less missing data and were free of other bias than non-industry funded trials.

There was no significant association between funding and majority of reported clinical outcomes or authors’ conclusions. However, there was a significant association between funding source and reported antibiotic use and conclusion on weight gain. Majority of RCTs were industry funded, more non-industry funded research is needed to further assess the impact of funding on methodological quality, reported clinical outcomes and authors’ conclusions.