Introduction

In all, 3–5% of the population in industrialized countries like Austria and other central European countries, suffer from pollen allergy [1]. According to Zuberbier et al. each untreated pollen allergy sufferer costs the health care system approximately 2400 € per year [2]. Therefore, the potentially one million pollen allergy sufferers in Austria [3] might be responsible for yearly costs amounting to about 2.4 billion € in the health care system. To minimize the socioeconomic impact of allergies due to reduced work force or school performance, doctors now have the possibility to reduce the burden of allergy sufferers by selecting a treatment that works best for each individual patient.

These include symptom-relieving nonsedating H1-antihistamines and topical corticosteroids (control-therapy treatment) as well as the immune-modifying allergen-specific immunotherapy [4]. To approve the efficacy of such classic therapeutic interventions the randomized controlled trial (RCT) is currently the state-of-the-art method [5]. However, these studies are often associated with high costs [6] and drop-out rates even though frequent visits to the trial centres are a prerequisite for such RCTs [7].

In addition to the above-mentioned western medical therapy approaches, a large variety of alternative and/or complementing therapies are available such as acupuncture or food supplements which are used by an increasing number of allergy sufferers [8]. As dietary supplements are classified as food or foodstuff, for complementing the normal human diet, they are regulated by other European and national directives than medicinal products [9]. As the purpose of such supplements is not to cure or prevent diseases, RCTs or similar clinical studies are only required if certain health claims are advertised [10].

In the present study a commonly available dietary supplement, Lectranal INTENS® (KOSAN Pharma GmbH, Seewalchen, Austria), was administered to birch (Betula sp.), grass (Poaceae) or ragweed (Ambrosia sp.) pollen allergy sufferers. The active agent in this product is an herbal mineral complex, mainly consisting of an Astragalus membranaceus (Fisch. ex. Bunge) root extract. This substance has been used in traditional Chinese medicine for a long time to reinforce “Qi” (the vital energy)[11, 12]. Pharmaceutical studies have already demonstrated numerous beneficial effects of the main active compounds. Besides positive effects on hepatoprotection, neuroprotection and on anti-aging activity, some components are also attested with anti-cancer and anti-inflammatory effects, as well as cardiotonic properties [12,13,14,15,16,17,18]. A similar food supplement, with the same herbal mineral complex, was already tested in a double-blind placebo-controlled RCT study in Croatia in 2007 [19]. During that study three patient visits to the study centre were scheduled and 7 of the 48 subjects (about 15%) did not complete the trial.

Based on these results the present work tests a novel study approach with the aim to decrease not only the dropout rate but the effort for all participants in general, while still being able to record the efficacy of a food supplement treatment. This innovative study design is based solely on the evaluation of allergy symptom data of study participants and users of the Patients Hay-fever Diary (PHD, www.pollendiary.com). Therefore, all Austrian study participants represent the “treatment group” of this study, whereas the crowd-sourced data of the remaining Austrian PHD-users act as a baseline for further analysis. The present pilot study aims to demonstrate that a simple questionnaire of the PHD and the statistical evaluation of crowd-sourced symptom data can be used to prove the efficacy of food supplements and lead to a lower dropout rate as a result of reducing the effort of study participants.

Materials and methods

This study was conducted during the 2018 pollen season from March until September, with a total of 328 participants from all Austrian counties. By self-assessment 145 participants classified themselves as sensitized to birch pollen (Betula sp.), 119 to grass pollen (Poaceae) and 64 to ragweed pollen (Ambrosia sp.). The participants had the option to select more than one aeroallergen in this assessment. All were supplied with a batch of food supplement that lasts for a period of 8 weeks per allergen selected in the self-assessment. The active component is a 160 mg herbal and mineral complex of an Astragalus membranaceus (Fisch. ex Bunge) root extract. The participants were instructed to take the capsules twice a day on an empty stomach and 30 min before a meal. This routine was initiated 2 weeks prior to the calculated start of the pollen season. Depending on their location the data for one of the 7 biogeographical regions of Austria (ATR1-7) was used (Fig. 1). Pollen data for these regions originate from Austrian monitoring stations and from neighbouring countries (Table 1). In case a sampling site was located at the border of two biogeographic regions, it was used for season calculations of both. This applied to the stations ATTATZ, ATLIEN, ATSVPG, ATVILL and ATVOEC. For further analysis no individual pollen concentrations but the average from all active pollen monitoring stations in the respective biogeographical region was used. Hence, the start of the 2018 pollen seasons in each region were estimated by calculating the average start date of the respective aeroallergen over years 2013–2017, by applying the European Aeroallergen Network (EAN) season definition that is based on the calculation of the Annual Pollen Integral (APIn) defined by Galán et al. [20, 21]. According to the EAN definition, the respective pollen season starts at the day where 1% of the APIn is reached and lasts until 95% of the APIn [20].

Fig. 1
figure 1

Austrian biogeographic regions (ATR). ATR1 Bohemian massif, ATR2 Danube valley and prealpine area, ATR3 Pannonian lowlands, ATR4 Illyrian basins, ATR5 Northern limestone alps, ATR6 Alpine valleys central/south, ATR7 Alpine valleys Austria west; 1–37 pollen monitoring stations (for details see Table 1)

Table 1 Pollen monitoring stations included in the study, sorted by biogeographical region

In addition to the predicted dates of the 2018 pollen season the actual start and end dates were calculated by applying the EAN standard season definition to the 2018 pollen data retrospectively. To assess the accuracy of the pollen season forecast all the requested aeroallergens were compared to the actual start dates of the 2018 pollen season. For a retrospective assessment of the pollen seasons graphs of the seven Austrian biogeographic regions were drafted to compare the 2018 pollen season with the historical data (Figs. 2, 3 and 4).

Fig. 2
figure 2

Birch pollen season 2018 (black) in comparison to the historical average from 2013–2017 (grey) for the seven austrian biogeographic Regions (ATR); x‑axis shows the timeline, y‑axis the pollen concentration in particles/m3 air; a Bohemian massif (ATR1), b Danube valley and prealpine area (ATR2), c Pannonian lowlands (ATR3), d Illyrian basins (ATR4), e Northern limestone alps (ATR5), f Alpine valleys central/south (ATR6), g Alpine valleys Austria west (ATR7)

Fig. 3
figure 3

Grass pollen season 2018 (black) in comparison to the historical average from 2013–2017 (grey) for the seven austrian biogeographic Regions (ATR); x‑axis shows the timeline, y‑axis the pollen concentration in particles/m3 air; a Bohemian massif (ATR1), b Danube valley and prealpine area (ATR2), c Pannonian lowlands (ATR3), d Illyrian basins (ATR4), e Northern limestone alps (ATR5), f Alpine valleys central/south (ATR 6), g Alpine valleys Austria west (ATR7)

Fig. 4
figure 4

Ragweed pollen season 2018 (black) in comparison to the historical average from 2013–2017 (grey) for the seven austrian biogeographic Regions (ATR); x‑axis shows the timeline, y‑axis the pollen concentration in particles/m3 air; a Bohemian massif (ATR1), b Danube valley and prealpine area (ATR2), c Pannonian lowlands (ATR3), d Illyrian basins (ATR4), e Northern limestone alps (ATR5), f Alpine valleys central/south (ATR6), g Alpine valleys Austria west (ATR7)

During the pollination period of the respective plant groups, the participants had to continuously enter their allergic symptoms into the PHD. This free-of-charge online questionnaire is available as a mobile app and via a web portal (www.pollendiary.com) and allows for a daily record of allergic symptoms throughout the pollen season. Using this tool, pollen allergy sufferers can document their overall wellbeing, the experienced symptoms of eyes (foreign body sensation, itching, redness, watering), nose (blocked, itching, running nose, sneezing) and lungs (asthma, cough, shortness of breath, wheezing) as well as the severity of the above-mentioned symptoms and the applied medication. The symptoms and medication parameters were then combined to an overall symptom and medication score [22]. As a benefit for using this service, the participants received a personalized pollen forecast for the following days [23]. This anonymized symptom data can be used for various research purposes [22,23,24,25,26].

To label the participants their PHD accounts were marked with a study code. To test the food supplements efficacy, the symptom complexes (eyes, nose and lungs) of the participants were compared with those of other PHD users who were not participating in the study but were located in the same biogeographical region. To make this data set comparable the individual symptom and medication scores need to be normalized, as pollen allergy sufferers can react differently to the same amount of allergen exposure [27]. This parameter, the symptom load index (SLI), was developed by Bastl et al. [24] and results in values ranging from 0 to 10 which allows a more comprehensible visualization of symptom severity [28]. In addition to the overall SLI, the SLI of the nasal symptom complex was calculated since nasal symptoms tend to affect the quality-of-life of pollen allergy sufferers the most [27]. This nasal SLI was calculated for participants and baseline by combining only nose symptoms and the applied medication [24].

For calculating the SLI values of the baseline, all PHD users from a biogeographic region (excluding the study participants) were considered, as long as they entered symptoms for 7 or more days in a row and showed a positive correlation to the pollen concentrations of the respective aeroallergen.

After the end of the trial the self-assessment of the participants was checked for positive correlation to the pollen seasons of interest followed by an eventual reclassification to match symptoms and pollen concentrations to achieve a better consistency.

In addition, the participants had to complete a special questionnaire provided by KOSAN Pharma at the end of the study period (Online Resource 1). It consisted of 38 questions to evaluate basal information on the participant (i.e. age, sex, diagnosed pollen allergy), the effect of the food supplement on the participants (i.e. quality of life questions, experienced symptom relief, tolerability) and questions relevant for marketing purposes (i.e. recommendation of the product, reasons for participation, comparison to conventional drugs).

The statistical analysis was performed in R Statistics (R foundation for statisical computing, Vienna, Austria) [29]. A Shapiro–Wilk test for the overall SLI and the nasal SLI scores of participants and the baseline was performed to check for normality of the score vectors. Normality was rejected, so a Wilcoxon–Mann–Whitney rank sum test was performed to compare participants with the baseline. To refine the results, an additional analysis was performed for the SLI of the nose. For graphical display diagrams were plotted in R Statistics and Excel (Microsoft, Redmond, WA, USA).

Results

In a comparison of the predicted and the actual start dates of the 2018 seasons, birch showed the lowest divergence with a prediction between 0–9 days prior to the actual season start. Followed by grasses with differences between 3–12 days earlier (ATR4, ATR5, ATR6 and ATR7) and 2–13 days later (ATR1, ATR2 and ATR3). The prediction of the ragweed pollen season showed high variability with 14 or more days in four biogeographic regions (ATR1, ATR4, ATR5 and ATR7), moderate variability of 12 days earlier in ATR6 and only low variability of 1–4 days delay in ATR2 and ATR3.

The 2018 birch pollen season started with a delay of 1–2 weeks compared to the historic average (Fig. 2) and reached above average intensity throughout Austria (except ATR5). The 2018 grass pollen season in Austria (Fig. 3) started slightly earlier than the historic data suggests but was otherwise of average intensity. The abundance of ragweed in the eastern parts of Austria is clearly visible in the data (Fig. 4), as only the regions ATR1, ATR2, ATR3 and ATR4 (Fig. 4a–d) show a distinct ragweed pollen season. In ATR1 the ragweed season was below average, whereas ATR2, ATR3 and ATR4 recorded a pollen season comparable to the 5‑year average.

Data from 102 birch, 92 grass and 21 ragweed pollen allergy sufferers were recorded in the corresponding seasons resulting in adherence rates of 70.3% for birch, 77.3% for grass and 32.8% for ragweed respectively (Table 2). To gain additional insights on the performance of the food supplement the symptom data of study participants were compared with the baseline. After the filtering process this baseline included up to 65 (birch), 63 (grass) and 15 (ragweed) significant positive correlated users per day respectively for each biogeographical region. Due to the strict inclusion criteria of users the baseline is a significant reference value. The reduction of the mean overall and nasal SLI values of participants compared to the baseline is shown in Table 2. For the overall SLI only study participants sensitized to ragweed recorded a significantly lower SLI than the baseline (∆ = −2.67; p-value < 0.001). Participants sensitized to birch and grasses recorded a lower mean overall SLI than the baseline as well but was not statistically significant.

Table 2 Comparison of participant adherence and symptom load index (SLI) values for ragweed (AMBR), birch (BETU) and grasses (POAC)

For the nasal SLI all participants recorded a significantly lower value (Table 2). On average the participants reported values during the ragweed season that were 1.27 units (p-value < 0.001) than the baseline. During the grass and birch pollen season the average was 0.37 units (p-value < 0.001) and 0.29 units lower (p-value < 0.001) respectively.

The KOSAN Pharma questionnaire (Online Resource 1) was completed by 141(97.2%) birch, 110 (92.4%) grass and 63 (98.4%) ragweed pollen allergy sufferers. Participants recorded a decreasing severity of symptoms in all three groups (Online Resource 2). Throughout the birch pollen season, the percentage of high and moderate burden decreased from 36% to 14% and from 39% to 23% respectively, whereas the number of participants reporting low burden increased from 16% to 54%. During the grass pollen season high burden dropped from 45% to 9% and moderate burden from 43% to 18%, whereas the low burden increased from 7% to 54%. During the ragweed pollen season high burden dropped from 33% to 8% and medium burden from 48% to 32%, whereas low burden increased from 13% to 51%.

For nasal symptoms a reduced burden was recorded as well. For the symptom “blocked nose” 68% of the birch, 81% of the grass and 70% of the ragweed pollen allergy sufferers stated a reduction of the symptom severity. For the symptom “sneezing” similar values were recorded with 65% for birch, 73% for grass and 79% for ragweed pollen allergy sufferers. Symptom relief was also reported for “runny nose” in 67% of birch, 75% of grass and 83% of ragweed pollen allergy sufferers.

Discussion

Pollen season

Applying the EAN season definition to historical pollen data for predicting the start of the 2018 pollen season worked properly for birch. The actual start of the birch pollen season took place 0–9 days prior to the calculated start and therefore already within the puffer period where the participants started to take in the food supplement. For the grass pollen season the predictions had some higher variation ranging from 3–12 days earlier to 2–13 days later but stayed within the puffer period as well thus, resulting in no potential negative effects as well. The season prediction for ragweed showed the highest variability and was not as precise since it is strongly influenced by long-distance transport of pollen in parts of Austria where the plant rarely occurs. In ATR1 calculations determined a season start in the beginning of May. However, this is not supported by phenological observations, since ragweed is usually flowering in late summer and autumn [30]. This is one flaw of the here used season definition, as it is susceptible for errors if the APIn is too low. By using the 5‑year average for predicting the start of the ragweed pollen season the result became more congruent to phenological observations and therefore replaced the actual start date in ATR1 (10 August 2018) for the analysis of adherence and symptom data. Similar observations were detected for the regions ATR4, ATR5, ATR6 and ATR7. The start date of the ragweed pollen season for ATR4 was predicted long before the actual start of the season in 2018. This discrepancy was caused by the withdrawal of service by two monitoring stations in this biogeographical region in mid 2016. For the regions ATR5, ATR6 and ATR7 the season prediction does not result in accurate starting dates either, because ragweed is not an abundant weed in these areas [31, 32]. Therefore, the results from the EAN season definition calculations are neither representative nor congruent to phenological observations. The pollen concentrations in ATR5 are caused mainly by long-distance transport of ragweed pollen from the surrounding areas, whereas ATR6 and ATR7 record only low concentrations caused by locally restricted ragweed populations [31, 32]. These populations may cause a local burden but do not provide a solid base for a regional season definition. Such effects must be monitored more carefully in future studies to provide more accurate pollen season predictions. In ATR2 and ATR3, the forecasting model calculated start dates that were 2–5 days after the actual start of the 2018 ragweed pollen season. Therefore, all participants already started with the food supplement intake.

Symptom load index

The symptom load index (SLI) is a robust parameter to display the burden of pollen allergy sufferers [24, 27, 28]. It combines symptoms of eyes, nose and lungs with a medication score [24]. The allergenic burden of various pollen allergy sufferers can be compared by calculating the SLI despite the individual reaction pattern of each person [33]. It should be mentioned that many participants, by nature, were sensitized to more than one aeroallergen [34].

The SLI allows the comparison of study participants with other users of the PHD who were combined to the baseline in this study. While the present study shows a slight trend that the participants recorded a lower SLI than the baseline for all three pollen seasons, no significant differences between participants and baseline were recorded for birch and grasses (Table 2). Only during the ragweed pollen season was a highly significant difference between the two groups detected, as the mean SLI of participants was 2.67 units lower than the mean of the baseline (Table 2).

SLI nose score

A retrospective analysis of the symptom data was conducted to compare the nasal SLI scores of the participants and the baseline since this symptom complex impacts the quality of life of pollen allergy sufferers the most [27]. The study participants recorded a significantly lower burden than the baseline during the three pollen seasons indicating that the food supplement positively affects the study participants quality of life. The highest difference between participants and baseline were recorded for ragweed, followed by grasses and birch (Table 2) indicating that the food supplement positively affects the study participants quality-of-life during the three tested pollen seasons.

Comparison to the KOSAN questionnaire

At the end of the 2018 pollen season a one-time questionnaire from the food supplement manufacturer was distributed to all study participants (Online Resource 1). Over 90% of participants completed this questionnaire whose results support that the participants suffered from less severe allergic symptoms (especially in the organ complex nose), which ultimately led to a higher quality-of-life.

Participant adherence, study design and possible improvements

The aim of this work was to test a new approach to increase the adherence of participants during a study. The main aspect to achieve this was to reduce the individual efforts, by replacing the necessity of blood samples with symptom data from the PHD while using the tested food supplement. This task requires a maximum of 5 min per day and can be done via a web browser or an app. Despite these low requirements the current study was not able to reach a dropout rate of less than 15% and was therefore poorer than a RCT that tested a similar food supplement [19].

Based on long-term observations of the PHD-user behaviour it becomes apparent that pollen allergy sufferers tend to enter their symptom data more consistently during the time they experience severe allergenic burden [24]. Even though the present study was conducted during the predicted main pollination period of the three aeroallergens only 70.3% of the participants entered data during the birch pollen season, 77.3% during the grass pollen season and 32.8% during the ragweed pollen season. The benefits of personalized pollen information and the provision of free food supplement for 8 weeks did not increase the adherence of the participants as expected. Still, the simple study design allowed the recruitment of a large number of participants within a short timeframe and a comprehensive statistical analysis. The presented study which combines symptom data of study participants with crowd-sourced data as a baseline should not be discarded since the results are convincing and the baseline of PHD users is robust. During future studies, the data entry frequency of study participants must be monitored more precisely. In case some users forget to enter their daily symptom data either a push notification via the app, or an e‑mail reminder seem promising to further increase participant adherence. Moreover, a reward system could be developed to improve adherence during the study period even further. The effect of daily reminders on the adherence rate could be evaluated in upcoming studies. Depending on the effect of this adaptation and the available budget, financial compensation for a complete data track might also be an option.

Conclusion

The study design based on crowd sourced symptom data shows potential to be used for similar purposes after performing the proposed improvements to enhance the participant’s adherence. Despite evidence of numerous beneficial effects of the active agents in Astragalus membranaceus extracts, the current approach did not record a statistically significant reduction in the overall symptom load index (SLI), but only for the symptom complex nose (nasal SLI). However, the collected symptom data show a trend towards a reduced symptom load supported by the KOSAN quality-of-life questionnaire.