Introduction

Athletic individuals have unique nutritional demands as consideration must be made not only for maintaining health and nutrient sufficiency, but also to ensure tissue repair, facilitate adaptation and enhance performance  [20]. Whilst recreational athletes can meet requirements for health and training by following national healthy eating guidelines [8], care must still be taken to ensure adequate energy and nutrient consumption. Ensuring athletic individuals follow appropriate dietary patterns to support health, performance and recovery is a crucial role for sports nutrition practitioners; depending on the training volume and level of competition, specific needs may need to be adhered to surrounding training [18]. As such, monitoring of dietary intake in a non-invasive and accurate manner is essential.

Numerous prospective and retrospective methods of dietary analysis are utilised for athletic individuals in sports nutrition research, including weighed and estimated food diaries, dietary recalls, and food frequency questionnaires [6]. Retrospective methods such as the food frequency questionnaire, dietary recall and diet history are prone to under-reporting due to participant memory [3]. Prospective methods are also prone to under-reporting due to the burden imposed on the individual; weighing individual food items and writing them down may result in an individual altering food intake to reduce burden or simply neglecting to log [3]. Practitioner variability in the interpretation and delivery of such methods can lead to considerable differences in the final nutrient data output [5].

The methods above are utilised frequently in both practice and sports nutrition research [9, 14], however the applicability in a free-living situation is questionable. For example, an athlete provided with a weighed food diary who eats out at restaurants frequently may not be able to provide accurate information for the determination of nutrient intake of which the remote food photography method (RFPM) has sought to address. Individuals are required to provide images of the food and beverages consumed via various methods such as wearable body cameras [15] or smartphone photographs [7]. When images are provided alongside descriptions of the meals, practitioners may be able to better identify dietary trends and intakes of those in their care. Energy intake measured via the smartphone RFPM was under-reported against doubly labelled water in some [13, 16] but not all [12] validation trials.

As the RFPM only requires access to a camera-embedded smartphone, the user is faced with less burden. Whilst such technologies may be more accessible to the individual whose diet is being monitored [17], the analysis of food images requires the practitioner to estimate portion sizes and/or ingredients in the meal unless weights and household measures are included. Like traditional methods of dietary intake monitoring [5]), such interpretations can be variable amongst practitioners independent of level of experience [19] and may be further influenced by variability in dietary intake, intentional or unintentional under-reporting and reporting fatigue [3].

The aim of the present study was to evaluate the relative validity of analysing energy and macronutrient intake using the RFPM via a free smartphone application in athletic individuals in a free-living environment.

Methods

Participants

Twenty-eight participants expressed interest in taking part in the study. Individuals were recruited if they self-identified as ‘athletic individuals’, defined as engaging in a sport or physical activity ≥ 3 days per week. Individuals expressing interest were invited to a session outlining the requirements of the study, and to sign informed consent forms if they wished to participate and agreed their data being published. Ethical approval for the study was obtained from the University of Waikato Human Research Ethics Committee (HREC(Health)2020#87).

Study design

Participants were required to log their dietary intake across three days using both a weighed food diary and the RFPM. Initially, participants attended an informed consent session to discuss the requirements of the study. During this session, the lead researcher demonstrated how to record their dietary intake using both methods to ensure appropriate analysis of the information could occur. Participants were advised to log the same items using both methods but to avoid including the weight of foods in the photo logs. If common household measures such as cups or spoons were used, this was deemed acceptable as they would be more practically accessible in a free-living situation than food scales.

Materials

For the weighed food diaries, participants were provided with household digital scales (Kmart, Melbourne, AU) sensitive to one gram and the capacity to measure fluid volume. A generic template food diary was provided as a hard copy to participants, with additional instructions included to assist with appropriate logging of food and beverage items.

The RFPM was implemented via a smartphone application (MealLogger, Wellness Foundry, Ashburn, VA). MealLogger was chosen as it allows users to upload photographs with descriptions to assist with the identification and analysis of foods or items. Additionally, the application has been identified as a preferred method to traditional dietary analysis methods in athletes [17]. The photographs were uploaded via the application in real-time allowing for the lead researcher to enquire about inadequate photos, however, unclear photos due to complex meals or inadequate descriptions were not enquired about to test the practical validity of the tool. Participants were required to take a clear photo of the entire food item or meal before and after consumption to account for leftovers. Photographs were to be taken from between a 90° and 45° to allow for the judgement of depth of the food. Participants were asked to place either a hand, pen or cutlery next to the food item as a size marker.

Analysis of both the written food diaries and RFPM was conducted using FoodWorks 10 (Version 10.0.4266, Xyris Software, Australia) as it contains a comprehensive database of food items in both Australia and New Zealand. If a food item was not present in FoodWorks, energy and macronutrient information was collected from food labels or the company website. The photographs and diaries were analyzed by the lead researcher, a graduate registrant of the Sport and Exercise Nutrition Register. Analysis of the photographs occurred as they were returned to the lead researcher. Written diaries were returned without names or identifying information attached and were analyzed as a group to ensure blinding of the researcher.

Statistical Analysis

Statistical analyses were conducted on Statistical Packages for Social Sciences (SPSS version 28.0.1.0, IBM Corporation, Chicago, Illinois, USA) and GraphPad Prism (GraphPad Software Inc version 9.2.0, San Diego, CA, USA). Descriptive data are displayed as mean ± SD. Significance was set at P < 0.05. Data were grouped into the average of days logged for each participant. Normality testing were conducted using Shapiro-Wilk tests; all data were normally distributed. The strength of the relationship and proportional bias of energy and macronutrient intake were assessed via Pearson correlations between the mean of both measures with the residuals and absolute residuals of the measures, respectively. Bland-Altman analysis was conducted to measure and visualize the systematic bias between RFPM and weighed food diaries. Mean % difference at both group and individual level and coefficient of variation (CV) were calculated to measure the level of agreement between RFPM and weighed food diaries. CV thresholds were interpreted using thresholds described by Stables et al. [19]: < 2% (excellent), < 5% (good), < 10% (acceptable), > 10% (poor), and > 20% (very poor).

Results

Participants

Of the 28 individuals expressing interest, 20 were included in the final analysis (33.0 ± 9.3 years, 173.6 ± 9.8 cm, 76.0 ± 15.0 kg, 30% female). Eighteen participants engaged in recreational resistance and/or endurance training, whilst two engaged in competitive amateur activities (football and cricket). Nineteen participants completed three days of logging that were of an acceptable quality for analysis, with one participant completing two days that were of acceptable quality for analysis. Three participants (15%) had prior experience with using weighed food diaries for monitoring dietary intake. The flow of participants is presented in Fig. 1.

Fig. 1
figure 1

Flow of participants. RFPM Remote Food Photography Method

Validation

A strong positive significant relationship between RFPM and weighed food diary was observed for energy (r = 0.74, P < 0.001), protein (r = 0.73, P < 0.001), carbohydrate (r = 0.80, P < 0.001) and fat (r = 0.66, P = 0.001). Assessment of proportional bias indicated a weak non-significant relationship between RFPM and weighed food diary for energy (r = 0.43, P = 0.062) and protein (r = 0.42, P = 0.063); a significant moderate relationship for carbohydrate (r = 0.58, P = 0.007) and fat (r = 0.59, P = 0.007) indicates greater heteroscedasticity. Bland-Altman plots for visualisation of the agreement between RFPM and weighed food diaries are presented in Figs. 2, 3, 4 and 5. Systematic and random error were not significantly different for energy (− 20.0 ± 455.5 kcal), protein (− 2.9 ± 34.6 g), carbohydrate (− 12.4 ± 49.3 g) or fat (2.3 ± 26.8 g).

Table 1 Individual participant's estimated energy and macronutrient intake between RFPM and weighed food diary with % difference between methods

Individual values for analysed nutrients and mean % difference are presented in Table 1. CV suggest acceptable agreement between RFPM and weighed food diary for energy (CV = 9.9%) and poor agreement for protein (CV = 13.1%), carbohydrate (CV = 10.0%) and fat (CV = 14.6%). Mean % difference of the grouped data is acceptable (Table 1), however considerable variability is observed in the individual calculated values, with the least and greatest difference being 0% and − 83.0%, respectively.

Fig. 2
figure 2

Bland–Altman plot for energy intake calculated using RFPM and weighed food diary. RFPM Remote Food Photography Method, LOA limits of agreement

Fig. 3
figure 3

Bland–Altman plot for protein intake calculated using RFPM and weighed food diary. RFPM Remote Food Photography Method, LOA limits of agreement

Fig. 4
figure 4

Bland–Altman plot for carbohydrate intake calculated using RFPM and weighed food diary. RFPM Remote Food Photography Method, LOA limits of agreement

Fig. 5
figure 5

Bland–Altman plot for fat intake calculated using RFPM and weighed food diary. RFPM Remote Food Photography Method, LOA limits of agreement

Discussion

The purpose of the present study was to examine the ecological validity of the RFPM to measure energy and macronutrient intake in free-living athletic individuals against a weighed food diary. Upon initial interpretation, agreement represented by low levels of bias warrants the practical use of the RFPM for the measurement of energy and macronutrients at a group level; however proportional bias, large limits of agreement and poor CV (> 10%) indicates that macronutrient values are not valid on an individual level and caution should be applied when interpreting results. Furthermore, observation of individual mean % difference between RFPM and weighed food diaries for energy and macronutrient intake suggest under-estimation and over-estimation in individuals.

A strong positive relationship was observed for energy and macronutrient intake, however proportional bias analysis, observation of the individual datapoints, mean % difference and visualisation of Bland-Altman plots suggests considerable inter-individual variability in the estimation of nutrient intake. Such a finding is interesting as Pearson correlation should demonstrate the strength of the relationship at the individual level [11], which occurs when corrected for absolute residuals to assess proportional bias. The energy and macronutrient intake demonstrates larger differences at greater intakes, which have also been reported when using the adapted 24-hour recall method for energy and macronutrient intake [1], protein intake [21], and food frequency questionnaire for antioxidant intake [4]. A possible explanation for this finding could be that as greater food and beverage intakes are analysed, the potential for errors in the analysis increases. Practitioners must consider these differences as athletes are likely to require elevated energy requirements and thus, food intake due to training and competition volume and intensity  [20].

Individual agreement between RFPM and weighed food diary was acceptable for energy but poor for macronutrient intake as interpreted by CV values. Similar to the studies demonstrating proportional bias between dietary assessment methods in athletes [2, 4, 21], agreement was deemed weaker than overall group validity. Such an observation in the present data was expected due to the considerable variability in individual differences in nutrient intake between methods; the difference in fat intake was 0% for one individual and − 89% for another, whilst overall mean % difference for fat intake was − 3.5%. This highlights potential issues with presenting only mean values in both applied sport and exercise research and practical settings; large inter-individual variability may negatively influence the interpretation of results and thus the quality of information and service provided based on said values.

Whilst the results of the present validation study indicate the RFPM may be a valid tool for analysing energy and macronutrient intake on a population level in athletic individuals, several limitations have been identified. The current analysis was conducted in athletic individuals, and therefore the results may not be translated to trained competitive athletes. On a population level the RFPM may be a valid tool for analysing nutrient intake, such as within a team or group, however the individual data indicates RFPM is prone to both under-estimating and over-estimating energy and macronutrient intake when compared to a weighed food diary. As such, practitioners delivering specific nutrition advice and recommendations based on monitoring of dietary intake using RFPM must remain cautious. Combining elements of both a weighed food diary and RFPM may be beneficial to reduce measurement errors. Additionally, we were unable to detect true reporting bias as both methods are self-reported. Accessibility, acceptability, and cost mean the application of additional biomarker methods such as DLW is often unfeasible and thus, the data collected using self-reported dietary analysis methods may not reflect true nutrient intake.

A major limitation in the analysis of dietary intake is the presence of inter-individual variability between practitioners during the food diary analysis process. In the present study, a single trained sports nutritionist interpreted both the RFPM and weighed food diaries. Previous studies have identified variability between practitioners when coding both weighed food diaries [5] and food photographs [19] provided by athletes.

Future research should aim to assess the validity of practical dietary analysis methods such as the RFPM against biological markers such as DLW. Furthermore, validity should be assessed in trained athletic populations and the degree to which individual data influences population data in teams and groups of variable sizes and disciplines quantified to further ensure ecological validity of dietary analysis methods.

Conclusion

The present study demonstrated that the RFPM using a mobile phone application to record both photographs and descriptions of food, meals and beverages is a valid tool for analysing energy and macronutrient intake in athletic individuals at the group level. For individuals, considerable variability is apparent and therefore, it may not be appropriate for practitioners to prescribe detailed recommendations and feedback based on the data collected from such tools.

Practical recommendations

Several observations were made during data collection which may explain the variability between RFPM and weighed food diary measurements in some participants. These observations should be considered by both practitioners and researchers when seeking to collect and interpret dietary analysis data.

  • Limited participants included fine details when recording their dietary intake. Important details were often missed, such as not including whether oil was used for cooking, not being descriptive about the cut and/or leanness of meat and not including the type of milk used [10]. In the FoodWorks software used to analyze dietary intake in the present study, meat has different options (rump steak, trimmed, semi trimmed or not trimmed) which can confound the nutrient analysis if details are not included (SI1). Whilst it did not negatively influence the validity analysis, this would be detrimental for practitioners or researchers aiming to accurately understand an individuals’ dietary intake or eating patterns.

  • Variability in the details added to the description indicates that whilst the use of food photographs may reduce burden for some individuals, following-up with those who do not provide adequate complementary details may increase the burden and increase non-compliance (SI3).

  • Individuals not including brands in the description alongside photographs or when completing food diaries may confound the true nutrient intake as the nutrient content of items can be variable between brands. Furthermore, the interpretation of a ‘serving’ in dietary analysis software may be different to that of a brand. This can be problematic as the nutrient content information may be variable.

  • Athletes may eat out at restaurants and cafes, may visit establishments where accurate logging of food intake is impractical, such as when visiting the cinema, and are likely to purchase pre-made food items (wraps and sandwiches) that cannot be adequately logged without disassembly. Using either weighed food diaries or food photographs can be impractical in these situations. Furthermore, when meals are prepared at home, care must be taken to present the food or meals such that analysis can occur if the individuals’ dietary intake is being monitored (SI4).

  • As above, situations where individuals eat out may be impractical for taking clear photographs. This may also apply to other scenarios, such as during the preparation of complex meals whereby the volume of individual items cannot be accurately estimated as they are hidden, such as meat and vegetables in a curry or stir-fry.

  • Many foods may not be present in the dietary analysis database and appropriate nutrition information may be absent online. In such situations, estimation of the nutrient content is likely warranted but threatens the accuracy of the information provided. Additionally, food purchased from a takeaway, such as a curry, presents a multi-faceted problem as this may not be present in food databases and is a complex meal resulting in difficulty determining the contents of the meal.

  • The presentation of food can result in imprecise interpretation of the nutrient content. If the meal is presented in a bowl or as stir-fry it can be difficult to determine the amounts of individual ingredients using photos if a detailed description is not added (SI2).

  • Individuals may not prepare food for themselves. This is common in young athletes who still live with parents or caregivers who purchase and prepare the foods and meals consumed by the athlete. This may confound dietary analysis as inadequate presentation of the foods and/or meals, others preparing meals for multiple people or others misremembering or not considering the portion sizes, cooking methods and other fine details of the food preparation process can influence the information the athlete ultimately provides the practitioner.

  • Similarly, athletes may be in a situation where they are cooking for family or friends. This would likely make logging impractical, particularly if a complex meal is being prepared and requires multiple photographs.