Skip to main content

Validity and reproducibility of a short food frequency questionnaire among patients with chronic kidney disease



A balanced diet is essential to slowing the progression of chronic kidney disease (CKD) and managing the symptoms. Currently, no tool is available to easily and quickly assess energy and macronutrient intake in patients with non end-stage CKD.

We aimed to develop and evaluate the validity and reproducibility of a new short 49-item food frequency questionnaire (SFFQ) adapted to patients with CKD.


The CKD-REIN study is a prospective cohort that enrolled 3033 patients with moderate or advanced CKD from a national sample of nephrology clinics. A sub-sample of 201 patients completed the SFFQ twice, at a one-year interval and were included in the reproducibility study. During this interval, 127 patients also completed six 24-h recalls and were included in the validity study. Main nutrient and dietary intakes were computed. Validity was evaluated by calculating crude, energy-adjusted and de-attenuated correlation coefficients (CC) between FFQ and the mean of the 24-h recall results. Bland-Altman plots were performed and cross-classification into quintiles of consumption of each nutrient and food group was computed. Reproducibility between the two SFFQs was evaluated by intraclass CC (ICC).


Regarding validity, CC ranged from 0.05 to 0.79 (unadjusted CC, median: 0.40) and 0.10 to 0.59 (de-attenuated CC, median: 0.35) for food group and nutrient intakes, respectively. Five of the most important nutrients of interest in CKD, i.e. protein, calcium, phosphorus, potassium, and sodium had de-attenuated CC of 0.46, 0.43, 0.39, 0.32, and 0.12, respectively. The median of classification into the same or adjacent quintiles was 68% and 65% for food and nutrient intakes, respectively, and ranged from 63% to 69% for the five nutrients mentioned before. Bland-Altman plots showed good agreement across the range of intakes. ICC ranged from 0.18 to 0.66 (median: 0.46).


The CKD-REIN SFFQ showed acceptable validity and reproducibility in a sample of patients with CKD, notably for CKD nutrients of importance. It can now be used in large-scale epidemiological studies to easily assess the relations between diet and CKD outcomes as well as in clinical routine. It may also serve as a basis for the development of FFQs in international CKD cohort networks.

Peer Review reports


Chronic Kidney Disease (CKD), defined by the presence of abnormalities in kidney structure or function for a period greater than 3 months, is common [1]. It is associated with high risks of mortality and progression to end-stage renal disease (ESRD), for which kidney replacement therapy (dialysis) or transplantation is required. To avoid progression to ESRD, prevention of CKD progression and management of the symptoms through nutrition are essential [2]. Indeed, epidemiological and clinical evidence have shown links between several micronutrients and CKD [3]. In this context, it is currently recommended (but rarely achieved) to reduce dietary protein intake (DPI) to 0.8 g/kg/day from CKD stage 3 [1, 4], even if the DPI effect on the progression of CKD is still debated [5,6,7]. Calcium, phosphorus, potassium and sodium chloride intakes also need to be monitored, from CKD stage 3, due to their relation with mineral, bone and cardiovascular CKD complications [1, 4]. Finally, because more than 40% of CKD patients have diabetes, they are encouraged to limit the specific nutrients diabetic patients are advised to limit (i.e. simple sugars and saturated fats) [8]. In terms of dietary patterns, the Dietary Approaches to Stop Hypertension (DASH) diet and the Mediterranean diet, both low in dietary acid load, have been associated with favorable CKD outcomes [3].

Despite these numerous and complex dietary recommendations and findings, very few CKD patients with non-ESRD have a dietetic follow-up, and little is known about their food consumption.

It is therefore essential to examine the relationship between dietary factors and outcomes in patients with CKD [9]. Food Frequency Questionnaires (FFQs) have been previously developed in the CKD context but most of them are long questionnaires (around 150 items) [1, 10,11,12,13] or focus on the estimation of specific nutrient/food intakes [14, 15]. One SFFQ of 76 food items was developed in the Brazilian context [16].

A consortium of 6 cohorts (E3N [17], E4N [18], CKD-REIN [13], i-Share [19], Elfe [20] and Psy-COH) was created to obtain a unique Short Food Frequency Questionnaire (SFFQ), useful to quickly assess the diet in several population subgroups: patients with CKD (CKD-REIN cohort), adolescents, students, adults, the elderly and patients with mental disorders.

Existing SFFQs have not been suitable to quickly assess the diet in several French population subgroups: i) the SFFQ developed by Vercambre et al. [21] was developed for senior women and focuses on nutrients of interest for this population, ii) one third of the items of the SFFQ developed by Giovannelli et al. [22] are not valid and no food composition table is available to study nutritional intakes, iii) the SFFQ developed by Barrat et al. [23] refers to past week intakes, does not take seasonal variability into account and does not focus on nutrients of interest in a CKD context. Therefore, the consortium decided to develop a new and unique SFFQ (40 items) adapted to several population subgroups of interest. They also agreed that few additional specific questions (10 items max., 9 in the present study) could be added to the questionnaire to aid in the estimation of some nutrients of interest, in the context of specific populations such as CKD patients.

The CKD-REIN (CKD-Renal Epidemiology and Information Network) cohort was chosen to be the first pilot study for evaluating the SFFQ feasibility and validity. Before using a newly developed or modified FFQ, it must first be validated to be considered as an acceptable method of dietary assessment [24]. The aim of the present study was to study the reproducibility of the newly developed SFFQ, and evaluate its validity against six 24-h recalls, in a sample of patients with moderate or advanced CKD.


Study population and design

The CKD-REIN study is a clinical-based prospective cohort that included 3033 adult patients with moderate or advanced CKD from a nationally representative sample of nephrology facilities between July 2013 and March 2016. The design and methods for this cohort have been described in detail elsewhere [25]. Between April and June 2014, participants who were included in the CKD-REIN study were informed about the design of the present reproducibility and validity study and were invited to participate. In total, 301 participants were volunteers, gave informed consent and were mailed the newly developed SFFQ. They were asked to complete the SFFQ twice, at a 1 year interval, in June 2014 and 2015. 244 participants completed the SFFQ once and 208 participants completed it twice. Participants who under- or over- reported energy intake in one of the SFFQs were excluded as previously described [26]: they were in the top and bottom 1% of the energy intake to energy requirement ratio distribution. Energy requirement was calculated as follows: Basal Metabolic Rate (BMR)* Physical Activity Level (the cutoff value of 1.55 for a minimal activity level was chosen [27]). BMR was computed on the basis of sex, age, height and weight, using the Schofield formula [28]. A total of 201 participants were included in the reproducibility study. Among them, 127 patients agreed to answer six 24-h recalls and were therefore included in the validity study (a flow diagram is presented in Additional file 1).

Short food frequency questionnaire

The food list of the SFFQ was defined on the basis of existing national food questionnaires [21,22,23, 29,30,31,32] and data from the second national study of individual food intakes of French adults (INCA 2) [33]. The SFFQ was self-administered, completed at home and then returned by mail. The questionnaire asked participants to report their usual dietary intake over the past year and was divided into two parts. In total, 49 items were used to obtain the nutritional data (see Additional file 2).

The first part was composed of 40 food group items. It quantified consumption by frequency (never or less than once a month, x times a day, x times a week or x times a month) and portion sizes per food group item. Photos previously validated [34] were directly integrated into the questionnaire to help participants estimate the consumed quantities of 21 food items (see Additional file 3). Most of the time, there were three photos showing increasing portion sizes with five possible answers (less than the lowest portion, the lowest portion, an intermediate portion, the biggest portion, more than the biggest portion). For items with no photo, participants were asked to quantify their consumption with respect to a standard portion size (typical household measurements such as spoons or standard units such as individual pots of yogurts).

The second part was specific to the study population of patients with CKD. It was composed of nine questions, with the objective of estimating the intake of some nutrients of specific interest as best as possible in this population, such as protein, calcium, phosphorus, potassium, and sodium. Seven of the nine questions provided more detailed information on some food group items asked in the first part of the questionnaire. The two remaining questions enquired about extra- salt added when cooking and the consumption of processed foods.

All the information collected was used to calculate daily intakes of each food group. Frequencies were converted into numbers of servings per day and multiplied by the declared portion size. An ad hoc composition table was developed using data from the INCA2 French representative population survey [33] to estimate the percentage of contribution of each food included in a food group item. Nutritional data were then obtained using the French food composition database established by the French Data Centre on Food Quality (Ciqual, last updated in 2013) [35].

Besides nutritional information, the SFFQ elicited information on sex, birth date, and anthropometric data. It also questioned the participants about dietitian visits and eventual changes of food habits during the past year due to particular situations (diet, pregnancy, move, surgery, depression,…).

24-h recalls

The reference method used to compare results from the SFFQ consisted of six 24-h recalls carried out each 2 months, during the year between the first and the second administration of the SFFQ. Study participants were asked to recall all foods and beverages consumed on the previous day (due to logistics, data for Saturdays were collected on Mondays). Participants were not informed in advance of the day of the recall. All weekdays and all seasons were covered by the recalls in order to account for intra-individual variation. Phone interviews were carried out by a trained dietitian who entered the food data into the Nutrilog Software (v2.70d). These data were instantaneously converted into nutrient intakes by the software, using the Ciqual food composition database [35]. A validated photo album of 42 foods [32] was previously sent to the participants’ homes in order to help them quantify the amount of consumed food during the phone interview.

Statistical analysis

We computed descriptive statistics (means and standard deviations) for nutrients and foods for both SFFQs and the average of the six 24-h recalls. Wilcoxon signed rank tests were performed to study differences between mean values.


To study relative validity, data evaluated by the second SFFQ were compared with the mean of the six 24-h recalls, since both methods covered the same period of time. A list of concordance was established between food group items from the SFFQ and food items provided by 24-h recalls.

Regarding food groups, unadjusted Spearman’s correlation coefficients were calculated. Regarding nutrient intakes, unadjusted and energy-adjusted Pearson correlation coefficients were calculated. Energy-adjusted coefficients, corrected for attenuation due to within-person variation in the reference method (de-attenuated coefficients) [36, 37], were also produced. Energy adjustment was performed using the residual method [37]. To improve the normal distribution, nutrient intakes were logarithmically transformed before analysis.

We examined the level of agreement in ranking subjects between the two methods through cross-classification into quintiles, in terms of food group and nutrient intakes. Misclassification was defined as the percentage of participants classified in the lowest quintile in the SFFQ and the highest quintile in the 24-h recalls and vice versa. Due to several food groups with a proportion of non-consumers > 20%, cross-classification into three classes was performed. Classes were defined as follows: class = 1 for null consumption; class = 2 for consumption below or equal to the median value in consumers, class = 3 for consumption over the median value in consumers. For food groups with a proportion of non-consumers < 20%, cross-classification into tertiles was also performed.

We also evaluated agreement between the SFFQ and the six 24-h recalls performing Bland-Altman plots on energy-adjusted values [38,39,40]. Mean differences between the two assessment methods were plotted against the average estimation of the two methods. The 95% limit of agreement was calculated as the mean difference ± 1.96 SD.


To evaluate reproducibility, data obtained from the first and second SFFQ were compared. Regarding food groups, unadjusted Spearman’s correlation coefficients and intraclass correlation coefficients (ICC) were estimated. Regarding nutrient intakes, unadjusted and energy-adjusted Pearson correlation coefficients as well as ICC were calculated. Nutrient intakes were logarithmically transformed before analysis, to improve the normal distribution.

The level of agreement in ranking subjects between the two SFFQs in terms of food group and nutrient intakes was examined through cross-classification into quintiles.

All statistical analyses were performed on SAS 9.4 (SAS Institute Inc., Cary, NC, USA). A P-value < 0.05 was considered statistically significant.


Baseline characteristics of the participants included in the validity and reproducibility studies were similar (Table 1 ). Briefly, 35.3% of the participants were women. The mean age was 65.3 ± 11.8 years and the mean BMI was 28.1 ± 5.5 kg/m2. The participants had moderate to advanced CKD: 56.2% stage 3 and 43.8% stage 4. Baseline mean Glomerular Filtration Rate (GFR) was 31.6 ± 11.8 ml/min/1.73m2. 39.3% of participants had diabetes (mean HbA1c = 6.3 ± 1.1% and mean glycaemia = 6.1 ± 1.7 mmol/l). Participants lived in all regions of France, with significant proportions in the Eastern North and Western South.

Table 1 Descriptive characteristics of the subjects included in the validity and reproducibility study


Food groups

Dietary intakes estimated by the SFFQ2 and the mean of the six 24-h recalls were mostly comparable (Table 2 ). However, the SFFQ overestimated some food groups: ‘whole-grain pasta, rice and wheat’, ‘legumes’, ‘milk’, ‘fruit juice’, ‘sweet beverages’, and ‘artificially-sweetened beverages’. The SFFQ also underestimated the following food group: ‘other alcoholic beverages’. These food groups had a large number of non-consumers (>20% of participants according to SFFQ2).

Table 2 Relative validity of the SFFQ for food groups (n = 127)

Unadjusted Spearman coefficients ranged from 0.05 (legumes) to 0.79 (tea and herb teas), the median value being 0.40. 13 food groups had correlation coefficients below 0.3.

The median proportion of participants classified in the same and adjacent quintiles of food group consumption by the SFFQ2, as well as by the mean of the six 24-h recalls, was 68.0%. The median proportion of misclassified participants was 3.0%. The median proportion of participants classified in the same tertile was 51.0%.


Mean macronutrient intakes estimated using the SFFQ2 were not statistically significantly different from those estimated using the six 24-h recalls, except for protein, dietary fibre and cholesterol intakes which were underestimated by the SFFQ (Table 3). When micronutrient intakes estimated using the SFFQ were different from those estimated using the six 24-h recalls (p value < 0.05), they were underestimated by the SFFQ, except for retinol and manganese intakes.

Table 3 Relative validity of the SFFQ for nutrients (n = 127)

Unadjusted correlation coefficients ranged from 0.11 (water) to 0.76 (alcohol), with the median value being 0.32. De-attenuation improved energy-adjusted correlation coefficients. De-attenuated CC ranged from 0.10 (water) to 0.59 (cholesterol), with the median value being 0.35. Correlation coefficients for nutrients of interest for CKD patients, including protein, calcium, phosphorus, and potassium ranged from 0.32 (potassium) to 0.46 (protein). CC for carbohydrates and lipids were 0.42 and 0.40 respectively. A total of 12 nutrients (carotene, vitamins B3, B5, C, D, iron, magnesium, zinc, manganese, iodine, sodium and water) had correlation coefficients lower than 0.3.

The median of percentages of participants classified in the same and adjacent quintiles of nutrient intakes by the SFFQ2, as well as by the mean of the six 24-h recalls, was 65.0%. The median proportion of misclassified participants was 4.5%. Regarding nutrients of interest for CKD patients, percentages of participants classified in the same and adjacent quintiles ranged from 63% (calcium) to 69% (phosphorus) and the median proportion of misclassified participants ranged from 1% (lipids) to 6% (sodium, phosphorus and potassium).

The Bland-Altman plot analysis graphs show good agreement between the two methods of estimation, across the range of intake, for macronutrients and nutrients of interest for CKD patients (Fig. 1). The mean difference between methods was near zero for all levels of intake, except for sodium and calcium. Across the range of intakes, sodium was systematically underestimated by the SFFQ2, which was consistent with the results displayed in Table 3. The percentage of points that were outside the limits of agreement ranged from 0.8% (vitamin B6) to 8.7% (vitamine B5), with a median value of 4.7%, which is theoretically the percentage of values outside the mean ± 1.96 SD. Finally, the agreement did not differ between high and low intakes.

Fig. 1
figure 1

Bland-Altman plots related to macronutrients and micronutrients of interest in CKD population. Difference in the daily intake of some energy-adjusted macronutrients and micronutrients [a) energy, b) protein, c) carbohydrate, d) lipid, e) sodium, f) potassium, g) phosphorus, h) calcium] derived from the six 24-h recalls and the food frequency questionnaire (FFQ2) plotted against the corresponding mean energy-adjusted daily intakes derived from the two methods. Solid lines represent mean difference, and dashed lines show lower and upper 95% limits of agreement (mean ± 1.96 SD) (n = 127)


Food groups

Absolute daily intakes of food groups were mostly comparable between the two SFFQs, except for ‘white bread and substitutes’, ‘sandwiches, burgers and kebabs’, offal’, ‘eggs’, ‘fruit’, and ‘artificially-sweetened beverages’ that showed a decrease between SFFQ1 and SFFQ2 (Table 4).

Table 4 Reproducibility of food group consumptions of the SFFQ (n = 201)

Unadjusted Spearman correlation coefficients ranged from 0.40 (white bread and substitutes) to 0.86 (wine), with the median value being 0.54. Intraclass correlation coefficients ranged from 0.02 (‘Fish fingers/breaded meat’) to 0.73 (‘wine’, ‘sunflower oil, groundnut oil’ and ‘margarine, mayonnaise’), with the median value being 0.40. Seven food groups (‘legumes’, ‘French Fries and other fried tubers’, ‘fish fingers/breaded meat’, ‘seafood (excluding fish)’, ‘offal’, ‘cheese’ and ‘fruit juice’) had intraclass correlation coefficients lower than 0.3.

The median of percentages of subjects classified in the same and adjacent quintiles of food group consumption by both SFFQs was 75.0%. The median proportion of misclassified participants was 1.0%. The median of percentages of subjects classified in the same tertile was 63.0%.


Absolute daily intake of energy and nutrients were comparable between the two SFFQs, although all nutrient intakes showed a significant slight decrease between SFFQ1 and SFFQ2 (Table 5).

Table 5 Reproducibility of nutrient intakes of the SFFQ (n = 201)

Crude correlation coefficients ranged from 0.39 (fibre) to 0.90 (alcohol), with the median value being 0.52. Energy-adjusted Pearson correlation coefficients ranged from 0.32 (sodium) to 0.60 (vitamin E), with the median value being 0.46. Intraclass correlation coefficients ranged from 0.18 (retinol) to 0.66 (alcohol), with the median value being 0.46. ICC for five of the most important nutrients of interest for CKD patients (i.e. protein, calcium, phosphorus, potassium and sodium) ranged from 0.39 (sodium) to 0.54 (calcium). ICC were 0.33 and 0.52 for carbohydrates and lipids, respectively. Two nutrients (retinol and vitamin B12) had intraclass correlation coefficients lower than 0.3.

The median proportion of subjects classified in the same and adjacent quintile of nutrient intakes by both SFFQs was 75.0%. The median proportion of misclassified participants was 2.0%. Regarding the nutrients of interest for CKD patients, the proportion of subjects classified in the same and adjacent quintile ranged from 67% (sodium) to 81% (calcium). The median proportion of misclassified participants ranged from 0% (calcium) to 3% (sodium).


The present study investigated the validity and reproducibility of a new SFFQ, customized for patients with CKD. This SFFQ was designed to estimate energy intake and to rank participants according to their dietary and nutrient intakes. The overall results indicate acceptable relative validity (for nutrient intakes, median correlation coefficient = 0.35 and median proportion of subjects classified in the same or adjacent quintiles by the SFFQ2 and the 24-h recalls = 65.0%) and good reproducibility (for nutrient intakes, median correlation coefficient = 0.46 and median proportion of subjects classified in the same or adjacent quintiles = 75.0%). Our tool demonstrated an acceptable ability to rank participants for most nutrients (including nutrients of interest for CKD patients: protein, calcium, phosphorus, potassium, sodium and carbohydrates and lipids) and food groups making it sufficiently informative to evaluate associations with health outcomes and adjust for nutritional intake in epidemiological studies [37, 41]. It can also be used to derive dietary patterns using collected food data.

In this study, six 24-h recalls were used as the reference method for determining the validity of the SFFQ. Repeated dietary recalls, despite their limitations, are one of the most used reference methods for validation studies of FFQs [42,43,44]. Even if there is some evidence that increasing the number of recording days in the reference method improves the apparent validity of a questionnaire [45], the optimal number of days of dietary recording has been discussed in the literature. Some authors have concluded that 8 days were necessary to accurately assess most nutrient intakes [46], but other authors have stated that the optimal study design would rarely require more than four or 5 days of dietary recording [47].

All French studies with data on food groups had similar ranges of unadjusted coefficients for validity [29,30,31,32]. 13 food groups had correlation coefficients below 0.3. 10 of them were rarely consumed foods (e.g. offal or legumes) which could explain why we observed such low CC for these foods groups. Such findings on rarely consumed foods have been previously reported [30,31,32]. Some food groups (e.g. vegetables, or alcoholic beverages) may have been over- or under-reported because of social approval or social desirability: healthy vs. unhealthy image of some food groups [41, 48, 49] and supposed consumption restriction of some of them because of CKD context (e.g. meat, poultry, fish, eggs, milk and dairy products, whole-grain foods, legumes and some vegetables [8, 50]).

For nutrients, the correlation coefficients were similar to those obtained in an international review for energy, fat and alcohol but were lower for protein, carbohydrates, calcium, vitamin C and dietary fiber [43]. Differences in the means of sodium, as estimated by both methods, were high. Even though a question about extra-salt added after food preparation was asked in the CKD-REIN-specific part of the questionnaire, it was still difficult to estimate its intake. 12 nutrients (carotene, vitamins B3, B5, C, D, iron, magnesium, zinc, manganese, iodine, sodium and water) had correlation coefficients lower than 0.3. Among those nutrients, sodium is of importance in CKD context. Even if CC was low for sodium, the SFFQ showed acceptable validity to rank people according to sodium intake (64% of people classified in the same or adjacent quintile when comparing sodium intake with the SFFQ and the 6 24-h recalls).

Some research teams, including the Deschamps et al. one [30], have previously developed long FFQs [29, 31, 32]. We were expecting lower correlation coefficients in our study in comparison with those studies, as increasing the number of food items should enable to better capture food intakes and therefore nutrient intakes. But, our results were similar to most of the previous work, except the FFQ obtained by Deschamps et al. [30] Regarding macronutrients [31] and other nutrients [29, 32], we obtained similar or higher correlation coefficients than other studies using longer questionnaires.

We obtained lower correlation coefficients than Barrat et al. [23] and Vercambre et al. [21] who developed SFFQs; probably due to the one-week time frame of the questionnaire developed, and the design of the validity study, respectively.

Adjustment for energy led to a decrease in correlation coefficients for most nutrients, which has been frequently reported and would be more related to a variability due to systematic errors of under/overestimation than to energy intake [30, 37]. De-attenuation led to improvement of coefficients as expected, but was less pronounced than in another study [32], probably due to the lower number of recalls used here (6 vs. 12).

Agreement in classification was acceptable, including for the nutrients of interest in CKD. Our results were close to the recommended 70% [51] and similar or slightly lower than those reported in other studies [21, 23, 30, 32]. The lowest level of agreement was observed for retinol (39% of subjects within the same or adjacent quintiles). One of the main sources of retinol is offal, which was rarely consumed and whose consumption was probably difficult to evaluate with only six 24-h recalls.

To study the SFFQ reproducibility, we adopted a one-year time interval which is long but frequently used and reported as acceptable [42, 43, 52]. When studying the reproducibility of a FFQ, the time frame between the two administrations of the tool has to be sufficiently long to prevent participants from remembering and repeating their responses. However, when a longer interval is used, true changes in dietary habits as well as variation in response contribute to reduced reproducibility [53]. Therefore the observed reproducibility here may be lower than the true value.

Our study showed acceptable reproducibility for most foods (range: 0.40–0.86) and nutrients (ranges: 0.32–0.60 and 0.32–0.53 for overall nutrients, and the CKD nutrients of interest respectively), with the best reproducibility observed for wine and vitamin E. Our findings were comparable to prior reported correlation coefficients for reproducibility [54].

According to a review, correlation coefficients of 0.5 to 0.7 between two administrations are commonly reported [42]. In our study, 72% and 59% of the food groups and nutrients studied had correlation coefficients ≥0.5. The proportion of correlation coefficients <0.5 may be due to the time interval between the two administrations. Patients with CKD may be at higher risk to modify their diet over a one-year period because of disease complications. The seven food groups with the lowest ICC (ICC < 0.3) corresponded to food groups which are rarely consumed in this population (i.e. ‘cheese’).

Despite CKD context, agreement in classification was very good (median of 75% and 74% for overall foods and nutrients, and the CKD nutrients of interest respectively).

In comparison with other FFQs used in a CKD context [55,56,57,58,59], we obtained similar results in terms of validity and reproducibility. When considering validity, the FFQ used by Mirmiran et al. [12] had crude correlation coefficients that ranged from 0.33 (legumes and nuts) to 0.79 (tea and coffee) [12, 55]. When the FFQ used by Lew et al. [11] was validated, energy and de-attenuated CC for nutrients ranged from 0.24 to 0.79 [58]. The SFFQ used by Domingos et al. [16] had ICC in the validation study that ranged between 0.17 (selenium) to 0.66 (calcium) [59]. Reproducibility results of the FFQ used by Diaz-Lopez et al. [13] were slightly higher than ours [57], but participants were specifically asked not to modify their dietary habits during the study’s 1-year duration. In another study, reproducibility Spearman CC obtained for food groups were much lower than ours (range: 0.19–0.67; median = 0.35 vs. range: 0.40–0.86; median = 0.54) but reproducibility was evaluated over an 8 year interval [55].

Strengths and limitations

The current work has some limitations, inherent to nutritional epidemiology. Learning effect was not measurable. Authors that compared both FFQs with 24-h recalls found that the second FFQ was more valid than the first. However, with the completion of the six 24-h recalls during the year, participants may pay more attention to their diet and are therefore in distinct conditions when fulfilling the second FFQ.

Furthermore, dietary intake cannot be estimated without error [60]. Comparison of energy intake(EI) with minimal energy requirements (basal metabolic rate- BMR) provides an indirect indication of bias. In our study, taking into account the cutoff value of 1.55 for a minimal activity level [27], EI/BMR estimates suggested underreporting by both SFFQ and 24-h recalls(Median < 1.55) (see additional file 4). We did not observe any major differences between the two methods. Under or overestimation are not necessarily problematic in epidemiological studies if ranking of people according to their dietary intake is valid [37].

Our work also has several strengths. In comparison to other validity and reproducibility studies, we worked on data from a large sample [42] and managed to maintain high response levels all over the one-year interval despite working with an aging population, with CKD.

Several CKD cohorts exist on an international level [61]. However few of them assess diet despite the impact of diet in CKD management. We developed a rapid tool to assess energy intake in CKD patients. It showed acceptable validity and reproducibility to rank people according to their food group and nutrient intakes, including nutrients of interest for CKD patients.

The tool we developed was easy to complete and not time consuming. With the portion size photos directly integrated into the questionnaire, it was easy for participants to estimate the amounts of food consumed.

Here, we present validity results for the SFFQ in a CKD sample. Further validity studies will be conducted in other population subgroups. One of the main strengths of the consortium work is that we will have a unique tool (due to the shared 40 items in the first part of the SFFQ), useful for several population subgroups. Diet and dietary patterns will therefore be comparable between studies and a standardized dietary assessment will be available for epidemiological and clinical research.

The methodology we used to obtain a standardized SFFQ could be adapted for other European and worldwide countries in order to foster international studies of nutrition in patients with CKD. Developing a smartphone app of the SFFQ is the next step. This type of tool may further be used in clinical routine to monitor patient nutrient intakes and provide them instantaneous feedback and recommendations about their diet.


For most food groups and nutrients, including nutrients of interest in CKD, the SFFQ showed acceptable validity and reproducibility in a sample of patients with CKD. Before being administered to a large sample, some minor modifications without substantial impact could be done to the questionnaire to improve its validity. Whole-grain and white bread, and whole-grain and white pasta could be grouped together. A question about added sugar and artificial sweeteners to hot beverages could also be added to the questionnaire, to better estimate sugar intakes.



Basal Metabolic Rate


Correlation Coefficient


Chronic Kidney Disease


CKD-Renal Epidemiology and Information Network


Dietary Protein Intake


End-Stage Renal Disease


Food Frequency Questionnaire


Glomerular Filtration Rate


Intraclass Correlation Coefficient


Short Food Frequency Questionnaire


  1. KDIGO 2012. Clinical practice guideline for the evaluation and Management of Chronic Kidney Disease. Kidney International Supplements (2013). 2013;3(1):73-90. Chapter 3.

  2. Ash S, Campbell KL, Bogard J, Millichamp A. Nutrition prescription to achieve positive outcomes in chronic kidney disease: a systematic review. Nutrients. 2014;6:416–51.

    Article  PubMed  PubMed Central  Google Scholar 

  3. Banerjee T, Liu Y, Crews DC. Dietary patterns and CKD progression. Blood Purif. 2016;41:117–22.

    Article  CAS  PubMed  Google Scholar 

  4. Academy of Nutrition and Dietetics. Chronic Kidney Disease (CKD) Guideline (2010). Available from: Accesed 22 July 2017.

  5. Fouque D, Mitch WE. Low-protein diets in chronic kidney disease: are we finally reaching a consensus? Nephrol Dial Transplant. 2015;30:6–8.

    Article  CAS  PubMed  Google Scholar 

  6. Klahr S, Levey AS, Beck GJ, Caggiula AW, Hunsicker L, Kusek JW, et al. The effects of dietary protein restriction and blood-pressure control on the progression of chronic renal disease. Modification of diet in renal disease study group. N Engl J Med. 1994;330:877–84.

    Article  CAS  PubMed  Google Scholar 

  7. Menon V, Kopple JD, Wang X, Beck GJ, Collins AJ, Kusek JW, et al. Effect of a very low-protein diet on outcomes: long-term follow-up of the modification of diet in renal disease (MDRD) study. Am J Kidney Dis. 2009;53:208–17.

    Article  CAS  PubMed  Google Scholar 

  8. Fouque D, Pelletier S, Mafra D, Chauveau P. Nutrition and chronic kidney disease. Kidney International. 2011;80:348–57.

  9. Bross R, Noori N, Kovesdy CP, Murali SB, Benner D, Block G, et al. Dietary assessment of individuals with chronic kidney disease. Semin Dial. 2010;23:359–64.

    Article  PubMed  PubMed Central  Google Scholar 

  10. Gopinath B, Harris DC, Flood VM, Burlutsky G, Mitchell P. Associations between dairy food consumption and chronic kidney disease in older adults. Sci Rep. 2016;6:39532.

    Article  CAS  PubMed  PubMed Central  Google Scholar 

  11. Lew QJ, Jafar TH, Koh HW, Jin A, Chow KY, Yuan JM, et al. Red meat intake and risk of ESRD. J Am Soc Nephrol. 2017;28:304–12.

    Article  PubMed  Google Scholar 

  12. Mirmiran P, Yuzbashian E, Bahadoran Z, Asghari G, Azizi F. Dietary Acid-Base load and risk of chronic kidney disease in adults: Tehran lipid and glucose study. Iran J Kidney Dis. 2016;10:119–25.

    PubMed  Google Scholar 

  13. Diaz-Lopez A, Bullo M, Basora J, Martinez-Gonzalez MA, Guasch-Ferre M, Estruch R, et al. Cross-sectional associations between macronutrient intake and chronic kidney disease in a population at high cardiovascular risk. Clin Nutr. 2013;32:606–12.

    Article  CAS  PubMed  Google Scholar 

  14. Koning SH, Gansevoort RT, Mukamal KJ, Rimm EB, Bakker SJ, Joosten MM. Alcohol consumption is inversely associated with the risk of developing chronic kidney disease. Kidney Int. 2015;87:1009–16.

    Article  CAS  PubMed  Google Scholar 

  15. Nerbass FB, Pecoits-Filho R, McIntyre NJ, McIntyre CW, Willingham FC, Taal MW. Demographic associations of high estimated sodium intake and frequency of consumption of high-sodium foods in people with chronic kidney disease stage 3 in England. J Ren Nutr. 2014;24:236–42.

    Article  CAS  PubMed  Google Scholar 

  16. Domingos MAM, Goulart AC, Lotufo PA, Bensenor IJM, Titan SMO. Chronic kidney disease - determinants of progression and cardiovascular risk. PROGREDIR cohort study: design and methods. Sao Paulo Med J. 2017;135:133–9.

    Article  PubMed  Google Scholar 

  17. Clavel-Chapelon F, van Liere MJ, Giubout C, Niravong MY, Goulard H, Le CC, et al. E3N, a French cohort study on cancer risk factors. E3N Group. Etude Epidemiologique aupres de femmes de l'Education Nationale. Eur J Cancer Prev. 1997;6:473–8.

    Article  CAS  PubMed  Google Scholar 

  18. Clavel-Chapelon F. Cohort profile: the French E3N cohort study. Int J Epidemiol. 2015;44:801–9.

    Article  PubMed  Google Scholar 

  19. Montagni I, Guichard E, Carpenet C, Tzourio C, Kurth T. Screen time exposure and reporting of headaches in young adults: a cross-sectional study. Cephalalgia. 2015;36(11):1020-7. doi:10.1177/0333102415620286.

  20. Vandentorren S, Bois C, Pirus C, Sarter H, Salines G, Leridon H. Rationales, design and recruitment for the Elfe longitudinal study. BMC Pediatr. 2009;9:58.

    Article  PubMed  PubMed Central  Google Scholar 

  21. Vercambre MN, Boutron-Ruault MC, Niravong M, Berr C, Clavel-Chapelon F, Ragusa S. Performance of a short dietary questionnaire to assess nutrient intake using regression-based weights. Public Health Nutr. 2009;12:547–52.

    Article  PubMed  Google Scholar 

  22. Giovannelli J, Dallongeville J, Wagner A, Bongard V, Laillet B, Marecaux N, et al. Validation of a short, qualitative food frequency questionnaire in French adults participating in the MONA LISA-NUT study 2005-2007. J Acad Nutr Diet. 2014;114:552–61.

    Article  PubMed  Google Scholar 

  23. Barrat E, Aubineau N, Maillot M, Derbord E, Barthes P, Lescuyer JF, et al. Repeatability and relative validity of a quantitative food-frequency questionnaire among French adults. Food Nutr Res. 2012;56:1,18472, doi: 10.3402/fnr.v56i0.18472.

  24. Kipnis V, Midthune D, Freedman L, Bingham S, Day NE, Riboli E, et al. Bias in dietary-report instruments and its implications for nutritional epidemiology. Public Health Nutr. 2002;5:915–23.

    Article  PubMed  Google Scholar 

  25. Stengel B, Combe C, Jacquelinet C, Briancon S, Fouque D, Laville M, et al. The French chronic kidney disease-renal epidemiology and information network (CKD-REIN) cohort study: to better understand chronic kidney disease. Nephrol Ther. 2016;12(Suppl 1):S49–56.

    Article  PubMed  Google Scholar 

  26. Cottet V, Touvier M, Fournier A, Touillaud MS, Lafay L, Clavel-Chapelon F, et al. Postmenopausal breast cancer risk and dietary patterns in the E3N-EPIC prospective cohort study. Am J Epidemiol. 2009;170:1257–67.

    Article  PubMed  Google Scholar 

  27. FAO/WHO/ONU. Report of a join expert consultation. Energy and protein requirements. Geneva: WHO Technical Report; 1985.

    Google Scholar 

  28. Schofield WN. Predicting basal metabolic rate, new standards and review of previous work. Hum Nutr Clin Nutr. 1985;39(Suppl 1):5–41.

    PubMed  Google Scholar 

  29. Bonifacj C, Gerber M, Scali J, Daures JP. Comparison of dietary assessment methods in a southern French population: use of weighed records, estimated-diet records and a food-frequency questionnaire. Eur J Clin Nutr. 1997;51:217–31.

    Article  CAS  PubMed  Google Scholar 

  30. Deschamps V, de Lauzon-Guillain B, Lafay L, Borys JM, Charles MA, Romon M. Reproducibility and relative validity of a food-frequency questionnaire among French adults and adolescents. Eur J Clin Nutr. 2009;63:282–91.

    Article  CAS  PubMed  Google Scholar 

  31. Kesse-Guyot E, Castetbon K, Touvier M, Hercberg S, Galan P. Relative validity and reproducibility of a food frequency questionnaire designed for French adults. Ann Nutr Metab. 2010;57:153–62.

    Article  CAS  PubMed  Google Scholar 

  32. van Liere MJ, Lucas F, Clavel F, Slimani N, Villeminot S. Relative validity and reproducibility of a French dietary history questionnaire. Int J Epidemiol. 1997;26(Suppl 1):S128–36.

    Article  PubMed  Google Scholar 

  33. AFSSA (Agence Française de Sécurité Sanitaire des Aliments). INCA2 - Etude Individuelle Nationale des Consommations Alimentaires 2 - 2009. Accessed 22 July 2017.

  34. Lucas F, Niravong M, Villeminot S, Kaaks R, Clavel-Chapelon F. Estimation of food portion size using photographs: relative validity, strengths, weaknesses and recommendations. J Hum Nutr Diet. 1995;8:65–74.

    Article  Google Scholar 

  35. ANSES (Agence nationale de sécurité sanitaire- alimentation et. 2016. Accessed 22 July 2017.

  36. Rosner B, Willett WC. Interval estimates for correlation coefficients corrected for within-person variation: implications for study design and hypothesis testing. Am J Epidemiol. 1988;127:377–86.

    Article  CAS  PubMed  Google Scholar 

  37. Willett WC. Nutritional epidemiology. New York: Oxford University Press edn; 1998.

    Book  Google Scholar 

  38. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986;1:307–10.

    Article  CAS  PubMed  Google Scholar 

  39. Bland JM, Altman DG. Agreed statistics: measurement method comparison. Anesthesiology. 2012;116:182–5.

    Article  PubMed  Google Scholar 

  40. Douglas G. Altman: practical statistics for medical research. Chap 14; 1990. p. 396–403.

    Google Scholar 

  41. Hebert JR, Hurley TG, Steck SE, Miller DR, Tabung FK, Peterson KE, et al. Considering the value of dietary assessment data in informing nutrition-related health policy. Adv Nutr. 2014;5:447–55.

    Article  PubMed  PubMed Central  Google Scholar 

  42. Cade J, Thompson R, Burley V, Warm D. Development, validation and utilisation of food-frequency questionnaires - a review. Public Health Nutr. 2002;5:567–87.

    Article  PubMed  Google Scholar 

  43. Molag ML, de Vries JH, Ocke MC, Dagnelie PC, van den Brandt PA, Jansen MC, et al. Design characteristics of food frequency questionnaires in relation to their validity. Am J Epidemiol. 2007;166:1468–78.

    Article  PubMed  Google Scholar 

  44. Satija A, Yu E, Willett WC, Hu FB. Understanding nutritional epidemiology and its role in policy. Adv Nutr. 2015;6:5–18.

    Article  PubMed  PubMed Central  Google Scholar 

  45. Potosky AL, Block G, Hartman AM. The apparent validity of diet questionnaires is influenced by number of diet-record days used for comparison. J Am Diet Assoc. 1990;90:810–3.

    CAS  PubMed  Google Scholar 

  46. Mennen LI, Bertrais S, Galan P, Arnault N. Potier de CG, Hercberg S. The use of computerised 24 h dietary recalls in the French SU.VI.MAX study: number of recalls required. Eur J Clin Nutr. 2002;56:659–65.

    Article  CAS  PubMed  Google Scholar 

  47. Stram DO, Longnecker MP, Shames L, Kolonel LN, Wilkens LR, Pike MC, et al. Cost-efficient design of a diet validation study. Am J Epidemiol. 1995;142:353–62.

    Article  CAS  PubMed  Google Scholar 

  48. Hebert JR, Ma Y, Clemow L, Ockene IS, Saperia G, Stanek EJ III, et al. Gender differences in social desirability and social approval bias in dietary self-report. Am J Epidemiol. 1997;146:1046–55.

    Article  CAS  PubMed  Google Scholar 

  49. Hebert JR, Ebbeling CB, Matthews CE, Hurley TG, Ma Y, Druker S, et al. Systematic errors in middle-aged women's estimates of energy intake: comparing three self-report measures to total energy expenditure from doubly labeled water. Ann Epidemiol. 2002;12:577–86.

    Article  PubMed  Google Scholar 

  50. Haute Autorité de santé.. Guide du parcours de soins. Maladie rénale Chronique de l'adulte. Saint-Denis, HAS, avril 2012, 29 pages.

  51. Pietinen P, Hartman AM, Haapa E, Rasanen L, Haapakoski J, Palmgren J, et al. Reproducibility and validity of dietary assessment instruments. II. A qualitative food frequency questionnaire. Am J Epidemiol. 1988;128:667–76.

    Article  CAS  PubMed  Google Scholar 

  52. Kaaks R, Slimani N, Riboli E. Pilot phase studies on the accuracy of dietary intake measurements in the EPIC project: overall evaluation of results. European prospective investigation into cancer and nutrition. Int J Epidemiol. 1997;26(Suppl 1):S26–36.

    Article  PubMed  Google Scholar 

  53. Tsubono Y, Nishino Y, Fukao A, Hisamichi S, Tsugane S. Temporal change in the reproducibility of a self-administered food frequency questionnaire. Am J Epidemiol. 1995;142:1231–5.

    Article  CAS  PubMed  Google Scholar 

  54. Cade JE, Burley VJ, Warm DL, Thompson RL, Margetts BM. Food-frequency questionnaires: a review of their design, validation and utilisation. Nutr Res Rev. 2004;17:5–22.

    Article  CAS  PubMed  Google Scholar 

  55. Asghari G, Rezazadeh A, Hosseini-Esfahani F, Mehrabi Y, Mirmiran P, Azizi F. Reliability, comparative validity and stability of dietary patterns derived from an FFQ in the Tehran lipid and glucose study. Br J Nutr. 2012;108:1109–17.

    Article  CAS  PubMed  Google Scholar 

  56. Barclay AW, Flood VM, Brand-Miller JC, Mitchell P. Validity of carbohydrate, glycaemic index and glycaemic load data obtained using a semi-quantitative food-frequency questionnaire. Public Health Nutr. 2008;11:573–80.

    Article  PubMed  Google Scholar 

  57. Fernandez-Ballart JD, Pinol JL, Zazpe I, Corella D, Carrasco P, Toledo E, et al. Relative validity of a semi-quantitative food-frequency questionnaire in an elderly Mediterranean population of Spain. Br J Nutr. 2010;103:1808–16.

    Article  CAS  PubMed  Google Scholar 

  58. Hankin JH, Stram DO, Arakawa K, Park S, Low SH, Lee HP, et al. Singapore Chinese health study: development, validation, and calibration of the quantitative food frequency questionnaire. Nutr Cancer. 2001;39:187–95.

    Article  CAS  PubMed  Google Scholar 

  59. Mannato LW, Pereira TS, Velasquez-Melendez G, Cardoso LO, Bensenor IM, Molina MC. Comparison of a short version of the food frequency questionnaire with its long version--a cross-sectional analysis in the Brazilian longitudinal study of adult health (ELSA-Brasil). Sao Paulo Med J. 2015;133:414–20.

    Article  PubMed  Google Scholar 

  60. Beaton GH. Approaches to analysis of dietary data: relationship between planned analyses and choice of methodology. Am J Clin Nutr. 1994;59:253S–61S.

    CAS  PubMed  Google Scholar 

  61. Dienemann T, Fujii N, Orlandi P, Nessel L, Furth SL, Hoy WE, et al. International network of chronic kidney disease cohort studies (iNET-CKD): a global network of chronic kidney disease cohorts. BMC Nephrol. 2016;17:121.

    Article  PubMed  PubMed Central  Google Scholar 

Download references


The authors are grateful to all participants for providing the data used in this validity and reproducibility study. We thank Anne Forhan for her advices.

CKD-REIN study investigators autorship: Bénédicte Stengel (PI- Inserm, Villejuif, France), Christian Jacquelinet (Agence de Biomédecine, Saint-Denis, France), Bruce Robinson (Arbor Research Collaborative for Health, Ann Arbor, USA), Ziad A.Massy (CHU A. Paré, Boulogne, France), Christian Combe (CHU de Bordeaux, Bordeaux, France), Denis Fouque et Maurice Laville (CHU Lyon-Sud), Luc Frimat (CHU de Nancy, Nancy, France), Carole Ayav (CHU de Nancy, Nancy, France) et Serge Briançon (CHU de Nancy, Nancy, France), Christophe Pascal (IFROSS, Université de Lyon), Yves-Edouard Herpe (Biobanque de Picardie, Picardie, France), François Deleuze (CEA-CNG, Evry, France), Joost Schanstra (Inserm Toulouse, Toulouse, France), Pascal Morel (EFS, Bourgogne, France).


The CKD-REIN cohort is funded by the Agence Nationale de la Recherche (ANR-10-COHO-01-05) through the 2010 ‘Cohortes-Investissements d’Avenir’ programme and by the 2010 national Programme Hospitalier de Recherche Clinique. CKD-REIN is also supported through partnership agreements with Amgen, Baxter, Fresenius Medical Care, GlaxoSmithKline, Lilly, Merck Sharp and Dohme-Chibret (MSD France), and Otsuka. This present work was supported by a grant from the French Research Institute in Public Health (IReSP) and the French multi-organism thematic Institutes in Public Health (ITMO Santé Publique). AA is supported by a doctoral grant from the French National Cancer Institute. SW is funded by the F-CRIN INI-CRCT network. GF is supported by the French Research Agency (ANR, Agence Nationale de la Recherche) via an “Investissement d’Avenir” grant (investment for the future grant, ANR-10-COHO-0006) that supports the E4N study. The CKD-REIN public-private funding partners, Inserm, IReSP, ITMO Santé Publique, the French National Cancer Institute, the F-CRIN INI-CRCT network and ANR had no role in the design, analysis or writing of this article.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Author information

Authors and Affiliations




AA, SW, DEF, CD, EC, MN, FC-C, JDC, DF, BS, M-CB-R and GF contributed to the data collection; AA and GF formulated the research questions, designed the research. DEF and SW performed the statistical analysis. AA performed primary manuscript preparation; AA, SW and GF wrote the paper. GF has primary responsibility for the final content; and SW, DEF, CD, EC, MN, FC-C, JDC, DF, BS and M-CB-R reviewed the paper and revised it critically. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Marie-Christine Boutron-Ruault.

Ethics declarations

Ethics approval and consent to participate

This study was conducted according to the guidelines laid down in the Declaration of Helsinki and all procedures involving human subjects were approved by the French National Commission for Computerized Data and Individual Freedom (CNIL). All participants signed a letter of informed consent to allow their data to be stored, as required by the CNIL.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Additional files

Additional file 1:

Flow diagram. (DOCX 85 kb)

Additional file 2:

SFFQ items used to obtain nutritional data (n = 49). (DOCX 20 kb)

Additional file 3:

Extract from the questionnaire. (DOCX 331 kb)

Additional file 4:

Distribution of EI/BMR according to dietary method and reproducibility/validity study. (DOCX 16 kb)

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (, which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and Permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Affret, A., Wagner, S., El Fatouhi, D. et al. Validity and reproducibility of a short food frequency questionnaire among patients with chronic kidney disease. BMC Nephrol 18, 297 (2017).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI:


  • Chronic kidney disease
  • Short food frequency questionnaire
  • Validity
  • Reproducibility
  • Diet
  • Dietary assessment