Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging
Abstract
:1. Introduction
2. Methods
2.1. Study Sample
2.2. Data Collection
2.3. SDQ
2.4. 24HRs
2.5. ASA24 Feasibility Questionnaire
2.6. Nutrient Calculations
2.7. Statistical Analyses
3. Results
3.1. Test-Retest Reliability
3.2. Validity
3.3. Feasibility of the ASA24
4. Discussion
Supplementary Materials
Author Contributions
Funding
Acknowledgments
Conflicts of Interest
References
- World Cancer Research Fund/American Institute for Cancer Research. Diet, Nutrition, Physical Activity and Cancer: A Global Perspective. Continious Update Project Expert Report 2018. 2018. Available online: https://www.wcrf.org/sites/default/files/Summary-third-expert-report.pdf (accessed on 25 June 2016).
- Schulze, M.B.; Martinez-Gonzalez, M.A.; Fung, T.T.; Lichtenstein, A.H.; Forouhi, N.G. Food based dietary patterns and chronic disease prevention. BMJ 2018, 361, k2396. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kiefte-de Jong, J.C.; Mathers, J.C.; Franco, O.H. Nutrition and healthy ageing: The key ingredients. Proc. Nutr. Soc. 2014, 73, 249–259. [Google Scholar] [CrossRef] [PubMed]
- Willett, W. Nutritional Epidemiology, 3rd ed.; Oxford University Press: New York, NY, USA, 2012. [Google Scholar]
- Bartali, B.; Turrini, A.; Salvini, S.; Lauretani, F.; Russo, C.R.; Corsi, A.M.; Bandinellia, S.; Amleto, D.A.; Pall, D.; Guralnik, J.M. Dietary intake estimated using different methods in two Italian older populations. Arch. Gerontol. Geriatr. 2004, 38, 51–60. [Google Scholar] [CrossRef]
- De Vries, J.H.; de Groot, L.C.; van Staveren, W.A. Dietary assessment in elderly people: Experiences gained from studies in the Netherlands. Eur. J. Clin. Nutr. 2009, 63 (Suppl. 1), S69–S74. [Google Scholar] [CrossRef] [PubMed]
- Eysteinsdottir, T.; Thorsdottir, I.; Gunnarsdottir, I.; Steingrimsdottir, L. Assessing validity of a short food frequency questionnaire on present dietary intake of elderly Icelanders. Nutr. J. 2012, 11, 12. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Jia, X.; Craig, L.C.; Aucott, L.S.; Milne, A.C.; McNeill, G. Repeatability and validity of a food frequency questionnaire in free-living older people in relation to cognitive function. J. Nutr. Health Aging 2008, 12, 735–741. [Google Scholar] [PubMed]
- Ortiz-Andrellucchi, A.; Sanchez-Villegas, A.; Doreste-Alonso, J.; de Vries, J.; de Groot, L.; Serra-Majem, L. Dietary assessment methods for micronutrient intake in elderly people: A systematic review. Br. J. Nutr. 2009, 102 (Suppl. 1), S118–S149. [Google Scholar] [CrossRef] [PubMed]
- Van Staveren, W.A.; de Groot, L.C.; Blauw, Y.H.; van der Wielen, R.P. Assessing diets of elderly people: Problems and approaches. Am. J. Clin. Nutr. 1994, 59 (Suppl. 1), 221S–223S. [Google Scholar] [CrossRef] [PubMed]
- Raina, P.S.; Wolfson, C.; Kirkland, S.A.; Griffith, L.E.; Oremus, M.; Patterson, C.; Tuokko, H.; Penning, M.; Balion, M.C.; Hogan, D.; et al. The Canadian longitudinal study on aging (CLSA). Can. J. Aging 2009, 28, 221–229. [Google Scholar] [CrossRef] [PubMed]
- Shatenstein, B.; Payette, H. Evaluation of the Relative Validity of the Short Diet Questionnaire for Assessing Usual Consumption Frequencies of Selected Nutrients and Foods. Nutrients 2015, 7, 6362–6374. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kelly, P.; Fitzsimons, C.; Baker, G. Should we reframe how we think about physical activity and sedentary behaviour measurement? Validity and reliability reconsidered. Int. J. Behav. Nutr. Phys. Act. 2016, 13, 32. [Google Scholar] [CrossRef] [PubMed]
- Schatzkin, A.; Subar, A.F.; Moore, S.; Park, Y.; Potischman, N.; Thompson, F.E.; Leitzmann, M.; Hollenbeck, A.; Morrissey, K.G.; Kipnis, V. Observational epidemiologic studies of nutrition and cancer: The next generation (with better observation). Cancer Epidemiol. Biomark. Prev. 2009, 18, 1026–1032. [Google Scholar] [CrossRef] [PubMed]
- Subar, A.F.; Kirkpatrick, S.I.; Mittl, B.; Zimmerman, T.P.; Thompson, F.E.; Bingley, C.; Willis, G.; Islam, N.G.; Baranowski, T.; McNutt, S.; et al. The Automated Self-Administered 24-h dietary recall (ASA24): A resource for researchers, clinicians, and educators from the National Cancer Institute. J. Acad. Nutr. Diet. 2012, 112, 1134–1137. [Google Scholar] [CrossRef] [PubMed]
- Kirkpatrick, S.I.; Subar, A.F.; Douglass, D.; Zimmerman, T.P.; Thompson, F.E.; Kahle, L.L.; George, S.M.; Dodd, K.W.; Potischman, N. Performance of the Automated Self-Administered 24-h Recall relative to a measure of true intakes and to an interviewer-administered 24-h recall. Am. J. Clin. Nutr. 2014, 100, 233–240. [Google Scholar] [CrossRef] [PubMed]
- Thompson, F.E.; Dixit-Joshi, S.; Potischman, N.; Dodd, K.W.; Kirkpatrick, S.I.; Kushi, L.H.; Alexander, G.L.; Coleman, L.A.; Zimmerman, T.P.; Sundaram, M.E. Comparison of Interviewer-Administered and Automated Self-Administered 24-H Dietary Recalls in 3 Diverse Integrated Health Systems. Am. J. Epidemiol. 2015, 181, 970–978. [Google Scholar] [CrossRef] [PubMed]
- Kirkpatrick, S.I.; Potischman, N.; Dodd, K.W.; Douglass, D.; Zimmerman, T.P.; Kahle, L.L. The Use of Digital Images in 24-H Recalls May Lead to Less Misestimation of Portion Size Compared with Traditional Interviewer-Administered Recalls. J. Nutr. 2016, 146, 2567–2573. [Google Scholar] [CrossRef] [PubMed]
- Ettienne-Gittens, R.; Boushey, C.J.; Au, D.; Murphy, S.P.; Lim, U.; Wilkens, L. Evaluating the feasibility of utilizing the Automated Self-administered 24-h (ASA24) dietary recall in a sample of multiethnic older adults. Procedia Food Sci. 2013, 2, 134–144. [Google Scholar] [CrossRef] [PubMed]
- Moinester, M.; Gottfried, R. Sample size estimation for correlations with pre-specified confidence interval. Quant. Methods Psychol. 2014, 10, 124–130. [Google Scholar] [CrossRef]
- Carroll, R.J.; Midthune, D.; Subar, A.F.; Shumakovich, M.; Freedman, L.S.; Thompson, F.E.; Kipnis, V. Taking advantage of the strengths of 2 different dietary assessment instruments to improve intake estimates for nutritional epidemiology. Am. J. Epidemiol. 2012, 175, 340–347. [Google Scholar] [CrossRef] [PubMed]
- Brooke, J. SUS: A “quick and dirty” usability scale”. In Usability Evaluation in Industry; Jordan, P.W., Thomas, B., McClelland, I.L., Weerdmeester, B., Eds.; Taylor & Francis: London, UK, 1996; pp. 189–194. [Google Scholar]
- Shatenstein, B.; Nadon, S.; Godin, C.; Ferland, G. Development and validation of a food frequency questionnaire. Can. J. Diet. Pract. Res. 2005, 66, 67–75. [Google Scholar] [CrossRef] [PubMed]
- Gaudreau, P.; Morais, J.A.; Shatenstein, B.; Gray-Donald, K.; Khalil, A.; Dionne, I.; Fülöp, T.; Jacques, D.; Kergoat, M.J.; Tessier, D. Nutrition as a determinant of successful aging: Description of the Quebec longitudinal study Nuage and results from cross-sectional pilot studies. Rejuvenation Res. 2007, 10, 377–386. [Google Scholar] [CrossRef] [PubMed]
- Reviewing & Cleaning ASA24® Data. Available online: https://epi.grants.cancer.gov/asa24/resources/cleaning.html. (accessed on 25 June 2016).
- Landis, J.R.; Koch, G.G. The measurement of observer agreement for categorical data. Biometrics 1977, 33, 159–174. [Google Scholar] [CrossRef] [PubMed]
- Gilsing, A.; Mayhew, A.J. McMaster University: Hamilton, ON, Canada, Unpublished work. 2018.
- Erkkola, M.; Karppinen, M.; Javanainen, J.; Rasanen, L.; Knip, M.; Virtanen, S.M. Validity and reproducibility of a food frequency questionnaire for pregnant Finnish women. Am. J. Epidemiol. 2001, 154, 466–476. [Google Scholar] [CrossRef] [PubMed]
- Hebden, L.; Kostan, E.; O’Leary, F.; Hodge, A.; Allman-Farinelli, M. Validity and reproducibility of a food frequency questionnaire as a measure of recent dietary intake in young adults. PLoS ONE 2013, 8, e75156. [Google Scholar] [CrossRef] [PubMed]
- Thompson, F.E.; Metzner, H.L.; Lamphiear, D.E.; Hawthorne, V.M. Characteristics of individuals and long term reproducibility of dietary reports: The Tecumseh Diet Methodology Study. J. Clin. Epidemiol. 1990, 43, 1169–1178. [Google Scholar] [CrossRef]
- Lombard, M.J.; Steyn, N.P.; Charlton, K.E.; Senekal, M. Application and interpretation of multiple statistical tests to evaluate validity of dietary intake assessment methods. Nutr. J. 2015, 14, 40. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Register of Validated Short Dietary Assessment Instruments. Available online: https://epi.grants.cancer.gov/diet/shortreg/ (accessed on 16 January 2018).
- Marks, G.C.; Hughes, M.C.; van der Pols, J.C. The effect of personal characteristics on the validity of nutrient intake estimates using a food-frequency questionnaire. Public Health Nutr. 2006, 9, 394–402. [Google Scholar] [CrossRef] [PubMed]
- Thompson, F.E.; Midthune, D.; Subar, A.F.; Kahle, L.L.; Schatzkin, A.; Kipnis, V. Performance of a short tool to assess dietary intakes of fruits and vegetables, percentage energy from fat and fibre. Public Health Nutr. 2004, 7, 1097–1105. [Google Scholar] [CrossRef] [PubMed]
- Thompson, F.E.; Midthune, D.; Kahle, L.; Dodd, K.W. Development and Evaluation of the National Cancer Institute’s Dietary Screener Questionnaire Scoring Algorithms. J. Nutr. 2017, 147, 1226–1233. [Google Scholar] [CrossRef] [PubMed] [Green Version]
- Kirkpatrick, S.I.; Gilsing, A.M.; Hobin, E.; Solbak, N.M.; Wallace, A.; Haines, J.; Mayhew, A.J.; Orr, S.K.; Raina, P.; Robson, P.J. Lessons from Studies to Evaluate an Online 24-H Recall for Use with Children and Adults in Canada. Nutrients 2017, 9, 100. [Google Scholar] [CrossRef] [PubMed]
n (Total = 232) | % | |
---|---|---|
Sex | ||
Males | 115 | 49.6 |
Females | 117 | 50.4 |
Age | ||
5–64 years | 103 | 44.4 |
65 + years | 129 | 55.6 |
Education | ||
Less than secondary | 6 | 2.6 |
Secondary | 22 | 9.5 |
Some post-secondary | 23 | 10.0 |
Post-secondary | 180 | 77.9 |
Household Income | ||
Less than $20,000 | 3 | 1.4 |
$20,000–$49,999 | 35 | 16.0 |
$50,000–$99,999 | 77 | 35.2 |
$100,000–$149,999 | 59 | 26.9 |
Greater than $150,000 | 45 | 20.5 |
Marital Status | ||
Single, never married, or never lived with partner | 11 | 5.0 |
Married, living common law | 172 | 78.5 |
Widowed, divorced, separated | 36 | 16.4 |
Body Mass Index | ||
Underweight (<18.5 kg/m2) | 2 | 0.9 |
Normal weight (18.5–24.9 kg/m2) | 58 | 25.0 |
Overweight (25.0–29.9 kg/m2) | 112 | 48.3 |
Obese (>30.0 kg/m2) | 60 | 25.9 |
Smoking Status | ||
Current smoker | 16 | 9.1 |
Former smoker | 98 | 56.0 |
Never smoker | 61 | 34.9 |
Alcohol Consumption in Past 12 Months | ||
Regular drinker (at least once a month) | 176 | 80.4 |
Occasional drinker | 24 | 11.0 |
Did not drink in the past 12 months | 19 | 8.7 |
SDQ1 | SDQ2 | ICC (95% CI) | Weighted Kappa (95% CI) | |||
---|---|---|---|---|---|---|
Mean | SD | Mean | SD | |||
Middle Aged (45–64 years; n = 103) | ||||||
Dietary fiber (g) | 14.3 | 4.8 | 13.2 | 5.1 | 0.57 (0.42–0.69) | 0.41 (0.30–0.52) |
Protein (g) | 65.4 | 20.3 | 63.5 | 16.6 | 0.49 (0.32–0.63) | 0.33 (0.20–0.46) |
Calcium (mg) | 740.4 | 381.6 | 750.0 | 317.8 | 0.53 (0.37–0.66) | 0.43 (0.31–0.55) |
Fat (g) | 53.5 | 17.3 | 51.2 | 14.4 | 0.49 (0.32–0.63) | 0.36 (0.23–0.49) |
Vitamin D (ug) | 4.7 | 3.0 | 5.0 | 2.5 | 0.54 (0.38–0.67) | 0.40 (0.28–0.52) |
Cholesterol (mg) | 221.4 | 84.8 | 208.9 | 74.4 | 0.62 (0.48–0.73) | 0.45 (0.33–0.58) |
MUFA (mg) | 19.8 | 6.9 | 18.8 | 5.7 | 0.44 (0.26–0.59) | 0.34 (0.21–0.47) |
PUFA (mg) | 10.3 | 3.5 | 10.0 | 3.3 | 0.52 (0.36–0.66) | 0.43 (0.31–0.54) |
Saturated fat (mg) | 19.2 | 6.6 | 18.1 | 5.6 | 0.57 (0.41–0.70) | 0.47 (0.42–0.52) |
Seniors (65+ years; n = 129) | ||||||
Dietary fiber (g) | 15.5 | 5.0 | 15.2 | 5.1 | 0.55 (0.41–0.66) | 0.34 (0.23–0.45) |
Protein (g) | 65.7 | 17.2 | 67.0 | 17.4 | 0.57 (0.44–0.68) | 0.38 (0.27–0.48) |
Calcium (mg) | 758.6 | 315.7 | 845.4 | 361.0 | 0.57 (0.42–0.68) | 0.37 (0.25–0.49) |
Fat (g) | 53.2 | 16.4 | 54.6 | 17.8 | 0.53 (0.39–0.65) | 0.36 (0.26–0.47) |
Vitamin D (ug) | 5.1 | 2.6 | 5.8 | 2.7 | 0.60 (0.46–0.70) | 0.40 (0.29–0.51) |
Cholesterol (mg) | 213.6 | 74.0 | 220.8 | 81.7 | 0.59 (0.46–0.70) | 0.42 (0.31–0.53) |
MUFA (mg) | 19.6 | 6.5 | 19.8 | 7.1 | 0.53 (0.39–0.65) | 0.38 (0.27–0.48) |
PUFA (mg) | 10.4 | 3.6 | 10.4 | 3.4 | 0.51 (0.37–0.63) | 0.28 (0.16–0.40) |
Saturated fat (mg) | 17.3 | 6.0 | 19.3 | 7.0 | 0.54 (0.38–0.66) | 0.35 (0.29–0.40) |
SDQ1 | SDQ2 | ICC (95%) CI | |||
---|---|---|---|---|---|
SDQ Line Item Combination | Mean | SD | Mean | SD | |
Fresh red meat 1 | 0.30 | 0.27 | 0.30 | 0.22 | 0.47 (0.36–0.56) |
Total fresh meat and fish 2 | 0.62 | 0.34 | 0.62 | 0.30 | 0.58 (0.48–0.66) |
Total fresh and processed meat, and fish 3 | 0.78 | 0.46 | 0.77 | 0.43 | 0.35 (0.23–0.46) |
Milk 4 | 0.90 | 0.97 | 1.05 | 0.85 | 0.62 (0.54–0.70) |
Cheese 5 | 0.52 | 0.35 | 0.52 | 0.45 | 0.42 (0.31–0.52) |
Eggs 6 | 0.32 | 0.24 | 0.32 | 0.24 | 0.70 (0.63–0.76) |
Yoghurt 7 | 0.52 | 0.46 | 0.47 | 0.42 | 0.72 (0.65–0.77) |
Vegetables excluding potatoes 8 | 1.89 | 1.07 | 1.82 | 1.00 | 0.49 (0.39–0.58) |
Fruit juice 9 | 0.41 | 0.56 | 0.42 | 0.71 | 0.50 (0.40–0.59) |
Calcium supplemented food 10 | 0.09 | 0.32 | 0.09 | 0.34 | 0.44 (0.33–0.54) |
Sweet desserts and chocolate 11 | 0.41 | 0.39 | 0.39 | 0.42 | 0.60 (0.51–0.68) |
Sweet and salty snacks and desserts 12 | 0.72 | 0.54 | 0.77 | 0.55 | 0.65 (0.57–0.72) |
SDQ2 | 24-HRs | Spearman R * | Weighted Kappa | |||
---|---|---|---|---|---|---|
Mean | SD | Mean | SD | |||
Middle aged (45–64 years; n = 96) | ||||||
Dietary fiber (g) | 13.3 | 5.3 | 19.8 | 8.1 | 0.59 | 0.36 |
Calcium (mg) | 734 | 312 | 899 | 353 | 0.50 | 0.37 |
Vitamin D (ug) | 4.8 | 2.5 | 5.5 | 4.5 | 0.51 | 0.28 |
Total fat (g) | 50.7 | 14 | 75.4 | 20 | 0.26 | 0.23 |
Cholesterol (mg) | 210 | 76 | 273 | 105 | 0.31 | 0.20 |
Monounsaturated fat (g) | 18.6 | 5.6 | 27.9 | 7.6 | 0.21 | 0.16 |
Polyunsaturated fat (g) | 9.9 | 3.2 | 16.3 | 5.8 | 0.29 | 0.14 |
Saturated fat (g) | 17.8 | 5.5 | 24.8 | 7.6 | 0.26 | 0.18 |
Seniors (65+ years; n = 104) | ||||||
Dietary fiber (g) | 15.5 | 4.8 | 21.4 | 4.1 | 0.29 | 0.17 |
Calcium (mg) | 849 | 352 | 922 | 351 | 0.38 | 0.22 |
Vitamin D (ug) | 5.9 | 2.5 | 6.6 | 4.3 | 0.49 | 0.32 |
Total fat (g) | 55.5 | 17 | 73.7 | 28 | 0.25 | 0.21 |
Cholesterol (mg) | 221 | 82 | 268 | 112 | 0.24 | 0.17 |
Monounsaturated fat (g) | 20.1 | 6.4 | 26.4 | 10.6 | 0.23 | 0.16 |
Polyunsaturated fat (g) | 10.9 | 3.5 | 17.1 | 8.5 | 0.17 | 0.17 |
Saturated fat (g) | 19.4 | 6.3 | 23.8 | 9.6 | 0.31 | 0.25 |
SUS Item | Disagree (%) | Neutral (%) | Agree (%) |
---|---|---|---|
I think that I would like to use the diet survey frequently | 45.1 | 37.2 | 17.7 |
I found the diet survey unnecessarily complex | 42.0 | 17.0 | 50.4 |
I thought the diet survey was easy to use | 31.9 | 17.7 | 50.4 |
I think I would need the support of a technical person to be able to use the diet survey | 77.0 | 10.6 | 12.4 |
I found the various functions of the ASA24-Canada were well integrated. | 17.7 | 31.0 | 51.3 |
I thought there was too much inconsistency in the ASA24-Canada | 55.8 | 37.2 | 7.1 |
I imagine that most people would learn to use the ASA24-Canada very quickly | 29.2 | 26.5 | 44.2 |
I found the ASA24-Canada very cumbersome to use | 39.8 | 16.8 | 43.4 |
I felt very confident using the ASA24-Canada | 12.5 | 23.2 | 64.3 |
I needed to learn a lot of things before I could use the ASA24-Canada | 71.7 | 20.4 | 8.0 |
© 2018 by the authors. Licensee MDPI, Basel, Switzerland. This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (http://creativecommons.org/licenses/by/4.0/).
Share and Cite
Gilsing, A.; Mayhew, A.J.; Payette, H.; Shatenstein, B.; Kirkpatrick, S.I.; Amog, K.; Wolfson, C.; Kirkland, S.; Griffith, L.E.; Raina, P. Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging. Nutrients 2018, 10, 1522. https://0-doi-org.brum.beds.ac.uk/10.3390/nu10101522
Gilsing A, Mayhew AJ, Payette H, Shatenstein B, Kirkpatrick SI, Amog K, Wolfson C, Kirkland S, Griffith LE, Raina P. Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging. Nutrients. 2018; 10(10):1522. https://0-doi-org.brum.beds.ac.uk/10.3390/nu10101522
Chicago/Turabian StyleGilsing, Anne, Alexandra J. Mayhew, Hélène Payette, Bryna Shatenstein, Sharon I. Kirkpatrick, Krystle Amog, Christina Wolfson, Susan Kirkland, Lauren E. Griffith, and Parminder Raina. 2018. "Validity and Reliability of a Short Diet Questionnaire to Estimate Dietary Intake in Older Adults in a Subsample of the Canadian Longitudinal Study on Aging" Nutrients 10, no. 10: 1522. https://0-doi-org.brum.beds.ac.uk/10.3390/nu10101522