Next Article in Journal
L-Ascorbic Acid Inhibits Breast Cancer Growth by Inducing IRE/JNK/CHOP-Related Endoplasmic Reticulum Stress-Mediated p62/SQSTM1 Accumulation in the Nucleus
Next Article in Special Issue
Dietary Diversity and Prostate Cancer in a Spanish Adult Population: CAPLIFE Study
Previous Article in Journal
Cholesterol and Egg Intakes, and Risk of Hypertension in a Large Prospective Cohort of French Women
Previous Article in Special Issue
Reply to “The Fallacy of Using Administrative Data in Assessing the Effectiveness of Food Fortification. Comment on: Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247”
 
 
Reply published on 8 May 2020, see Nutrients 2020, 12(5), 1335.
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Comment

The Fallacy of Using Administrative Data in Assessing the Effectiveness of Food Fortification. Comment on: “Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247”

1
Department of Epidemiology, Emory University Rollins School of Public Health, Atlanta, GA 30322, USA
2
Hubert Department of Global Health, Emory University Rollins School of Public Health, Atlanta, GA 30322, USA
3
Food Fortification Initiative, Atlanta, GA 30322, USA
4
Maternal Adolescent Reproductive and Child Health Centre, London School of Hygiene and Tropical Medicine, London WC1E 7HT, UK
5
Nutrition International, Ottawa, ON K2P 2K3, Canada
*
Author to whom correspondence should be addressed.
Submission received: 17 March 2020 / Accepted: 16 April 2020 / Published: 8 May 2020
(This article belongs to the Special Issue Nutrition Status and Health)

Abstract

:
Our objective in this comment is to highlight several limitations in an ecological research study that was published in Nutrients by Murphy and Westmark (2020) in January 2020. The study used data from the Food Fortification Initiative (FFI) website, and applying an ecological study design, made an error of “ecologic fallacy” in concluding that “national fortification with folic acid is not associated with a significant decrease in the prevalence of neural tube defects (NTDs) at the population level”. We list study limitations that led to their erroneous conclusions, stemming from incorrect considerations regarding NTD prevalence, the average grain availability for a country, the fortification coverage in a country, the population reach of fortified foods within a country, and the absence of the consideration of fortification type (voluntary vs. mandatory), country-specific policies on elective terminations for NTD-affected pregnancies, stillbirth proportions among those with NTDs, and fortification implementation. FFI data are derived from many sources and intended for fortification advocacy, not for hypothesis testing. The flawed study by Murphy & Westmark (2020) in Nutrients promotes a confusing and incorrect message to stakeholders, misguides policy makers, and hinders progress in global NTD prevention through a cost-effective, safe, and effective intervention: the mandatory large-scale folic acid fortification of staple foods.

Murphy & Westmark (2020) [1], published in Nutrients in January this year, using data from the Food Fortification Initiative (FFI) website (www.ffinetwork.org) and an ecological study design, have made an error in their study conclusion. Their study conclusion contradicts several systematic reviews and meta-analyses published earlier [2,3,4,5]. Ecologic fallacy is an inherent error in ecological study designs that lack individual-level data and rely on aggregate information pooled nationally or sub-nationally, collected by non-standardized sources.
We list below major limitations in Murphy & Westmark’s study that have led to their erroneous conclusion:
  • The modeled prevalence estimates for neural tube defects (NTDs) [6] used in their analysis have inherent biases and limitations, and they underestimate the true prevalence of NTDs for many developing countries that lack birth defect surveillance. They are mainly intended to provide policy makers with a crude burden of NTDs and not for scientific hypothesis-oriented research.
  • The FFI’s individual country profiles that contain grain fortification-related information are intended for stakeholders in the flour and rice milling industry, and organizations and policy-makers invested in grain fortification. Their variable “Folic acid fortification measured in ppm” is an incomplete measure of fortification reach and impact. The average fortification levels are meaningless without integrating data regarding the average grain availability for a country [7]. A low fortification level in a country with high grain availability would have a very different fortification impact compared to a low fortification level in a country with low grain availability.
  • Fortification compliance in a country was not considered, which is available online at https://fortificationdata.org/map-proportion-of-food-vehicle-that-is-fortified/. Several countries have a mandatory fortification policy, but where less than 100% of the food is fortified.
  • The population reach of fortified foods, which indicates the actual consumption of fortified foods, was not considered. Analyzing the population average fortification levels (ppm), without considering the reach and coverage of the fortified product [7], masks the differences found between consumers and non-consumers.
  • Other review studies [3,5] showing the effectiveness of fortification on NTD prevention were not cited.
  • Several supporting factors, including fortification type (voluntary vs. mandatory), country-specific policies on elective terminations for NTD-affected pregnancies, stillbirth proportions among those with NTDs, and fortification implementation were not considered.
According to the Centers for Evidence-Based Medicine, in the hierarchy of scientific evidence, evidence generated by ecological studies provides the lowest level of significance in establishing causality [8]. The FFI data are derived from many sources and intended for fortification advocacy, not for hypothesis testing. The flawed study by Murphy & Westmark (2020) in Nutrients promotes a confusing and incorrect message to stakeholders, misguides policy makers, and hinders progress in global NTD prevention through a cost-effective [9], safe [10] and effective [2,3,4,5] intervention: the mandatory large-scale folic acid fortification of staple foods.

Author Contributions

All authors contributed equally to this work. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Murphy, M.E.; Westmark, C.J. Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Castillo-Lancellotti, C.; Tur, J.A.; Uauy, R. Impact of folic acid fortification of flour on neural tube defects: A systematic review. Public Health Nutr. 2013, 16, 901–911. [Google Scholar] [CrossRef] [PubMed]
  3. Rosenthal, J.; Casas, J.; Taren, D.; Alverson, C.J.; Flores, A.; Frias, J. Neural tube defects in Latin America and the impact of fortification: A literature review. Public Health Nutr. 2014, 17, 537–550. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  4. Atta, C.A.; Fiest, K.M.; Frolkis, A.D.; Jette, N.; Pringsheim, T.; St Germaine-Smith, C.; Rajapakse, T.; Kaplan, G.G.; Metcalfe, A. Global Birth Prevalence of Spina Bifida by Folic Acid Fortification Status: A Systematic Review and Meta-Analysis. Am. J. Public Health 2016, 106, e24–e34. [Google Scholar] [CrossRef] [PubMed]
  5. Keats, E.C.; Neufeld, L.M.; Garrett, G.S.; Mbuya, M.N.N.; Bhutta, Z.A. Improved micronutrient status and health outcomes in low- and middle-income countries following large-scale fortification: Evidence from a systematic review and meta-analysis. Am. J. Clin. Nutr. 2019, 109, 1696–1708. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Blencowe, H.; Kancherla, V.; Moorthie, S.; Darlison, M.W.; Modell, B. Estimates of global and regional prevalence of neural tube defects for 2015: A systematic analysis. Ann. N. Y. Acad. Sci. 2018, 1414, 31–46. [Google Scholar] [CrossRef] [Green Version]
  7. Kancherla, V.; Wagh, K.; Johnson, Q.; Oakley, G.P., Jr. A 2017 global update on folic acid-preventable spina bifida and anencephaly. Birth Defects Res. 2018, 110, 1139–1147. [Google Scholar] [CrossRef] [PubMed]
  8. Burns, P.B.; Rohrich, R.J.; Chung, K.C. The Levels of Evidence and their role in Evidence-Based Medicine. Plast. Reconstr. Surg. 2011, 128, 305–310. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  9. Hoddinott, J. The investment case for folic acid fortification in developing countries. Ann. N. Y. Acad. Sci. 2018, 1414, 72–81. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Field, M.S.; Stover, P.J. Safety of folic acid. Ann. N. Y. Acad. Sci. 2018, 1414, 59–71. [Google Scholar] [CrossRef] [PubMed] [Green Version]

Share and Cite

MDPI and ACS Style

Kancherla, V.; Pachón, H.; Blencowe, H.; Martinez, H.; Oakley, G.P., Jr.; Berry, R.J. The Fallacy of Using Administrative Data in Assessing the Effectiveness of Food Fortification. Comment on: “Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247”. Nutrients 2020, 12, 1352. https://0-doi-org.brum.beds.ac.uk/10.3390/nu12051352

AMA Style

Kancherla V, Pachón H, Blencowe H, Martinez H, Oakley GP Jr., Berry RJ. The Fallacy of Using Administrative Data in Assessing the Effectiveness of Food Fortification. Comment on: “Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247”. Nutrients. 2020; 12(5):1352. https://0-doi-org.brum.beds.ac.uk/10.3390/nu12051352

Chicago/Turabian Style

Kancherla, Vijaya, Helena Pachón, Hannah Blencowe, Homero Martinez, Godfrey P. Oakley, Jr., and Robert J. Berry. 2020. "The Fallacy of Using Administrative Data in Assessing the Effectiveness of Food Fortification. Comment on: “Folic Acid Fortification and Neural Tube Defect Risk: Analysis of the Food Fortification Initiative Dataset. Nutrients 2020, 12, 247”" Nutrients 12, no. 5: 1352. https://0-doi-org.brum.beds.ac.uk/10.3390/nu12051352

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop