Next Article in Journal
The Relationship between Self-Rated Economic Status and Falls among the Elderly in Shandong Province, China
Previous Article in Journal
The Age-Related Performance Decline in Ironman 70.3
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Analysis of Cumulative Cancer Risk Associated with Disinfection Byproducts in United States Drinking Water

Environmental Working Group, 1436 U Street NW, Suite 100, Washington, DC 20009, USA
*
Author to whom correspondence should be addressed.
Int. J. Environ. Res. Public Health 2020, 17(6), 2149; https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17062149
Submission received: 4 March 2020 / Revised: 20 March 2020 / Accepted: 21 March 2020 / Published: 24 March 2020
(This article belongs to the Section Environmental Health)

Abstract

:
Hundreds of different disinfection byproducts form in drinking water following necessary treatment with chlorine and other disinfectants, and many of those byproducts can damage DNA and increase the risk of cancer. This study offers the first side-by-side comparison of cancer risk assessments based on toxicological and epidemiological studies of disinfection byproducts using a comprehensive contaminant occurrence dataset for haloacetic acids and trihalomethanes, two groups of disinfection byproducts that are regulated in drinking water. We also provide the first analysis of a new occurrence dataset for unregulated haloacetic acids that became available from the latest, fourth round of the U.S. EPA-mandated unregulated contaminant monitoring program (UCMR4). A toxicological assessment indicated that haloacetic acids, and in particular brominated haloacetic acids, are more carcinogenic and are associated with a greater number of attributable cancer cases than trihalomethanes. Based on the toxicological analysis, cumulative lifetime cancer risk due to exposure to trihalomethanes and haloacetic acids for community water systems monitored under UCMR4, estimated with standard default parameters for body weight and water intake, corresponds to 7.0 × 10−5 (3.5 × 10−5–1.3 × 10−4). The same analysis conducted with age sensitivity factors to account for elevated risk in infants and children yielded a cumulative risk estimate of 2.9 × 10−4 (1.7 × 10−4–6.2 × 10−4). Epidemiological data suggest that lifetime cancer risk from disinfection byproducts for the U.S. population served by community water systems is approximately 3.0 × 10−3 (2.1 × 10−4–5.7 × 10−3), or a lifetime cancer risk of three cases per thousand people. Overall, this analysis highlights the value of using human data in health risk assessments to the greatest extent possible.

1. Introduction

Drinking water treatment with disinfectants, such as chlorine, chloramine, and ozone creates a variety of reactive chemical intermediates and disinfection byproducts that may be harmful to human health and the environment [1,2]. Chlorine-based water disinfection, introduced at the beginning of the 20th century, has saved countless lives and drastically decreased the incidence of water-borne microbial diseases transmitted through drinking water. However, epidemiological research has reported associations between adverse health effects and the presence of disinfection byproducts in tap water at concentrations that generally meet applicable national drinking water standards [3]. Multiple studies have reported an increased risk of bladder cancer in association with exposure to drinking water disinfection byproducts [4,5,6], and the risk of other cancers has been suggested [7,8]. Birth defects [9] and miscarriages [10] have also been linked to disinfection byproducts. Toxicity and carcinogenicity of disinfection byproducts are mediated through pathways involving genotoxicity, cell cycle disruption, and oxidative stress [11].
The majority of epidemiological studies of water disinfection byproducts have focused on the combined exposure to four trihalomethanes (THM4): chloroform, bromoform, dibromochloromethane, and bromodichloromethane. The THM4 group, defined by the U.S. Environmental Protection Agency (EPA) as “total trihalomethanes” or TTHM, is regulated with a single maximum contaminant level of 80 µg/L in drinking water. This legal limit was established based on the costs and benefits of various water disinfection alternatives [12]. In addition to the THM4 group, the U.S. EPA also set maximum contaminant levels for several other disinfection byproducts: bromate, chlorite, and a group of five haloacetic acids (HAA5). The HAA5 group includes monochloroacetic acid, dichloroacetic acid, monobromoacetic acid, dibromoacetic acid, and trichloracetic acid; the entire group is regulated with a single maximum contaminant level of 60 µg/L in drinking water. The concentration and composition of disinfection byproduct mixtures in drinking water are influenced by a number of factors, such as the presence of natural organic matter in the supply water, pH, temperature, additional halogens such as bromide and iodide, and other co-occurring contaminants or water treatment chemicals [13]. A wide variety of halogenated and nitrogenated substances can form during water disinfection, and one recent review estimated that over a thousand different chemical contaminant species may occur [14]. Exposure data are primarily available for the regulated disinfection byproducts, particularly the THM4 and HAA5 groups, since community water systems are required to monitor the levels of these contaminants and report the data to their state drinking water authorities. However, human health risks reported in epidemiological studies are likely due to mixtures of disinfection byproducts, marked by the presence of THMs and HAAs in drinking water.
Given that water disinfection is essential for protecting public health from waterborne microbial diseases, a better understanding of the risks of exposure to disinfection byproducts, as well as ways to minimize that risk, is needed. Here we present an assessment of cumulative cancer risk due to disinfection byproducts based on toxicological and epidemiological data. The approach outlined in our study offers a valuable opportunity to compare human and animal data and to consider how such data can be used in risk assessments.

2. Materials and Methods

2.1. Exposure Assessment for Trihalomethanes and Haloacetic Acids in Drinking Water

This study utilizes two sets of disinfection byproduct occurrence data: the U.S. EPA’s Unregulated Contaminant Monitoring Rule 4 (UCMR4) dataset and occurrence data for trihalomethanes and haloacetic acids for the years 2014–2017, available in a comprehensive contaminant occurrence dataset for over 48 thousand community water systems in the U.S. [15], described previously [16,17,18,19]. The UCMR4 monitoring spans over three years, from 2018 to 2020, and data are posted on the EPA website as available prior to the official completion of the program. In this analysis, we used the latest accessible UCMR4 data that were posted in January 2020 [20], including data for 3579 community water systems serving a combined population of approximately 183 million people. The UCMR4 program has not yet been officially completed. Thus, the HAA occurrence information may slightly change for the final completed dataset, whenever it becomes publicly available. Nevertheless, even at this stage, the dataset offers extensive and valuable information on the occurrence of haloacetic acid groups in drinking water in the U.S.
This analysis includes data for four regulated trihalomethanes (THM4, including chloroform, bromoform, bromodichloromethane, and dibromochloromethane) and for nine haloacetic acids listed in Table 1. The UCMR4 dataset does not include concentration data for individual compounds and only reports group concentrations for the regulated HAA5 group, the HAA6Br group of six brominated haloacetic acids, and HAA9, which includes all nine chlorinated and brominated haloacetic acids (Table 2). All contaminant concentration values are reported in micrograms per liter (µg/L).
Population statistics for community water systems were obtained from state drinking water programs and supplemented with information from the U.S. EPA Envirofacts database [21]. Classifications of systems as groundwater or surface water follow the EPA’s Safe Drinking Water Information System (SDWIS) classifications. The total population served by community water systems per state was validated with 2017 census state-level population estimates available from U.S. Census data [22] and the estimated population served by private water sources, available from the U.S. Geological Survey [23]. For states where population estimates for the number of people served by community water systems differed from the U.S. Census data for the state, we applied a state-specific adjustment factor described in a prior publication [19]. All population numbers represent an estimate, and the specific number of customers served by community water systems may differ.
For contaminant concentrations, we calculated population-weighted averages (CPW) based on average contaminant concentrations in community water systems, according the formula:
C PW = Σ [ C system × ( P system P total ) ]
where the average contaminant concentration (Csystem) and system population (Psystem) refer to any individual water system included in the data set, total population (Ptotal) corresponds to the total population served by all community water systems in the dataset, and these factors are summed for all community water systems included in the dataset. Test data points for contaminants reported as “non-detect” are assigned the value of zero and included in all calculations in this study. Since it is possible that contaminants may be present at levels above zero but below the official limit of detection for reporting purposes, this approach for calculating averages is conservative and the calculated average values may be lower than the true national population-weighted averages.
Among the haloacetic acids, the national contaminant occurrence dataset is more robust for the constituents of the HAA5 group and is limited for four unregulated brominated haloacetic acids (Table 1) due to lack of nationwide monitoring requirements for those chemicals. Analysis for tribromoacetic acid, bromochloroacetic acid, bromodichloroacetic acid and chlorodibromoacetic acid relies on data from a smaller number of water systems, ranging between approximately one to eight thousand systems. For this study, we are making an assumption that the relative presence of individual disinfection byproducts in the available dataset is comparable to the concentrations for regulated contaminants on the national level. This assumption represents an uncertainty that will need to be addressed by future research.

2.2. Calculation of Lifetime Cancer Risk Based on Toxicological Studies of Disinfection Byproducts

Human-equivalent cancer slope factors calculated by the authors were derived using the U.S. EPA Benchmark Dose Modeling Software (BMDS), version 2.7 [24]. Datasets from National Toxicology Program animal studies on dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid were chosen for modeling based on the quality, suitability, and sensitivity of the studies, as well as the range of reported cancer sites and endpoints [25,26,27]. The two-year studies in rats and mice were chosen for modeling to reduce uncertainties regarding dosing and duration adjustments. Animal cancer incidence data deemed suitable using standard protocols and recommendations from benchmark dose modeling technical guidance documents were analyzed using the multi-stage cancer model [28,29].
After examining and modeling a number of endpoints with suitable animal dose-response data, combined response data for hepatocellular adenomas, hepatocellular carcinomas, and hepatoblastomas for male mice (dibromoacetic acid, bromochloroacetic acid) and female mice (bromodichloroacetic acid) were chosen as the most sensitive endpoint for determining a point of departure or benchmark dose [25,26,27]. These values were used to calculate the human-equivalent cancer slope factors after applying standard bodyweight transformations [30].
For toxicologically-estimated cancer risk based on animal studies, contaminant concentrations associated with a specific cancer risk level can be calculated from the cancer slope factor, taking into consideration daily water intake, body weight, and age susceptibility. This calculation, based on the U.S. EPA methodology [31], is
CSF = BMR POD
where benchmark response (BMR) can be an excess risk of 5%, 10%, or a different number used for benchmark dose modeling [28]. The point of departure (POD) or benchmark dose is derived from benchmark dose modeling of tumor incidence data from animal bioassays, and can represent either the central estimate of the benchmark dose or the upper or lower 95% confidence limit. Cancer slope factors can be converted to the human equivalent following
CSF human = CSF animal × ( BW human BW animal ) 1 4
where BWhuman is the default weight for human adults, 70 kg, and BWanimal corresponds to the average weight of animals in the control group of the animal bioassay used for the cancer slope determination. The formula is adapted from that used by the California Office of Environmental Health Hazard Assessment (OEHHA) [30].
The cancer risk-specific benchmark concentration (B) is
B = R CSF human × ( DWI BW )
where the risk level (R) can be one-in-a-million (10−6) or a different value. The cancer slope factor (CSFhuman) is expressed in (mg/kg-day)−1, average water intake (DWI) is L/day, and body weight (BW) is in kg. The interpretation of this calculation is that the daily ingestion of drinking water with this specified contaminant level over the course of a lifetime would increase lifetime cancer risk by the specific risk levels, such as one-in-a-million. Throughout this article, cancer risk-specific benchmarks are expressed in the units of µg/L.
For calculating cancer risk-specific benchmarks, water intake and body weight parameters are derived from national statistics information. EPA’s standard approach has used the default values for daily water intake of 2 L and adult body weight of 70 kg. However, body weight and water intake differ by age and gender [32]. For 2015–2016, U.S. National Health Statistics Reports calculated mean body weight in the American population at 89.8 kg for men and 77.4 kg for women [33]. In a 2004 analysis, the U.S. EPA reported the mean for direct and indirect community water ingestion for all ages and genders at 0.926 L (with a 90% interval of 0.903–0.949) and the 95th percentile at 2.54 (2.50–2.58) L/day [34]. The 95th percentile corresponds to 0.043 (0.41–0.44) L/kg daily water intake [34]. OEHHA used the upper 95th percentile of consumption of municipal water for the general population of 0.044 L/kg for establishing a cancer-risk specific benchmark for bromate [35]. Additionally, consumption of tap water changes over time, with trends for greater consumption of bottled water and more common use of in-home water filtration devices [36]. Concerns about tap water safety and discoveries of tap water contamination decrease municipal water consumption as residents in the affected communities turn to bottled water [36].
To account for heightened susceptibility of the fetus, infant, and developing child to chemical toxicity [37,38,39,40], age sensitivity factors are incorporated into the formula for deriving health-protective contaminant concentrations. The state of Minnesota Department of Health has published the following age-dependent susceptibility factors for calculation of 70-year lifetime cancer unit risk: a factor of 10 for age 0–2 (infant) and a factor of 3 for age 2–16 (child) [38]. California OEHHA used the same age sensitivity factors and also added the age-sensitivity factor of 10 for the exposure of the fetus during the 3rd trimester [41]. Incorporation of these factors into toxicological risk assessment for cancer is based on established research demonstrating greater cancer risk associated with exposure to carcinogenic substances at a younger age [38,39,40]. Here we followed California OEHHA’s estimates for the upper 95th percentile drinking water intake and age-sensitivity factor adjustments for trihalomethanes [42] and haloacetic acids [30], with adjusted drinking water consumption intakes of 0.18 and 0.129 L/kg-day, respectively.
Benchmark cancer risk concentrations for a group of contaminants (Bgroup) are calculated following the method presented in an analysis by California OEHHA in 2010 for the group of trihalomethanes [37] and described in an earlier study [16] as
B group = Σ ( C PW ) ÷ Σ ( C PW B )
where contaminant concentration averages (CPW) are national, population-weighted averages as listed in Table 1, and sums are for all contaminants included in a group.
Lifetime cancer risk due to the presence of a contaminant is calculated as
R = ( C B ) × 10 6
Cancer risks (R) for individual contaminants are treated in a response additive manner, following the approach that U.S. EPA uses for cumulative cancer risk assessment of air pollutants [39,40]. With this simple additive approach, national lifetime cancer risk (Rnational) was calculated as
R national = Σ ( R system × P system ) P total

2.3. Calculation of Lifetime Cancer Risk Based on Epidemiological Studies of Disinfection Byproducts

Calculations for bladder cancer risk and attributable case counts (Acases) followed previously published methodology [19], according to the formula
A cases = [ Σ ( P exposed × Δ OR ) ] × I baseline
where each exposed population (Pexposed) is the number of people exposed to drinking water with THM4 concentrations within a specified concentration range; ∆OR is the difference in odds ratios or risk ratios between the specified exposed population and the unexposed population; and baseline incidence (Ibaseline) is the estimated proportion of the cumulative cancer incidence that would be present in the absence of exposure.
Odds ratios for increased bladder cancer risk in relation to THM4 concentrations come from the 2015 publication by Regli and colleagues [6], which specifies both the central estimate and the upper and lower confidence limits for cancer risk observed in epidemiological studies in 10 µg/L intervals. For this study, odds ratios and relative risk ratios are considered interchangeable since cancer is a rare event [43]. Odds or risk ratios for the unexposed population are assumed to be 1.0 for this calculation, reflecting the expected absence of excess risk when there is no exposure to disinfection byproducts in drinking water.
Baseline incidence is estimated as a proportion of cumulative incidence and is calculated as
I baseline = I cumulative × P total ( Σ ( P exposed × OR ) ) + ( P unexposed )
where the cumulative incidence (Icumulative) is the lifetime risk of cancer diagnosis in the total population, the unexposed population (Punexposed) is the total population less the exposed populations and other values, as described previously.
The cancer risk attributable to exposure to disinfection byproducts (Arisk) can then be calculated as
A risk = A cases P total
where the total population (Ptotal) is the total population served by community water systems.
This analysis uses the national lifetime risk of diagnosis of bladder cancer, calculated with the DevCan software [44] (https://surveillance.cancer.gov/devcan/). The possibility of developing bladder cancer in a lifetime of 95 years is calculated using the cross-sectional counts of incident cases in males and females between 2014 and 2016 as reported through the NCI Surveillance, Epidemiology, and End Results (SEER) program [45].

2.4. Calculation of Economic Costs due to Estimated Bladder Cancer Cases Associated with Disinfection Byproducts

The economic cost of cancer cases was calculated as the direct medical cost in 2015 U.S. dollars. Annualized mean net costs of care per patient for bladder cancer published by the National Cancer Institute were based on research by Mariotto and colleagues [46]. Cost per case was calculated as
E case = E initial + E continuing + E final
where the continuing cost (Econtinuing) was multiplied by median years lived with disease less two for the first and last year. Median years lived with disease was calculated as the difference between median age at death and median age at diagnosis as reported by National Cancer Institute, and the average of costs for men and women was included here. Cost for last year of life (Efinal) was the average of the two values reported as cancer death and other cause of death. Values were converted from 2010 U.S. dollars to 2015 U.S. dollars by using the Bureau of Economic Analysis Personal Consumption Expenditures Health Index. To address volatility in the health care index, the blended account index was used, as recommended by Bureau of Economic Analysis [47].
Values reported in the text have been rounded to two or three significant digits. Due to rounding, some totals in the tables may not correspond precisely to sums of the reported values.

3. Results

3.1. Exposure Assessment for Trihalomethanes and Haloacetic Acids in Drinking Water

Based on UCMR4 data, we calculated population-weighted averages of 24.9 µg/L for HAA9, 19.1 µg/L for HAA5, and 7.0 µg/L for HAA6Br for the systems included in UCMR monitoring (Table 2). In an earlier study, we reported the population-weighted average of THM4 in the United States community water supplies as 26 µg/L [16]. While relative concentrations of individual disinfection byproducts depend on multiple water chemistry conditions, there is an overall correlation between trihalomethanes and haloacetic acids, as anticipated (Figure 1).
The UCMR-monitored systems serve an estimated 183 million people, approximately 65% of the population served by community water systems in the U.S. We compared average HAA5 levels reported in the UCMR4 dataset with average HAA5 levels for the same utilities in the 2014–2017 period based on compliance testing data in the comprehensive dataset. We selected the hundred largest water systems, serving a combined population of over 74 million. As Figure 2 demonstrates, there is a clear correlation of the reported HAA5 concentrations for each dataset, indicating consistency between the two sources, yet the values are not identical. Further, the levels of disinfection byproducts vary throughout a drinking water distribution system. To address this uncertainty, we adapted the approach of averaging all available sampling values in a given dataset for individual water systems. The resulting average value reflects overall disinfection byproduct concentrations in each system, and concentrations at specific locations in a system may be different.

3.2. Calculation of Lifetime Cancer Risk Based on Toxicological Studies of Disinfection Byproducts

Assessment of human cancer risk from animal toxicology data requires a translation of the dose-response data from laboratory animals to humans, accounting for different body sizes and species-specific differences in toxicokinetics and toxicodynamics [48]. The risk calculation can also include factors to account for heightened susceptibility of early life stages, such as the developing fetus, infants, and children [38,41,49]. Following the U.S. EPA methodology, we calculated cancer potency for three brominated disinfection byproducts using Benchmark Dose Modeling Software (Table 3). For this analysis, we used animal bioassay data for dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid from toxicology studies conducted by the National Toxicology Program [25,26,27]. Benchmark responses of 5% or 10% are both used for benchmark modeling in risk assessment [50]. We calculated human-equivalent cancer slope factors based on 95% lower confidence limits of the benchmark doses, following the approach of California OEHHA and the U.S. EPA. Table 3 demonstrates that calculated cancer slope factors are very similar, whether calculated based on 5% or 10% excess risk, suggesting that either approach can be used for assessing cumulative cancer risk for disinfection byproducts. Numerically smaller slope factors indicate weaker carcinogenic potency, while larger slope factors indicate higher carcinogenic potency. According to the available data, bromochloroacetic acid has higher carcinogenic potency compared to dibromoacetic acid and bromodichloroacetic acid (Table 3).
We compiled the reported human cancer slope factors and one-in-a-million cancer risk benchmarks for haloacetic acids and trihalomethanes published by California OEHHA and by the U.S. EPA (Table 4). For calculating cancer slope factors, California OEHHA used an approach with 5% extra risk, while U.S. EPA used 10%, and the two cancer slope values, where available for the same chemical, are overall similar.
Of note, California OEHHA used age-specific water intake and age sensitivity factors for defining cancer risk-specific concentrations, while the U.S. EPA used a default adult body weight of 70 kg, and default daily water intake of 2 L, and did not apply any adjustments for children’s body weight, water intake, or susceptibility to carcinogens. Differences in approaches for calculating risk-specific contaminant concentrations explain why those values are different between California OEHHA and the U.S. EPA, even though the cancer slope factors are broadly similar. The differences between calculated slope factors are likely due to the specific animal bioassay studies chosen for benchmark modeling. Our modeled cancer slope factor for dibromoacetic acid using 5% extra risk is close to the one reported by California OEHHA: a slope factor of 0.210 (mg/kg-day)−1 (Table 3) versus a slope factor of 0.250 (mg/kg-day)−1 (Table 4 and [30]).
To illustrate the data options associated with the development of cancer slope factors, Figure 3 presents our derivation of human-equivalent cancer slope factors for dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid calculated from tumor incidence in different animal tissues. This comparison highlights how the choice of specific animal bioassay study and modeling approaches influence the calculated cancer slope factors. In National Toxicology Program studies, various types of tumors were observed in laboratory rats and mice exposed to these chemical substances [25,26,27]. Among those tumors and tumor sites, the liver was the most sensitive organ for exposure-related tumor development, as indicated by the highest slope factors. As noted in Table 3, we adapted cancer slope factors for dibromoacetic acid, bromochloroacetic acid and bromodichloroacetic acid based on the liver data. For all subsequent analyses in this study, we used cancer slope factors calculated with a benchmark response of 5% extra risk as the most sensitive approach for the detection of excess cancer risk.
To assess cancer risk due to the presence of haloacetic acids in drinking water, we were faced with a data limitation in the UCMR4 dataset whereby the U.S. EPA reported only the group concentrations for HAA5, HAA6Br, and HAA9 and not the concentrations of individual haloacetic acids. We developed concentration-weighted cancer risk benchmarks for the three HAA groups following Equation (5), as previously described [16,37]. Calculated group risk benchmarks are listed in Table 5 and used for analyses in Table 6.
Cancer bioassay animal studies are not available for chlorodibromoacetic acid and tribromoacetic acid. However, they were both listed by the National Toxicology Program as “reasonably anticipated to be a human carcinogen” based on metabolism data and similarity to other haloacetic acids, which have been tested in animal bioassays [57]. Following a recent study from the scientists at the National Toxicology Program [58], we used a read-across approach for these two haloacetic acids whereby the same cancer risk benchmark is applied to chlorodibromoacetic acid as calculated for bromochloroacetic acid and to tribromoacetic acid as calculated for dibromoacetic acid (Table 5). With the parameters listed, we calculated an additive, concentration-weighted cancer risk benchmark for each group (Table 5). We note that monochloroacetic and monobromoacetic acids are not considered carcinogenic and do not have a cancer risk benchmark. For chloroform, California OEHHA calculated a risk-specific concentration from the geometric mean of cancer slope factors modeled from five different animal bioassays [42]. The benchmark dose from a study published by the U.S. National Cancer Institute [56], with the cancer slope factor closest to this geometric mean, is included in Table 5 and used in later analysis for comparison (Figure 4).
Based on group cancer risk benchmarks and UCMR4 data for the average concentrations of HAA5, HAA6Br, and HAA9 in each water utility in the UCMR program, we calculated the estimated number of lifetime cancer cases attributable to these chemical groups. The upper bound estimate presented in Table 6 represents the number of attributable cases calculated using the lower bound estimate of the benchmark dose, and vice versa for the lower bound estimate of cancer cases. The previously reported value of 47.9 thousand cases for trihalomethanes calculated for the dataset spanning 2010–2017 [16] falls in this calculated range (Table 6).
For the HAA5 group, we compared the estimates of attributable lifetime cancer cases from a comprehensive national dataset and from the UCMR4 dataset. Calculations for the UCMR4 dataset results in approximately 72% of cases expected for the HAA5 group from the national dataset. This finding makes sense, as the UCMR4 program includes all the large community water systems with a combined population of approximately 183 million people. It is reasonable to hypothesize that the UCMR4 data for HAA6Br and HAA9 underestimate the total nationwide HAA6Br- and HAA9-attributable cases to a similar extent as we report for the HAA5 group. As noted earlier, cancer slope factors and cancer potency are greater for brominated haloacetic acids compared to chlorinated haloacetic acids, and this is reflected in the greater number of attributable cancer cases due to the HAA6Br group relative to the HAA5 group. As expected, the greatest number of attributable cases is calculated for the HAA9 group. Finally, we calculated cumulative cancer risk due to HAA9 and THM4 groups for the subset of systems included in the UCMR4 program. Central estimates for this cumulative lifetime risk range between 7.0 × 10−5 and 2.9 × 10−4, depending on whether default parameters or age-sensitivity parameters are used to estimate risk (Table 6).
The read-across approach for chlorodibromoacetic acid and tribromoacetic acids represents an area of uncertainty for our study. Given that trichloroacetic acid is a more potent carcinogen compared to dichloroacetic acid, we hypothesize that a similar cancer potency relationship would apply for dibromoacetic and tribromoacetic acids. Further, the population-weighted concentrations of chlorodibromoacetic acid and tribromoacetic acid, at 0.28 and 0.21 µg/L, respectively, are lower than the population-weighted concentrations of other haloacetic acids associated with cancer risk, which range from 1.1 to 7.8 µg/L. Thus, we anticipate that the uncertainty around cancer potency of chlorodibromoacetic acid and tribromoacetic acid would not significantly affect the estimated cumulative cancer risk due to the haloacetic acids presented here.

3.3. Calculation of Annual and Lifetime Cancer Risk Based on Epidemiological Studies of Disinfection Byproducts

To assess cancer risk based on human data, we relied on epidemiological studies that found an association between the presence of disinfection byproducts in drinking water (marked by the THM4 levels) and increased risk of bladder cancer. Trihalomethane concentrations correlate with HAA9 concentrations in drinking water (Figure 1), and an assumption is made that trihalomethane concentrations may correlate with levels of other carcinogenic disinfection byproducts in tap water. For this portion of our analysis, we used the THM4 occurrence data for 2014–2017 for 48,363 community water systems in the U.S., serving an estimated 86% of the U.S. population. All estimates for attributable cases were calculated together with upper and lower boundaries based on epidemiologically-derived odds ratios for bladder cancer risk.
The largest number of estimated lifetime bladder cancer cases, approximately 400,000 (Table 7), is calculated for large surface water systems serving communities with more than 0.1 million residents. Combined, these systems serve 40% of the total population served by community water systems in the U.S. As expected, a lower risk is associated with small groundwater systems that serve a smaller proportion of the population and generally have lower disinfection byproduct levels. Converting the estimates of disinfection byproduct-attributable lifetime bladder cancer cases into cancer risk, we estimate that lifetime cancer risk from disinfection byproducts is 3.0 × 10−3 (2.1 × 10−4–5.7 × 10−3) for the 279 million people served by community water systems in the U.S. These estimates are significantly greater than the de minimus risk of one-in-a-million (10−6). We completed the same analysis just for the water systems included in the UCMR4 monitoring program and obtained very similar risk estimates of 3.2 × 10−3 (2.1 × 10−4–6.1 × 10−3). This similarity in estimates makes sense given that the UCMR4 program includes all large community water systems in the U.S.
We note that different risk estimates are obtained from calculations based on either annual bladder cancer incidence or lifetime risk of a bladder cancer diagnosis. Analysis based on the annual incidence of bladder cancer results in an annual risk of 2.4 × 10−5 due to disinfection byproducts. Multiplying the annual cancer risk estimate by 70, the “statistical length of life” used by U.S. EPA for human health risk assessments, results in a lifetime risk of 1.7 × 10−3. This value is lower than an estimated lifetime attributable risk of 3.0 × 10−3 calculated from data in Table 7 because the lifetime bladder cancer probability is estimated with the National Cancer Institute DevCan software, which uses a longer lifetime of 95 years and accounts for the higher risk of developing bladder cancer with age.

3.4. Calculation of Economic Costs due to Estimated Bladder Cancer Cases Associated with Disinfection Byproducts

We calculated possible costs of medical treatment that would be incurred annually for disinfection byproduct-attributable bladder cancer cases. Bladder cancer is the seventh most common cancer in the U.S. [45]. Around 2.4% of the U.S. population will be diagnosed with bladder cancer during their lifetime, and this cancer occurs three times more frequently in men compared to women. Approximately a quarter of those cases results in death due to cancer, as the 5-year survival rate for bladder cancer is 77%, according to the 2009–2015 data from the National Cancer Institute [45]. Based on annual bladder cancer incidence, we calculate that 6,800 bladder cancer cases every year could be due to disinfection byproducts in drinking water. We estimated a cost of $91,000 per case of bladder cancer (2015 U.S. dollars) using Equation (11) and cancer cost estimates from Mariotto and colleagues [46]. When applied to the national estimate of bladder cancer cases attributable to disinfection byproducts in drinking water, this translates into annual overall medical costs of USD 620 million (2015 dollars). The estimates are conservative in that they account for direct medical costs only, and do not account for lost productivity, indirect medical costs, as well as economic costs and losses for family members and/or caregivers for each patient.

3.5. Comparison of Epidemiologically-Based and Toxicologically Based Cancer Risk Estimates

To compare risk estimates using toxicological and epidemiological approaches, we focused all analyses on the 3579 systems in the UCMR4 program. For the toxicological estimates, we calculated the combined cancer risk for THM4 and HAA9 based on lower bound, central, and upper bound estimates of the benchmark dose-derived cancer slope factors. The overall toxicologically-based cancer risk was estimated as 7.0 × 10−5 (3.5 × 10−5–1.3 × 10−4) using default body weight and water intake factors and 2.9 × 10−4 (1.7 × 10−4–6.2 × 10−4) when incorporating age sensitivity factors (Figure 4). The epidemiologically-based assessment of cancer risk in Figure 4 is calculated from lower, central, and upper estimates of bladder cancer risk reported in human studies.
In a side-by-side comparison of toxicological and epidemiological risk estimates, it is important to acknowledge tumor site non-concordance between animal and human studies. While epidemiological research finds an association of disinfection byproducts in drinking water with bladder cancer, tumors at different sites are observed in laboratory animals (see Figure 3). Using the same exposure data, the central estimate of risk based on human data is five-fold greater than the upper bound estimate of risk calculated from animal data with included age sensitivity factors. This comparative analysis suggests that human epidemiological data must be used to the greatest extent possible to capture risks based on real-world exposures. Risk calculations based on animal bioassays are an essential part of risk assessment and mitigation. As Figure 4 demonstrates, the inclusion of age sensitivity factors brings toxicological risk estimates closer to epidemiological risk estimates, while the default weight and water intake factors produce risk estimates that are smaller than epidemiological estimates by approximately 40-fold.

4. Discussion

Toxicological, epidemiological, and mechanistic studies of disinfection byproducts have provided strong evidence for the carcinogenicity of disinfection byproducts. At the same time, individual disinfection byproducts show differences in both cancer potency and overall toxicity [42,57,59,60]. This differential toxicity is reflected in the diversity of carcinogen classifications for individual disinfection byproduct substances published by the U.S. EPA, National Toxicology Program Report on Carcinogens, and International Agency for Research on Cancer (Table 8). In addition to the chemicals listed and analyzed here, there are numerous other contaminants that form during water disinfection, and they can have greater carcinogenic potency than trihalomethanes and haloacetic acids [61].
Here we present the first analysis of the recently published Unregulated Contaminant Monitoring Rule 4 occurrence data for haloacetic acids. Toxicological assessment indicates haloacetic acids have overall greater cancer potency than trihalomethanes. We found that the group of five regulated haloacetic acids is associated with a smaller number of attributable cancer cases compared to the HAA6Br group, suggesting that in addition to HAA5, levels of other haloacetic acids should be lowered in drinking water in order to protect public health.
Side-by-side comparison of toxicological and epidemiological estimates for cancer risk due to disinfection byproducts in drinking water in the United States represents a unique and novel aspect of our study (Figure 4). While there have been prior studies that looked at toxicological and epidemiological risk estimates [61,69,70], this is the first study to conduct such an analysis on a comprehensive national scale. As our study demonstrates, cumulative risks due to disinfection byproducts of 7 × 10−5 to 3 × 10−4 according to toxicological calculations (central estimates), or 3 × 10−3 according to epidemiological estimates, are significantly greater than one-in-a-million (10−6) which is considered as “de minimus” acceptable risk in contaminant risk assessments published by the U.S. EPA. In the opinion of the authors of this study, the concept of one-in-a-million risk as a health benchmark remains relevant. However, it is important for future research and policy discussions to address the fact that actual cumulative risks are much greater than this goal of minimal cancer risk.
We calculated that around 6800 annual bladder cancer cases and around 828,000 lifetime bladder cancer cases may be due to disinfection byproducts in drinking water. These estimates are based on the overall incidence of bladder cancer, as reported by the U.S. Centers for Disease Control and Prevention, which includes both invasive and non-invasive bladder cancer cases. Using the 2017 census report of 325 million for the U.S. population and the lifetime risk of bladder cancer of 0.02447 as calculated with the DevCan software, we estimate that about 10% of bladder cancer cases are due to disinfection byproducts (828,000 lifetime bladder cancer cases out of nearly 8 million for the total U.S. population). The U.S. EPA reported that the best estimate for the number of disinfection byproduct-attributable annual bladder cancer cases is between 731 and 6720, depending on the method of calculation [71]. Thus, the number of 6800 annual bladder cancer cases calculated here is in alignment with the earlier analysis.
We recognize the scientific uncertainties associated with the calculation of health risks from toxicology data. For example, cancer slope factors calculated here for dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid used liver tumor data in mice as the most sensitive endpoint across species and tissues. In animal bioassays, exposure-related tumors were observed in different organs (Figure 3), yet not in the bladder, the target site observed in human studies. Translation of animal bioassay data to human risk requires the risk assessors to make certain process decisions and assumptions, such as the use of 5% versus 10% excess risk as the benchmark response level as well as assumptions about the length of exposure, water intake, and age sensitivity factors for early life stages. Even with age sensitivity factors, risk calculations based on animal data might not capture the full range of susceptibility of the fetus, infant, and young child to carcinogens.
The limitations in epidemiological studies also can influence the reliability of risk estimates. Accurate human exposure assessment generally is challenging. A number of factors could influence epidemiological risks, including confounding risk factors like tobacco smoke exposure, occupational exposures, and co-occurring arsenic contamination [16,72]. Genetic marker research has identified subpopulations particularly susceptible to bladder cancer due to disinfection byproduct exposure [73]. Polymorphisms in metabolizing enzymes involved in the processing of ingested toxic chemicals modify the risk due to disinfection byproduct exposure, although these modifying effects differ in populations with different genetic backgrounds, such as Asian populations versus Caucasian populations, as noted in a recent systematic review [74]. Finally, epidemiological studies focus on exposure to one contaminant or group of contaminants, such as THM4, and the assumption is that the THM4 group concentration reflects the presence of other disinfection byproducts. The reliability of this assumption will need to be assessed in future studies.
The latency period in the development of bladder cancer or any other cancer also represents uncertainty in the calculations of bladder cancer cases attributable to disinfection byproducts. Attributable bladder cancer risk is likely due to prior decades of exposure to disinfection byproducts in drinking water, and changes in water disinfection approaches and disinfection byproduct levels would influence both current and future risk. U.S. EPA regulations in Stage I (1998) and Stage II (2006) Disinfectants and Disinfection Byproduct Rules have decreased overall levels of disinfection byproducts throughout drinking water distribution systems. Thus, risks due to current exposures to disinfection byproducts in United States tap water may be lower than what we calculate from estimates of risks based on earlier epidemiological studies.
Finally, there is uncertainty about trade-offs between cancer risk of disinfection byproducts and avoided risks of death and microbial disease thanks to drinking water disinfection. A comparison of toxicological and microbiological risks is beyond the scope of our study and merits future research. Here, we limit ourselves to noting that a side-by-side analysis of toxicological and epidemiological estimates can provide helpful information for risk assessment and risk mitigation.

5. Conclusions

In closing, this study offers a compelling argument for conducting a cumulative risk assessment for both regulated and unregulated contaminants. Regulated disinfection byproducts constitute just a portion of the contaminants that form during the disinfection process. The inclusion of unregulated haloacetic acids in a toxicologically-based framework increases the likelihood that a cancer risk assessment for disinfection byproducts accurately reflects risk.
Additionally, our analysis highlights the value of using human data in health risk assessments. Epidemiological approaches capture real-world risks from drinking water contaminant mixtures in ways that, at present, cannot be fully assessed by toxicological studies. Thus, we hope that the present study will facilitate the application of epidemiological information in public policy development.

Author Contributions

Conceptualization, S.E. and O.V.N.; methodology, S.E. and O.V.N.; analysis, S.E.; resources, C.C.; data curation, C.C.; writing—original draft preparation, S.E. and O.V.N.; writing—review and editing, S.E. and O.V.N.; visualization, S.E.; supervision, O.V.N. All authors have read and agreed to the published version of the manuscript.

Funding

This work was supported by grants from The JPB Foundation and the Park Foundation.

Acknowledgments

The authors gratefully acknowledge the help of David Andrews, Alexis Temkin, and Tasha Stoiber for their assistance with a technical review of the manuscript, and we thank Dan Dinh and Connie Xiong, former interns with our research group, for their assistance with data analysis.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Diana, M.; Felipe-Sotelo, M.; Bond, T. Disinfection byproducts potentially responsible for the association between chlorinated drinking water and bladder cancer: A review. Water Res. 2019, 162, 492–504. [Google Scholar] [CrossRef]
  2. Von Gunten, U. Oxidation Processes in Water Treatment: Are We on Track? Environ. Sci. Technol. 2018, 52, 5062–5075. [Google Scholar] [CrossRef]
  3. Villanueva, C.M.; Cantor, K.P.; Cordier, S.; Jaakkola, J.J.; King, W.D.; Lynch, C.F.; Porru, S.; Kogevinas, M. Disinfection byproducts and bladder cancer: A pooled analysis. Epidemiology 2004, 15, 357–367. [Google Scholar] [CrossRef]
  4. Beane-Freeman, L.E.; Cantor, K.P.; Baris, D.; Nuckols, J.R.; Johnson, A.; Colt, J.S.; Schwenn, M.; Ward, M.H.; Lubin, J.H.; Waddell, R.; et al. Bladder Cancer and Water Disinfection By-product Exposures through Multiple Routes: A Population-Based Case Control Study (New England, USA). Environ. Health Perspect. 2017, 125, 067010. [Google Scholar] [CrossRef] [Green Version]
  5. Costet, N.; Villanueva, C.M.; Jaakkola, J.J.; Kogevinas, M.; Cantor, K.P.; King, W.D.; Lynch, C.F.; Nieuwenhuijsen, M.J.; Cordier, S. Water disinfection by-products and bladder cancer: Is there a European specificity? A pooled and meta-analysis of European case-control studies. Occup. Environ. Med. 2011, 68, 379–385. [Google Scholar] [CrossRef]
  6. Regli, S.; Chen, J.; Messner, M.; Elovitz, M.S.; Letkiewicz, F.J.; Pegram, R.A.; Pepping, T.J.; Richardson, S.D.; Wright, J.M. Estimating Potential Increased Bladder Cancer Risk Due to Increased Bromide Concentrations in Sources of Disinfected Drinking Waters. Environ. Sci. Technol. 2015, 49, 13094–13102. [Google Scholar] [CrossRef]
  7. Karagas, M.R.; Villanueva, C.M.; Nieuwenhuijsen, M.; Weisel, C.P.; Cantor, K.P.; Kogevinas, M. Disinfection byproducts in drinking water and skin cancer? A hypothesis. Cancer Causes Control 2008, 19, 547–548. [Google Scholar] [CrossRef] [Green Version]
  8. Villanueva, C.M.; Gracia-Lavedan, E.; Bosetti, C.; Righi, E.; Molina, A.J.; Martin, V.; Boldo, E.; Aragones, N.; Perez-Gomez, B.; Pollan, M.; et al. Colorectal Cancer and Long-Term Exposure to Trihalomethanes in Drinking Water: A Multicenter Case-Control Study in Spain and Italy. Environ. Health Perspect. 2017, 125, 56–65. [Google Scholar] [CrossRef] [Green Version]
  9. Wright, J.M.; Evans, A.; Kaufman, J.A.; Rivera-Nunez, Z.; Narotsky, M.G. Disinfection By-Product Exposures and the Risk of Specific Cardiac Birth Defects. Environ. Health Perspect. 2017, 125, 269–277. [Google Scholar] [CrossRef]
  10. Waller, K.; Swan, S.H.; DeLorenze, G.; Hopkins, B. Trihalomethanes in drinking water and spontaneous abortion. Epidemiology 1998, 9, 134–140. [Google Scholar] [CrossRef]
  11. Chaves, R.S.; Guerreiro, C.S.; Cardoso, V.V.; Benoliel, M.J.; Santos, M.M. Hazard and mode of action of disinfection by-products (DBPs) in water for human consumption: Evidences and research priorities. Comp. Biochem. Physiol. C Toxicol. Pharmacol. 2019, 223, 53–61. [Google Scholar] [CrossRef]
  12. Roberson, J.A.; Cromwell, J.E.I.; Krasner, S.W.; McGuire, M.J.; Owen, D.M.; Regli, S.; Summers, R.S. The D/DBP Rule: Where did the numbers come from? J. Am. Water Works Assoc. 1995, 87, 46–57. [Google Scholar] [CrossRef]
  13. Ding, S.; Deng, Y.; Bond, T.; Fang, C.; Cao, Z.; Chu, W. Disinfection byproduct formation during drinking water treatment and distribution: A review of unintended effects of engineering agents and materials. Water Res. 2019, 160, 313–329. [Google Scholar] [CrossRef]
  14. Li, X.-F.; Mitch, W.A. Drinking Water Disinfection Byproducts (DBPs) and Human Health Effects: Multidisciplinary Challenges and Opportunities. Environ. Sci. Technol. 2018, 52, 1681–1689. [Google Scholar] [CrossRef]
  15. Environmental Working Group. EWG’s Tap Water Database 2019 Update. Available online: https://www.ewg.org/tapwater/ (accessed on 3 March 2020).
  16. Evans, S.; Campbell, C.; Naidenko, O.V. Cumulative risk analysis of carcinogenic contaminants in United States drinking water. Heliyon 2019. [Google Scholar] [CrossRef] [Green Version]
  17. Stoiber, T.; Temkin, A.; Andrews, D.; Campbell, C.; Naidenko, O.V. Applying a cumulative risk framework to drinking water assessment: A commentary. Environ. Health 2019, 18, 37. [Google Scholar] [CrossRef] [Green Version]
  18. Schaider, L.A.; Swetschinski, L.; Campbell, C.; Rudel, R.A. Environmental justice and drinking water quality: Are there socioeconomic disparities in nitrate levels in U.S. drinking water? Environ. Health 2019, 18, 3. [Google Scholar] [CrossRef] [Green Version]
  19. Temkin, A.; Evans, S.; Manidis, T.; Campbell, C.; Naidenko, O.V. Exposure-based assessment and economic valuation of adverse birth outcomes and cancer risk due to nitrate in United States drinking water. Environ. Res. 2019, 108442. [Google Scholar] [CrossRef]
  20. United States Environmental Protection Agency. Occurrence Data for the Unregulated Contaminant Monitoring Rule; 2020. Available online: https://www.epa.gov/dwucmr/occurrence-data-unregulated-contaminant-monitoring-rule#4 (accessed on 3 March 2020).
  21. United States Environmental Protection Agency. Envirofacts; US EPA: Washington, DC, USA, 2017.
  22. United States Census Bureau. American Fact Finder. Available online: https://factfinder.census.gov/faces/nav/jsf/pages/index.xhtml (accessed on 3 March 2020).
  23. United States Geological Survey. Estimated Use of Water in the United States in 2005; 2005. Available online: https://pubs.usgs.gov/circ/1344/pdf/c1344.pdf (accessed on 3 March 2020).
  24. United States Environmental Protection Agency. Benchmark Dose Software Version 2.7. Available online: https://www.epa.gov/bmds (accessed on 3 March 2020).
  25. National Toxicology Program. NTP Technical Report on the Toxicology and Carcinogenesis Studies of Dibromoacetic Acid in F344/N Rats and B6C3F1 Mice; United States Department of Health and Human Services: Washington, DC, USA, 2007.
  26. National Toxicology Program. NTP Technical Report on the Toxicology and Carcinogenesis Studies of Bromochloroacetic Acid in F344/N Rats and B6C3F1 Mice; United States Department of Health and Human Services: Washington, DC, USA, 2009.
  27. National Toxicology Program. NTP Technical Report on the Toxicology Studies of Bromodichloroacetic Acid in F344/N Rats and B6C3F1/N Mice and Toxicology and Carcinogenesis Studies of Bromodichloroacetic Acid in F344/NTac Rats and B6C3F1/N Mice; United States Department of Health and Human Services: Washington, DC, USA, 2015.
  28. United States Environmental Protection Agency. Benchmark Dose Technical Guidance; United States Environmental Protection Agency: Washington, DC, USA, 2012. Available online: https://www.epa.gov/risk/benchmark-dose-technical-guidance (accessed on 3 March 2020).
  29. United States Environmental Protection Agency. Benchmark Dose Software; US EPA: Washington, DC, USA, 2009.
  30. California Office of Environmental Health Hazard Assessment. First Public Review Draft, Haloacetic Acids in Drinking Water; 2020. Available online: https://oehha.ca.gov/water/crnr/announcement-availability-draft-technical-support-document-and-public-workshop-proposed (accessed on 31 January 2020).
  31. United States Environmental Protection Agency. Human Health Benchmarks for Pesticides: Updated 2017 Technical Document; 2017. Available online: https://www.epa.gov/sdwa/human-health-benchmarks-pesticides-drinking-water (accessed on 3 March 2020).
  32. Kahn, H.D.; Stralka, K. Estimated daily average per capita water ingestion by child and adult age categories based on USDA’s 1994-1996 and 1998 continuing survey of food intakes by individuals. J. Expo. Sci. Environ. Epidemiol 2009, 19, 396–404. [Google Scholar] [CrossRef] [Green Version]
  33. Fryar, C.D.; Kruszon-Moran, D.; Gu, Q.; Ogden, C.L. Mean Body Weight, Height, Waist Circumference, and Body Mass Index Among Adults: United States, 1999–2000 through 2015–2016. 2018. Available online: https://stacks.cdc.gov/view/cdc/61430 (accessed on 3 March 2020).
  34. United States Environmental Protection Agency. Estimated Per Capita Water Ingestion and Body Weight in the United States—An Update; EPA-822-R-00-001; 2004. Available online: https://hero.epa.gov/hero/index.cfm/reference/download/reference_id/730449 (accessed on 3 March 2020).
  35. California Office of Environmental Health Hazard Assessment. Public Health Goals for Chemicals in Drinking Water: Bromate; 2009. Available online: https://oehha.ca.gov/water/public-health-goal/final-public-health-goal-bromate-drinking-water (accessed on 3 March 2020).
  36. Rosinger, A.Y.; Herrick, K.A.; Wutich, A.Y.; Yoder, J.S.; Ogden, C.L. Disparities in plain, tap and bottled water consumption among US adults: National Health and Nutrition Examination Survey (NHANES) 2007–2014. Public Health Nutr. 2018, 21, 1455–1464. [Google Scholar] [CrossRef] [Green Version]
  37. California Office of Environmental Health Hazard Assessment. Draft Public Health Goal for Trihalomethanes in Drinking Water. 2010. Available online: https://oehha.ca.gov/media/downloads/water/document/thmphg090910.pdf (accessed on 3 March 2020).
  38. Minnesota Department of Health. Risk Assessment Advice for Incorporating Early-Life Sensitivity into Cancer Risk Assessments for Linear Carcinogens. 2010. Available online: https://www.health.state.mn.us/communities/environment/risk/docs/guidance/adafrecmd.pdf (accessed on 3 March 2020).
  39. United States Environmental Protection Agency. Regulatory Impact Analysis of the Final Revision to the National Ambient Air Quality Standards for Ground-Level Ozone; EPA-452/R-15-007; 2015. Available online: https://www3.epa.gov/ttnecas1/docs/20151001ria.pdf (accessed on 3 March 2020).
  40. United States Environmental Protection Agency. Technical Support Document: EPA’s 2014 National Air Toxics Assessment; United States Environmental Protection Agency: Research Triangle Park, NC, USA, 2018. Available online: https://www.epa.gov/sites/production/files/2018-09/documents/2014_nata_technical_support_document.pdf (accessed on 3 March 2020).
  41. California Office of Environmental Health Hazard Assessment. Appendix J: In Utero and Early Life Susceptibility to Carcinogens: The Derivation of Age-at-Exposure Sensitivity Measures; 2009. Available online: https://oehha.ca.gov/air/crnr/technical-support-document-cancer-potency-factors-2009 (accessed on 3 March 2020).
  42. California Office of Environmental Health Hazard Assessment. First Public Review Draft, Trihalomethanes in Drinking Water; 2018. Available online: https://oehha.ca.gov/media/downloads/crnr/thmsdraft100518.pdf (accessed on 3 March 2020).
  43. Higgins, J.P.T.; Green, S.; Cochrane Collaboration. Cochrane Handbook for Systematic Reviews of Interventions; Wiley-Blackwell: Chichester, England; Hoboken, NJ, USA, 2008; 649p. [Google Scholar]
  44. National Cancer Institute. DevCan—Probability of Developing or Dying of Cancer; DevCan 6.7.7 (Released April 2019); National Cancer Institute: Bethesda, MD, USA, 2019.
  45. National Cancer Institute. Cancer Stat Facts: Bladder Cancer. Available online: https://seer.cancer.gov/statfacts/html/urinb.html (accessed on 3 March 2020).
  46. Mariotto, A.B.; Yabroff, K.R.; Shao, Y.; Feuer, E.J.; Brown, M.L. Projections of the cost of cancer care in the United States: 2010–2020. J. Natl. Cancer Inst. 2011, 103, 117–128. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  47. Bureau of Economic Analysis. Health Care Satellite Account. Available online: https://www.bea.gov/data/special-topics/health-care (accessed on 3 March 2020).
  48. United States Environmental Protection Agency. Guidelines for Carcinogen Risk Assessment; 630-P-03-001F; 2005. Available online: https://www.epa.gov/risk/guidelines-carcinogen-risk-assessment (accessed on 3 March 2020).
  49. Barton, H.A.; Cogliano, V.J.; Flowers, L.; Valcovic, L.; Setzer, R.W.; Woodruff, T.J. Assessing susceptibility from early-life exposure to carcinogens. Environ. Health Perspect. 2005, 113, 1125–1133. [Google Scholar] [CrossRef]
  50. EFSA Scientific Committee; Hardy, A.; Benford, D.; Halldorsson, T.; Jeger, M.J.; Knutsen, K.H.; More, S.; Mortensen, A.; Naegeli, H.; Noteborn, H.; et al. Update: Use of the benchmark dose approach in risk assessment. EFSA J. 2017, 15, e04658. [Google Scholar] [CrossRef]
  51. United States Environmental Protection Agency. Bromodichloromethane; CASRN 75-27-4; 1993. Available online: https://cfpub.epa.gov/ncea/iris/iris_documents/documents/subst/0213_summary.pdf (accessed on 3 March 2020).
  52. United States Environmental Protection Agency. Trichloroacetic Acid (TCA); CASRN 76-03-9; 2011. Available online: https://cfpub.epa.gov/ncea/iris/iris_documents/documents/subst/0655_summary.pdf (accessed on 3 March 2020).
  53. United States Environmental Protection Agency. Dibromochloromethane; CASRN 124-48-1; 1990. Available online: http://cfpub.epa.gov/ncea/iris/iris_documents/documents/subst/0222_summary.pdf (accessed on 3 March 2020).
  54. United States Environmental Protection Agency. Dichloroacetic Acid; CASRN 79-43-6; 2003. Available online: https://cfpub.epa.gov/ncea/iris/iris_documents/documents/subst/0654_summary.pdf (accessed on 3 March 2020).
  55. United States Environmental Protection Agency. Bromoform; CASNR 75-25-2; 1990. Available online: http://cfpub.epa.gov/ncea/iris/iris_documents/documents/subst/0214_summary.pdf (accessed on 3 March 2020).
  56. National Cancer Institute. Report on Carcinogenesis Bioassay of Chloroform; Report on Carcinogenesis Bioassay of Chloroform; National Institute of Health: Bethesda, MD, USA, 1976.
  57. National Toxicology Program. Report on Carcinogens: Monograph on Haloacetic Acids Found as Water Disinfection by-Products; 2018. Available online: https://ntp.niehs.nih.gov/ntp/roc/monographs/haafinal_508.pdf (accessed on 3 March 2020).
  58. Atwood, S.T.; Lunn, R.M.; Garner, S.C.; Jahnke, G.D. New Perspectives for Cancer Hazard Evaluation by the Report on Carcinogens: A Case Study Using Read-Across Methods in the Evaluation of Haloacetic Acids Found as Water Disinfection By-Products. Environ. Health Perspect. 2019, 127, 125003. [Google Scholar] [CrossRef]
  59. International Agency for Research on Cancer. IARC Monographs on the Evaluation fo Carcinogenic Risks to Humans; 1999; Volume 73: Some Chemicals that Cause Tumours of the Kidney or Urinary Bladder in Rodents and Some Other Substances. [Google Scholar]
  60. United States Environmental Protection Agency. Drinking Water Criteria Document for Brominated Trihalomethanes; EPA-822-R-05-011; 2005. Available online: https://www.epa.gov/dwstandardsregulations/drinking-water-criteria-document-brominated-trihalomethanes (accessed on 3 March 2020).
  61. Melnick, R.L.; Boorman, G.A.; Dellarco, V. Water chlorination, 3-chloro-4-(dichloromethyl)-5-hydroxy-2(5H)-furanone (MX), and potential cancer risk. J. Natl. Cancer Inst. 1997, 89, 832–833. [Google Scholar] [CrossRef] [Green Version]
  62. International Agency for Research on Cancer. IARC Monographs on the Evaluation of Carcinogenic Risks to Humans; International Agency for Research on Cancer: Lyon, France, 1991; Volume 52: Chlorinated Drinking Water; Chlorination Byproducts; Some Other Halogenated Compounds; Cobalt and Cobalt Compounds. [Google Scholar]
  63. United States Environmental Protection Agency. Drinking Water Criteria Document for Brominated Trihalomethanes; 2005. Available online: https://www.epa.gov/sites/production/files/2019-03/documents/dw-brominated-trihalomethanes.pdf (accessed on 3 March 2020).
  64. National Toxicology Program. Report on Carcinogens, Fourteenth Edition: Bromodichloromethane CAS No. 75-27-4; 2016. Available online: https://ntp.niehs.nih.gov/ntp/roc/content/profiles/bromodichloromethane.pdf (accessed on 3 March 2020).
  65. United States Environmental Protection Agency. Chloroform; CASRN 67-66-3; 2001. Available online: https://cfpub.epa.gov/ncea/iris2/chemicalLanding.cfm?substance_nmbr=25 (accessed on 3 March 2020).
  66. National Toxicology Program. Report on Carcinogens, Fourteenth Edition: Chloroform CAS No. 67-66-3; 2016. Available online: https://ntp.niehs.nih.gov/ntp/roc/content/profiles/chloroform.pdf (accessed on 3 March 2020).
  67. International Agency for Research on Cancer. IARC Monographs on the Evaluation fo Carcinogenic Risks to Humans; International Agency for Research on Cancer: Lyon, France, 2013; Volume 101: Some Chemicals Present in Industrial and Consumer Products, Food, and Drinking Water. [Google Scholar]
  68. International Agency for Research on Cancer. IARC Monographs on the Evaluation of Carcinogenic Risks to Humans; International Agency for Research on Cancer: Lyon, France, 2014; Volume 106: Trichloroethylene, Tetrachloroethylene, and Some Other Chlorinated Agents. [Google Scholar]
  69. Cantor, K.P. Water chlorination, mutagenicity, and cancer epidemiology. Am. J. Public Health 1994, 84, 1211–1213. [Google Scholar] [CrossRef] [Green Version]
  70. Bull, R.J.; Birnbaum, L.S.; Cantor, K.P.; Rose, J.B.; Butterworth, B.E.; Pegram, R.; Tuomisto, J. Water chlorination: Essential process or cancer hazard? Fundam Appl. Toxicol. 1995, 28, 155–166. [Google Scholar] [CrossRef]
  71. United States Environmental Protection Agency. Economic Analysis for the Final Stage 2 Disinfectants and Disinfection Byproducts Rule; EPA 815-R-05-101; 2005. Available online: https://nepis.epa.gov/Exe/ZyPDF.cgi?Dockey=P1005OOX.txt (accessed on 3 March 2020).
  72. Burger, M.; Catto, J.W.; Dalbagni, G.; Grossman, H.B.; Herr, H.; Karakiewicz, P.; Kassouf, W.; Kiemeney, L.A.; La Vecchia, C.; Shariat, S.; et al. Epidemiology and risk factors of urothelial bladder cancer. Eur. Urol. 2013, 63, 234–241. [Google Scholar] [CrossRef]
  73. Cantor, K.P.; Villanueva, C.M.; Silverman, D.T.; Figueroa, J.D.; Real, F.X.; Garcia-Closas, M.; Malats, N.; Chanock, S.; Yeager, M.; Tardon, A.; et al. Polymorphisms in GSTT1, GSTZ1, and CYP2E1, disinfection by-products, and risk of bladder cancer in Spain. Environ. Health Perspect. 2010, 118, 1545–1550. [Google Scholar] [CrossRef] [Green Version]
  74. Yin, X.; Xiong, W.; Wang, Y.; Tang, W.; Xi, W.; Qian, S.; Guo, Y. Association of CYP2E1 gene polymorphisms with bladder cancer risk: A systematic review and meta-analysis. Medicine 2018, 97, e11910. [Google Scholar] [CrossRef]
Figure 1. The average concentration of trihalomethanes (THM4) in community drinking water systems according to compliance testing results for 2014 to 2017, and the average concentration of haloacetic acids (HAA9) as reported in the EPA Unregulated Contaminant Monitoring Rule 4 occurrence dataset for testing conducted in 2018 to 2019 for 3579 community water systems.
Figure 1. The average concentration of trihalomethanes (THM4) in community drinking water systems according to compliance testing results for 2014 to 2017, and the average concentration of haloacetic acids (HAA9) as reported in the EPA Unregulated Contaminant Monitoring Rule 4 occurrence dataset for testing conducted in 2018 to 2019 for 3579 community water systems.
Ijerph 17 02149 g001
Figure 2. The average concentration of regulated haloacetic acids (HAA5) in community drinking water systems as reported by utilities for 2014 to 2017, and the average concentration of regulated haloacetic acids (HAA5) as reported in the EPA Unregulated Contaminant Monitoring Rule 4 occurrence dataset for testing from 2018 to 2019 for the 100 largest community water systems, which serve a combined population of 74 million. The dotted line indicates where values from both datasets would be identical.
Figure 2. The average concentration of regulated haloacetic acids (HAA5) in community drinking water systems as reported by utilities for 2014 to 2017, and the average concentration of regulated haloacetic acids (HAA5) as reported in the EPA Unregulated Contaminant Monitoring Rule 4 occurrence dataset for testing from 2018 to 2019 for the 100 largest community water systems, which serve a combined population of 74 million. The dotted line indicates where values from both datasets would be identical.
Ijerph 17 02149 g002
Figure 3. Distribution of human-equivalent cancer slope factors (mg/kg-day−1) for dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid, as derived from tumor incidence data [25,26,27] in the tissues of rats and mice using a benchmark response of 5% excess risk and the lower 95% confidence limit on the benchmark dose.
Figure 3. Distribution of human-equivalent cancer slope factors (mg/kg-day−1) for dibromoacetic acid, bromochloroacetic acid, and bromodichloroacetic acid, as derived from tumor incidence data [25,26,27] in the tissues of rats and mice using a benchmark response of 5% excess risk and the lower 95% confidence limit on the benchmark dose.
Ijerph 17 02149 g003
Figure 4. Cumulative assessment of lifetime cancer risk due to disinfection byproducts in drinking water using epidemiologically derived risk estimates based on human studies of disinfection byproducts and bladder cancer and toxicologically derived risk estimates based on animal studies of disinfection byproducts. Values in this figure are calculated for community water systems included in the UCMR4 program.
Figure 4. Cumulative assessment of lifetime cancer risk due to disinfection byproducts in drinking water using epidemiologically derived risk estimates based on human studies of disinfection byproducts and bladder cancer and toxicologically derived risk estimates based on animal studies of disinfection byproducts. Values in this figure are calculated for community water systems included in the UCMR4 program.
Ijerph 17 02149 g004
Table 1. Input data for analysis of haloacetic acid occurrence based on the national contaminant occurrence dataset [15].
Table 1. Input data for analysis of haloacetic acid occurrence based on the national contaminant occurrence dataset [15].
Disinfection ByproductNumber of Community Water Systems Included in the AnalysisPopulation Weighted-Average Concentration (µg/L)HAA Group
Monochloroacetic acid29,6720.48HAA5
Dichloroacetic acid29,6737.8HAA5
Trichloroacetic acid29,6696.4HAA5
Monobromoacetic acid29,6690.24HAA5HAA6Br
Dibromoacetic acid29,6691.2HAA5HAA6Br
Tribromoacetic acid9860.21 HAA6Br
Bromochloroacetic acid 80242.9 HAA6Br
Bromodichloroacetic acid 9921.1 HAA6Br
Chlorodibromoacetic acid9860.28 HAA6Br
Table 2. Input data for analysis of haloacetic acid occurrence based on the Unregulated Contaminant Monitoring Rule 4 (UCMR4) dataset [15].
Table 2. Input data for analysis of haloacetic acid occurrence based on the Unregulated Contaminant Monitoring Rule 4 (UCMR4) dataset [15].
Disinfection ByproductNumber of Community Water Systems Included in the Analysis aPopulation Weighted-Average Concentration (µg/L)
HAA5357619.1
HAA6Br35797.0
HAA9357629.4
a Data on five haloacetic acids (HAA5) and nine chlorinated and brominated haloacetic acids (HAA9) was unavailable for three systems in the published UCMR4 dataset.
Table 3. Human-equivalent cancer slopes derived from benchmark dose modeling of animal data.
Table 3. Human-equivalent cancer slopes derived from benchmark dose modeling of animal data.
Disinfection Byproduct and Source of Animal Toxicology DataBenchmark Dose Calculated from Animal Bioassay (mg/kg-day) aHuman-Equivalent Cancer Slope Factor (lower 95% Confidence Limit) b (mg/kg-day)−1Benchmark Dose Calculated from Animal Bioassay (mg/kg-day) aHuman-Equivalent Cancer Slope Factor (lower 95% Confidence Limit) b (mg/kg-day)−1
Benchmark response5% excess risk10% excess risk
Bromochloroacetic acid [26]1.0 (0.7–1.6)0.4632.0 (1.3–3.2)0.451
Bromodichloroacetic acid [27]2.8 (1.6–9.1)0.1855.7 (3.2–18.7)0.180
Dibromoacetic acid [25]2.2 (1.4–3.8)0.2104.5 (3.0–7.7)0.205
a Benchmark doses modeled for 5% or 10% extra risk of tumor incidence in the liver of mice, the most sensitive site in exposed laboratory animals; central estimates, as well as upper and lower confidence limits, are reported. b Cancer slope factors were calculated using the lower 95% confidence limit of the benchmark dose and transformed to the human-equivalent using Equation (3).
Table 4. Human cancer slope factors and cancer risk concentrations reported in other studies.
Table 4. Human cancer slope factors and cancer risk concentrations reported in other studies.
Disinfection ByproductCancer Slope Factor Reported by OEHHA a (mg/kg/day−1)OEHHA One-in-a-Million Cancer Risk Benchmark Concentration (µg/L)Cancer Slope Factor Reported by the U.S. EPA a (mg/kg-day−1)U.S. EPA One-in-a-Million Cancer Risk Benchmark Concentration (µg/L)
Dibromoacetic acid0.2500.03, 2020 [30]N/AN/A
Bromodichloromethane0.0870.06, 2018 [42]0.0620.6, 1993 [51]
Trichloroacetic acid0.0710.1, 2020 [30]0.0670.5, 2011 [52]
Dibromochloromethane0.0450.1, 2018 [42]0.0840.4, 1990 [53]
Dichloroacetic acid0.0410.2, 2020 [30]0.0480.7, 2003 [54]
Chloroform0.0140.4, 2018 [42]N/AN/A
Bromoform0.0110.5, 2018 [42]0.0084.0, 1990 [55]
a Cancer slope factors are based on the lower 95% confidence limit of the benchmark dose or point of departure.
Table 5. Benchmark doses and cancer risk concentrations for haloacetic acids and trihalomethanes.
Table 5. Benchmark doses and cancer risk concentrations for haloacetic acids and trihalomethanes.
Disinfection Byproduct aBenchmark Doses from Animal Bioassay, 5% Excess Cancer Risk (mg/kg-day)Concentrations Corresponding to One-in-a-Million Cancer Risk c (µg/L)Source of the Risk Benchmark
Bromochloroacetic acid 1.0 (0.7–1.6) b0.02Calculated in this study
Chlorodibromoacetic acidNot Available0.02Applied by read-across from bromochloroacetic acid
Bromodichloroacetic acid 2.8 (1.6–9.1) b0.04Calculated in this study
Dibromoacetic acid2.2 (1.4–3.8) b0.04Calculated in this study
Tribromoacetic acid Not Available0.04Applied by read-across from dibromoacetic acid
Trichloroacetic acid8.1 (4.4–28.8)0.1OEHHA 2020 [30]
Dichloroacetic acid32.7 (7.9–40.2)0.2OEHHA 2020 [30]
HAA5 groupNot applicable0.1Calculated in this study
HAA6Br groupNot applicable0.03Calculated in this study
HAA9 groupNot applicable0.06Calculated in this study
Bromodichloromethane11.1 (3.9–21.9)0.06OEHHA 2018 [42]
Dibromochloromethane26.2 (7.5–39.1)0.1OEHHA 2018 [42]
Chloroform33.4 (14.1–51.6) d 0.4 eOEHHA 2018 [42]
Bromoform31.0 (18.7–82.7)0.5[42]
THM4 groupNot applicable0.15Evans et al. [16]
a There is no evidence of carcinogenicity for monobromoacetic acid and monochloroacetic acid. b Benchmark doses were modeled using 5% extra risk of tumor incidence in the liver of mice, the most sensitive site in exposed laboratory animals. c Risk-specific concentrations were calculated based on 95th percentile drinking water intake and adjustment factors to account for early-life sensitivity. d Benchmark modeling results for chloroform vary depending on the specific bioassay [42,56]; benchmark dose data reported here are from California OEHHA modeling of the data from the National Cancer Institute 1976 report on chloroform carcinogenicity [56]. e The benchmark, as reported by California OEHHA, is based on the geometric mean of cancer slope factors from five different animal studies [42].
Table 6. Toxicological estimates for attributable lifetime cancer cases and cumulative cancer risks due to haloacetic acids and trihalomethanes.
Table 6. Toxicological estimates for attributable lifetime cancer cases and cumulative cancer risks due to haloacetic acids and trihalomethanes.
Chemical GroupCancer Estimates Using Default Parameters a,bCancer Estimates Using Age Sensitivity Factors a,c
Lifetime cancer cases calculated using the national tap water dataset (thousands)
THM4 d3.1 (1.7–10.2)19.1 (10.2–57.2)
HAA54.0 (2.0–8.4)18.5 (8.6–40.1)
Lifetime cancer cases calculated for systems in the UCMR4 program (thousands)
HAA52.9 (1.5–6.1)13.4 (6.2–29.1)
HAA6Br8.6 (4.4–12.8)32.1 (21.4–42.8)
HAA910.9 (5.4–17.5)41.4 (25.3–76.0)
THM4 d and HAA912.8 (6.5–24.1)53.7 (31.9–112.8)
Lifetime cancer risk calculated for systems in the UCMR4 program
Cumulative cancer risk estimates for THM4 d and HAA97.0 × 10−5 (3.5 × 10−5–1.3 × 10−4)2.9 × 10−4 (1.7 × 10−4–6.2 × 10−4)
a Estimates are based on the benchmark dose and the corresponding 90% confidence intervals. The upper bound estimate of cancer cases corresponds to the cancer slope factor calculated from the lower bound estimate of the benchmark dose, and vice versa. b Default parameters use the adult drinking water intake of 2 L/day and body weight of 70 kg. c Susceptibility factors include an age-sensitivity adjusted 95th percentile drinking water intake of 0.129 L/kg-day for haloacetic acids [30] and 0.18 L/kg-day for trihalomethanes [42]. d Cancer risk estimates for THM4 are based on benchmark doses reported in Table 5; chloroform benchmark doses are from modeled National Cancer Institute data [42,56].
Table 7. Lifetime bladder cancer cases attributable to disinfection byproducts in drinking water (thousands of cases).
Table 7. Lifetime bladder cancer cases attributable to disinfection byproducts in drinking water (thousands of cases).
Water SourcePopulation ServedUp to 20 ug/L20–40 ug/L40–60 ug/L60–80 ug/LAbove 80 ug/LAll Concentrations
Groundwater10,000 or less13.2
(0–29.4)
13.7
(0–27.4)
6.7
(1–11.9)
3.2
(1.2–4.9)
2.3
(0.3–5.1)
39.2
(2.5–78.6)
141.5
(10.2–276.5)
828.1
(57.2–1590.2)
10,001 to 100,00017.1
(0–37.8)
28.4
(0–56.8)
16.9
(2.7–29.6)
3.6
(1.3–5.6)
0.5
(0.1–1)
66.4
(4–130.8)
More than 100,0004.4
(0–9.7)
14.6
(0–28.5)
11.6
(1.8–20.4)
5.3
(1.8–8.4)
0
(0–0)
35.9
(3.6–67)
Surface Water10,000 or less5.2
(0–11.4)
22.8
(0–44.9)
26.5
(4.2–46.5)
10.6
(3.9–16.4)
5.1
(1–10.6)
70.1
(9.1–129.8)
686.6
(47.1–1313.6)
10,001 to 100,00027.5
(0–60.9)
100.1
(0–197.8)
74.4
(10.9–131.3)
9.7
(3.5–15.2)
4.9
(0.6–11.2)
216.7
(15–416.4)
More than 100,00035.4
(0–78.4)
217.6
(0–427.9)
131.1
(19.2–231.4)
10.8
(3.8–17.1)
4.9
(0–12.6)
399.9
(23–767.4)
Table 8. Halogenated disinfection byproducts classified as carcinogens by authoritative government agencies.
Table 8. Halogenated disinfection byproducts classified as carcinogens by authoritative government agencies.
Disinfection ByproductInternational Agency for Research on Cancer (IARC)U.S. Environmental Protection AgencyNational Toxicology Program (U.S.)
Trihalomethanes
BromodichloromethanePossibly carcinogenic to humans (Group 2B) [62]; Probable human carcinogen (Group B2) [51]; Likely to be carcinogenic to humans [63];Reasonably anticipated to be a human carcinogen [64];
BromoformUnclassifiable as to carcinogenicity in humans (Group 3) [62]; Probable human carcinogen (Group B2) [55]; Likely to be carcinogenic to humans [63];
Chloroform Possibly carcinogenic to humans (Group 2B) [59]; Probable human carcinogen (Group B2) [65]; Likely to be carcinogenic to humans by all routes of exposure under exposure conditions that lead to cytotoxicity and regenerative hyperplasia in susceptible tissues; not likely to be carcinogenic to humans by any route of exposure under exposure conditions that do not cause cytotoxicity and cell regeneration [65];Reasonably anticipated to be a human carcinogen [66];
DibromochloromethaneNot classifiable as to its carcinogenicity to humans (Group 3) [67];Possible human carcinogen (Group C) [53];
Haloacetic acids
Dichloroacetic AcidPossibly carcinogenic to humans (Group 2B) [68]; Likely to be carcinogenic to humans [54];Reasonably anticipated to be a human carcinogen [57]
Dibromoacetic acidPossibly carcinogenic to humans (Group 2B) [67]; Reasonably anticipated to be a human carcinogen [57]
Bromochloroacetic acid Possibly carcinogenic to humans (Group 2B) [67]; Reasonably anticipated to be a human carcinogen [57]
Bromodichloroacetic acid Reasonably anticipated to be a human carcinogen [57]
Trichloroacetic acidPossibly carcinogenic to humans (Group 2B) [68]; Suggestive evidence of carcinogenic potential [52];
Chlorodibromoacetic acid Reasonably anticipated to be a human carcinogen [57]
Tribromoacetic acid Reasonably anticipated to be a human carcinogen [57]

Share and Cite

MDPI and ACS Style

Evans, S.; Campbell, C.; Naidenko, O.V. Analysis of Cumulative Cancer Risk Associated with Disinfection Byproducts in United States Drinking Water. Int. J. Environ. Res. Public Health 2020, 17, 2149. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17062149

AMA Style

Evans S, Campbell C, Naidenko OV. Analysis of Cumulative Cancer Risk Associated with Disinfection Byproducts in United States Drinking Water. International Journal of Environmental Research and Public Health. 2020; 17(6):2149. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17062149

Chicago/Turabian Style

Evans, Sydney, Chris Campbell, and Olga V. Naidenko. 2020. "Analysis of Cumulative Cancer Risk Associated with Disinfection Byproducts in United States Drinking Water" International Journal of Environmental Research and Public Health 17, no. 6: 2149. https://0-doi-org.brum.beds.ac.uk/10.3390/ijerph17062149

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop