Next Article in Journal
Development of National Newborn Screening Quality Indicators in the United States
Next Article in Special Issue
Factors Influencing Parental Awareness about Newborn Screening
Previous Article in Journal / Special Issue
Initial Evaluation of Prospective and Parallel Assessments of Cystic Fibrosis Newborn Screening Protocols in Eastern Andalusia: IRT/IRT versus IRT/PAP/IRT
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Wisconsin’s Screening Algorithm for the Identification of Newborns with Congenital Adrenal Hyperplasia

1
Wisconsin State Laboratory of Hygiene, University of Wisconsin School of Medicine and Public Health, Madison, WI 53706, USA
2
Department of Biostatistics and Medical Informatics, University of Wisconsin School of Medicine and Public Health, Madison, WI 53726, USA
3
Department of Pediatrics, University of Wisconsin School of Medicine and Public Health, Madison, WI 53792-4108, USA
*
Author to whom correspondence should be addressed.
Int. J. Neonatal Screen. 2019, 5(3), 33; https://0-doi-org.brum.beds.ac.uk/10.3390/ijns5030033
Submission received: 31 July 2019 / Revised: 30 August 2019 / Accepted: 2 September 2019 / Published: 6 September 2019
(This article belongs to the Special Issue Selected Papers from 11th ISNS European Regional Meeting)

Abstract

:
Newborn screening for congenital adrenal hyperplasia (CAH) has one of the highest false positive rates of any of the diseases on the Wisconsin panel. This is largely due to the first-tier immune assay cross-reactivity and physiological changes in the concentration of 17-hydroxyprogesterone during the first few days of life. To improve screening for CAH, Wisconsin developed a second-tier assay to quantify four different steroids (17-hydroxyprogesterone, 21-deoxycortisol, androstenedione, and cortisol) by liquid chromatography–tandem mass spectrometry (LC–MSMS) in dried blood spots. From validation studies which included the testing of confirmed CAH patients, Wisconsin established its own reporting algorithm that incorporates steroid concentrations as well as two different ratios—the birth weight and the collection time—to identify babies at risk for CAH. Using the newly developed method and algorithm, the false positive rate for the CAH screening was reduced by 95%. Patients with both classical forms of CAH, salt-wasting and simple virilizing, were identified. This study replicates and expands upon previous work to develop a second-tier LC–MSMS steroid profiling screening assay for CAH. The validation and prospective study results provide evidence for an extensive reporting algorithm that incorporates multiple steroids, birth weight, and collection times.

1. Introduction

Congenital Adrenal Hyperplasia (CAH) is a group of autosomal recessive disorders caused by enzymatic defects within the biosynthetic pathways of mineralocorticoids, glucocorticoids, and sex hormones. The most common defect, accounting for greater than 90% of CAH cases, is due to 21-hydroxylase (21-OH) deficiency, and has an estimated prevalence in the United States of 1 in 16,000 to 1 in 20,000 [1,2,3]. There are three presentations of 21-OH deficiency that range in severity: classical salt-wasting (SW), classical simple virilizing (SV), and non-classical. Patients with SW-CAH may experience a life-threatening adrenal crisis within the first week of life, leading to hyponatremia, dehydration, alkalosis, and shock. Early treatment with glucocorticoid and mineralocorticoid replacement is effective and lifesaving [1,2,3].
Newborn screening for 21-OH deficiency was first introduced in 1977 [4], with the objective to identify patients with the severe salt-wasting form (SW-CAH) of the disease to provide therapeutic intervention and reduce mortality [5,6]. Wisconsin added CAH to its newborn screening panel of diseases in 1983. All states utilize a first-tier immunoassay, measuring 17-hydroxyprogesterone (17-OHP) in dried blood spot specimens [7]. Although screening for CAH using 17-OHP is effective at identifying severely affected patients at risk for salt-wasting crisis, there is a high false positive rate associated with the assay [7]. Assay limitations, such as cross-reactivity with other steroid sulfatides [8], and physiological differences between newborns particularly within the premature infant population, contribute to the high false positive rate [9,10]. The use of alternative antibodies within the assay and modifications to cutoff values based on birth weight and/or gestational age has not substantially reduced the burden of mis-identification [11,12,13]. At present, 9 states mandate a second screen on all newborns at 9–14 days of life [14]. This additional screen can impact the positive predictive value of CAH testing, however, the logistical and financial burden is large.
In recent years, newborn screening programs have implemented second-tier testing to reduce false positive rates. This second-tier test is typically performed on the original specimen, when the first-tier screening result—elevated 17-OHP—is abnormal. In 2004, Lacey et al. published the first report of a second-tier method for CAH [15]. This method extracted cortisol (F), 17-OHP, and androstenedione (4-A) from the dried blood spot specimen using diethyl ether, followed by separation, identification, and quantification of the three steroids using liquid chromatography–tandem mass spectrometry (LC–MSMS). Modifications to this original method, eliminating the diethyl ether extraction, were published by other state newborn screening programs; however, states continued to only quantify cortisol, 17-OHP, and androstenedione [16,17]. Research groups later demonstrated the feasibility of analyzing a larger panel of steroids in dried blood spots using LC–MSMS with up to 9 analytes, including 11-deoxycortisol (11) and 21-deoxycortisol (21) [18,19]. Additional reports have highlighted the utility of 21-deoxycortisol, measured in serum, as a marker of 21-OH deficiency [20,21].
In 2007, Janzen et al. published an original method validation and prospective study which incorporated analysis of 21-deoxycortisol in dried blood spots, along with the ratio of (17-OHP + 21)/F [22]. The article highlighted differences in steroid concentrations across a range of gestational ages. While comprehensive, the article did not consider the collection timing of the specimen, nor did it provide a testing algorithm. A more recent pilot study for CAH screening performed in Turkey used only the ratio of (17-OHP + 21)/F, stratifying by gestational age and birth weight, to identify cases of CAH. Timing of blood spot collection within this study was considerably later (3–5 days) than practices of state newborn screening programs [23]. To date, a prospective screening study for CAH—including second-tier LC–MSMS analysis of a steroid panel and multiple associated ratios—has not been reported. Likewise, a comprehensive screening algorithm, incorporating first- and second-tier analyses and stratification by birth weight and timing of collection, has not been proposed.
This study adds to the literature by outlining the method validation for four different steroids measured by LC–MSMS. Details on the development of an algorithm, which incorporates first-tier testing and second-tier analysis of multiple steroids and associated ratios, stratified by birth weight and the timing of specimen collection, are provided. Lastly, this study summarizes the year-long implementation of the second-tier test and its influence on positive predictive value and false positive screening rates for CAH within the Wisconsin population.

2. Materials and Methods

2.1. Dried Blood Specimens

A protocol (2019-0118) for the use of residual dried blood spot (DBS) newborn screening (NBS) specimens was approved by the Health Sciences Institutional Review Board (IRB) at the University of Wisconsin (3/28/2019). For the assay validation, DBS specimens from 18 patients with CAH were obtained from newborn screening laboratories and were de-identified according to the IRB-approved protocol. Residual, known false positives specimens (n = 144), obtained through the Wisconsin NBS program, were also used for the validation. The true and false positive specimens were stored at −20 °C prior to analysis. For the prospective study, all dried blood spot specimens were collected between 0 and 168 h after birth and were stored at 4 °C after routine NBS was completed.

2.2. Reagents and Standards

Standards for cortisol (F) and 17-hydroxyprogesterone (17-OHP) were purchased from Sigma (St. Louis, MO, USA). The standard for 21-deoxycortisol (21) was purchased from ChemCruz (Dallas, TX, USA), and the standard for 4-androstene-3,17-dione (4-A) was obtained from Cambridge Isotopes (Tewksbury, MA, USA). The isotopically labeled internal standards D-7, 4-androstene-3,17-dione (2,2,4,6,6,16,16), D-8, 21-deoxycortisol (2,2,4,6,6,21,21,21), D-8, 17-hydroxyprogesterone (2,2,4,6,6,21,21,21), and D-4, cortisol (9,11,12,12) were purchased from CDN isotopes (Pointe-Claire, Greater Montreal, QC, Canada). Acetonitrile and methanol HPLC–MS grade solvents were purchased from J.T. Baker through Fisher Scientific (Pittsburgh, PA, USA). Grade 903 filter paper for DBS preparation was purchased from Whatman GmbH (Dassel, Germany). Sera Con II charcoal filtered de-lipidated plasma was acquired from SeraCare Life Sciences (Milford, MA, USA). Packed red blood cells (RBC) from O-positive donor and plasma were purchased from the American Red Cross (St. Louis, MO, USA). Plasma and washed RBC were combined in 50/50 v/v (to achieve a 50% hematocrit) to make whole blood.

2.3. Quality Control and Calibrators

Three different sets of quality control materials for the four steroids at varying concentrations were prepared. Whole blood was enriched with 15 ng/mL or 150 ng/mL of 17-OHP, 11, 21, and 4-A to prepare the low- and high-quality control materials respectively. The normal control was not inoculated with 17-OHP, 21, or 4-A. Cortisol was inversely spiked into the normal, low- and high-quality control materials at concentrations of 80, 15 and 5 ng/mL, respectively, to mimic patient profiles with high 17-OHP and low cortisol concentrations.
Calibrators were prepared with equimolar enrichment of each steroid in the following levels: 0, 2.5, 5.0, 10, 50, 100 and 250 ng/mL. These calibrators were also used to assess the method’s linearity and limit of quantification.
The unenriched and enriched whole blood pools used in creation of the quality control materials and calibrators were dispensed onto filter paper, dried overnight under ambient conditions, and stored at –20 °C in zip-closure plastic bags containing desiccant packets.

2.4. First-Tier Screening Assay for the Quantification of 17-Hydroxyprogesterone

As part of routine screening within Wisconsin, whole blood samples obtained from newborns between 0 and 168 h after birth were collected on Whatman GmbH grade 903 filter paper, dried, and sent to the Wisconsin NBS laboratory. 17-OHP was measured on all specimens using a time-resolved fluoroimmunoassay according to the manufacturer’s specifications (GSP; PerkinElmerLife and Analytical Sciences; Shelton, CT, USA). The results of this first-tier CAH screening were interpreted according to the birth weight of the newborn (Figure 1). Any specimen with a 17-OHP value greater than the cutoff was analyzed by second-tier screening assay.

2.5. Second-Tier Screening Assay for Quantification of Five Steroids

A 3.2 mm (⅛”) punch of the DBS specimen was placed into a 96-well, round-bottom polypropylene plate. The steroids (F, 17-OHP, 21, 4-A) were extracted from the punch using 175 µL of an 80:20 acetonitrile/water solution containing 3 ng/mL of each internal standard, followed by shaking at 50 °C for 60 min. The extraction solution was transferred to a clean 96-well plate and dried under nitrogen gas for 35–40 min at a temperature of 40 °C. The dried well was reconstituted using 50 µL of 40:60 methanol/water solution with 0.3% formic acid and then shaken for 10 min at room temperature, prior to analysis.
The steroids were separated by liquid chromatography using a Phenomenex Kinetex (Torrance, CA, USA) 5 µm C18 110A 50 × 2.1 mm column and analyzed using an AB Sciex API 4500 tandem mass spectrometer with a TurboV electrospray ionization source. The API 4500 was operated in positive-ionization mode with the ion spray voltage set to 1500 V, declustering potential 70 V, excitation potential of 10 V, and a collision cell exit potential of 13 V. Additional steroid dependent parameters are in Table 1. Two mobile phases of water with 0.1% formic acid and 10 µM ammonium formate (mobile phase A) and 100% methanol with 0.1% formic acid and 10 µM ammonium formate (mobile phase B) were used with the injection profile (Table 2).
Adequate baseline separation of the four steroids, the column wash and re-equilibration was achieved with a total run time of nine minutes. The injected sample volume was 20 µL. The steroids and associated internal standard were analyzed using the multiple reaction monitoring (MRM) pairs in Table 1. Steroid identities were confirmed by their retention time as compared to the labeled internal standard and by the identifying transitions (I). The concentrations were determined using the quantifying transitions (Q) and a linear regression curve with no weighting and forced through zero. All data acquisition and processing were performed using Analyst 1.6.2 software (AB Sciex, Redwood City, MA, USA).

2.6. Analysis

The analytical method described above extracts, identifies, and quantifies four steroids. The described assay validation results below highlight these four steroids (17-OHP, 21, 4-A, and F). To identify newborns with congenital adrenal hyperplasia due to 21-OH deficiency, the following three steroids (17-OHP, 21, and 4-A) and two ratios [(17-OHP + 21)/F and (17-OHP + 4A)/F] were used for interpretation.
For the population assessment, the four steroid values were log transformed to improve symmetry of the data and stabilize variance across the range of birth weight. Statistical analysis of the data was performed using non-parametric analysis of variance (ANOVA; Kruskal–Wallis test) and Mann–Whitney tests for follow-up pairwise comparisons. Significance was defined as p < 0.0001 and all tests are two-sided.

3. Results

3.1. Method Validation

A complete clinical assay laboratory validation was performed for four steroids quantified within the second-tier assay (F, 17-OHP, 21, and 4-A). Assay precision was assessed using the two quality control specimens and the unenriched specimen analyzed in six replicates on seven different days. The intra- and inter-assay precision was less than 11% and 15% respectively for all four steroids at varying concentrations exceeding the limit of detection (determined to be 1.0 ng/mL with a 3:1 signal to noise). The limit of quantification was assessed at 2.5 ng/mL for each steroid, with a CV of 26% or less. Linearity ranged from 0 to 500 ng/mL with slopes averaging between 0.83 and 1.15 and a coefficient of determination (R2) of >0.9970. The recovery of each steroid was within ±15% of expected concentration across the linear range.

3.2. Normal Distribution

Routine NBS was performed on 783 specimens, collected between 0 to 167 h (average 24.6 h, median 24 h) after birth. The birth weights for these patient specimens ranged from 300 to 4810 g: 27% with a birth weight less than or equal to 1500 g; 28% with a birth weight between 1501 and 2500 g; and 45% with birth weight >2500 g. The 17-OHP values as measured by the first-tier immunoassay were within the normal range as determined by the birth weight adjusted cutoff (see Figure 1 for birth weight adjusted algorithm). All specimens were analyzed by the second-tier LC–MSMS test to assess the normal population distribution for the four steroids (17-OHP, F, 21, 4-A).
For each steroid (17OHP, F, 4-A, 21), the data was plotted and a linear regression of the log transformed value against a 5-knot restricted cubic spline for birth weight was fit, with the model stratified according to age at sample collection (before 24 h versus 24–168 h) (Figure 2). 17-hydroxyprogesterone was inversely related to the birth weight of the newborn. This has been shown with previous studies. Additionally, the 17OHP values stratified into three groups based upon the birth weight (≤1500 g, 1501–2500 g and >2500 g) were statistically different (p-value <0.0001) as assessed by the one-way ANOVA Kruskal–Wallis test. Androstenedione also declined in concentration with increasing birth weight and was statistically different between each of the three birth weight groups (p-values <0.0001). Cortisol and 21-deoxycortisol were not statistically related to birth weight (p-values of 0.3217 and 0.0012, respectively).
Steroid concentrations were also assessed by the timing of collection, either before 24 h, or at 24 h or greater; 61% of specimens were collected at 24 h or greater; and 39% of specimens were collected at less than 24 h. The 17-OHP, 4-A, F, and 21 concentrations in specimens collected before 24 h as compared to 24 h or greater were all statistically different (p-value <0.0001) as assessed by the Mann–Whitney test. Further stratification by timing of collection and birth weight, using the weight categories listed above, showed statistical differences between groupings for 17-OHP and 4-A (Mann–Whitney p-values <0.0001). The Mann–Whitney tests performed on cortisol and 21-deoxycortisol were not consistently significant among the groups (stratified by birth weight and collection time).
The normal range of values for 17-OHP and androstenedione are summarized in Table 3 along with the median, mean, three standard deviation (3stdev) value, and the 99th percentile (0.99). Based upon the analysis above, these two steroids were stratified by both birth weight and collection time. Overall, 21-deoxycortisol was not statistically different when stratified and therefore the data was grouped together using all 783 samples. For the two ratios projected to have utility in the interpretation of second-tier results (17-OHP + 4-A)/F and (17-OHP + 21)/F, the groups were stratified by birth weight, but not by timing of collection, because the Mann–Whitney tests were not significantly different (data not provided). Projected cutoffs based upon the distribution of values across various groups were suggested to be at 3 standard deviations, which correlate similarly to the 99th percentile.

3.3. Retrospective Analysis

3.3.1. Confirmed Cases and False Positives

Second-tier analysis was performed retrospectively on residual specimens from 18 confirmed CAH patients with varying forms of the disease. (See Table 4) In 16 of the 18 patient specimens, the 17-OHP, 4-A, and 21 values and two ratios were above the 3stdev cutoff given the reported birth weight. All of these patients had a classical form of CAH, either salt wasting or simple virilizing. Specimen collection for one patient (#16) was performed at 2 h after birth and only 21, [(17-OHP + 4-A)/F] and [(17-OHP + 21)/F] were elevated; however, the ratios were greater than 10 standard deviations above the mean. In another specimen, collected from a patient (#12) known to have non-classical CAH, only 17-OHP and 21 were elevated; however, the 21 concentration was greater than 10 standard deviations from the mean. All 18 confirmed patients had a birth weight greater than or equal to 2500 grams and specimen collection between 24 to 168 h with the exception of patient 16, whose birth weight was less than 1500 g and specimen collection prior to 24 h.
The second-tier assay was performed on 144 residual false positive CAH specimens (specimens from patients with abnormal first-tier results but unaffected with disease). Within the 144 specimens, 9 (6.3%) were collected prior to 24 h and 135 (93.7%) were collected at 24 h or later. The birth weight in this population ranged from 403 to 4060 g; 19.4% had a birth weight ≤1500 g, 13.9% were between 1501 and 2500 g, and 66.7% were greater than 2500 g. None of the false positive specimens had all five markers (three steroids and two ratios) greater than 3stdev above the mean, nor were any of the individual markers greater than 10 standard deviations. However, 7 out of 144 specimens (~5%) had abnormal results, greater than 3stdev, for four of the five markers. The remaining 137 specimens had three or fewer markers above the 3stdev cutoff.

3.3.2. Wisconsin Algorithm

An interpretation algorithm was proposed after analysis of the 18 specimens from confirmed cases, 144 false positive specimens, and 783 presumptively normal specimens. All newborns will continue to receive the routine first-tier immune assay to measure the 17-OHP concentration. If the 17-OHP value is determined to be abnormal, depending upon the birth weight adjusted cutoff, the specimen will be referred for second-tier testing. The second-tier test will measure four different steroid concentrations and two ratios. Specimens with 17-OHP, 4-A, 21, and the two ratios [(17-OHP + 4-A)/F and (17-OHP + 21)/F] above three standard deviations will be reported as abnormal (screened positive). Patients will be immediately referred for endocrine consultation and confirmatory testing. Likewise, any sample with any of the five markers (three steroids or two ratios) above 10 standard deviations will also be referred for immediate endocrine consultation and confirmatory testing. To allow for a conservative interpretation and to limit the possibility of false negative results, specimens with four of the five markers above the three standard deviation cutoffs would result in a request for repeat newborn screen See the algorithm in Figure 1.
As per the Wisconsin protocol for babies in special care units, a routine repeat screen at 14 days of life will continue to be performed on all newborns with a birth weight <2200 g, regardless of the initial CAH result. These repeat specimens will be tested and evaluated using the same algorithm, with the exception of the first-tier 17-OHP cutoff. The repeat specimens will have a more stringent first-tier 17-OHP cutoff, dropping from initial birth weight cutoff to the next lower cutoff (i.e., for a 1100 g baby with an initial cutoff of ≥125 ng/mL for 17-OHP, the cutoff applied to the repeat specimen will be 64 ng/mL for 17-OHP).

3.4. Prospective Study Using the Proposed Wisconsin Algorithm

A one-year prospective study incorporating second-tier testing for CAH was implemented into routine newborn screening using the algorithm in Figure 1. The results are summarized below in Figure 3. A total of 63,725 babies were screened during the one-year prospective study, with the average time of collection at 24 h. All first-tier testing was performed within 12 h after receipt of the specimen. Four-hundred and seventy-two babies (0.7% of the total) had an elevated 17-OHP value measured by first-tier analysis above the birth-weight-based cutoff; 66% had a birth weight greater than 2500 g; 18% with birth weight between 1501–2500 g; and 16% has a birth weight ≤1500 g. The second-tier test was performed on the initial screening specimen within 48 h after receiving the abnormal first-tier results. From this group of 472 babies, 29 (6%) were determined to have screened positive second-tier results. The total screening time for all 29 babies, who received both first and second-tier testing, was less than 72 h. Eight of the 29 specimens had elevations of all five markers, and the other 21 specimens had elevations of four of the five markers. The eight newborns with abnormal, screened positive, results were referred for confirmatory testing and endocrine evaluation. Five of the eight babies were confirmed to have classical CAH, either SW or SV, as reported by the endocrinologist or primary care physician. The results of the second-tier testing for the five confirmed babies are highlighted in Table 4 (specimen numbers 19 through 23). The other three babies were determined to be false positives, not affected with CAH. A repeat newborn screen was collected for the 21 newborns with elevations of four markers after second-tier analysis. The second repeat specimens all had normal 17-OHP values as measured by the first-tier test and therefore second-tier testing was not performed. These newborns were considered to be false positives for CAH. To our knowledge, no true cases of CAH were missed by newborn screening (false negatives) during the prospective study.
A calculation of the false positive rates within the prospective study (false positives/total screened) was determined to be 0.75% following first-tier testing, decreasing to 0.04% after second-tier testing and resulting in a greater than 95% reduction in false positive cases. The calculated positive predictive value [true positives/(true positives + false positives)] before and after second-tier testing was also dramatically improved, from 1% to 17%.

4. Discussion

The introduction of newborn screening for CAH has profoundly impacted the well-being of affected individuals (approximately 3 to 6 newborns each year in Wisconsin) by reducing the morbidity and the risk of neonatal death due to salt-wasting crisis. However, the current first-tier screening protocol has a high false-positive rate (approximately 0.75% in Wisconsin), leading to unnecessary testing and clinical evaluations, along with parental anxiety and stress [24,25]. The causes of the high false positive rate are many and varied, including limitations of the first-tier assay and physiological factors. The successful implementation of a LC–MSMS second-tier assay for quantification of 17-OHP and other steroids has occurred in several laboratories, with reports of increased assay specificity and positive predictive value, along with a reduction of false positive results by greater than 90% [26,27].
The success of the second-tier test for CAH has been tempered recently with a concern for false-negative results. Previous reports of missed cases have largely been limited to the milder forms of CAH missed by first-tier analysis [28,29,30]. However, a recent article from the Minnesota newborn screening program questioned the sensitivity of the second-tier tests. In a 10-year review, Minnesota reported 15 false negative cases of CAH; patients with either the SV or SW form. Of the 15 missed cases, 4 cases had a normal 17-OHP first-tier test results, while 11 cases had abnormal first-tier results but normal second-tier test results [31]. Missed cases after second-tier analysis raises concerns for the validity of the algorithm. It is possible that additional steroids and ratios, along with factors such as birth weight, gestational age, or the timing of collection need to be considered. Given that false negative cases are often not reported to NBS programs, it is likely that other programs using a simplified second-tier testing algorithm may also miss cases.
This study describes the Wisconsin experience with the validation and implementation of the second-tier LC–MSMS test, including the development of an algorithm for the interpretation of results. Wisconsin chose to analyze four different steroids (17-OHP, 4-A, 21, and F). Assay performance metrics, including precision, accuracy, and linearity, were all consistent with previously reported studies. As part of the assay validation, a complete analysis of the steroid concentrations within the normal population was performed. Consistent with literature reports, steroid concentrations change over time and are also impacted by physiological differences between a premature, low-birth-weight baby compared to a full-term baby [32]. Therefore, Wisconsin stratified the normal population range by both the timing of collection and the birth weight of the newborn. Birth weight instead of gestational age was used as a marker of prematurity, because gestational age is often not collected by state programs or may be inaccurate. Likewise, stratification by collection times, particularly before or after 24 h, is important to consider as state practices continue to push for earlier collection times [33].
From the assessment of the normal population, along with false positive and confirmed cases, an interpretation algorithm including multiple steroids (17-OHP, 21, 4-A) and two additional ratios, stratified by birth weight and specimen collection timing, was proposed. Sixteen of the confirmed cases of classical CAH (SV or SW) had all five markers elevated above 3 standard deviations from the mean. There was, however, a dramatic range in steroid concentration within the confirmed cases (17-OHP ranged from 6.14 to 395.00 ng/mL). The Wisconsin screening algorithm also incorporates provisions for when a single marker is elevated at a concentration greater than 10 standard deviations from the mean. One patient confirmed to have SV CAH was collected at 2 h of life. In this specimen, 3 markers were elevated, but both ratios were greater than 10 standard deviations from the mean. In addition, the Wisconsin modified algorithm, incorporating a 10 standard deviations cutoff from the mean, also detected a non-classical CAH patient. To address the potential for false negatives due to missed interpretations, the algorithm includes a “possible abnormal” reporting option to be used when four of the five markers are outside three standard deviations. The one-year prospective study achieved a 95% reduction in false positive rate to 0.04%, even with a conservative algorithm allowing for a “possible” abnormal interpretation. This tempered approach may be an appropriate alternative to minimize false negatives, but not substantially increase the false positive results. During the prospective study, 5 CAH patients were identified out of 63,725 analyzed (incidence of 1 in 12,600). This is higher than the reported incidence of 1 in 20,000, and suggests that it is likely no cases of CAH were missed.
The impact of the second-tier test on the entire newborn screening program is significant. Studies have demonstrated that the second-tier test for CAH reduces the burden of follow-up care and has improved clinical practice by minimizing the need for sub-specialty, endocrine evaluations [34]. In addition, the second-tier test performed on the initial specimen is cost-effective—when compared to the alternative of additional testing, either repeat newborn screens or confirmatory tests [27]. Lastly, abnormal CAH screening results that were once considered to be “most likely a false-positive” by physicians are now likely to be a true case. This places a higher priority on the need to obtain endocrine consult and appropriate confirmatory testing in a timely manner. Changes in laboratory practices, such as implementation of second-tier testing, should be accompanied by proper notifications and education for care providers.
The risk of missed CAH cases, whether after first- or second-tier analysis, will always remain a concern for programs. The decrease in flux through the steroid synthesis pathways, largely due to cortisol inhibition or the lack of mature enzyme function, will continue to contribute to false negative rates. The incorporation of a more complete steroid panel, including measuring steroids within the mineralocorticoid pathway, may allow for a more thorough assessment of the pathway. Additionally, clinically relevant factors—such as birth weight or the timing of collection—should be incorporated into all screening algorithms, similar to what has been proposed by Rinaldo et al. [35]. In the past, NBS programs have been somewhat hampered by limitations of statistical assessments and the ability to account for multiple factors. It is likely that molecular analysis would also increase specificity [36]. However, not all mutations can be reliably detected in the screening setting and therefore may ultimately limit the sensitivity [37]. Furthermore, even with the incorporation of molecular analysis, a first-tier biochemical assay needs to be performed, and at this time, the LC–MSMS second-tier method, with a relatively long run time, cannot replace the immunoassay. Our future studies will move toward a more thorough examination of the steroid synthesis pathway, assessing the weighted impact of other analytes and physiological factors, to guide disease identification.
This study replicates and expands upon previous work to validate and implement a second-tier assay for classical CAH. Multiple steroids and ratios, along with appropriate adjustment for physiological factors, collection time and birth weight, enabled Wisconsin to suggest a more comprehensive screening algorithm that has not been previously delineated.

Author Contributions

Conceptualization, E.R.B., M.R.L. and P.K.H.; methodology, E.R.B. and P.K.H.; validation, E.R.B. and P.K.H.; formal analysis, E.R.B., M.R.L. and P.K.H; data curation, E.R.B., M.R.L. and P.K.H.; writing—original draft preparation, P.K.H.; writing—review and editing, E.R.B., M.R.L. and P.K.H.

Funding

This research received no external funding.

Acknowledgments

The authors would like to acknowledge the Wisconsin endocrine sub-committee for their guidance on implementation of the second-tier test. The authors would also like to acknowledge Katy Penland for her contributions in editing and formatting the manuscript for publication.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. El-Maouche, D.; Arlt, W.; Merke, D.D. Congenital adrenal hyperplasia. Lancet 2017, 390, 2194–2210. [Google Scholar] [CrossRef]
  2. Falhammar, H.; Wedell, A.; Nordenstrom, A. Biochemical and genetic diagnosis of 21-hydroxylase deficiency. Endocrine 2015, 50, 306–314. [Google Scholar] [CrossRef]
  3. Speiser, P.; White, P.P. Congenital adrenal hyperplasia. N. Engl. J. Med. 2003, 349, 776–788. [Google Scholar] [CrossRef]
  4. Pang, S.; Hotchkiss, J.; Drash, A.A.; Levine, L.L.; New, M.M. Microfilter paper method for 17α-hydroxyprogesterone radioimmunoassay: Its application for rapid screening for congenital adrenal hyperplasia. J. Clin. Endocrinol. Metab. 1977, 45, 1003–1008. [Google Scholar] [CrossRef]
  5. White, P.P. Neonatal screening for congenital adrenal hyperplasia. Nat. Rev. Endocrinol. 2009, 5, 490–498. [Google Scholar] [CrossRef]
  6. Speiser, P.W.; Arlt, W.; Auchus, R.J.; Baskin, L.S.; Conway, G.S.; Merke, D.P.; Meyer-Bahlburg, H.F.L.; Miller, W.L.; Murad, H.H.; White, P.C.; et al. Congenital adrenal hyperplasia due to steroid 21-hydroxylase deficiency: An endocrine society clinical practic guideline. J. Clin. Endocrinol. Metab. 2018, 103, 4043–4088. [Google Scholar] [CrossRef] [PubMed]
  7. White, P.P. Optimizing newborn screening for congenital adrenal hyperplasia. J. Pediatr. 2013, 163, 10–12. [Google Scholar] [CrossRef]
  8. Wong, T.; Shackleton, C.H.L.; Covey, T.T.; Ellis, G. Identification of the steroids in neonatal plasma that interfere with 17α-hydroxyprogesterone radioimmunoassays. Clin. Chem. 1992, 38, 1830–1837. [Google Scholar] [PubMed]
  9. Lee, M.; Rajagopalan, L.; Berg, G.G.; Moshang, T., Jr. Serum adrenal steroid concentrations in premature nfants. J. Clin. Endocrinol. Metab. 1989, 69, 1133–1136. [Google Scholar] [CrossRef] [PubMed]
  10. Berry, J.; Betts, P.; Wood, P.P. The interpretation of bloodspot 17-α-hydroxyprogesterone levels in term and pre-term neonates. Ann. Clin. Biochem. 1986, 23, 546–551. [Google Scholar] [CrossRef]
  11. Allen, D.D.; Hoffman, G.G.; Fitzpatrick, P.; Laessig, R.; Maby, S.; Slyper, A. Improved precision of newborn screening for congenital adrenal hyperplasia using weight-adjusted criteria for 17-hydroxyprogesterone levels. J. Pediatr. 1997, 130, 128–133. [Google Scholar] [CrossRef]
  12. Van der Kamp, H.J.; Oudshoorn, C.G.; Elvers, B.H.; van Baarle, M.; Otten, B.J.; Wit, J.M.; Verkerk, P.H. Cutoff levels of 17-α-hydroxyprogesterone in neonatal screening for congenital adrenal hyperplasia should be based on gestational age rather than on birth weight. J. Clin. Endocrinol. Metab. 2005, 90, 3904–3907. [Google Scholar] [CrossRef] [PubMed]
  13. Olgemoller, B.; Roscher, A.A.; Liebl, B.; Fingerhut, R. Screening for congenital drenal hyperplasia; adjustment of 17-hydroxyprogesterone cut-off values to both age and birth weight markedly improves the predictive value. J. Clin. Endocrinol. Metab. 2003, 88, 5790–5794. [Google Scholar] [CrossRef]
  14. Held, P.K.; Shapira, S.K.; Hinton, C.F.; Jones, E.; Hannon, W.H.; Ojodu, J. Congenital adrenal hyperplasia cases identified by newborn screening in one- or two-screen states. Mol. Genet. Metab. 2015, 116, 133–138. [Google Scholar] [CrossRef]
  15. Lacey, J.M.; Minutti, C.Z.; Magera, M.J.; Tauscher, A.L.; Casetta, B.; McCann, M.; Lymp, J.; Hahn, S.H.; Rinaldo, P.; Matern, D. Improved specificity of newborn screening for congenital adrenal hyperplasia by second-tier steroid profiling using tandem mass spectrometry. Clin. Chem. 2004, 50, 621–625. [Google Scholar] [CrossRef] [PubMed]
  16. Schwarz, E.; Liu, A.; Randall, H.; Haslip, C.; Keune, F.; Murray, M.; Longo, N.; Pasquali, M. Use of steroid profiling by UPLC-MS/MS as a second-tier test in newborn screening for congenital adrenal hyperplasia: The Utah experience. Pediatr. Res. 2009, 66, 230–235. [Google Scholar] [CrossRef] [PubMed]
  17. Dhillon, K.; Ho, T.; Rich, P.; Xu, D.; Lorey, F.; She, J.; Bhandal, A. An automated method on analysis of blood steroids using liquid chromatography–tandem mass spectrometry: Application to population screening for congenital adrenal hyperplasia in newborns. Clin. Chim. Acta 2011, 412, 2076–2084. [Google Scholar] [CrossRef]
  18. Janzen, N.; Sander, S.; Terhardt, M.; Pter, M.; Sander, J. Fast and direct quantification of adrenal steroids by tandem mass spectrometry in serum and dried blood spots. J. Chromatogr. B Analyt. Technol. Biomed. Life Sci. 2008, 861, 117–122. [Google Scholar] [CrossRef]
  19. Boelen, A.; Ruiter, A.F.; Claahsen-van der Grinten, H.L.; Endert, E.; Ackermans, M.T. Determination of a steroid profile in heel prick blood using LC–MSMS. Bioanalysis 2016, 8, 375–384. [Google Scholar] [CrossRef]
  20. Fiet, J.; Le Bouc, Y.; Guéchot, J.; Hélin, N.; Maubert, M.A.; Farabos, D.; Lamazière, A. A liquid chromatography/Tandem mass spectrometry profile of 16 serum steroids, including 21-deoxycortisol and 21-deoxycorticosterone, for management of congenital adrenal hyperplasia. J. Endocr. Soc. 2017, 1, 186–201. [Google Scholar] [CrossRef]
  21. Costa-Barbosa, F.A.; Carvalho, V.M.; Nakamura, O.H.; Bachega, T.A.S.S.; Vieira, J.G.H.; Kater, C.E. Zona fasciculata 21-hydroxysteroids and precursor-to-product ratios in 21-hydroxylse deficiency: Further characterization of classic and non-classic patients and heterozygote carriers. J. Endocrinol. Investig. 2011, 34, 587–592. [Google Scholar] [CrossRef] [PubMed]
  22. Janzen, N.; Peter, M.; Sander, S.; Steuerwald, U.; Terhardt, M.; Holtkamp, U.; Sander, J. Newborn screening for congenital adrenal hyperplasia: Additional steroid profile using liquid chromatography-tandem mass spectrometry. J. Clin. Endocrinol. Metab. 2007, 92, 2581–2589. [Google Scholar] [CrossRef] [PubMed]
  23. Güran, T.; Tezel, B.; Gürbüz, F.; Eklioğlu, B.S.; Hatipoğlu, N.; Kara, C.; Şimşek, E.; Çizmecioğlu, F.M.; Ozon, A.; Aydın, M.; et al. Neonatal screening for congenital adrenal hyperplasia in turkey: A pilot study with 38,935 infants. J. Clin. Res. Pediatr. Endocrinol. 2019, 11, 13–23. [Google Scholar] [CrossRef] [PubMed]
  24. Bodegard, G.; Fyro, K.; Larsson, A. Psychological reactions in 102 families with a newborn who has a falsely positive screening test for congenital hypothyroidism. Acta Paediatr. Scand. Suppl. 1983, 304, 1–21. [Google Scholar] [CrossRef]
  25. Kwon, C.; Farrell, P.P. The magnitude and challenge of false-positive newborn screening test results. Arch. Pediatr. Adolesc. Med. 2000, 154, 714–718. [Google Scholar] [CrossRef] [PubMed]
  26. Matern, D.; Tortorelli, S.; Oglesbee, D.; Favrilov, D.; Rinaldo, P. Reduction of the false-positive rate in newborn screening by implementation of MS/MS-based second-tier tests: The Mayo Clinic experience (2004–2007). J. Inherit. Metab. Dis. 2007, 30, 585–592. [Google Scholar] [CrossRef] [PubMed]
  27. Minutti, C.Z.; Lacey, J.M.; Magera, M.J.; Hahn, S.H.; McCann, M.; Schulze, A.; Cheillan, D.; Dorche, C.; Chace, D.H.; Zimmerman, D.; et al. Steroid profiling by tandem mass spectrometry improves the positive predictive value of newborn screening for congenital adrenal hyperplasia. J. Clin. Endocrinol. Metab. 2004, 89, 3687–3693. [Google Scholar] [CrossRef] [PubMed]
  28. Varness, T.T.; Allen, D.D.; Hoffman, G.G. Newborn screening for congenital adrenal hyperplasia has reduced sensitivity in girls. J. Pediatr. 2005, 147, 493–498. [Google Scholar] [CrossRef] [PubMed]
  29. Therrell, B.L.; Berenbaum, S.A.; Manter-Kapanke, V.; Simmank, J.; Korman, K.; Prentice, L.; Prentice, L.; Gonzalez, J.; Gunn, S. Results of screening 1.9 million Texas newborns for 21-hydroxylase-deficient congenital adrenal hyperplasia. Pediatrics 1998, 101 Pt 1, 583–590. [Google Scholar] [CrossRef] [PubMed]
  30. Sarafoglou, K.; Banks, K.; Kyllo, J.; Pittock, S.; Thomas, W. Cases of congenital adrenal hyperplasia missed by newborn screening in Minnesota. JAMA 2012, 307, 2371–2374. [Google Scholar] [CrossRef]
  31. Sarafoglou, K.; Banks, K.; Gaviglio, A.; Hietala, A.; McCann, M.; Thomas, W. Comparison of one-tier and two-tier newborn screening metrics for congenital adrenal hyperplasia. Pediatrics 2012, 130, e1261–e1268. [Google Scholar] [CrossRef] [PubMed]
  32. Sarafoglou, K.; Gaviglio, A.; Hietala, A.; Forgner, G.; Banks, K.; McCann, M.; Thomas, W. Comparison of Newborn Screening Protocols for Congenital Adrenal Hyperplasia in Preterm Infants. J. Pediatr. 2014, 164, 1136–1140. [Google Scholar] [CrossRef]
  33. Tang, H.; Feuchtbaum, L.; Neogi, P.; Ho, T.; Gaffney, L.; Currier, R.R. Damaged goods? An empirical cohort study of blood specimens collected 12 to 23 hours after birth in newborn screening in California. Genet. Med. 2016, 18, 259–264. [Google Scholar] [CrossRef] [PubMed]
  34. Seo, J.Y.; Park, H.D.; Kim, J.W.; Oh, H.J.; Yang, J.S.; Chang, Y.S.; Park, W.S.; Lee, S.Y. Steroid profiling for congenital adrenal hyperplasia by tandem mass spectrometry as a second-tier test reduced follow-up burdens in a tertiary care hospital; A retrospective and prospective evaluation. J. Perinat. Med. 2014, 42, 121–127. [Google Scholar] [CrossRef] [PubMed]
  35. Marquardt, G.; Currier, R.; McHugh, D.M.; Gavrilov, D.; Magera, M.J.; Matern, D.; Oglesbee, D.; Raymond, K.; Rinaldo, P.; Tortorelli, S.; et al. Enhanced interpretation of newborn screening results without analyte cutoff values. Genet. Med. 2012, 14, 648–655. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  36. Kopacek, C.; Prado, M.J.; da Silva, C.M.; de Castro, S.M.; Beltrão, L.A.; Vargas, P.R.; Grandi, T.; Rossetti, M.L.R.; Spritzer, P.M. Clinical and molecular profile of newborns with confirmed or suspicious congenital adrenal hyperplasia detected after a public screening program implementation. J. Pediatr. 2019, 95, 282–290. [Google Scholar] [CrossRef] [PubMed]
  37. Nordenstrom, A.; Wedell, A.; Hagenfeldt, L.; Marcus, C.; Larsson, A. Neonatal screening for congenital adrenal hyperplasia: 17-hydroxyprogesterone levels and CYP21 genotypes in preterm infants. Pediatrics 2001, 108, E68. [Google Scholar] [CrossRef]
Figure 1. Newborn screening algorithm for congenital adrenal hyperplasia. Figure 1 provides the screening algorithm used to detect cases of congenital adrenal hyperplasia which includes both the first-tier assay and the second-tier assay, stratified by birth weight and collection time, and the corresponding interpretation guidelines. The five markers used for interpretation are 17OHP, 4-A, 21, [(17-OHP + 4-A)/F] and [(17-OHP+21)/F]. BW = birth weight.
Figure 1. Newborn screening algorithm for congenital adrenal hyperplasia. Figure 1 provides the screening algorithm used to detect cases of congenital adrenal hyperplasia which includes both the first-tier assay and the second-tier assay, stratified by birth weight and collection time, and the corresponding interpretation guidelines. The five markers used for interpretation are 17OHP, 4-A, 21, [(17-OHP + 4-A)/F] and [(17-OHP+21)/F]. BW = birth weight.
Ijns 05 00033 g001
Figure 2. Normal distribution profiles. Figure 2 plots the log-transformed value for each steroid (17OHP, 4-A, F, 21) against the birth weight of the newborn. Dots in orange represent specimens collected prior to 24 h of life. Dots in blue represent specimens collected at 24 h of life or greater.
Figure 2. Normal distribution profiles. Figure 2 plots the log-transformed value for each steroid (17OHP, 4-A, F, 21) against the birth weight of the newborn. Dots in orange represent specimens collected prior to 24 h of life. Dots in blue represent specimens collected at 24 h of life or greater.
Ijns 05 00033 g002
Figure 3. Summary of prospective study. Figure 3 summarizes data from the prospective study. Of the 63,725 newborn screened, there were 472 cases flagged for second-tier testing. Second-tier test results were abnormal for 29 cases. Five of the 29 cases were confirmed to have CAH.
Figure 3. Summary of prospective study. Figure 3 summarizes data from the prospective study. Of the 63,725 newborn screened, there were 472 cases flagged for second-tier testing. Second-tier test results were abnormal for 29 cases. Five of the 29 cases were confirmed to have CAH.
Ijns 05 00033 g003
Table 1. Parameters for detection of steroids and internal standards. Table 1 provides the multiple reaction monitoring (MRM) transitions, retention times, and collision energy for each steroid and its corresponding internal standard. Q = quantifying transition, I = identifying transition, MRM = multiple reaction monitoring.
Table 1. Parameters for detection of steroids and internal standards. Table 1 provides the multiple reaction monitoring (MRM) transitions, retention times, and collision energy for each steroid and its corresponding internal standard. Q = quantifying transition, I = identifying transition, MRM = multiple reaction monitoring.
Steroids and Internal StandardsMRM Transitions Retention Time (min)Collision Energy (V)
17-hydroxyprogesterone (Q)331.2→973.160
17-hydroxyprogesterone (I)331.2→10960
Cortisol (Q)363.3→121.22.2530
Cortisol (I)363.3→327.124
Androstenedione (Q)287.2→972.928
Androstenedione (I)287.2→10931
21-Deoxycortisol (Q)347.3→311.22.525
21-Deoxycortisol (I)347.3→109.0146
D8-17-hydroxygrogesterone 339.2→113.13.147
D4-Cortisol367.1→121.12.2534
D7-Androstenedione294.2→100.12.927
D8 21-Deoxycortisol355.2→319.22.525
Table 2. Injection Profile. Table 2 provides the liquid chromatography injection profile for separation of the steroids. %B = percentage of mobile phase B at the corresponding time.
Table 2. Injection Profile. Table 2 provides the liquid chromatography injection profile for separation of the steroids. %B = percentage of mobile phase B at the corresponding time.
Time (min)%BFlow Rate (mL/min)
0.0142.50.25
4.41000.25
4.451000.25
4.51000.5
6.51000.5
6.551000.25
6.61000.25
6.6142.50.25
8.742.50.25
Table 3. Distribution of steroid concentrations within the normal population. Table 3 provides the concentrations for each steroid (17OHP, 4-A, 21) and both ratios within the normal population. The median, mean, 3 standard deviation (3stdev), and 99th percentile (0.99) values are provided. The normal population is stratified by birth weight and time of collection. In situations where there was no statistical difference between the stratified groups, the data is combined. BW = birth weight.
Table 3. Distribution of steroid concentrations within the normal population. Table 3 provides the concentrations for each steroid (17OHP, 4-A, 21) and both ratios within the normal population. The median, mean, 3 standard deviation (3stdev), and 99th percentile (0.99) values are provided. The normal population is stratified by birth weight and time of collection. In situations where there was no statistical difference between the stratified groups, the data is combined. BW = birth weight.
17-Hydroxyprogesterone (ng/mL)4-Androstenedione (ng/mL)(17-OHP + 4-A)/F)(17-OHP + 21)/F)21-Deoxycortisol (ng/mL)
BW (g) 24–168 h<24 h24–168 h<24 hNo Stratification by TimingNo Stratification by TimingNo Stratification by Timing or BW
≤1500count103106103106209209783
median3.314.550.881.840.260.190.15
mean5.056.161.202.520.740.570.21
3stdev18.7220.994.568.645.434.520.78
0.9918.7525.315.838.606.134.440.92
1501–2499count1219912199220220
median1.072.790.811.620.150.10
mean1.653.181.072.070.410.28
3stdev6.269.053.807.922.591.86
0.996.919.124.1612.252.451.63
≥2500count2569825698354354
median0.811.010.620.980.080.05
mean0.891.560.711.420.170.12
3stdev2.306.261.925.980.850.62
0.992.506.982.026.451.000.76
Table 4. Summary of confirmed congenital adrenal hyperplasia (CAH) cases identified by newborn screening. Table 4 provides the concentration of 17OHP measured by the first-tier assay and the concentrations of 17OHP, 4-A, 21, and ratios measured by the second-tier assay within confirmed cases. The non-shaded cases were evaluated as part of the second-tier assay validation. The shaded cases were identified during the one-year prospective study. The form of CAH confirmed within each patient is provided. For some patients (labeled as only classical), the endocrinologist did not distinguish between salt wasting and simple virilizing forms of CAH. SW = salt wasting, SV = simple virilizing.
Table 4. Summary of confirmed congenital adrenal hyperplasia (CAH) cases identified by newborn screening. Table 4 provides the concentration of 17OHP measured by the first-tier assay and the concentrations of 17OHP, 4-A, 21, and ratios measured by the second-tier assay within confirmed cases. The non-shaded cases were evaluated as part of the second-tier assay validation. The shaded cases were identified during the one-year prospective study. The form of CAH confirmed within each patient is provided. For some patients (labeled as only classical), the endocrinologist did not distinguish between salt wasting and simple virilizing forms of CAH. SW = salt wasting, SV = simple virilizing.
Patient #17-OHP Birthweight (g)Age at Collection (h)17-OHP4-A21(17-OHP + 4-A)/F)(17-OHP + 21)/F)Form of CAH
(ng/mL)(ng/mL)(ng/mL)(ng/mL)
1st tier2nd tier2nd tier2nd tier2nd tier2nd tier
1>18937805684.7055.1050.506.996.76Classical-SW
211630305313.9017.205.752.161.36Classical-SV
3>18930622460.108.9738.6012.1617.38Classical-SW
4>22041902648.2010.4013.902.562.71Classical-SW
512536772520.406.1916.001.441.97Classical
6>22036022433.909.515.181.561.41Classical-SW
7>22028402771.1038.7011.6020.2615.26Classical-SW
8622860247.233.001.630.990.86Classical-SW
9484079256.142.630.831.080.86Classical-SW
1015627304514.102.873.661.171.22Classical
11724100368.562.375.691.642.14Classical
12333340243.021.654.980.320.56Non-classical
13425285048294.00364.0015.8037.8217.80Classical-SW
1436534702578.5043.4011.309.036.65Classical
15418315737395.0020.6068.1028.6631.94Classical-SW
16531180219.102.681.1434.5732.13Classical-SV
1712936104519.904.4522.001.252.15Classical
189637353310.603.071.364.083.57Classical-SV
19>200353024359.0076.6038.9028.1025.67Classical
20>200305545135.00275.002.1531.0610.39Classical-SW
21>200265035172.00234.006.1457.6725.30Classical
2212341006321.3014.607.483.552.85Classical
23>20029702774.1064.6023.108.465.93Classical-SW

Share and Cite

MDPI and ACS Style

Bialk, E.R.; Lasarev, M.R.; Held, P.K. Wisconsin’s Screening Algorithm for the Identification of Newborns with Congenital Adrenal Hyperplasia. Int. J. Neonatal Screen. 2019, 5, 33. https://0-doi-org.brum.beds.ac.uk/10.3390/ijns5030033

AMA Style

Bialk ER, Lasarev MR, Held PK. Wisconsin’s Screening Algorithm for the Identification of Newborns with Congenital Adrenal Hyperplasia. International Journal of Neonatal Screening. 2019; 5(3):33. https://0-doi-org.brum.beds.ac.uk/10.3390/ijns5030033

Chicago/Turabian Style

Bialk, Eric R., Michael R. Lasarev, and Patrice K. Held. 2019. "Wisconsin’s Screening Algorithm for the Identification of Newborns with Congenital Adrenal Hyperplasia" International Journal of Neonatal Screening 5, no. 3: 33. https://0-doi-org.brum.beds.ac.uk/10.3390/ijns5030033

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop