Next Article in Journal
Dereplication, Annotation, and Characterization of 74 Potential Antimicrobial Metabolites from Penicillium Sclerotiorum Using t-SNE Molecular Networks
Previous Article in Journal
Impact on Bile Acid Concentrations by Alveolar Echinococcosis and Treatment with Albendazole in Mice
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Identification of Indicators for Preterm Birth Using Retinoid Metabolites

1
Department of Obstetrics and Gynecology, Ewha Medical Institute and College of Medicine, Ewha Womans University, Seoul 07804, Korea
2
Department of Pharmacy, Ewha Womans University, Seoul 03760, Korea
3
Graduate Program in System Health Science and Engineering, Ewha Womans University, Seoul 03760, Korea
4
MolecularRecognition Research Center, Korea Institute of Science and Technology, Seoul 02792, Korea
*
Authors to whom correspondence should be addressed.
Equal contribution as first author.
Submission received: 31 May 2021 / Revised: 15 June 2021 / Accepted: 1 July 2021 / Published: 7 July 2021
(This article belongs to the Section Endocrinology and Clinical Metabolic Research)

Abstract

:
Metabolites reflect the biochemical dynamics for the maintenance of pregnancy and parturition. UPLC-Q/TOF-MS and LC-MS/MS metabolomics were performed to identify and validate the plasma metabolomic signatures of preterm birth (PTB). We recruited pregnant women between 16 and 40 weeks 5 days gestational age at Ewha Womans Mokdong Hospital for a nested case-control study. In untargeted UPLC-Q/TOF-MS, score plots of partial least-squares discriminant analysis clearly separated the PTB group from the term birth (TB, n = 10; PTB, n = 11). Fifteen metabolites were significantly different between the two groups, as indicated by a variable importance in projection >1 and p < 0.05. Metabolic pathways involving retinol, linoleic acid, d-arginine, and d-ornithine were associated with PTB. Verification by LC-MS/MS focused on retinol metabolism (TB, n = 39; PTB, n = 20). Retinol levels were significantly reduced in PTB compared to TB, while retinal palmitate, all-trans-retinal, and 13-cis-retinoic acid (13cis-RA) significantly increased (p < 0.05). Retinol-binding protein levels were also elevated in PTB. Additionally, all-trans-retinal (AUC 0.808, 95% CI: 0.683–0.933) and 13cis-RA (AUC 0.826, 95% CI: 0.723–0.930) showed improved predictions for PTB-related retinol metabolites. This study suggests that retinoid metabolism improves the accuracy of PTB predictions and plays an important role in maintaining pregnancy and inducing early parturition.

1. Introduction

Preterm birth (PTB) is defined as giving birth before 37 weeks of gestation and is a major cause of death in children below 5 years worldwide [1]. Additionally, complications of PTB among some survivors may affect long-term life, impairing neurodevelopmental functioning by increasing the risk of cerebral palsy, causing learning impairments and visual disorders, and affecting long-term physical health with a higher disease risk [2]. Although the potential cause of PTB includes a wide range of pathological processes associated with risk factors, including biological, environmental, behavioral, and social influences and interactions between maternal and fetal factors, the main causes of PTB is unclear and often complex [3,4,5,6,7,8,9].
Clinical methods to predict preterm birth include a history of preterm birth, cervical length (CL) in the 2nd trimester, cervical elastography, and biochemical markers. Although fetal fibronectin (fFN) is commercially available in the clinical field, its sensitivity is only 56% and has low prediction rate; even in asymptomatic women, although specificity is 97%, the sensitivity is 26% [10,11]. Improving preterm morbidity and mortality therefore requires a greater understanding of the processes associated with PTB and the biomarkers that can accurately predict PTB.
Spontaneous PTB results from preterm labor and preterm premature rupture of membrane (pPROM) induced by various pathological processes in approximately 70% of cases [12,13]. It is not well known how the process of PTB is initiated, but the main pathways are fetal and maternal tissue activation by cervical insufficiency, stress, inflammation, hemorrhage, uterine distension, and immune dysregulation. These risks result in myometrium contractions and/or rupture of the fetal membranes by the release of mediators, including prostaglandins and interleukins (ILs) [14]. Also, membrane rupture is related to biochemical changes in collagen structure and formation, as well as increased oxidative stress [15,16], involving an imbalance between synthesis and matrix metalloproteinase-induced collagen degradation within the extracellular matrix of the chorioamniotic membrane [17].
Using these pathophysiological pathways, many researchers have sought to identify biomarkers of inflammation related to ascending intrauterine infection to predict PTB [18]. Notably, ascending infection and PTB have been known to be associated with dysbiosis of the vaginal microbiome induced by a shift of dominant species from Lactobacillus to Bacteroides, Prevotella, Klebsiella, and Mobiluncus [13,19,20,21]. We have also previously reported that increased cytokine levels (MIP-1α, IL-6, and IL-17α) and metabolites (glycolate, ethylene glycol, isopropanol, methanol, formate, and trimethylamine N-oxide) are critically related to PTB [22,23]. Thus, vaginal microbiome dysbiosis and alterations in cytokine and metabolite levels are likely to be predictive biomarkers of ascending intrauterine infection-induced PTB, although further investigations are required.
Studies have reported that PTB-induced oral pathogens can be transmitted to gestational tissues via hematogenous spread [24,25]. Additionally, we previously reported that altered composition of the blood microbiome could affect gestational tissue, leading to PTB [26]. Changes in blood microbiome can affect metabolite production, which can lead to outbreaks of various diseases, including PTB [27,28]. Accordingly, we performed metabolome profile analysis in maternal plasma and found that metabolic pathways related to retinol, linoleic acid, d-arginine, and d-ornithine are associated with PTB.
Adequate levels of vitamin A during pregnancy are of critical importance for the health of pregnant women and their fetuses [29]. Low levels of vitamin A may be associated with complications in pregnancy, including death, increased infections, or low iron levels in the mother or baby, or having a baby with any of the following complications: early delivery, low birth weight, or a congenital abnormality [29,30,31]. In higher concentrations, retinoids inhibit cell growth and can be pro-oxidant, cytotoxic, mutagenic, and teratogenic [30,32]. These observations point to the need to reevaluate the role of vitamin A in maternal and child health and in preterm birth in particular [30]. Here, we report the results of validation focused on retinoid metabolism to improve the prediction of PTB and understand its broader mechanism.

2. Results

2.1. Clinical Charateristics of Subjects

We collected peripheral blood from pregnant women, at 16 to 40 weeks and 5 days gestational age to identify the metabolomic signatures of PTB (term birth, TB n = 10; PTB, n = 11; Table S1) and to validate the targeted metabolites (TB, n = 39; PTB, n = 20) (Figure 1). Clinical parameters, including gestational age at sampling and delivery were significantly different between the two groups in both the discovery and validation groups (p < 0.05, Table 1). The white blood cell count and C-reactive protein levels were also significantly different between the two groups in the validation group (p < 0.05). Liver function enzymes, such as alanine and aspartate aminotransferases, and lipid profiles in pregnant women in their 3rd trimester did not show statistically significant differences between the two groups (p < 0.05, Table S2). Two PTB patients were identified to have chorioamnionitis, but not women who delivered at term.

2.2. The Metabolome Profiling of Maternal Plasma Samples

To discover PTB-specific metabolites and pathways, a non-targeted metabolite profiling was conducted using ultra-high performance liquid chromatography (UPLC) coupled with an LTQ-Orbitrap Velos Pro hybrid mass spectrometer. Multivariate analysis was performed to obtain a list of variables from variant metabolic profiles in the plasma of pregnant women with TB and PTB. The score plots of partial least-squares discriminant analysis (PLS-DA) were applied to identify metabolomic patterns that could be used to distinguish PTB from the TB group. Figure 2 shows clearly separated categories to PTB compared with TB in reverse phased chromatography (RPC) positive mode (Q2 = 0.072; R2 = 0.085). Out of 235 variable ions, 15 metabolites were determined based on the value of a variable importance in projection (VIP) larger than 1, and p-value less than 0.05. Detailed information is provided in Table S3.

2.3. The PTB Related with Metabolic Pathways

To better understand how metabolome changes in the maternal plasma are associated with PTB, we performed a metabolic pathway analysis. The pathway impact analysis was based on the KEGG database and MetaboAnalyst 3.0 for comprehensive metabolic data analysis, visualization, and interpretation [33,34]. Results of the impact pathway analysis are shown in Figure 3. The x- and y-axis represent the pathway topology analysis and pathway enrichment analysis, respectively. Metabolic pathways, including retinol, linoleic acid, and d-arginine and d-ornithine metabolism were shown to be associated with PTB.

2.4. Analysis of Targeted Plasma Metabolite

We next focused on the metabolites involved in retinoid metabolism to investigate the pathological mechanisms underlying PTB and to identify indicators for predicting PTB. The retinoid metabolites in the plasma of pregnant women were analyzed using LC-MS/MS (TB, n = 39; PTB, n = 20). When the gestational age was adjusted, remarkable differences were found in the amount of various retinol metabolites between PTB and TB (Figure 4 and Table S4). While retinol levels were significantly lower, retinal palmitate, all trans (At)-retinal, and 13-cis-retinoic acid (13cis-RA) levels were significantly higher in PTB than in TB (p < 0.05).

2.5. Analysis of Plasma RBP

We further analyzed the concentration of retinol-binding protein (RBP) to determine its correlation with retinol levels in a subset of maternal plasma. Although retinol was significantly decreased in PTB compared to TB, RBP levels were significantly increased in PTB (Table 2).

2.6. Predictive Performance for PTB

The diagnostic accuracy of PTB was summarized by evaluating the area under the curve (AUC) of the receiver operating characteristic (ROC) curves. All retinoid metabolites and RBP showed a significantly high predictive value (p < 0.01) of over 0.6 for PTB (Table 3, Figure 5). Among the four metabolites, At-retinal (AUC 0.808, 95% CI: 0.683–0.933) and 13cis-RA (AUC 0.826, 95% CI: 0.723–0.930) served as improved prediction markers for PTB. Interestingly, RBP levels were positively correlated with At-retinal (r = 0.415, p = 0.008) and 13cis-RA (r = 0.462, p = 0.003).

3. Discussion

We evaluated the plasma metabolome profiles and metabolic pathways to identify the etiological mechanism of PTB and indicators to predict PTB in pregnant women. Our results showed that the metabolome profile of PTB was significantly different from that of TB, especially At-retinal and 13cis-RA, which served as markers to significantly improve the prediction of PTB among the analyzed retinol metabolites. Although retinol levels were decreased in PTB, the RBP levels increased, showing a positive correlation with At-retinal and 13cis-RA. This is the first study to demonstrate the possibility of discovering indicators of PTB using plasma metabolites in pregnant Korean women.
Although the mechanisms of PTB and normal parturition are not well understood, the rupture of the fetal membranes is a common feature of TB and PTB. Understanding the membrane rupture process could provide important clues to premature rupture of membranes (PROM) in PTB [30]; pPROM accounts for one-third of spontaneous PTBs [35] and is strongly associated with adverse pregnancy outcomes [36,37]. Membrane rupture can result from biochemical changes in collagen structure and formation as well as increased oxidative stress [15,16]. Thus, classification of TB or PTB groups by metabolites as indicators may enable identification of high-risk pregnancies, especially with maternal peripheral blood as a useful biological sample for non-invasive biomarker identification [38,39].
A study reported that maternal plasma metabolites, in which plasma was collected directly after admission to the hospital, before steroid or tocolytic therapy, are different between TB and PTB parturitions [38]. Another study reported that serum retinol levels are essentially constant during pregnancy and lower in pregnant women and parturient mothers than in non-pregnant women [31]. We collected maternal blood at the time of an outpatient visit in the 2nd trimester or at delivery in our study. Despite the adjusted gestational age, plasma metabolome profiles were different in PTB compared with TB, with changes in retinoid metabolites associated with PTB. We previously reported that microbial composition differs between the blood of TB and PTB, and plasma in PTB is rich in Butyricicoccus and Ruminococcaceae belonging to Clostridia order [26]. Furthermore, production of vitamin A metabolites could be regulated by bacteria such as Clostridia in the gut [40,41]. This microbial imbalance suggests involvement in PTB by altering the production of vitamin A metabolites.
Vitamin A and its synthetic derivatives (retinoids) are crucial micronutrients for pregnant women and their fetuses [29]. In normal physiological levels, retinoids are essential for numerous biological functions such as cellular homeostasis, embryonic development, vision, tissue differentiation, growth, and mucus secretion [30]. Vitamin A is mainly dietary-derived fat-soluble signaling molecules and is stored about 80% of vitamin A (retinyl ester) in the stellate cells of the liver [30]. Pregnancy physiologically represents an inflammatory process in view of the immunological adaptations necessary to ensure the viability of the conceptus [42,43]. These physiological changes can alter the relationship between hepatic reserves and circulating retinol during pregnancy. Our results showed that levels of liver enzymes in the 3rd trimester of pregnancy did not differ between the plasma of TB and PTB, but C-reactive protein (CRP) levels were increased in PTB compared to TB. These results suggest that retinoid metabolites were associated with inflammation rather than liver enzymes.
Circulating retinol is transported in the plasma in a 1:1 complex with RBP [29], which has been proposed to play an important role in the delivery of retinoid from mother to fetus [44,45]. In this study, retinol levels were similar in TB and PTB plasma in the 2nd trimester, but decreased in PTB compared to TB in the 3rd trimester (Figure S1). Low plasma retinol can be caused by insufficient intake of vitamin A or inflammation [32]. However, considering that the study subjects were pregnant women, the significant decrease in retinol levels in the 3rd trimester can be considered that the process of delivery due to inflammation or infection occurs rapidly, leading to PTB.
RBP levels as well as At-retinal and 13cis-RA levels increased in PTB plasma in both 2nd and 3rd trimesters (Figure S1), with these metabolites positively correlated. RBP can be combined with retinol, At-retinal, and 13cis-RA and can be delivered to target tissues, such as the placenta and retina, through the Stra6 receptor [46,47]. In these tissues, vitamin A is then stored in the form of retinyl esters (mainly at the level of the liver) and is converted by the enzymatic cascade to the active forms AtRA and 9-cis-retinoic acid (9cis-RA) [31]. High levels of certain metabolites of retinoic acid (AtRA and 13cis-RA) can influence gene activity during critical periods of organogenesis and embryogenesis, leading to teratogenicity [30].
At gene level, retinoic acids bind to two effectors, retinoic acid receptor (RAR) and retinoic X receptor (RXR), which belong to a large family of nuclear receptors. They reside within the promoter of the gene and allow the regulation of transcription by vitamin A [29,46]. RAR and RXR may also be involved in pPROM by regulating the tissue-type plasminogen activator (PLAT) gene, which affects collagenolytic actions [48].
Taken together, this study revealed changes in metabolome profiles and target metabolites between the maternal plasma of TB and PTB. Particularly, At-retinal and 13cis-RA showed improved predictions for PTB, and At-retinal and 13cis-RA along with retinol was potentially bound to RBP and migrated to the target tissue, suggesting the possibility of involvement in amniotic membrane rupture. By employing a nested, case-control study design to match a discovery cohort of PTB cases with TB controls, we were able to increase statistical efficiency by having all cases and controls derived from the same well-defined source population, and to address relative confounders [49].
This study suggests that retinoid metabolism significantly improves the accuracy of PTB prediction and plays an important role in maintaining pregnancy and inducing early parturition. Further studies are required to confirm the relationship between PTB and retinoid metabolites in large groups amongst different races and to trace changes in retinoid metabolites among pregnant women during their pregnancies.

4. Materials and Methods

4.1. Study Subjects

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Ewha Womans University Medical Center (EUMC 2018-07-007-010). Informed consent was obtained from all subjects involved in the study.
We recruited pregnant women who visited the Ewha Womans University Medical Center for prenatal examinations and delivery. These subjects were divided into a discovery group (10 TB and 11 PTB) to analyze the metabolite profile, and validation group (39 TB and 20 PTB) to analyze the retinoid metabolite. We collected maternal blood at the time of an outpatient visit in the 2nd trimester or at delivery in our study. The study subjects were recruited at the time of an outpatient visit in the 2nd trimester or at the hospitalization of singleton pregnant women with labor and/or premature rupture of membrane (RPOM) between 16 weeks and 40 weeks and 5 days of gestational age. Preterm labor (PTL) was diagnosed in patients with regular uterine contraction and 4 or more contractions in 20 min, or 8 or more in 60 min, as detected by cardiotocography. To diagnose preterm PROM, we conducted a sterile speculum examination to detect amniotic fluid pooling in the vaginal cavity, and a nitrazine test for detecting rupture of the membranes. Gestational age was determined on the first day of the last menstrual period and ultrasound examination. When pregnant women were visited for prenatal examinations or admitted to the hospital for delivery, blood samples were collected and stored at −80 °C until metabolomic analysis.

4.2. Maternal Blood Sample Preparation

Plasma samples (200 μL) were precipitated with 600 μL solvent mixture (acetonitrile/methanol/acetone; 1:1:1, v/v), mixed by vortexing for 3 min, then kept at −20 °C for 30 min. Precipitated samples were centrifuged at 10,000× g at 4 °C for 10 min, after which 600 μL of the supernatant was transferred into another test tube and evaporated to dryness under a gentle nitrogen stream. The residue was reconstituted with 200 μL of 50% methanol, and 5 μL (RPC separation mode) of samples was analyzed by UPLC-LTQ–Orbitrap MS. A pooled quality control (QC) sample was made by mixing equal amounts of samples and blank solvent used for checking system stability and sample carryover.

4.3. Metabolomic Profiling by LTQ-Orbitrap MS

Metabolite profiling was performed on an Ultimate 3000 UHPLC system (Thermo Fisher Scientific, San Jose, CA, USA) coupled with an LTQ-OrbitrapVelos Pro hybrid mass spectrometer (Thermo Fisher Scientific) equipped with an electrospray source operating in both positive mode (ESI+) and negative mode (ESI−). MS operation parameters were as follows: spray voltage, 3.5–5 kV; sheath gas, 5–45 (arbitrary units); auxiliary gas, 1 (arbitrary units); sweep gas, 1 (arbitrary units); and capillary temperature, 320 °C. Each sample was analyzed in FTMS full scan mode at a resolving power of 100,000 and m/z ranges were set to 50–1200 in centroid mode. The system was controlled by Xcalibur software v2.2, Tune Plus 2.7, and Chromeleon MS Link software v6.80 from Thermo Fisher Scientific.
Reversed-phase separation was performed on an Acquity™ UPLC BEH C18 column (2.1 mm × 100 mm, 1.7 μm, Waters, Milford, MA, USA) UPLC analytical column. The mobile phase solvents were 95% water, 5% ACN, 0.1% formic acid (mobile phase A), and 95% ACN, 5% water, and 0.1% formic acid (mobile phase B). The elution gradient was as follows: 100% mobile phase A from 0 to 3 min; linear increase to 50% mobile phase B from 3 to 10 min; linear increase of mobile phase B from 50% to 90% from 10 to 12 min; linear increase in mobile phase A from 100% to 12 to 15 min; and re-equilibration with 100% mobile phase A from 15 to 18 min. The column was maintained at 40 °C and the total run time was 18 min. A 5 μL aliquot of each sample was injected for analysis. The samples were stored at 4 °C using an auto sampler during the analysis.
The data processing procedure was as follows: Raw data were analyzed by Thermo Scientific SIEVE software v2.1 with “Small molecule”, “Chromatographic Alignment and Framing”, and “Nondifferential single class analysis” options. All data was scaled by the Pareto (Par) scaling method before analysis. Multivariate analysis (MVA) was performed using SIMCA-P software v14.0+ from Umetrics (Umea, Sweden) for partial least-squares discriminant analysis (PLS-DA). The variable importance in projection (VIP) value > 1 was considered significant. Statistical significance was analyzed with SPSS 22.0 (SPSS Inc., Chicago, IL, USA). The Mann-Whitney U-test was performed for a comparison of the two groups. Differences with p-value < 0.05 were considered statistically significant. Fold change was measured using the variation of the measured value. Pathway impact analysis was performed by Metaboanalyst 3.0 (Montreal, QC, Canada), a web-based metabolomics data processing tool and visualization metabolomics.

4.4. Preperation of Standard Stock Solution for Verification of Retinoid Metabolites

Retinoid metabolites were analyzed to establish the metabolic pathway differences between TB and PTB. Stock solutions of all indicated analytical reference and internal standards of the retinoids were uniformly dissolved in methanol to obtain final concentrations of 2000 ppm for retinol, retinyl acetate (RAc), retinyl palmitate (RP), all-trans retinal, At-RA, 13cis-RA, retinyl acetate-D6 (RAc-D6), all-trans retinal-D6 (At-RAL-D6), and all-trans retinoic acid-D6 (At-RA-D6). Retinol-D6 (ROH-D6) was prepared at a final concentration of 1000 ppm. Solutions were stored at −20 °C until use. Calibration curves for the final quantification of the target retinoids were generated by performing four-fold serial dilutions of these standard stock solutions in the range of 800 to 0.05 ppb. ROH, RAc, at-RAL, and at-RA standards were obtained from Cayman Chemicals, Inc. (Ann Arbor, MI, USA), and RP and 13cis-RA were acquired from Sigma Aldrich Corp. (St. Louis, MO, USA). All four isotope-labeled internal standards mentioned above were purchased from Cambridge Isotopes Laboratories, Inc. (Tewksbury, MA, USA).

4.5. Sample Preperation

A liquid-liquid extraction method was applied to extract the target retinoids from plasma samples. An isotope-labeled internal standard mixture was added to 200 μL of each plasma sample and vortexed briefly prior to serum protein precipitation with 200 μL acetonitrile. After vortexing for 1 min, 1.2 mL of methyl-tert-butyl ether was added to each tube and vortexed for 1 min. Samples were centrifuged at 13,000 rpm at 4 °C for 10 min, and the upper organic layer was transferred to a new test tube. The transferred supernatant was dried with nitrogen gas at room temperature, and the residue was reconstituted with 20 μL of methanol. After vortexing for 5 min, the supernatant was transferred to a clean glass MS vial tube and capped for LC-MS/MS analysis.

4.6. LC-MS/MS Analysis

Chromatographic separation of plasma sample extracts was performed on an Accucore C18 column (2.1 × 100 mm, 2.6 µm particle size, Thermo Scientific, Waltham, MA, USA), with the temperature maintained at 30 °C throughout the experiment. The injection volume of the samples was fixed at 2 μL. Target retinoids were separated within 22 min under a mobile phase composition consisting of 80% acetonitrile (A) and 100% methanol (B), both modified with 0.1% formic acid. The mobile phase system was initially maintained in isocratic mode at 100% of phase A for 7 min, with the flow rate linearly increased from 0.2 to 0.4 mL/min; it was then immediately changed to 100% of phase B and held for up to 15 min, with the flow rate maintained at 0.4 mL/min. For an additional 2 min, the system was gradually returned to 100% phase A with a linear gradient, and the flow rate was decreased back to 0.2 mL/min. Conditions were maintained for 5 min for re-equilibration. The column effluent was analyzed using an Agilent 6460C triple quadrupole LC-MS/MS system equipped with an electrospray ionization (ESI) source at Drug Development Research Core Center. Mass spectrometer was operated in positive ion mode using nitrogen as the nebulization gas. The temperature of the heated nebulizer was set to 300 °C with an ionspray voltage of 4500. Quantification of the retinoids was performed in multiple reaction monitoring (MRM) mode by selecting precursor ions of [M+H-fatty acid-H2O]+ for ROH, ROH-D6, RAc, RAc-D6, and RP, and [M+H]+ for At-RAL, At-RAL-D6, At-RA, 9cis-RA, 13cis-RA, and At-RA-D6. The optimized MRM transitions, MS parameters, and LC retention times of all the mentioned analytes are summarized in Table S5. LC-MS/MS spectra obtained from the blood sample were represented in Figure S2. For the final quantification, each peak area of the target retinoids was normalized to the response of corresponding internal standards (0.5 ppm ROH-D6 for ROH; 0.25 ppm RAc-D6 for RAc and RP; 0.25 ppm At-RAL-D6 for At-RAL; 1 ppm At-RA-D6 for At-RA, 9cis-RA, 13cis-RA). Overall quantitative analysis was performed using Agilent Mass Hunter software (Santa Clara, CA, USA).

4.7. Plasma RBP Analysis

Plasma RBP was analyzed using a Human RBP-ELISA kit (cat no. LS-F28830, Life span BioSciences Inc., Seattle, WA, USA). The assay procedure and reagent preparation were performed according to the manufacturer’s protocol.

4.8. Statistical Analysis

The basic characteristics of the study groups were compared using the Student’s t-test for continuous variables and the chi-square test for categorical variables. Multivariate analysis was performed to obtain a list of variables from the varied metabolic profiles in the plasma of pregnant women with TB and PTB. Analysis of covariance was performed to compare the levels of retinoid metabolites, by adjusting gestational age at sampling time. Multivariate analysis was performed using the SIMCA-P software v14.0+ (Umetrics, Umeå, Sweden). Pathway impact analysis and heat map visualization were performed using Metaboanalyst 3.0 (Montréal, QC, Canada), a web-based metabolomics data processing tool, and visualization metabolomics. Pathway mapping and chemical similarity analysis were performed using R version 3.2.2, MetaMapp, and CytoScape 3.4.0 (Boston, MA, USA) [50,51]. For verification using LC-MS/MS, differential metabolite levels were analyzed with a generalized linear model adjusted for gestational age at sampling time. The diagnostic accuracy of PTB was summarized by applying the AUC of the ROC curves. Statistical significance was set at p < 0.05. The Statistical Package for Social Sciences (SPSS, Version 2.0 Chicago, IL, USA) and online MEDCALC software were used for statistical analysis.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/metabo11070443/s1, Table S1: Clinical characteristics of subjects for analysis of untargeted metabolome profiles, Table S2: Comparison of blood indices related retinoid metabolism between TB and PTB (n = 59), Table S3: Ranked results of multivariate analysis on variable ions identified by UPLC-LTQ–Orbitrap MS, Table S4: Comparison of retinoid levels adjusted gestational age between maternal plasma of term and preterm birth, Table S5: LC retention times, MRM transitions, and MS parameters of target analytes, Figure S1: Changes in retinoid metabolites between 2nd and 3rd trimester.

Author Contributions

Conceptualization, Y.-A.Y. and Y.-J.K.; Methodology, J.L. and Y.K.; Validation, S.-Y.H., S.P. (Seojeong Park) and Y.K.; Formal Analysis, S.-M.K., G.-I.L., S.P. (Sunwha Park) and A.A.; Investigation, Y.-A.Y.; Data Curation, J.L. and Y.K.; Writing—Original Draft Preparation, Y.-A.Y.; Writing—Review and Editing, Y.K. and Y.-J.K.; Visualization, A.A.; Supervision, Y.-J.K.; Funding Acquisition, Y.-J.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by funding from the National Research Foundation of Korea (NRF-2020R1A2C3011850) and the BK21 FOUR funded by the Ministry of Education and NRF. The paper (Young-Ah You) was supported by RP-Grant 2019 of Ewha Womans University.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of Ewha Womans University Medical Center (EUMC 2018-07-007-010).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available from the corresponding author, Y.K., upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Chawanpaiboon, S.; Vogel, J.P.; Moller, A.B.; Lumbiganon, P.; Petzold, M.; Hogan, D.; Landoulsi, S.; Jampathong, N.; Kongwattanakul, K.; Laopaiboon, M.; et al. Global, regional, and national estimates of levels of preterm birth in 2014: A systematic review and modelling analysis. Lancet Glob. Health 2019, 7, e37–e46. [Google Scholar] [CrossRef] [Green Version]
  2. Rogers, L.K.; Velten, M. Maternal inflammation, growth retardation, and preterm birth: Insights into adult cardiovascular disease. Life Sci. 2011, 89, 417–421. [Google Scholar] [CrossRef] [PubMed]
  3. Conde-Agudelo, A.; Papageorghiou, A.T.; Kennedy, S.H.; Villar, J. Novel biomarkers for the prediction of the spontaneous preterm birth phenotype: A systematic review and metaanalysis. BJOG Int. J. Obstet. Gynaecol. 2011, 118, 1042–1054. [Google Scholar] [CrossRef] [PubMed]
  4. Sabour, S. Prediction of spontaneous preterm delivery in women with threatened preterm labour: A prospective cohort study of multiple proteins in maternal serum. BJOG Int. J. Obstet. Gynaecol. 2012, 119, 1544. [Google Scholar] [CrossRef] [PubMed]
  5. Laudanski, P.; Lemancewicz, A.; Kuc, P.; Charkiewicz, K.; Ramotowska, B.; Kretowska, M.; Jasinska, E.; Raba, G.; Karwasik-Kajszczarek, K.; Kraczkowski, J.; et al. Chemokines profiling of patients with preterm birth. Mediat. Inflamm. 2014, 2014, 185758. [Google Scholar] [CrossRef] [PubMed]
  6. Kuć, P.; Laudański, P.; Kowalczuk, O.; Chyczewski, L.; Laudański, T. Expression of selected genes in preterm premature rupture of fetal membranes. Acta Obstet. Gynecol. Scand. 2012, 91, 936–943. [Google Scholar] [CrossRef]
  7. Kmiecik, G.; Niklińska, W.; Kuć, P.; Pancewicz-Wojtkiewicz, J.; Fil, D.; Karwowska, A.; Karczewski, J.; Mackiewicz, Z. Fetal membranes as a source of stem cells. Adv. Med. Sci. 2013, 58, 185–195. [Google Scholar] [CrossRef] [Green Version]
  8. Institute of Medicine (US) Committee on Understanding Premature Birth and Assuring Healthy Outcomes. Preterm Birth: Causes, Consequences, and Prevention; Behrman, R.E., Butler, A.S., Eds.; National Academies Press: Washington, DC, USA, 2007; pp. 87–258.
  9. Romero, R.; Dey, S.K.; Fisher, S.J. Preterm labor: One syndrome, many causes. Science 2014, 345, 760–765. [Google Scholar] [CrossRef] [Green Version]
  10. Heng, Y.J.; Liong, S.; Permezel, M.; Rice, G.E.; Di Quinzio, M.K.; Georgiou, H.M. Human cervicovaginal fluid biomarkers to predict term and preterm labor. Front. Physiol. 2015, 6, 151. [Google Scholar] [CrossRef]
  11. Seol, H.J.; Sung, J.H.; Seong, W.J.; Kim, H.M.; Park, H.S.; Kwon, H.; Hwang, H.S.; Jung, Y.J.; Kwon, J.Y.; Oh, S.Y. Standardization of measurement of cervical elastography, its reproducibility, and analysis of baseline clinical factors affecting elastographic parameters. Obstet. Gynecol. Sci. 2020, 63, 42–54. [Google Scholar] [CrossRef]
  12. Goldenberg, R.L.; Culhane, J.F. Preterm birth and periodontal disease. N. Engl. J. Med. 2006, 355, 1925–1927. [Google Scholar] [CrossRef]
  13. You, Y.A.; Kwon, E.J.; Choi, S.J.; Hwang, H.S.; Choi, S.K.; Lee, S.M.; Kim, Y.J. Vaginal microbiome profiles of pregnant women in Korea using a 16S metagenomics approach. Am. J. Reprod. Immunol. 2019, 82, e13124. [Google Scholar] [CrossRef]
  14. Rubens, C.E.; Sadovsky, Y.; Muglia, L.; Gravett, M.G.; Lackritz, E.; Gravett, C. Prevention of preterm birth: Harnessing science to address the global epidemic. Sci. Transl. Med. 2014, 6, 262sr5. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  15. Knudtson, E.J.; Smith, K.; Mercer, B.M.; Miodovnik, M.; Thurnau, G.R.; Goldenberg, R.L.; Meis, P.J.; Moawad, A.H.; Vandorsten, J.P.; Sorokin, Y.; et al. National Institutes of Child Health and Human Development Maternal-Fetal Medicine Units Network. Serum homocysteine levels after preterm premature rupture of the membranes. Am. J. Obstet. Gynecol. 2004, 191, 537–541. [Google Scholar] [CrossRef]
  16. Yoo, J.Y.; You, Y.A.; Kwon, E.J.; Park, M.H.; Shim, S.; Kim, Y.J. Differential expression and methylation of integrin subunit alpha 11 and thrombospondin in the amnion of preterm birth. Obstet. Gynecol. Sci. 2018, 61, 565–574. [Google Scholar] [PubMed]
  17. Fortunato, S.J.; Menon, R. Distinct molecular events suggest different pathways for preterm labor and premature rupture of membranes. Am. J. Obstet. Gynecol. 2001, 184, 1399–1405. [Google Scholar] [CrossRef] [PubMed]
  18. Romero, R.; Espinoza, J.; Kusanovic, J.P.; Gotsch, F.; Hassan, S.; Erez, O.; Chaiworapongsa, T.; Mazor, M. The preterm parturition syndrome. BJOG Int. J. Obstet. Gynaecol. 2006, 113, 17–42. [Google Scholar] [CrossRef]
  19. McDonald, H.; O’loughlin, J.; Jolley, P.; Vigneswaran, R.; McDonald, P.J. Vaginal infection and preterm labour. Br. J. Obstet. Gynaecol. 1991, 98, 427–435. [Google Scholar] [CrossRef]
  20. Freitas, A.C.; Bocking, A.; Hill, J.E.; Money, D.M.; the VOGUE Research Group. Increased richness and diversity of the vaginal microbiota and spontaneous preterm birth. Microbiome 2018, 6, 117. [Google Scholar] [CrossRef]
  21. Son, K.A.; Kim, M.; Kim, Y.M.; Kim, S.H.; Choi, S.J.; Oh, S.Y.; Roh, C.R.; Kim, J.H. Prevalence of vaginal microorganisms among pregnant women according to trimester and association with preterm birth. Obstet. Gynecol. Sci. 2018, 61, 38–47. [Google Scholar] [CrossRef]
  22. Park, S.; You, Y.A.; Yun, H.; Choi, S.J.; Hwang, H.S.; Choi, S.K.; Lee, S.M.; Kim, Y.J. Cervicovaginal fluid cytokines as predictive markers of preterm birth in symptomatic women. Obstet. Gynecol. Sci. 2020, 63, 455–463. [Google Scholar] [CrossRef]
  23. Ansari, A.; Lee, H.; You, Y.A.; Jung, Y.; Park, S.; Kim, S.M.; Hwang, G.S.; Kim, Y.J. Identification of Potential Biomarkers in the Cervicovaginal Fluid by Metabolic Profiling for Preterm Birth. Metabolites 2020, 10, 349. [Google Scholar] [CrossRef]
  24. Han, Y.W.; Ikegami, A.; Bissada, N.F.; Herbst, M.; Redline, R.W.; Ashmead, G.G. Transmission of an uncultivated Bergeyella strain from the oral cavity to amniotic fluid in a case of preterm birth. J. Clin. Microbiol. 2006, 44, 1475–1483. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Aagaard, K.; Ma, J.; Antony, K.M.; Ganu, R.; Petrosino, J.; Versalovic, J. The placenta harbors a unique microbiome. Sci. Transl. Med. 2014, 6, 237ra65. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  26. You, Y.A.; Yoo, J.Y.; Kwon, E.J.; Kim, Y.J. Blood Microbial Communities During Pregnancy Are Associated With Preterm Birth. Front. Microbiol. 2019, 10, 1122. [Google Scholar] [CrossRef]
  27. Horgan, R.; Clancy, O.; Myers, J.; Baker, P.N. Gynaecology. An overview of proteomic and metabolomic technologies and their application to pregnancy research. BJOG Int. J. Obstet. Gynaecol. 2009, 116, 173–181. [Google Scholar] [CrossRef] [PubMed]
  28. Nicholson, J.K.; Lindon, J.C. Systems biology: Metabolomics. Nature 2008, 455, 1054–1056. [Google Scholar] [CrossRef]
  29. Bastos Maia, S.; Rolland Souza, A.S.; Costa Caminha, M.F.; Lins da Silva, S.; Callou Cruz, R.S.B.L.; Carvalho Dos Santos, C.; Batista Filho, M. Vitamin A and Pregnancy: A Narrative Review. Nutrients 2019, 11, 681. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  30. Mawson, A.R. A Role for the Liver in Parturition and Preterm Birth. J. Transl. Sci. 2016, 2, 154–159. [Google Scholar] [CrossRef] [Green Version]
  31. Berggren Söderlund, M.; Fex, G.A.; Nilsson-Ehle, P. Concentrations of retinoids in early pregnancy and in newborns and their mothers. Am. J. Clin. Nutr. 2005, 81, 633–636. [Google Scholar] [CrossRef]
  32. Quadro, L.; Hamberger, L.; Gottesman, M.E.; Colantuoni, V.; Ramakrishnan, R.; Blaner, W.S. Transplacental delivery of retinoid: The role of retinol-binding protein and lipoprotein retinyl ester. Am. J. Physiol. Endocrinol. Metab. 2004, 286, E844–E851. [Google Scholar] [CrossRef]
  33. Suhre, K.; Schmitt-Kopplin, P. MassTRIX: Mass translator into pathways. Nucleic Acids Res. 2008, 36, W481–W484. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Xia, J.; Sinelnikov, I.V.; Han, B.; Wishart, D.S. MetaboAnalyst 3.0—Making metabolomics more meaningful. Nucleic Acids Res. 2015, 43, W251–W257. [Google Scholar] [CrossRef] [Green Version]
  35. Goldenberg, R.L.; Culhane, J.F.; Iams, J.D.; Romero, R. Epidemiology and causes of preterm birth. Lancet 2008, 371, 75–84. [Google Scholar] [CrossRef]
  36. McParland, P.C.; Taylor, D.J. Recent Advances in Obstetrics and Gynaecology; Bonnar, J., Dunlop, W., Eds.; Royal Society of Medicine Press: London, UK, 2005; Volume 23, Chapter 3; p. 27. [Google Scholar]
  37. Menon, R. Spontaneous preterm birth, a clinical dilemma: Etiologic, pathophysiologic and genetic heterogeneities and racial disparity. Acta Obstet. Gynecol. Scand. 2008, 87, 590–600. [Google Scholar] [CrossRef]
  38. Lizewska, B.; Teul, J.; Kuc, P.; Lemancewicz, A.; Charkiewicz, K.; Goscik, J.; Kacerovsky, M.; Menon, R.; Miltyk, W.; Laudanski, P. Maternal Plasma Metabolomic Profiles in Spontaneous Preterm Birth: Preliminary Results. Mediat. Inflamm. 2018, 2018, 9362820. [Google Scholar] [CrossRef] [Green Version]
  39. Yoo, J.Y.; Hyeon, D.Y.; Shin, Y.; Kim, S.M.; You, Y.A.; Kim, D.; Hwang, D.; Kim, Y.J. Integrative analysis of transcriptomic data for identification of T-cell activation-related mRNA signatures indicative of preterm birth. Sci. Rep. 2021, 11, 2392. [Google Scholar] [CrossRef] [PubMed]
  40. Grizotte-Lake, M.; Zhong, G.; Duncan, K.; Kirkwood, J.; Iyer, N.; Smolenski, I.; Isoherranen, N.; Vaishnava, S. Commensals Suppress Intestinal Epithelial Cell Retinoic Acid Synthesis to Regulate Interleukin-22 Activity and Prevent Microbial Dysbiosis. Immunity 2018, 49, 1103–1115.e6. [Google Scholar] [CrossRef] [Green Version]
  41. Iyer, N.; Vaishnava, S. Vitamin A at the interface of host-commensal-pathogen interactions. PLoS Pathog. 2019, 15, e1007750. [Google Scholar] [CrossRef] [Green Version]
  42. Mei, Z.; Li, H.; Serdula, M.K.; Flores-Ayala, R.C.; Wang, L.; Liu, J.M.; Grummer-Strawn, L.M. C-reactive protein increases with gestational age during pregnancy among Chinese women. Am. J. Hum. Biol. 2016, 28, 574–579. [Google Scholar] [CrossRef]
  43. Miller, E.M. Changes in serum immunity during pregnancy. Am. J. Hum. Biol. 2009, 21, 401–403. [Google Scholar] [CrossRef] [Green Version]
  44. Sapin, V.; Begue, R.J.; Dastugue, B.; Chambon, P.; Dolle, P. Retinoids and mouse placentation. Trophobl. Res. 1998, 12, 57–76. [Google Scholar] [CrossRef]
  45. Soprano, D.R.; Blaner, W.S. Plasma retinol-binding protein. In The Retinoids, Biology, Chemistry and Medicine; Sporn, M.B., Roberts, A.B., Goodman, D.S., Eds.; Raven: New York, NY, USA, 1994; pp. 257–282. [Google Scholar]
  46. Horwitz, J.; Heller, J. Interactions of all-trans, 9-, 11-, and 13-cis-retinal, all-trans-retinyl acetate, and retinoic acid with human retinol-binding protein and prealbumin. J. Biol. Chem. 1973, 248, 6317–6324. [Google Scholar] [CrossRef]
  47. Kawagushi, R.; Yu, J.; Honda, J.; Hu, J.; Whitelegge, J.; Ping, P.; Wiita, P.; Bok, D.; Sun, H. A membrane receptor for retinol binding protein mediates cellular uptake of Vitamin A. Science 2007, 315, 820–825. [Google Scholar] [CrossRef] [PubMed]
  48. Blanchon, L.; Marceau, G.; Borel, V.; Prat, C.; Herbet, A.; Bouvier, D.; Gallot, D.; Sapin, V. Implications of retinoid pathway in human fetal membranes: Study of target genes. Gynecol. Obstet. Fertil. 2011, 39, 370–372. [Google Scholar] [CrossRef]
  49. Dey, T.; Mukherjee, A.; Chakraborty, S. A practical overview of case-control studies in clinical practice. Chest 2020, 158, S57–S64. [Google Scholar] [CrossRef] [PubMed]
  50. Barupal, D.K.; Haldiya, P.K.; Wohlgemuth, G.; Kind, T.; Kothari, S.L.; Pinkerton, K.E.; Fiehn, O. MetaMapp: Mapping and visualizing metabolomic data by integrating information from biochemical pathways and chemical and mass spectral similarity. BMC Bioinform. 2012, 13, 99. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  51. Shannon, P.; Markiel, A.; Ozier, O.; Baliga, N.S.; Wang, J.T.; Ramage, D.; Amin, N.; Schwikowski, B.; Ideker, T. Cytoscape: A software environment for integrated models of biomolecular interaction networks. Genome Res. 2003, 13, 2498–2504. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Flowchart for subject selection. TB, term birth; PTB, preterm birth.
Figure 1. Flowchart for subject selection. TB, term birth; PTB, preterm birth.
Metabolites 11 00443 g001
Figure 2. PLS-DA score plots showing that metabolites are differentially categorized in the plasma of PTB compared to TB subjects. (a) Quality control (QC) samples (b) RPC positive.
Figure 2. PLS-DA score plots showing that metabolites are differentially categorized in the plasma of PTB compared to TB subjects. (a) Quality control (QC) samples (b) RPC positive.
Metabolites 11 00443 g002
Figure 3. Scatter plot of pathway impact analysis. y-axis represents p value.
Figure 3. Scatter plot of pathway impact analysis. y-axis represents p value.
Metabolites 11 00443 g003
Figure 4. Retinoid metabolites showing changes in plasma of preterm birth using retinoid metabolite analysis (39 TB, 20 PTB). At: all trans. Student’s t-test, * p < 0.05, ** p < 0.01, *** p < 0.001, and ns = non-significant.
Figure 4. Retinoid metabolites showing changes in plasma of preterm birth using retinoid metabolite analysis (39 TB, 20 PTB). At: all trans. Student’s t-test, * p < 0.05, ** p < 0.01, *** p < 0.001, and ns = non-significant.
Metabolites 11 00443 g004
Figure 5. Receiver operating characteristics (ROC) curve analysis for metabolites: Predictive performance of signatures for preterm birth using ROC curves of sensitivity and specificity.
Figure 5. Receiver operating characteristics (ROC) curve analysis for metabolites: Predictive performance of signatures for preterm birth using ROC curves of sensitivity and specificity.
Metabolites 11 00443 g005
Table 1. Clinical characteristics of subjects for validation (n = 59).
Table 1. Clinical characteristics of subjects for validation (n = 59).
CharacteristicsTerm Birth (n = 39)Preterm Birth (n = 20)p-Value
Maternal age33.3 ± 0.732.7 ± 1.00.626
GAS23.0 ± 0.827.6 ± 1.60.010 *
preBMI21.0 ± 0.421.7 ± 0.70.397
Parity 0.488
Nulliparous16 (42.1)8 (40.0)
Multiparous21 (57.9)12 (60.0)
Gravidity 0.416
025 (64.1)11 (55.0)
≥114 (35.9)9 (45.0)
WBC (×103/mL)8.8 ± 0.411.6 ± 0.6<0.001 *
C-reactive protein (mg/dL)0.3 ± 0.10.8 ± 0.20.034 *
pregBMI26.8 ± 0.626.4 ± 0.80.397
GAD39.0 ± 0.233.3 ± 1.0<0.001 *
Delivery mode 0.026
Normal delivery23 (59.0)5 (25.0)
Cesarean section16 (41.0)15 (75.0)
Birth weight (Kg)3.2 ± 0.12.2 ± 0.2<0.001 *
Gender, n (%) 0.651
Male25 (64.1)14 (70.0)
Female14 (35.9)6 (30.0)
APGAR 1 min9.7 ± 0.17.9 ± 0.50.002 *
APGAR 5 min9.9 ± 0.18.9 ± 0.40.009 *
Continuous variables are presented as mean ± SE. * Student’s t-test, p < 0.05; χ2 test, p < 0.05. GAS, gestational age at sampling; preBMI, body mass index before pregnancy; pregBMI, body mass index at delivery; WBC, white blood cell; GAD, gestational age at delivery; APGAR, appearance, pulse, grimace, activity, respiration.
Table 2. Comparison of RBP levels between maternal blood of term and preterm birth.
Table 2. Comparison of RBP levels between maternal blood of term and preterm birth.
Term Birth (n = 24, mg/L)Preterm Birth (n = 16, mg/L)p-Value
63.4 ± 4.2122.9 ± 16.7 *0.012
Data are presented as the mean ± SE. * Mann-Whitney t-test, p < 0.05.
Table 3. Efficacy of retinol-related metabolites for predicting preterm birth.
Table 3. Efficacy of retinol-related metabolites for predicting preterm birth.
MetaboliteAUCp-ValueSENSSPECPPVNPVAccuracy
At-retinal0.808<0.00175.0%84.2%68.2%86.5%79.7%
13cis-RA0.826<0.00185.0%68.4%58.6%90.0%74.6%
9cis-RA0.6790.02645.0%92.1%69.2%76.1%74.6%
Retinyl palmitate0.6700.03540.0%94.7%72.7%75.0%74.6%
RBP0.7360.01262.5%95.8%90.9%79.3%82.5%
Receiver operating characteristic (ROC) curve analysis was performed for statistical analysis, and p < 0.05, was considered significant. AUC, area under the curve; SENS, sensitivity; SPEC, specificity; PPV, positive predictive value; NPV, negative predictive value; OR, odds ratio; At, all trans; RA, retinoic acid; RBP, retinol binding protein.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

You, Y.-A.; Hwang, S.-Y.; Kim, S.-M.; Park, S.; Lee, G.-I.; Park, S.; Ansari, A.; Lee, J.; Kwon, Y.; Kim, Y.-J. Identification of Indicators for Preterm Birth Using Retinoid Metabolites. Metabolites 2021, 11, 443. https://0-doi-org.brum.beds.ac.uk/10.3390/metabo11070443

AMA Style

You Y-A, Hwang S-Y, Kim S-M, Park S, Lee G-I, Park S, Ansari A, Lee J, Kwon Y, Kim Y-J. Identification of Indicators for Preterm Birth Using Retinoid Metabolites. Metabolites. 2021; 11(7):443. https://0-doi-org.brum.beds.ac.uk/10.3390/metabo11070443

Chicago/Turabian Style

You, Young-Ah, Soo-Yeon Hwang, Soo-Min Kim, Seojeong Park, Ga-In Lee, Sunwha Park, AbuZar Ansari, Jeongae Lee, Youngjoo Kwon, and Young-Ju Kim. 2021. "Identification of Indicators for Preterm Birth Using Retinoid Metabolites" Metabolites 11, no. 7: 443. https://0-doi-org.brum.beds.ac.uk/10.3390/metabo11070443

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop