Next Article in Journal
Human Peptides α-Defensin-1 and -5 Inhibit Pertussis Toxin
Previous Article in Journal
Ochratoxins in Wines: A Review of Their Occurrence in the Last Decade, Toxicity, and Exposure Risk in Humans
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Circulating p-Cresyl Sulfate, Non-Hepatic Alkaline Phosphatase and Risk of Bone Fracture Events in Chronic Kidney Disease-Mineral Bone Disease

1
Division of Nephrology, Department of Internal Medicine, En Chu Kong Hospital, New Taipei City 237, Taiwan
2
Department of Nursing, Yuanpei University of Medical Technology, Hsinchu 300, Taiwan
3
Division of Nephrology, Department of Internal Medicine, Shuang Ho Hospital, Taipei Medical University, New Taipei City 235, Taiwan
4
Research Center of Urology and Kidney, Taipei Medical University, Taipei City 110, Taiwan
5
Renal Care Joint Foundation, New Taipei City 220, Taiwan
6
School of Biomedical Engineering, Taipei Medical University, Taipei 110, Taiwan
7
Division of Nephrology, Department of Medicine, Taipei Tzu Chi Hospital, Buddhist Tzu Chi Medical Foundation, New Taipei City 231, Taiwan
8
Division of Nephrology, Department of Internal Medicine, School of Medicine, College of Medicine, Taipei Medical University, Taipei 110, Taiwan
9
Department of Civil Engineering, National Taiwan University, Taipei 106, Taiwan
10
Department of Orthopaedic Surgery, School of Medicine, National Taiwan University, Taipei 100, Taiwan
11
Department of Orthopaedic Surgery, National Taiwan University Hospital, Taipei 100, Taiwan
12
Department of Biomedical Engineering, Yuanpei University of Medical Technology, Hsinchu 300, Taiwan
13
Department of Orthopaedic Surgery, En-Chu-Kong Hospital, New Taipei City 237, Taiwan
*
Author to whom correspondence should be addressed.
Submission received: 14 May 2021 / Revised: 6 July 2021 / Accepted: 7 July 2021 / Published: 10 July 2021
(This article belongs to the Section Uremic Toxins)

Abstract

:
Patients with chronic kidney disease (CKD), especially those undergoing hemodialysis, are at a considerably high risk of bone fracture events. Experimental data indicate that uremic toxins intricately involved in bone-related proteins exert multi-faced toxicity on bone cells and tissues, leading to chronic kidney disease–mineral and bone disorder (CKD-MBD). Nonetheless, information regarding the association between p-cresyl sulfate (PCS), non-hepatic alkaline phosphatase (NHALP) and skeletal events remains elusive. We aim to explore the association between PCS, NHALP and risk of bone fracture (BF) in patients with hemodialysis. Plasma concentrations of PCS and NHALP were ascertained at study entry. Cox proportional hazard regression analyses were used to determine unadjusted and adjusted hazard ratios (aHRs) of PCS for BF risk. In multivariable analysis, NHALP was associated with incremental risks of BFs [aHR: 1.06 (95% CI: 1.01–1.11)]. The association between the highest PCS tertile and BF risk remained robust [aHR: 2.87 (95% CI: 1.02–8.09)]. With respect to BF events, the interaction between NHALP and PCS was statistically significant (p value for the interaction term < 0.05). In addition to mineral dysregulation and hyperparathyroidism in hemodialysis patients, higher circulating levels of PCS and NHALP are intricately associated with incremental risk of BF events, indicating that a joint evaluation is more comprehensive than single marker. In light of the extremely high prevalence of CKD-MBD in the hemodialysis population, PCS may act as a pro-osteoporotic toxin and serve as a potential surrogate marker for skeletal events.
Key Contribution: Uremic toxin (p-cresyl sulfate) and non-hepatic alkaline phosphatase are intricately associated with incremental risk of bone fracture events. p-Cresyl sulfate may act as a pro-osteoporotic toxin and serve as a potential surrogate marker for chronic kidney disease–mineral and bone disorder.

1. Introduction

Chronic kidney disease-mineral bone disorder (CKD-MBD) is an intricate systemic complication in CKD patients with abnormal mineral and bone metabolism, typically manifested by dysregulated circulating levels of calcium and phosphorus, intact parathyroid hormone (iPTH), vitamin D, impaired skeletal health and vascular or ectopic soft tissue calcification [1]. Patients with later stages of CKD are doomed to suffer from lower bone mineral density, leading to strikingly higher risk of bone fracture (BF) and subsequent morbidity and mortality [2]. As CKD declines, failing renal clearance results in retention of organic compounds and anorganic substances (e.g., phosphate), also referred to as uremic solutes [3,4]. Among uremic solutes, p-cresyl sulfate (PCS) is a protein-bound uremic toxin (PBUT) generated from the metabolism of aromatic amino acids (phenylalanine, tryptophan and tyrosine) by intestinal bacteria [5]. In contrast to phosphate, PCS is difficult to be removed by conventional hemodialysis (HD) modality and thereby accumulates to an extreme degree [5]. Through exerting pro-oxidant and pro-inflammatory effects on complex organ systems, circulating PCS level is an independent predictor of CKD progression and risk of diverse clinical events [6,7,8].
There is growing evidence indicating that both hyperphosphatemia-induced secondary hyperparathyroidism (SHPT) and PBUT accumulation aggravate bone turnover by activating osteoclast activities and increasing the release of calcium and phosphate from bones, leading to bone mineral density (BMD) loss and BF events [4,9,10,11]. Meanwhile, uremic toxins reduce the expression of parathyroid hormone (PTH) receptors and enhance skeletal resistance to PTH in osteoblasts, accounting for a vicious cycle in SHPT [12]. Notably, elevated circulating non-hepatic alkaline phosphatase (NHALP) has been recognized as a robust biomarker for BF events and relevant mortality in high bone turnover diseases [13,14,15]. Nonetheless, the association between PCS, NHALP and BF events remains elusive. Thus, we aim to evaluate the joint effect of PCS and NHALP on BF events in patients with HD.

2. Results

2.1. Age, Prevalence of DM, HD Vintage, Kt/V Urea, PCS, NHALP, Normalized Protein Catabolic Rate, Albumin, Phosphate, iPTH, Hemoglobin and Hematocrit Levels Were Significantly Different Between BF Event and Event-Free Groups

The baseline bio-clinical data of 352 HD patients with comparisons between BF and BF-free survivors were demonstrated in Table 1. The mean duration of follow-up was 28.4 ± 4.7 months. The overall incidence rate of BFs was 14.5% during 9968 person-months of follow-up, corresponding to an annual event rate of 6.1%. Age, prevalence of diabetes mellitus (DM), HD vintage, Kt/V urea, PCS, NHALP, albumin, normalized protein catabolic rate (nPCR), phosphate, and iPTH levels differed significantly between two groups. The mean age of the whole study group was 64.6 ± 9.3; while the mean age of the group with or without fracture events was 69.9 ± 7.7 and 63.7 ± 9.3 years. Patients with BF had higher prevalence of DM (66.7%) compared to the BF-free group (41.9%) and longer HD vintage (87.4 ± 42.2 vs. 48.6 ± 37.6 months). Notably, the levels of PCS (33.4 ± 21.0 vs. 18.8 ± 12.7 μg/mL), NHALP (117.6 ± 86.8 vs. 81.0 ± 45.6 IU/L), nPCR (1.0 ± 0.2 vs. 1.1 ± 0.2), albumin (3.8 ± 0.5 vs. 3.9 ± 0.4 g/dL), phosphate (6.0 ± 1.5 vs. 5.0 ± 1.4 mg/dL), iPTH (830.3 ± 390.9 vs. 234.3 ± 198.8 pg/mL), hemoglobin (10.2 ± 1.2 vs. 10.8 ± 1.5 g/dL) and hematocrit (31.4 ± 4.1 vs. 31.5 ± 3.8%) were significantly different between the BF event and event-free groups.

2.2. BF Event Rates, Kt/V Urea, NHALP, Albumin, Blood Urea Nitrogen, Calcium and iPTH Levels Were Significantly Different among PCS Tertile Groups

Table 2 summarizes the comparison of BF events and relevant bio-clinical data between groups according to circulating levels of PCS categorized as tertiles in the whole study patients. All patients were stratified by the PCS tertiles into three categories: the low, middle and high PCS concentration tertiles were designated as tertile 1 (<16 μg/mL), tertile 2 (16–26.8 μg/mL) and tertile 3 (>26.8 pg/mL). The total BF events in the PCS tertile groups were 10, 15 and 26, corresponding to an annual BF rate of 3.4%, 5.6% and 9.8% respectively. BF events (10, 15, and 26, respectively), Kt/V urea (1.5 ± 0.3, 1.5 ± 0.3 and 1.4 ± 0.3, respectively), albumin (3.8 ± 0.4, 4.0 ± 0.4, and 4.0 ± 0.4, respectively), blood urea nitrogen (57.2 ± 15.2, 59.5 ± 20.5, 62.8 ± 16.0, respectively), calcium (9.3 ± 0.9, 9.2 ± 0.6, and 9.0 ± 0.6, respectively) and iPTH levels (162.7 ± 265.0, 289.9 ± 199.8, and 529.6 ± 349.4, respectively) were significantly different among PCS tertile groups. Notably, levels of NHALP were significantly different and increased in parallel with PCS tertiles (65.6 ± 37.7, 86.5 ± 27.6, and 109.4 ± 78.4 IU/L, respectively). Although the patients in tertile 3 had higher circulating phosphate concentrations and lower hemoglobin levels, the results for statistical difference were insignificant between groups (p-value = 0.13 and 0.07, respectively).

2.3. The Highest Concentration Tertiles of PCS and NHALP Are Related to an Incremental Risk of BFs

Figure 1 displays accumulating event-free survival curves of BFs among patients with three PCS tertiles during 9968 person-months of follow-up. With respect to tertile 1 (PCS concentration < 16 μg/mL) as a reference group, patients in tertile 3 (PCS concentration > 26.8 μg/mL) were related to an incremental risk of BFs (aHR: 3.25 [95% CI: 1.57–6.73], p < 0.05). Figure 2 demonstrated cumulative event-free survival curves of BFs among subjects with respect to different tertiles of plasma concentrations of NHALP: the low tertile 1, NHALP concentration < 70 IU/L; the middle tertile 2, NHALP concentration = 70–100 IU/L; and the high tertile 3, NHALP concentration > 100 IU/L, respectively. With respect to NHALP tertile 1 (<70 IU/L) as reference group, the association between the middle tertile of NHALP (70–100 IU/L) and BF risk was statistically insignificant [aHR: 1.47 (95% CI: 0.71–3.06), p value = 0.30]. Notably, the subjects with the high tertile of NHALP (>100 IU/L) were independently associated with an incremental risk of BFs (aHR: 2.3 [95% CI: 1.15–4.52], p < 0.05). Figure 3 illustrates cumulative event-free survival curves of BF risk among subjects with respect to different categories of plasma concentrations of PCS and NHALP: Category 1, PCS < 16 μg/mL and NHALP < 70 IU/L; Category 2, PCS 16–26.8 μg/mL and NHALP < 70 IU/L; Category 3, PCS > 26.8 μg/mL and NHALP < 70 IU/L; Category 4, PCS < 16 μg/mL and NHALP 70–100 IU/L; Category 5, PCS 16–26.8 μg/mL and NHALP 70–100 IU/L; Category 6, PCS < 16 μg/mL and NHALP concentration > 100 IU/L; Category 7, PCS > 26.8 μg/mL and NHALP 70–100 IU/L; Category 8, PCS 16–26.8 μg/mL and NHALP > 100 IU/L; Category 9, PCS > 26.8 μg/mL and NHALP >100 IU/L. Patients with a combination of higher PCS tertile (> 26.8 μg/mL) and higher NHALP tertile (>100 IU/L) had the greatest risk of BF events. With respect to the risk of BF events, the interaction term between NHALP and PCS was statistically significant (p value for the interaction term < 0.05).

2.4. In Multivariate Cox Regression Analysis, the Associations between the Highest PCS Tertile and Risk of BF Events Remain Robust

Table 3 summarizes the independent risk factors of BF events from the unadjusted Cox regression model and PCS tertiles in predicting the occurrence of BF events after multivariate adjustment. Model 1 without adjustment demonstrated that the highest PCS tertile (PCS concentration > 26.8 pg/mL) was independently associated with the risk of BF events (aHR: 3.25 [95% CI: 1.57–6.73]), compared with PCS tertile 1 (<16 μg/mL) as the reference group. Furthermore, age (aHR: 1.05 [95% CI: 1.00–1.10]), DM (aHR: 2.61 [95% CI: 1.46–2.68]), NHALP (aHR: 1.09 [95% CI: 1.05–1.12]), albumin (aHR: 0.53 [95% CI: 0.30–0.95]), HD vintage (aHR: 1.02 [95% CI: 1.01–1.03]), phosphate (aHR: 1.40 [95% CI: 1.19–1.64]), iPTH (aHR: 1.02 [95% CI: 1.02–1.03]) and hemoglobin (aHR: 0.77 [95% CI: 0.63–0.93]) were all independent risk factors of BF events in the current study. Model 2 adjusted for all independent risk factors of BFs demonstrated the highest PCS tertile was associated with BF risk [aHR: 2.87 (95% CI: 1.02–8.09)]. The following independent risk factors of BF events remained strong after multivariate adjustment: age (aHR: 1.06 [95% CI: 1.02–1.11]), NHALP (aHR: 1.06 [95% CI: 1.01–1.11]), HD vintage (aHR: 1.01 [95% CI: 1.00–1.02]), phosphate (aHR: 1.48 [95% CI: 1.26–1.92]), and iPTH (aHR: 1.03 [95% CI: 1.02–1.03]), respectively.

3. Discussion

BF events in CKD-MBD stand for the toughest complications that increase the risk of subsequent high rates of hospitalization and mortality dramatically [15,16,17,18]. However, none of the prior research investigated the association between PCS, NHALP and BF events. Therefore, we show a brand-new idea that a joint evaluation of PCS and NHALP for BF events is more comprehensive than a single surrogate marker. Specifically, higher circulating levels of PCS and NHALP interact to enhance the risk of BFs. Several key points in the current study deserve detailed discussion.
Epidemiological studies indicate that, for CKD stages 1 to 2, 3a, 3b, and 4, the incidence of BF rises progressively from 15.0 to 20.5, 24.2, 31.2, and 46.3/1000 person-years, respectively [19]. The BF risk is almost five times elevated in CKD patients with stage 5 disease versus stage 1–2 disease. In accordance with the previous research, our data reveal the overall incidence rate of BFs was 14.5% in the HD population, corresponding to an annual event rate of 6.1% (Table 1). In our cohort study, age, prevalence of DM, HD vintage, Kt/V urea, PCS, NHALP, albumin, nPCR, phosphate, iPTH, hemoglobin and hematocrit levels were significantly different between the BF event and event-free group. Overall, BF patients aged older and had higher prevalence of DM; longer HD vintage; higher levels of PCS, NHALP, phosphate, and iPTH; and lower levels of Kt/V urea, albumin, nPCR, hemoglobin and hematocrit. After stratification into three tertile groups according to circulating levels of PCS (Table 2), the annual BF rates in the PCS tertile groups were increased in parallel with PCS tertiles (3.4%, 5.6% and 9.8% respectively). Moreover, Kt/V urea, NHALP, albumin, blood urea nitrogen, calcium and iPTH levels were significantly different between PCS tertile groups. Accordingly, we examined the associations between PCS tertiles, other clinical risk factors and BF events in a Cox proportional hazard regression model (Table 3). After multivariate Cox regression analysis, the associations between the highest PCS tertile and risk of BF events remained robust. In addition, both the highest concentration tertiles of PCS and NHALP were associated with an incremental risk of BFs (Figure 1 and Figure 2). Most of all, patients with a combination of higher PCS tertile (> 26.8 μg/mL) and higher NHALP tertile (>100 IU/L) show the greatest risk of BF events (Figure 3), suggesting that a joint evaluation is more comprehensive than a sole marker.
In parallel with renal function decline, PBUTs are difficult to remove by HD that accumulate along with persistent iPTH elevation. Mounting evidence indicates that PBUTs aggravate skeletal resistance to PTH though downregulating peripheral PTH receptor expression and inducing inflammation, oxidative stress and apoptosis in osteoblasts [20,21]. Meanwhile, the parathyroid glands have the potential for overriding peripheral PTH resistance, inevitably resulting in high-turnover bone disease in patients with advanced CKD. Such deterioration of bone quantity with prominent bone resorption culminates in extremely high prevalence of BF events in the HD population. Uremic osteoporosis, a new nomenclature of uremic toxin-related bone illness, is a typical manifestation of CKD-induced bone material abnormalities, particularly in bone elasticity [18]. Uremic osteoporosis is a unique concept describing bone illness in CKD-MBD patients, and the pathophysiological background is not fully understood [9]. Furthermore, uremic osteoporosis is similar but somehow different from conventional skeletal osteoporosis in the general population. For example, the decrease of BMD occurrs mainly in hip, but not in spine, and is associated with age and SHPT in CKD patients [22]. Beyond the risk factor of age, the evaluation of BF risk was not simply the same as the general population due to high prevalence of multiple comorbidities and an altered microenvironment for bone in CKD-MBD, e.g., uremic burden, anemia, malnutrition-inflammation complex syndrome, hyperphosphatemia and SHPT, etc. [19,23]. Indeed, conventional risk factors for BFs, such as gender and DM, did not show significant results in univariate and multivariate Cox regression models. In particular, we demonstrated that the assessment of BF risk in CKD patients intricately interacted with circulating PCS and the biomarker of bone metabolism (NHALP). An additional observational study for the mortality associated with BF events, PBUTs or other novel biomarkers is underway to prove that HD patients suffer high frequency of BF as well as subsequent adverse clinical outcomes. Above all, the medical cost for BFs is more than $1 billion annually in the United States [13]. To reduce medical expenditure, the assessment of BF risk and prevention strategies should be considered in nephrology practice.
To monitor and diagnose bone abnormalities, bone biopsy is regarded as the gold standard, but is very invasive and cumbersome. In clinical routine practice, measurements of circulating bone turnover markers are warranted in CKD patients. To investigate it further, we analyzed the baseline bio-clinical data of 352 HD patients with or without BF events and found older age, higher prevalence of DM, higher levels of PCS and NHALP, hypoalbuminemia, anemia, longer HD vintage and hyperphosphatemia and SHPT were associated with greater risk of BFs. NHALP and iPTH were shown to be bone turnover markers that could serve as surrogate tools for BF risk assessment, corresponding to recommendations of the Kidney Disease Improving Global Outcomes (KDIGO) 2017 revised version [24]. Managing risk factors associated with CKD-MBD is crucial for reducing adverse clinical outcomes. Older age, prevalence of DM, and HD vintage were non-modifiable risk factors, whereas hypoalbuminemia, anemia and hyperphosphatemia were modifiable factors that should be corrected. In the general population, age-related osteoporosis increases the risk of BF events. Beside bone loss, different lipid and polar metabolite profiles were found in bone tissues in older individuals with CKD, surprisingly including the accumulation of uremic toxins [25]. Myriads of studies confirm the cardiovascular and skeletal toxicity of uremic toxins since they share common pathophysiological mechanisms in CKD-MBD [26,27,28], but even so, PBUTs are particularly sticky because of their protein-binding abilities and difficulty to be removed by dialysis. Our study provided novel evidence that the accumulation of circulating PCS could provide clinical predictive value regarding BF events in HD patients.
We acknowledged several limitations about this study. To begin with, we could not infer causality from observational data in the cross-sectional cohort. Next, our cohort constituted of a relatively small sample of an Asian population, such that the results should be interpreted with caution. After that, the circulating biochemical values were obtained at a single time point upon study entry, and variability over time might not be reflected. In addition, the data of BMD monitored by dual-energy x-ray absorptiometry or other bone quality measurements were not performed in our patients. Thus, the severity of osteoporosis was not accessible. Last but not least, we lack information on patient frailty and history of glucocorticoid use, which may significantly affect BF risk.

4. Methods

4.1. Participants in the Cohort

The Research Ethics Review Committees of En Chu Kong Hospital and Taipei Medical University have approved the study (ECKIRB1070102; TMU-IRB-N201705021) in accordance with the ethical standards of the committee and the Helsinki declaration for research in humans. The study methods were described in detail previously [29,30]. The written informed consent was obtained from the participants of this study. Patients undergoing HD treatment for at least 3 months were eligible for inclusion. All patients had to be older than 18 years of age and be receiving thrice-weekly HD; 388 patients were included. Thirty-six patients were excluded from the study because of unwillingness to participate, terminal illness, death prior to BF events, inadequate dialysis, active infections, advanced cancer, active hepatitis, profound malnutrition, incomplete data or loss of follow-up. The study finally included 352 HD patients with complete medical records and follow-up.

4.2. Assessment of Outcomes

The incidence of BF events, which was defined as a new diagnosis of BF for any sites that occurred during follow-up, including skull, all vertebrae bones, ribs, shoulder, humerus, forearm, wrist, hip, pelvis, femur, knee, leg, ankle, fingers, toes or other skeletal bones, were defined as primary outcomes. The occurrence of BF events was evaluated by clinical diagnosis (either from inpatient medical records or outpatient chart review) with evidence of BFs in the formal image report (computed tomography or roentgenogram) by radiologists. Vertebral fractures were assessed with Genant’s method as described previously [13]. The outcome information was centrally assessed by trained clinicians, nephrologists and radiologists.

4.3. Measurement of Circulating PCS Levels

We obtained a standard sample of PCS from Alsachim (Illkirch-Graffenstaden, France). The measurement of circulating PCS levels were described in detail previously [6]. Samples containing mixtures of PCS were analyzed with the UHPLC through the Accela 1250 autosampler and separated by a Shiseido HPLC CAPCELL PAK C18 MGII column (150 mm x 1.5 mm, 3.0 μm, Tokyo, Japan). The multiple reaction monitoring (MRM) scanning mode was applied for quantification. We used the Xcalibur software (version 2.2, Thermo-Finnigan Inc., San Jose, CA, USA) to acquire the MS spectra and control the mass spectrometer.

4.4. Assessment of Covariates

The following bio-demographic and laboratory parameters of each patient were recorded at baseline: age, gender, hypertension, DM, HD vintage, pre-dialysis blood urea nitrogen, normalized protein catabolic rate, creatinine, potassium, calcium, phosphorus, NHALP, alanine aminotransferase, albumin, uric acid, total cholesterol, triglyceride, hemoglobin, hematocrit, and iPTH. Patients with hepatobiliary diseases were excluded in our study after careful chart review. Thus, the origins of elevated ALP concentrations were determined to be non-hepatic, such as CKD-mineral bone diseases or skeletal events [13]. NHALP is one of the most important osteoblast marker proteins for bone mineralization, hydrolysis of mineralization inhibitor pyrophosphate, and UVC associated mortality in CKD patients [31]. HD vintage was defined as the duration of time between the first day of HD treatment and the first day that the patient entered the cohort. Pre-dialysis blood samples were obtained from existing vascular access for further analyses. All laboratory tests were performed by standard procedures with certified methods.

4.5. Statistics

We expressed continuous variables as mean ± standard deviation and categorical variables as number (%). The independence of risk factors associated with BF was investigated using univariate Cox regression analysis. In the Cox regression model, unadjusted and multivariable adjusted hazard ratios (aHRs) of BF risk were calculated for plasma PCS tertiles. The cumulative event-free survival probability and proportional hazards were illustrated with graphical methods. The modification effect between higher NHALP and PCS on BF risk was examined using an interaction product term. A p value < 0.05 was considered statistically significant. We used the PASW Statistics SPSS version 22.0 (IBM, NY, USA) to analyze all bio-clinical data of MHD patients.

5. Conclusions

In addition to mineral dysregulation and SHPT in HD patients, higher circulating levels of PCS and NHALP are intricately associated with incremental risk of BF events, such that a joint evaluation is more comprehensive than a sole marker. In light of the extremely high prevalence of CKD-MBD in hemodialysis population, PCS may act as a pro-osteoporotic toxin and serve as a potential surrogate marker for CKD–MBD.

Author Contributions

J.-F.C. and C.-C.W. were responsible for study design, data interpretation, manuscript writing and draft. C.-Y.H., C.-M.Z., K.-C.L., J.-C.L., S.-W.C., M.-S.W. and T.-M.W. were responsible for study supervision and revision of the manuscript. All authors have read and agreed to the published version of the manuscript.

Funding

This work was financially supported by ECKH_W10808, Ministry of Science and Technology (MOST 109-2628-B-385 -001 and 109-2221-E-038 -013), and the research grant of National Taiwan University Hospital (NTUH-110-S5154). This research was also funded by a grant from the Academia and Industry Collaboration Project of Taipei Medical University & En Chu Kong Hospital & Pharmofoods Medical Editing Co., Ltd. (A-108-031), and the Renal Care Joint Foundation.

Institutional Review Board Statement

The study was conducted according to the guidelines of the Declaration of Helsinki, and approved by the Institutional Review Board of En Chu Kong Hospital and Taipei Medical University (ECKIRB1070102; TMU-IRB-N201705021).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available from the corresponding author, Chang-Chin Wu, upon reasonable request.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Isakova, T.; Nickolas, T.L.; Denburg, M.; Yarlagadda, S.; Weiner, D.E.; Gutiérrez, O.M.; Bansal, V.; Rosas, S.E.; Nigwekar, S.; Yee, J.; et al. KDOQI US Commentary on the 2017 KDIGO Clinical Practice Guideline Update for the Diagnosis, Evaluation, Prevention, and Treatment of Chronic Kidney Disease-Mineral and Bone Disorder (CKD-MBD). Am. J. Kidney Dis. 2017, 70, 737–751. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  2. Hung, K.C.; Chang, J.F.; Hsu, Y.H.; Hsieh, C.Y.; Wu, M.S.; Wu, M.Y.; Chiu, I.J.; Syu, R.S.; Wang, T.M.; Wu, C.C.; et al. Therapeutic Effect of Calcimimetics on Osteoclast-Osteoblast Crosslink in Chronic Kidney Disease and Mineral Bone Disease. Int. J. Mol. Sci. 2020, 21, 8712. [Google Scholar] [CrossRef]
  3. Six, I.; Flissi, N.; Lenglet, G.; Louvet, L.; Kamel, S.; Gallet, M.; Massy, Z.A.; Liabeuf, S. Uremic Toxins and Vascular Dysfunction. Toxins 2020, 12, 404. [Google Scholar] [CrossRef] [PubMed]
  4. Vervloet, M. Modifying Phosphate Toxicity in Chronic Kidney Disease. Toxins 2019, 11, 522. [Google Scholar] [CrossRef] [Green Version]
  5. Gryp, T.; Vanholder, R.; Vaneechoutte, M.; Glorieux, G. p-Cresyl Sulfate. Toxins 2017, 9, 52. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  6. Chang, J.F.; Hsieh, C.Y.; Liou, J.C.; Liu, S.H.; Hung, C.F.; Lu, K.C.; Lin, C.C.; Wu, C.C.; Ka, S.M.; Wen, L.L.; et al. Scavenging Intracellular ROS Attenuates p-Cresyl Sulfate-Triggered Osteogenesis through MAPK Signaling Pathway and NF-κB Activation in Human Arterial Smooth Muscle Cells. Toxins 2020, 12, 472. [Google Scholar] [CrossRef]
  7. Hénaut, L.; Mary, A.; Chillon, J.M.; Kamel, S.; Massy, Z.A. The Impact of Uremic Toxins on Vascular Smooth Muscle Cell Function. Toxins 2018, 10, 218. [Google Scholar] [CrossRef] [Green Version]
  8. Lim, Y.J.; Sidor, N.A.; Tonial, N.C.; Che, A.; Urquhart, B.L. Uremic Toxins in the Progression of Chronic Kidney Disease and Cardiovascular Disease: Mechanisms and Therapeutic Targets. Toxins 2021, 13, 142. [Google Scholar] [CrossRef]
  9. Kazama, J.J.; Iwasaki, Y.; Fukagawa, M. Uremic osteoporosis. Kidney Int. Suppl. 2013, 3, 446–450. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  10. Iwasaki, Y.; Kazama, J.J.; Yamato, H.; Matsugaki, A.; Nakano, T.; Fukagawa, M. Altered material properties are responsible for bone fragility in rats with chronic kidney injury. Bone 2015, 81, 247–254. [Google Scholar] [CrossRef]
  11. Black, A.P.; Cardozo, L.F.; Mafra, D. Effects of Uremic Toxins from the Gut Microbiota on Bone: A Brief Look at Chronic Kidney Disease. Ther. Apher. Dial. 2015, 19, 436–440. [Google Scholar] [CrossRef] [Green Version]
  12. Yamamoto, S.; Fukagawa, M. Uremic Toxicity and Bone in CKD. J. Nephrol. 2017, 30, 623–627. [Google Scholar] [CrossRef] [PubMed]
  13. Yeh, J.C.; Wu, C.C.; Choy, C.S.; Chang, S.W.; Liou, J.C.; Chen, K.S.; Tung, T.H.; Lin, W.N.; Hsieh, C.Y.; Ho, C.T.; et al. Non-Hepatic Alkaline Phosphatase, hs-CRP and Progression of Vertebral Fracture in Patients with Rheumatoid Arthritis: A Population-Based Longitudinal Study. J. Clin. Med. 2018, 7, 439. [Google Scholar] [CrossRef] [Green Version]
  14. Haarhaus, M.; Brandenburg, V.; Kalantar-Zadeh, K.; Stenvinkel, P.; Magnusson, P. Alkaline phosphatase: A novel treatment target for cardiovascular disease in CKD. Nat. Rev. Nephrol. 2017, 13, 429–442. [Google Scholar] [CrossRef] [PubMed]
  15. Pimentel, A.; Ureña-Torres, P.; Zillikens, M.C.; Bover, J.; Cohen-Solal, M. Fractures in patients with CKD-diagnosis, treatment, and prevention: A review by members of the European Calcified Tissue Society and the European Renal Association of Nephrology Dialysis and Transplantation. Kidney In.t 2017, 92, 1343–1355. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  16. Pimentel, A.; Ureña-Torres, P.; Bover, J.; Luis Fernandez-Martín, J.; Cohen-Solal, M. Bone Fragility Fractures in CKD Patients. Calcif. Tissue Int. 2021, 108, 539–550. [Google Scholar] [CrossRef]
  17. Pimentel, A.; Bover, J.; Elder, G.; Cohen-Solal, M.; Ureña-Torres, P.A. The Use of Imaging Techniques in Chronic Kidney Disease-Mineral and Bone Disorders (CKD-MBD)-A Systematic Review. Diagnostics 2021, 11, 772. [Google Scholar] [CrossRef] [PubMed]
  18. Tentori, F.; McCullough, K.; Kilpatrick, R.D.; Bradbury, B.D.; Robinson, B.M.; Kerr, P.G.; Pisoni, R.L. High rates of death and hospitalization follow bone fracture among hemodialysis patients. Kidney Int. 2014, 85, 166–173. [Google Scholar] [CrossRef] [Green Version]
  19. Naylor, K.L.; Garg, A.X.; Zou, G.; Langsetmo, L.; Leslie, W.D.; Fraser, L.A.; Adachi, J.D.; Morin, S.; Goltzman, D.; Lentle, B.; et al. Comparison of fracture risk prediction among individuals with reduced and normal kidney function. Clin. J. Am. Soc. Nephrol. 2015, 10, 646–653. [Google Scholar] [CrossRef] [Green Version]
  20. Nii-Kono, T.; Iwasaki, Y.; Uchida, M.; Fujieda, A.; Hosokawa, A.; Motojima, M.; Yamato, H.; Kurokawa, K.; Fukagawa, M. Indoxyl sulfate induces skeletal resistance to parathyroid hormone in cultured osteoblastic cells. Kidney Int. 2007, 71, 738–743. [Google Scholar] [CrossRef] [Green Version]
  21. Liu, W.C.; Wu, C.C.; Lim, P.S.; Chien, S.W.; Hou, Y.C.; Zheng, C.M.; Shyu, J.F.; Lin, Y.F.; Lu, K.C. Effect of uremic toxin-indoxyl sulfate on the skeletal system. Clin. Chim. Acta 2018, 484, 197–206. [Google Scholar] [CrossRef]
  22. Bezerra de Carvalho, K.S.; Vasco, R.F.V.; Custodio, M.R.; Jorgetti, V.; Moysés, R.M.A.; Elias, R.M. Chronic kidney disease is associated with low BMD at the hip but not at the spine. Osteoporos. Int. 2019, 30, 1015–1023. [Google Scholar] [CrossRef]
  23. Hsu, C.Y.; Chen, L.R.; Chen, K.H. Osteoporosis in Patients with Chronic Kidney Diseases: A Systemic Review. Int. J. Mol. Sci. 2020, 21, 6846. [Google Scholar] [CrossRef]
  24. Ketteler, M.; Block, G.A.; Evenepoel, P.; Fukagawa, M.; Herzog, C.A.; McCann, L.; Moe, S.M.; Shroff, R.; Tonelli, M.A.; Toussaint, N.D.; et al. Executive summary of the 2017 KDIGO Chronic Kidney Disease-Mineral and Bone Disorder (CKD-MBD) Guideline Update: What’s changed and why it matters. Kidney Int. 2017, 92, 26–36. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Nam, M.; Huh, J.E.; Kim, M.S.; Ryu, D.H.; Park, J.; Kim, H.S.; Lee, S.Y.; Hwang, G.S. Metabolic alterations in the bone tissues of aged osteoporotic mice. Sci. Rep. 2018, 8, 8127. [Google Scholar] [CrossRef] [PubMed]
  26. Vanholder, R.; Pletinck, A.; Schepers, E.; Glorieux, G. Biochemical and Clinical Impact of Organic Uremic Retention Solutes: A Comprehensive Update. Toxins 2018, 10, 33. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  27. Fujii, H.; Goto, S.; Fukagawa, M. Role of Uremic Toxins for Kidney, Cardiovascular, and Bone Dysfunction. Toxins 2018, 10, 202. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  28. Hamza, E.; Metzinger, L.; Metzinger-Le Meuth, V. Uremic Toxins Affect Erythropoiesis during the Course of Chronic Kidney Disease: A Review. Cells 2020, 9, 2039. [Google Scholar] [CrossRef]
  29. Chang, J.F.; Chen, P.C.; Hsieh, C.Y.; Liou, J.C. A Growth Differentiation Factor 15-Based Risk Score Model to Predict Mortality in Hemodialysis Patients. Diagnostics 2021, 11, 286. [Google Scholar] [CrossRef]
  30. Chang, J.F.; Chou, Y.S.; Wu, C.C.; Chen, P.C.; Ko, W.C.; Liou, J.C.; Hsieh, C.Y.; Lin, W.N.; Wen, L.L.; Chang, S.W.; et al. A Joint Evaluation of Neurohormone Vasopressin-Neurophysin II-Copeptin and Aortic Arch Calcification on Mortality Risks in Hemodialysis Patients. Front. Med. 2020, 7, 102. [Google Scholar] [CrossRef] [Green Version]
  31. Chang, J.F.; Liu, S.H.; Lu, K.C.; Ka, S.M.; Hsieh, C.Y.; Ho, C.T.; Lin, W.N.; Wen, L.L.; Liou, J.C.; Chang, S.W.; et al. Uremic Vascular Calcification Is Correlated With Oxidative Elastic Lamina Injury, Contractile Smooth Muscle Cell Loss, Osteogenesis, and Apoptosis: The Human Pathobiological Evidence. Front. Med. 2020, 7, 78. [Google Scholar] [CrossRef] [PubMed]
Figure 1. Accumulating event-free survival curves of bone fracture risk among patients with respect to different tertiles of circulating PCS during 9968 person-months of follow-up. Tertile 1, PCS concentration < 16 μg/mL; Tertile 2, PCS concentration = 16–26.8 μg/mL; Tertile 3, PCS concentration > 26.8 μg/mL. PCS = p-cresyl sulfate.
Figure 1. Accumulating event-free survival curves of bone fracture risk among patients with respect to different tertiles of circulating PCS during 9968 person-months of follow-up. Tertile 1, PCS concentration < 16 μg/mL; Tertile 2, PCS concentration = 16–26.8 μg/mL; Tertile 3, PCS concentration > 26.8 μg/mL. PCS = p-cresyl sulfate.
Toxins 13 00479 g001
Figure 2. Accumulating event-free survival curves of bone fracture risk among patients with respect to different tertiles of plasma concentrations of NHALP during 9968 person-months of follow-up. Tertile 1, NHALP concentration < 70 IU/L; Tertile 2, NHALP concentration = 70–100 IU/L; Tertile 3, NHALP concentration > 100 IU/L. NHALP = non-hepatic alkaline phosphatase.
Figure 2. Accumulating event-free survival curves of bone fracture risk among patients with respect to different tertiles of plasma concentrations of NHALP during 9968 person-months of follow-up. Tertile 1, NHALP concentration < 70 IU/L; Tertile 2, NHALP concentration = 70–100 IU/L; Tertile 3, NHALP concentration > 100 IU/L. NHALP = non-hepatic alkaline phosphatase.
Toxins 13 00479 g002
Figure 3. Accumulating event-free survival curves of bone fracture risk among patients with respect to different categories of plasma concentrations of PCS and NHALP during 9968 person-months of follow-up. Category 1, PCS < 16 μg/mL and NHALP < 70 IU/L; Category 2, PCS 16–26.8 μg/mL and NHALP < 70 IU/L; Category 3, PCS > 26.8 μg/mL and NHALP < 70 IU/L; Category 4, PCS < 16 μg/mL and NHALP 70–100 IU/L; Category 5, PCS 16–26.8 μg/mL and NHALP 70–100 IU/L; Category 6, PCS < 16 μg/mL and NHALP concentration > 100 IU/L; Category 7, PCS > 26.8 μg/mL and NHALP 70–100 IU/L; Category 8, PCS 16–26.8 μg/mL and NHALP > 100 IU/L; Category 9, PCS > 26.8 μg/mL and NHALP >100 IU/L. NHALP = non-hepatic alkaline phosphatase. PCS = p-cresyl sulfate.
Figure 3. Accumulating event-free survival curves of bone fracture risk among patients with respect to different categories of plasma concentrations of PCS and NHALP during 9968 person-months of follow-up. Category 1, PCS < 16 μg/mL and NHALP < 70 IU/L; Category 2, PCS 16–26.8 μg/mL and NHALP < 70 IU/L; Category 3, PCS > 26.8 μg/mL and NHALP < 70 IU/L; Category 4, PCS < 16 μg/mL and NHALP 70–100 IU/L; Category 5, PCS 16–26.8 μg/mL and NHALP 70–100 IU/L; Category 6, PCS < 16 μg/mL and NHALP concentration > 100 IU/L; Category 7, PCS > 26.8 μg/mL and NHALP 70–100 IU/L; Category 8, PCS 16–26.8 μg/mL and NHALP > 100 IU/L; Category 9, PCS > 26.8 μg/mL and NHALP >100 IU/L. NHALP = non-hepatic alkaline phosphatase. PCS = p-cresyl sulfate.
Toxins 13 00479 g003
Table 1. Baseline bio-clinical data with comparisons between bone fracture group and fracture-free survivors in maintenance hemodialysis patients.
Table 1. Baseline bio-clinical data with comparisons between bone fracture group and fracture-free survivors in maintenance hemodialysis patients.
Overall Population
(n = 352)
BF Events
(n = 51)
Event-Free Survivors
(n = 301)
Age (years)64.6 ± 9.369.9 ± 7.763.7 ± 9.3
Male, n (%)181 (51.4)25 (49.0)156 (51.8)
Diabetes mellitus, n (%)160 (45.5)34 (66.7)126 (41.9)
Hypertension, n (%)180 (51.1)22 (43.1)158 (52.5)
Hemodialysis vintage (months)42 (18.9–80.9)75.8 (58.7–129.2)34.2 (17.1–76.0)
Kt/V urea1.5 ± 0.31.4 ± 0.31.5 ± 0.3
PCS (μg/mL)20.9 ± 15.033.4 ± 21.018.8 ± 12.7
NHALP (IU/L)86.3 ± 54.9117.6 ± 86.881.0 ± 45.6
nPCR1.1 ± 0.21.0 ± 0.21.1 ± 0.2
Aspartate aminotransferase (IU/L)16.0 ± 6.715.6 ± 5.816.1 ± 6.9
Alanine aminotransferase (IU/L)13.0 ± 9.915.0 ± 14.312.7 ± 8.9
Total cholesterol (mg/dL)193.4 ± 48.0202.8 ± 45.2191.8 ± 48.3
Triglyceride (mg/dL)206.5 ± 180.5239.3 ± 181.3200.9 ± 180.1
Low-density lipoprotein106.1 ± 38.1112.3 ± 40.2105.0 ± 37.7
Blood glucose (mg/dL)125.8 ± 60.1134.3 ± 69.8124.3 ± 58.3
Blood urea nitrogen (mg/dL)59.7 ± 17.461.3 ± 19.259.4 ± 17.1
Creatinine (mg/dL)10.2 ± 1.89.9 ± 1.610.3 ± 1.9
Uric acid (mg/dL)7.4 ± 1.37.2 ± 0.97.5 ± 1.4
Potassium (mmol L−1)4.5 ± 0.94.4 ± 0.74.6 ± 0.9
Phosphate (mg/dL)5.2 ± 1.56.0 ± 1.55.0 ± 1.4
Albumin (g/dL)3.9 ± 0.43.8 ± 0.53.9 ± 0.4
Calcium (mg/dL)9.2 ± 0.79.2 ± 0.89.2 ± 0.7
iPTH (pg/mL)236.5 (118.0–409.0)745.0 (628.0–925.0)201 (105.0–319.5)
Hemoglobin (g/dL)10.7 ± 1.410.2 ± 1.210.8 ± 1.5
Hematocrit (%)33.1 ± 4.031.4 ± 4.131.5 ± 3.8
Continuous variables were expressed as mean ± SD for Gaussian data, or median (25th–75th percentile) for non-Gaussian data. Categorical variables are expressed as n (%). Boldface represents that the values are significantly different between event-free survivors and non-survivors. iPTH = intact parathyroid hormone; Kt/V urea = dialysis dose calculated by Gotch’s method; NHALP = non-hepatic alkaline phosphatase; nPCR = normalized protein catabolic rate; PCS = p-cresyl sulfate.
Table 2. Comparison of bio-clinical parameters and BF events based on circulating levels of PCS categorized as tertiles in the whole study population.
Table 2. Comparison of bio-clinical parameters and BF events based on circulating levels of PCS categorized as tertiles in the whole study population.
Tertile 1
<16 μg/mL
Tertile 2
16–26.8 μg/mL
Tertile 3
>26.8 pg/mL
Patients, n (%)126 (35.8)114 (32.4)112 (31.8)
BF events, n (%)10 (7.9)15 (13.2)26 (23.2)
Annual BF rates (%)3.45.69.8
Age (years)64.1 ± 8.964.2 ± 9.065.6 ± 10.0
Diabetes mellitus, n (%)58 (46.0)48 (42.1)54 (48.2)
Hypertension, n (%)60 (47.6)56 (49.1)64 (57.1)
Hemodialysis vintage (months)41.8 (20.2–71.4)51.7 (16.6–93.3)37.3 (20.2–89.5)
PCS (μg/mL)5.6 ± 4.422.1 ± 2.437.0 ± 12.5
Kt/V urea1.5 ± 0.31.5 ± 0.31.4 ± 0.3
NHALP65.6 ± 37.786.5 ± 27.6109.4 ± 78.4
nPCR (g/kg/day)1.1 ± 0.21.0 ± 0.31.1 ± 0.2
Potassium (mmol L−1)4.6 ± 0.84.5 ± 0.94.5 ± 0.8
Blood urea nitrogen (mg/dL)57.2 ± 15.259.5 ± 20.562.8 ± 16.0
Creatinine (mg/dL)10.2 ± 1.810.5 ± 1.910.3 ± 1.6
Blood glucose (mg/dL)130.0 ± 62.1135.8 ± 79.8135.6 ± 68.4
Uric acid (mg/dL)7.6 ± 1.47.2 ± 1.07.5 ± 1.4
Calcium (mg/dL)9.3 ± 0.99.2 ± 0.69.0 ± 0.6
Phosphate (mg/dL)5.0 ± 1.55.1 ± 1.45.4 ± 1.4
Albumin (g/dL)3.8 ± 0.44.0 ± 0.44.0 ± 0.4
Intact parathyroid hormone (pg/mL)96.0 (53.2–139.0)224.0 (175.0–293.0)413.5 (341.0–552.0)
Hemoglobin (g/dL)10.8 ± 1.810.8 ± 1.210.4 ± 1.0
Hematocrit (%)33.5 ± 5.733.5 ± 3.832.3 ± 3.2
Continuous variables were expressed as mean ± SD for Gaussian data, or median (25th–75th percentile) for non-Gaussian data. Categorical variables are expressed as n (%). Boldface represents that the values are significantly different between PCS tertiles. BF = bone fracture. Kt/V urea = dialysis dose calculated by Gotch’s method. nPCR = normalized protein catabolic rate. PCS = p-cresyl sulfate.
Table 3. The associations between PCS tertiles, other independent risk factors and bone fracture events in a Cox proportional hazard regression model.
Table 3. The associations between PCS tertiles, other independent risk factors and bone fracture events in a Cox proportional hazard regression model.
Model 1Model 2
HR (95% CI) p ValueHR (95% CI) p Value
PCS Tertiles
Tertile 3 vs. Tertile 1
3.25 (1.57–6.73) < 0.012.87 (1.02–8.09) < 0.05
Diabetes mellitus (yes vs. no)2.61 (1.46–2.68) < 0.011.49 (0.76–2.95) 0.25
NHALP (per 10 unit increase)1.09 (1.05–1.12) < 0.011.06 (1.01–1.11) < 0.01
Age (per year increase)1.05 (1.00–1.10) < 0.051.06 (1.02–1.11) < 0.05
Albumin (per unit increase)0.53 (0.30–0.95) < 0.050.81 (0.35–1.87) 0.62
HD vintage (per month increase)1.02 (1.01–1.03) < 0.011.01 (1.00–1.02) < 0.05
Phosphate (per unit increase)1.40 (1.19–1.64) < 0.011.48 (1.26–1.92) < 0.05
iPTH (per 10 unit increase)1.02 (1.02–1.03) < 0.011.03 (1.02–1.03) < 0.01
Hemoglobin (per unit increase)0.77 (0.63–0.93) < 0.010.82 (0.62–1.10) 0.18
CI = confidence interval; HR = hazard ratio. PCS Tertile 1 indicated PCS concentration < 16 μg/mL; Tertile 3 indicated PCS concentration > 26.8 pg/mL. Model 1: independent risk factors from the unadjusted Cox regression model; Model 2: adjusted for all independent risk factors in the model 1 (PCS, diabetes mellitus, NHALP, age, albumin, HD vintage, phosphate, iPTH, hemoglobin). HD = Hemodialysis; iPTH = intact parathyroid hormone; NHALP = non-hepatic alkaline phosphatase; PCS = p-cresyl sulfate.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Chang, J.-F.; Hsieh, C.-Y.; Liou, J.-C.; Lu, K.-C.; Zheng, C.-M.; Wu, M.-S.; Chang, S.-W.; Wang, T.-M.; Wu, C.-C. Circulating p-Cresyl Sulfate, Non-Hepatic Alkaline Phosphatase and Risk of Bone Fracture Events in Chronic Kidney Disease-Mineral Bone Disease. Toxins 2021, 13, 479. https://0-doi-org.brum.beds.ac.uk/10.3390/toxins13070479

AMA Style

Chang J-F, Hsieh C-Y, Liou J-C, Lu K-C, Zheng C-M, Wu M-S, Chang S-W, Wang T-M, Wu C-C. Circulating p-Cresyl Sulfate, Non-Hepatic Alkaline Phosphatase and Risk of Bone Fracture Events in Chronic Kidney Disease-Mineral Bone Disease. Toxins. 2021; 13(7):479. https://0-doi-org.brum.beds.ac.uk/10.3390/toxins13070479

Chicago/Turabian Style

Chang, Jia-Feng, Chih-Yu Hsieh, Jian-Chiun Liou, Kuo-Cheng Lu, Cai-Mei Zheng, Mai-Szu Wu, Shu-Wei Chang, Ting-Ming Wang, and Chang-Chin Wu. 2021. "Circulating p-Cresyl Sulfate, Non-Hepatic Alkaline Phosphatase and Risk of Bone Fracture Events in Chronic Kidney Disease-Mineral Bone Disease" Toxins 13, no. 7: 479. https://0-doi-org.brum.beds.ac.uk/10.3390/toxins13070479

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop