Next Article in Journal
A Decade of Progress in Deep Brain Stimulation of the Subcallosal Cingulate for the Treatment of Depression
Previous Article in Journal
Defining Pre-Clinical Psoriatic Arthritis in an Integrated Dermato-Rheumatology Environment
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Redefining the Prognostic Value of High-Sensitivity Troponin in COVID-19 Patients: The Importance of Concomitant Coronary Artery Disease

by
Marco Schiavone
1,†,
Alessio Gasperetti
1,†,
Massimo Mancone
2,*,
Aaron V. Kaplan
3,
Cecilia Gobbi
4,
Giosuè Mascioli
5,
Mattia Busana
6,
Ardan M. Saguner
7,
Gianfranco Mitacchione
1,
Andrea Giacomelli
8,
Gennaro Sardella
2,
Maurizio Viecca
1,
Firat Duru
7,
Spinello Antinori
8,9,
Stefano Carugo
4,
Antonio L. Bartorelli
9,10,
Claudio Tondo
10,11,
Massimo Galli
8,9,
Francesco Fedele
2 and
Giovanni B. Forleo
1
1
Department of Cardiology, ASST-Fatebenefratelli Sacco, Luigi Sacco University Hospital, 20157 Milan, Italy
2
Department of Clinical Internal, Anesthesiological and Cardiovascular Science, Sapienza University of Rome, 00161 Rome, Italy
3
Department of Cardiovascular Medicine, Dartmouth Hitchcock Medical Center, Lebanon, NH 03766, USA
4
Department of Cardiology, ASST Santi Paolo e Carlo, San Paolo University Hospital, 20142 Milan, Italy
5
Cardiovascular Department, Humanitas Gavazzeni Hospital, 24125 Bergamo, Italy
6
Department of Anesthesiology, Emergency and Intensive Care Medicine, University of Göttingen, 37073 Göttingen, Germany
7
Department of Cardiology, University Heart Center Zürich, 8091 Zürich, Switzerland
8
Department of Infectious Diseases, ASST Fatebenefratelli-Sacco, Luigi Sacco University Hospital, 20157 Milan, Italy
9
Luigi Sacco Department of Biomedical and Clinical Sciences DIBIC, University of Milan, 20157 Milan, Italy
10
Centro Cardiologico Monzino IRCCS, 20138 Milan, Italy
11
Department of Clinical Sciences and Community Health, University of Milan, 20122 Milan, Italy
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
J. Clin. Med. 2020, 9(10), 3263; https://0-doi-org.brum.beds.ac.uk/10.3390/jcm9103263
Submission received: 17 September 2020 / Revised: 5 October 2020 / Accepted: 9 October 2020 / Published: 12 October 2020
(This article belongs to the Section Cardiology)

Abstract

:
Background: Although studies assessing cardiovascular comorbidities and myocardial injury in Coronavirus disease 2019 (COVID-19) patients have been published, no reports focused on clinical outcomes of myocardial injury in patients with and without chronic coronary syndromes (CCS) are currently available. Methods: In this study, consecutive COVID-19 patients admitted to four different institutions were screened for enrolment. Patients were divided into two groups (CCS vs. no-CCS). Association with in-hospital mortality and related predictors represented the main study outcome; myocardial injury and its predictors were deemed secondary outcomes. Results: A total of 674 COVID-19 patients were enrolled, 112 (16.6%) with an established history of CCS. Myocardial injury occurred in 43.8% patients with CCS vs. 14.4% patients without CCS, as confirmed by high-sensitivity cardiac troponin (hs-cTn) elevation on admission or during hospitalization. The mortality rate in the CCS cohort was nearly three-fold higher. After adjusting for disease severity, myocardial injury resulted significantly associated with in-hospital mortality in the no-CCS group but not in CCS patients. Conclusions: Patients with CCS and COVID-19 showed high mortality rate. Myocardial injury may be a bystander in CCS patients and COVID-19, while in patients without known history of CCS, myocardial injury has a significant role in predicting poor outcomes.

1. Introduction

In recent times, the available body of evidence assessing the novel Coronavirus disease (COVID-19) has led to a progressive steering from a lung-centered disease paradigm in favor of a systemic disease concept. Several studies have reported the presence of an important interplay between the cardiovascular system, coagulation derangements, and COVID-19 [1,2,3,4]. The presence of myocardial injury, defined as high-sensitivity cardiac troponin (hs-cTn) elevation, was described especially among most critically ill patients with COVID-19 [5,6,7]. In these reports, older patients with acute myocardial injury suffered from more cardiovascular (CV) comorbidities and faced less favorable prognosis [8], and biomarker elevation was present also in patients without underlying obstructive coronary artery disease (CAD) [9]. Moreover, frequency of arrhythmias was noted to be higher in patients with myocardial injury [10], potentially leading to worse outcomes.
It is well accepted that respiratory infections—e.g., influenza A/B and previous severe acute respiratory syndrome (SARS) infections—are associated with CV events, cardiac arrhythmias [11], and especially acute coronary syndromes (ACS) [12,13]. A pro-inflammatory state leading to plaque instability and prothrombotic state (type 1 myocardial infarction (MI)) or a mismatch between oxygen supply and/or demand related with respiratory failure (predominantly hypoxemia) and infectious diseases (type 2 MI) have been proposed to explain those links [14,15,16]. Similar mechanisms have been postulated to explain the onset of myocardial injury in relationship with severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) infection, although a direct myocardial “myocarditis-like” effect, potentially associated with clinically relevant cardiac arrhythmias [17], has not been completely ruled out.
Patients with chronic coronary syndromes (CCS) defined according to the European guidelines [18] may be more susceptible to triggers that can lead to type 1 or 2 MI [19,20]. Although CV diseases [11,21] and myocardial injury [5] are postulated to have a role in worsening clinical outcomes in COVID-19, clear links between history of CCS, myocardial injury, and in-hospital outcomes have not been described.
The aim of this study was to evaluate clinical outcomes of CCS patients with COVID-19 and the potential mechanisms of myocardial injury in CCS and no-CCS patients with COVID-19.

2. Methods

2.1. Study Population

Consecutive confirmed cases of COVID-19 admitted to four Italian institutions (Luigi Sacco Hospital, Milan, Italy; Policlinico Umberto I, Rome, Italy; Humanitas Gavazzeni Hospital, Bergamo, Italy; and Centro Cardiologico Monzino, Milan, Italy) between 23 February 2020 and 1 May 2020 were screened for enrolment. Patients were prospectively enrolled, and data were retrospectively analyzed. A confirmed case of COVID-19 was defined by a positive result on a reverse-transcriptase-polymerase-chain-reaction (RT-PCR) assay performed on a nasopharyngeal swab, according to the World Health Organization (WHO) guidelines.
Patients with CCS were defined as specifically stated by the European Guidelines [18], as follows: “asymptomatic and symptomatic patients with stabilized symptoms <1 year after ACS or patients with recent revascularization; asymptomatic and symptomatic patients >1 year after initial diagnosis or revascularization”.
Patients presented to the emergency department (ED) with SARS-CoV-2 infection and ACS were excluded from the analysis. Clinical outcomes were monitored up to the final date of follow-up (11 May 2020). All patients still hospitalized or with an incomplete follow-up were excluded.
This study was approved by the local ethical board (project identification code 2020/ST/081) in accordance with national regulations and was conducted in accordance to the Declaration of Helsinki. The cause of death in all patients were adjudicated in a standardized fashion.

2.2. Data Collection

Baseline demographic, clinical, laboratory, and radiological characteristics as well as treatment and outcomes data were obtained from in-hospital electronic medical records on each patient. Myocardial injury was defined according to the European Guidelines for the fourth universal definition of MI, i.e., elevated hs-cTn with at least one value (on admission or during hospitalization) above the 99th percentile upper reference limit (URL), regardless of new electrocardiographic or echocardiographic abnormalities. Hs-cTn levels analysis was performed using peak hs-cTn values during hospitalization. Fever was defined as axillary temperature ≥37.5 °C. Acute respiratory distress syndrome (ARDS) was defined according to the Berlin definition [22]. Chronic kidney disease (CKD) was defined by a glomerular filtration rate (eGFR) ≤ 60 mL/min/m2, obtained with the CKD-EPI equation. Baseline laboratory values were analyzed on arterial and venous blood samples collected at the time of hospitalization. Radiological findings were assessed using a chest radiograph severity scoring system validated in patients with severe acute respiratory infection [23]. All data were independently reviewed and entered into a general and de-identified database by 4 different data collectors.

2.3. Cohort Definition and Study Outcome

Patients were classified into two groups (CCS and no-CCS) according to their medical history. Association with in-hospital mortality and related predictors represented the main study outcome; myocardial injury and its predictors were deemed secondary outcomes.

2.4. Statistical Analysis

Categorical variables are reported as counts (percentage). Normality of distribution was tested for all continuous variables using a Shapiro–Wilk test. Continuous variables are reported as mean ± standard deviation (s.d.) or as median [inter-quartile range] (IQR) if normally or nonnormally distributed, respectively. Comparisons were performed using a student T test, a Mann Whitney U test, a Chi Square test, or a Fisher exact test, as appropriate. A multivariate logistic regression was performed to test the association between dichotomic outcomes (mortality and myocardial injury) and cardiovascular risk factors and/or parameters of clinical interest for COVID-19 patients; strength of association is reported using odds ratios (OR). A by-group survival analysis was performed using Kaplan–Meier curves. Kaplan–Meier curves were compared first using a log-rank test for overall difference among the three groups, and then a post hoc all pair-wise comparisons was performed using a Bonferroni correction. A two-tailed p value < 0.05 was deemed as statistically significant. All statistical analyses were performed using STATA version 14.0 (Stata Corp, TX, USA).

3. Results

3.1. Baseline Characteristics

A total of 674 consecutive COVID-19 patients were prospectively enrolled, 112 (16.6%) of whom had an established history of CCS. CCS patients were significantly older than no-CCS patients and presented with more CV risk factors. Both CV (heart failure and atrial fibrillation) and non-CV (chronic obstructive pulmonary disease (COPD) and chronic kidney disease (CKD)) comorbidities were more frequent in the CCS group. Patients with CCS were more likely to receive CV medications. Baseline characteristics of the whole cohort are summarized in Table 1.
Clinical characteristics on admission are summarized in Table 2.
CCS patients were less likely to present to the ED with fever, cough, and sore throat, although no difference in the time interval between symptom onset and admission was found. Oxygen saturation (SaO2) and PaO2/FiO2 ratio were significantly lower among CCS patients. Patients with CCS had more severe findings on admission chest x-ray.

3.2. In-Hospital Outcomes

Median in-hospital stay, intensive care unit (ICU) admissions, and use of mechanical invasive ventilation were similar in the two groups. When compared to non-CCS patients, CCS patients received noninvasive ventilation (NIV) more frequently and developed ARDS more often. Myocardial injury occurred in 43.8% patients with CCS vs. 14.4% patients without CCS (p < 0.001), as confirmed by elevation of hs-cTn at admission or during hospitalization. The mortality rate in the CCS cohort was nearly three-fold higher.
The total data from in-hospital stay are summarized in Table 3.

3.3. Mortality and Outcome Predictors

At overall multivariate logistical regression, PaO2/FiO2 < 300, HF, age > 65 years, male gender, myocardial injury, and CCS were independently and significantly associated with an increased risk of death during hospitalization (Figure 1A and Table S1).
A stratification of in-hospital mortality between CCS and non-CCS was performed and is reported in Figure 1B and Table S2A,B. Myocardial injury was significantly associated with in-hospital mortality in the no-CCS group but not in CCS patients. A low PaO2/FiO2 ratio was a significant mortality predictor in both groups, while HF was a significant mortality predictor in non-CCS patients and reached borderline significance only in CCS patients. Of note, CCS patients without prior percutaneous coronary intervention (PCI) or coronary artery bypass graft (CABG) showed a trend towards significance for a higher risk of death. Figure 2 shows Kaplan–Meier survival curves for CCS patients, no-CCS patients, and no-CCS patients developing myocardial injury during in-hospital stay.
Both CCS and no-CCS patients with myocardial injury had a higher mortality than no-CCS patients (both < 0.001), while no difference between groups was found (log rank p = 0.171). A second multivariate analysis exploring predictors of myocardial injury is reported in Figure 1C,D and Tables S3 and S4A,B.

4. Discussion

Although studies assessing cardiovascular comorbidities in COVID-19 patients have been published, this study, to the best of our knowledge, is the first to be specifically focused on clinical outcomes associated with myocardial injury in patients with and without CCS.

4.1. Outcomes in CCS Patients

Our study shows that patients with CCS and COVID-19 have a very high mortality rate (42.0%), in line with a smaller cohort of patients with CV diseases described by Inciardi et al. [21] (36%). Nevertheless, the overall mortality rate (15.6%) was similar or lower than other studies that analyzed CV involvement in COVID-19 (Shi et al. [5], 13.7%; Guo et al. [24], 23%; Zhou et al. [1], 28%; Inciardi et al. [21], 26%; and Lala et al. [7], 18.5%). However, it should be underlined that, in the Lala et al. [7] cohort, 40.1% of patients were still hospitalized. Older age was found to be an independent risk factor for increased mortality, in line with the aforementioned studies and other reports [25,26] (median age of our cohort: 60.8 ± 15.9 years). Some have postulated that elderly patients have a hyperreactive proinflammatory profile [27], especially if suffering from hypertension and diabetes, as well as a reduction in ACE-2 levels and upregulation of angiotensin II proinflammatory pathway, that may explain higher mortality rates in patients > 65 years [28,29,30].
Obviously, patients with CCS have significantly more underlying CV risk factors and more comorbidities. Several studies have shown an association between chronic CV diseases and the development of severe complications associated with COVID-19 (including ARDS and death) [5,21,24] and higher fatality rates (10.5% for those with CV diseases vs. 0.9% in patients with no comorbidities in a Chinese report) [31]. Our findings are in line with these reports.
On admission, CCS patients presented with higher creatinine and lower hemoglobin, which seem to be an expression of underlining CKD and anemia, more than multiorgan involvement due to COVID-19 severity. CCS patients were treated with similar drug regimens (hydroxychloroquine, antibiotic, antiviral, and corticosteroids). The increased mortality observed in CCS patients occurred despite a more frequent use of tocilizumab, which indeed has not shown significant impact on the clinical outcomes in another study [32], and heparin, that may represent a useful treatment when lung disease is sufficiently severe [4].

4.2. Myocardial Injury and Mortality in CCS Patients

Myocardial injury has been shown to be a common condition among COVID-19 hospitalized patients and has been associated with higher risk of in-hospital mortality in general populations [1,2,3,5,7,33]. Our findings are in line with these studies regarding the prevalence of myocardial injury in COVID-19 patients (19.3% in our entire cohort vs. 12% [3], 7.2% [2], 17% [1], and 19.7% [5] in other reports), apart from the Lala et al. [7] study that reported elevation of cTn in 36% of patients.
At multivariate analysis (Figure 1A), myocardial injury was an independent predictor of mortality, for which importance was overshadowed by preexisting CCS (OR 2.5 [1.3–4.5] vs. 2.3 [1.1–5.1]). Several clinical conditions causing a mismatch between oxygen supply and demand, such as an hypoxemic respiratory failure or sepsis, may induce myocardial injury and have been proposed to explain these findings [5].
Additionally, an inflammatory state may trigger production of cytokines that can activate inflammatory cells in atherosclerotic plaques [34]. Thus, it can be hypothesized that a severe SARS-CoV-2 infection may destabilize CCS and, in turn, worsening of preexisting CCS could exacerbate COVID-19 course. However, a previous report (2009) [35] showed that, in 35% of patients with SARS-CoV infection, the SARS-CoV genome was positively detected in the heart, suggesting a possible direct SARS-CoV-2 damage to cardiomyocytes [24]. All these data seem to put in evidence two possible culprit mechanisms representing the extremes of a common pathogenesis spectrum behind the development of myocardial injury in COVID-19 patients (Figure 3).
In patients with a preexisting CCS, myocardial injury may be due predominantly to a worsening of the preexisting CCS condition due to an increased mismatch of the supply/delivery of oxygen, while in patients without a preexisting diagnosis of CCS, a direct myocardial damage (myocarditis-like) may have a relevant role. However, at present, there are no findings providing evidence of direct infection and replication of SARS-CoV-2 in cardiomyocytes [14].
When evaluating myocardial injury, it should be remembered that low levels of hs-cTn (slightly above the URL) can be detected in many CCS patients [18,36] and that also mild CCS is associated with quantifiable circulating levels of hs-cTn [37]. Hence, we performed a stratified analysis of multivariate clinical data in CCS and no-CCS patients (Figure 1D). Surprisingly, our analysis showed that myocardial injury is significantly associated with in-hospital death in no-CCS patients but not in CCS patients. Several reasons may explain this finding. First, in a sizable number of CCS patients, hs-cTn elevation may be associated with preexisting CAD, more than with an acute injury triggered by a pro-inflammatory state or hypoxemia, especially when hs-cTn is only slightly above the URL. This explanation is corroborated by well-known findings in patients with stable angina, among which the presence and extent of CAD is related with circulating levels of hs-cTn, and in the absence of ischemia, suggesting an ischemia-independent mechanism of hs-cTn release [38]. Moreover, interpretation of high hs-cTn levels may be problematic in patients with CKD, who are more likely to have hs-cTn elevation in the absence of clinical myocardial ischemia. Therefore, in these patients, hs-cTn should be measured sequentially when cardiac involvement is suspected [39].
Second, a trend towards significance shown in non-revascularized patients may support our findings, since patients with moderate stenoses not suitable for revascularization or who had stable CCS treated with medications, may be more susceptible to mismatch between oxygen supply or demand and therefore may have a higher risk of death (a subanalysis was not run given the paucity of the cohort, n = 26). On the other hand, patients with elevated hs-cTn but without preexisting CCS have less confounders that may lead to myocardial injury, and therefore, it is more likely that hs-cTn elevation represents a new-onset myocardial involvement which can significantly worsen prognosis and clinical outcomes. Myocardial injury in no-CCS patients may be more easily detected by hs-cTn elevation in contrast to what happens in CCS patients, in whom hs-cTn elevation is more likely a nonspecific finding.
Lastly, cardiac arrhythmia is a significant cause of morbidity and mortality in critically ill COVID-19 patients [17]. Although studies specifically focused on cardiac arrhythmias in COVID-19 are lacking, myocardial involvement with arrhythmic events has been described in a non-negligible number of patients [1,40,41], especially in the most critically ill. Apart from myocardial injury, it has to been postulated that cardiac arrhythmias may also be related to potential QT-prolonging drugs, with an inherent risk of ventricular arrhythmias and torsades de point. Nevertheless, last evidences point towards a general arrhythmic safety of hydroxychloroquine, azithromycin, and other QT-prolonging drugs administered in COVID-19 [42,43]. Unfortunately, arrhythmic data were not routinely collected in this subset of patients, mostly due to logistic difficulties in continuous heart rhythm monitoring during the pandemic. Further considerations on cardiac arrhythmias and myocardial injury related to direct damage to cardiomyocytes and systemic inflammation are difficult to provide in our cohort.

4.3. Limitations

Our study has several limitations. First, peak hs-cTn values were used in the analysis to define myocardial injury but a number of patients did not undergo serial hs-cTn measurements. Thus, the presence of myocardial injury may be underestimated. Moreover, a subanalysis using hs-cTn as a time-dependent variable was not prespecified in the study protocol and the data needed for an unbiased analysis were not routinely collected across the several centers involved. N-terminal pro-brain natriuretic peptide (NT-pro-BNP) values were not available in the majority of patients and are not reported in our analysis. Moreover, due to the logistic limitations of managing patients in isolation, electrocardiograms (ECGs) and echocardiograms as well as arrhythmic data that were not routinely collected with ECG continuous monitoring were acquired in a few patients only.

5. Conclusions

Patients with CCS and COVID-19 have a poor prognosis and a high mortality rate that was nearly three-fold higher than that observed in those without a known history of CCS. Although myocardial injury has been shown to be associated with worse outcomes in COVID-19, hs-cTn elevation had a prognostic value in non-CCS patients, while it was not predictive of poor outcomes in patients with CCS. Myocardial injury may be a bystander in CCS, whereas in patients without known history of CCS, it has a significant role in predicting poor outcomes. Further data are needed to understand proper mechanisms of myocardial injury in CCS and no-CCS patients with COVID-19.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/2077-0383/9/10/3263/s1. Table S1: Overall mortality predictors in multivariate logistical regression. Table S2: stratification of in-hospital mortality between CCS and non-CCS patients; Table S3: overall myocardial injury predictors in multivariate logistical regression; Table S4: stratification of myocardial injury between CCS and non-CCS patients.

Author Contributions

M.S.: conceptualization, data curation, formal analysis, investigation, methodology, software, validation, visualization, writing—original draft, and writing—review and editing; A.G. (Alessio Gasperetti): conceptualization, data curation, formal analysis, investigation, methodology, software, validation, visualization, writing—original draft, and writing—review and editing; M.M.: conceptualization, investigation, methodology, and supervision; A.V.K.: methodology, supervision, validation, and writing—review and editing; C.G.: investigation, visualization, writing—original draft, and writing—review and editing; G.M. (Giosuè Mascioli): data curation and investigation; M.B.: investigation, visualization, writing—original draft, and writing—review and editing; A.M.S.: methodology, supervision, and validation; G.M. (Gianfranco Mitacchione): data curation, investigation, visualization, and writing—review and editing; A.G. (Andrea Giacomelli): data curation and investigation; G.S.: methodology, supervision, and validation; M.V.: methodology, supervision, and validation; F.D.: methodology, supervision, and validation; S.A.: methodology, supervision, validation, and writing—review and editing; S.C.: methodology, supervision, and validation; A.L.B.: methodology, supervision, validation, and writing—review and editing; C.T.: methodology, supervision, and validation; M.G.: methodology, supervision, and validation; F.F.: methodology, supervision, and validation; and G.B.F.: conceptualization, investigation, methodology, project administration, supervision, validation, visualization, and writing—review and editing. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Conflicts of Interest

AMS owns shares from Gilead Sciences. All other authors declare no conflict of interest.

References

  1. Zhou, F.; Yu, T.; Du, R.; Fan, G.; Liu, Y.; Liu, Z.; Xiang, J.; Wang, Y.; Song, B.; Gu, X.; et al. Clinical course and risk factors for mortality of adult inpatients with COVID-19 in Wuhan, China: A retrospective cohort study. Lancet 2020, 395, 1054–1062. [Google Scholar] [CrossRef]
  2. Wang, D.; Hu, B.; Hu, C.; Zhu, F.; Liu, X.; Zhang, J.; Wang, B.; Xiang, H.; Cheng, Z.; Xiong, Y.; et al. Clinical Characteristics of 138 Hospitalized Patients with 2019 Novel Coronavirus-Infected Pneumonia in Wuhan, China. JAMA 2020, 323, 1061. [Google Scholar] [CrossRef] [PubMed]
  3. Huang, C.; Wang, Y.; Li, X.; Ren, L.; Zhao, J.; Hu, Y.; Zhang, L.; Fan, G.; Xu, J.; Gu, X.; et al. Clinical features of patients infected with 2019 novel coronavirus in Wuhan, China. Lancet 2020, 395, 497–506. [Google Scholar] [CrossRef] [Green Version]
  4. Schiavone, M.; Gasperetti, A.; Mancone, M.; Curnis, A.; Mascioli, G.; Mitacchione, G.; Busana, M.; Sabato, F.; Gobbi, C.; Antinori, S.; et al. Oral anticoagulation and clinical outcomes in COVID-19: An Italian multicenter experience. Int. J. Cardiol. 2020, 1–5. [Google Scholar] [CrossRef]
  5. Shi, S.; Qin, M.; Shen, B.; Cai, Y.; Liu, T.; Yang, F.; Gong, W.; Liu, X.; Liang, J.; Zhao, Q.; et al. Association of Cardiac Injury With Mortality in Hospitalized Patients With COVID-19 in Wuhan, China. JAMA Cardiol. 2020, 5, 802. [Google Scholar] [CrossRef] [Green Version]
  6. Peng, Y.; Xu, Y.-N.; Wang, B.; Yang, Y.-Y.; Liang, Z.-A.; Lei, X.-Z.; Ge, Y.; Yang, M.; Zhang, L.; Zeng, M.-Q.; et al. Acute myocardial injury is common in patients with COVID-19 and impairs their prognosis. Heart 2020, 106, 1154–1159. [Google Scholar] [CrossRef]
  7. Lala, A.; Johnson, K.W.; Januzzi, J.L.; Russak, A.J.; Paranjpe, I.; Richter, F.; Zhao, S.; Somani, S.; Van Vleck, T.; Vaid, A.; et al. Prevalence and Impact of Myocardial Injury in Patients Hospitalized With COVID-19 Infection. J. Am. Coll. Cardiol. 2020, 76, 533–546. [Google Scholar] [CrossRef]
  8. Li, X.; Guan, B.; Su, T.; Liu, W.; Chen, M.; Bin Waleed, K.; Guan, X.; Gary, T.; Zhu, Z. Impact of cardiovascular disease and cardiac injury on in-hospital mortality in patients with COVID-19: A systematic review and meta-analysis. Heart 2020, 106, 1142–1147. [Google Scholar] [CrossRef]
  9. Prasad, A.; Panhwar, S.; Hendel, R.C.; Sheikh, O.; Mushtaq, Z.; Dollar, F.; Vinas, A.; Alraies, C.; Almonani, A.; Nguyen, T.H.; et al. COVID-19 and the cardiovascular system: A review of current data, summary of best practices, outline of controversies, and illustrative case reports. Am. Heart J. 2020, 226, 174–187. [Google Scholar] [CrossRef]
  10. Babapoor-Farrokhran, S.; Gill, D.; Walker, J.; Rasekhi, R.T.; Bozorgnia, B.; Amanullah, A. Myocardial injury and COVID-19: Possible mechanisms. Life Sci. 2020, 253, 117723. [Google Scholar] [CrossRef]
  11. Kochi, A.N.; Tagliari, A.P.; Forleo, G.B.; Fassini, G.M.; Tondo, C. Cardiac and arrhythmic complications in patients with COVID-19. J. Cardiovasc. Electrophysiol. 2020, 31, 1003–1008. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  12. Kwong, J.C.; Schwartz, K.L.; Campitelli, M.A.; Chung, H.; Crowcroft, N.S.; Karnauchow, T.; Katz, K.; Ko, D.T.; McGeer, A.J.; McNally, D.; et al. Acute myocardial infarction after laboratory-confirmed influenza infection. N. Engl. J. Med. 2018, 378, 345–353. [Google Scholar] [CrossRef] [PubMed]
  13. Guan, X.; Yang, W.; Sun, X.; Wang, L.; Ma, B.; Li, H.; Zhou, J. Association of influenza virus infection and inflammatory cytokines with acute myocardial infarction. Inflamm. Res. 2012, 61, 591–598. [Google Scholar] [CrossRef] [PubMed]
  14. Imazio, M.; Klingel, K.; Kindermann, I.; Brucato, A.; De Rosa, F.G.; Adler, Y.; De Ferrari, G.M. COVID-19 pandemic and troponin: Indirect myocardial injury, myocardial inflammation or myocarditis? Heart 2020, 106, 1127–1131. [Google Scholar] [CrossRef]
  15. Schiavone, M.; Gobbi, C.; Biondi-Zoccai, G.; D’Ascenzo, F.; Palazzuoli, A.; Gasperetti, A.; Mitacchione, G.; Viecca, M.; Galli, M.; Fedele, F.; et al. Acute Coronary Syndromes and Covid-19: Exploring the Uncertainties. J. Clin. Med. 2020, 9, 1683. [Google Scholar] [CrossRef]
  16. Musher, D.M.; Abers, M.S.; Corrales-Medina, V.F. Acute infection and myocardial infarction. N. Engl. J. Med. 2019, 380, 171–176. [Google Scholar] [CrossRef]
  17. Babapoor-Farrokhran, S.; Rasekhi, R.T.; Gill, D.; Babapoor, S.; Amanullah, A. Arrhythmia in COVID-19. SN Compr. Clin. Med. 2020, 1–6. [Google Scholar] [CrossRef]
  18. Knuuti, J.; Wijns, W.; Achenbach, S.; Agewall, S.; Barbato, E.; Bax, J.J.; Capodanno, D.; Cuisset, T.; Deaton, C.; Dickstein, K.; et al. 2019 ESC guidelines for the diagnosis and management of chronic coronary syndromes. Eur. Heart J. 2019, 41, 407–477. [Google Scholar] [CrossRef]
  19. Omland, T.; De Lemos, J.A.; Sabatine, M.S.; Christophi, C.A.; Rice, M.M.; Jablonski, K.A.; Tjora, S.; Domanski, M.J.; Gersh, B.J.; Rouleau, J.L.; et al. A sensitive cardiac troponin T assay in stable coronary artery disease. N. Engl. J. Med. 2009, 361, 2538–2547. [Google Scholar] [CrossRef] [Green Version]
  20. Eggers, K.M.; Lagerqvist, B.; Venge, P.; Wallentin, L.; Lindahl, B. Persistent cardiac troponin I elevation in stabilized patients after an episode of acute coronary syndrome predicts long-term mortality. Circulation 2007, 116, 1907–1914. [Google Scholar] [CrossRef] [Green Version]
  21. Inciardi, R.M.; Adamo, M.; Lupi, L.; Cani, D.S.; Di Pasquale, M.; Tomasoni, D.; Italia, L.; Zaccone, G.; Tedino, C.; Fabbricatore, D.; et al. Characteristics and outcomes of patients hospitalized for COVID-19 and cardiac disease in Northern Italy. Eur. Heart J. 2020. [Google Scholar] [CrossRef] [PubMed]
  22. Ranieri, V.M.; Rubenfeld, G.D.; Thompson, B.T.; Ferguson, N.D.; Caldwell, E.; Fan, E.; Camporota, L.; Slutsky, A.S. Acute respiratory distress syndrome: The Berlin definition. JAMA 2012, 307, 2526–2533. [Google Scholar] [CrossRef] [PubMed]
  23. Taylor, E.; Haven, K.; Reed, P.; Bissielo, A.; Harvey, D.; McArthur, C.; Bringans, C.; Freundlich, S.; Ingram, R.J.H.; Perry, D.; et al. A chest radiograph scoring system in patients with severe acute respiratory infection: A validation study. BMC Med. Imaging 2015, 15, 1–10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  24. Guo, T.; Fan, Y.; Chen, M.; Wu, X.; Zhang, L.; He, T.; Wang, H.; Wan, J.; Wang, X.; Lu, Z. Cardiovascular Implications of Fatal Outcomes of Patients with Coronavirus Disease 2019 (COVID-19). JAMA Cardiol. 2020, 5, 811–818. [Google Scholar] [CrossRef] [Green Version]
  25. Richardson, S.; Hirsch, J.S.; Narasimhan, M.; Crawford, J.M.; McGinn, T.; Davidson, K.W.; Barnaby, D.P.; Barnaby, D.P.; Becker, L.B.; Chelico, J.D.; et al. Presenting Characteristics, Comorbidities, and Outcomes among 5700 Patients Hospitalized with COVID-19 in the New York City Area. JAMA 2020, 323, 2052. [Google Scholar] [CrossRef]
  26. Grasselli, G.; Zangrillo, A.; Zanella, A.; Antonelli, M.; Cabrini, L.; Castelli, A.; Cereda, D.; Coluccello, A.; Foti, G.; Fumagalli, R.; et al. Baseline Characteristics and Outcomes of 1591 Patients Infected with SARS-CoV-2 Admitted to ICUs of the Lombardy Region, Italy. JAMA 2020, 323, 1574. [Google Scholar] [CrossRef] [Green Version]
  27. Giacomelli, A.; Ridolfo, A.L.; Milazzo, L.; Oreni, L.; Bernacchia, D.; Siano, M.; Bonazzetti, C.; Schiuma, M.; Covizzi, A.; Passerini, M.; et al. 30-day mortality in patients hospitalized with COVID-19 during the first wave of the Italian epidemic: A prospective cohort study. Pharmacol. Res. 2020, 158, 104931. [Google Scholar] [CrossRef]
  28. AlGhatrif, M.; Cingolani, O.; Lakatta, E.G. The Dilemma of Coronavirus Disease 2019, Aging, and Cardiovascular Disease: Insights from Cardiovascular Aging Science. JAMA Cardiol. 2020, 5, 747. [Google Scholar] [CrossRef] [Green Version]
  29. Rodrigues Prestes, T.R.; Rocha, N.P.; Miranda, A.S.; Teixeira, A.L.; Simoes-e-Silva, A.C. The Anti-Inflammatory Potential of ACE2/Angiotensin-(1-7)/Mas Receptor Axis: Evidence from Basic and Clinical Research. Curr. Drug Targets 2017, 18, 1301–1313. [Google Scholar] [CrossRef]
  30. Lakatta, E.G. The reality of getting old. Nat. Rev. Cardiol. 2018, 15, 499–500. [Google Scholar] [CrossRef]
  31. Yang, C.; Jin, Z. An Acute Respiratory Infection Runs into the Most Common Noncommunicable Epidemic-COVID-19 and Cardiovascular Diseases. JAMA Cardiol. 2020, 5, 743. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Morena, V.; Milazzo, L.; Oreni, L.; Bestetti, G.; Fossali, T.; Bassoli, C.; Torre, A.; Vittoria, M.; Minari, C.; Ballone, E.; et al. Off-label use of tocilizumab for the treatment of SARS-CoV-2 pneumonia in Milan, Italy. Eur. J. Intern. Med. 2020, 76, 36–42. [Google Scholar] [CrossRef] [PubMed]
  33. Inciardi, R.M.; Lupi, L.; Zaccone, G.; Italia, L.; Raffo, M.; Tomasoni, D.; Cani, D.S.; Cerini, M.; Farina, D.; Gavazzi, E.; et al. Cardiac Involvement in a Patient with Coronavirus Disease 2019 (COVID-19). JAMA Cardiol. 2020. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Mauriello, A.; Sangiorgi, G.; Fratoni, S.; Palmieri, G.; Bonanno, E.; Anemona, L.; Schwartz, R.S.; Spagnoli, L.G. Diffuse and active inflammation occurs in both vulnerable and stable plaques of the entire coronary tree: A histopathologic study of patients dying of acute myocardial infarction. J. Am. Coll. Cardiol. 2005, 45, 1585–1593. [Google Scholar] [CrossRef]
  35. Oudit, G.Y.; Kassiri, Z.; Jiang, C.; Liu, P.P.; Poutanen, S.M.; Penninger, J.M.; Butany, J. SARS-coronavirus modulation of myocardial ACE2 expression and inflammation in patients with SARS. Eur. J. Clin. Investig. 2009, 39, 618–625. [Google Scholar] [CrossRef]
  36. Baker, J.O.; Reinhold, J.; Redwood, S.; Marber, M.S. Troponins: Redefining their limits. Heart 2010, 97, 447–452. [Google Scholar] [CrossRef]
  37. Laufer, E.M.; Mingels, A.M.A.; Winkens, M.H.M.; Joosen, I.A.P.G.; Schellings, M.W.M.; Leiner, T.; Wildberger, J.E.; Narula, J.; Van Dieijen-Visser, M.P.; Hofstra, L. The extent of coronary atherosclerosis is associated with increasing circulating levels of high sensitive cardiac troponin T. Arterioscler. Thromb. Vasc. Biol. 2010, 30, 1269–1275. [Google Scholar] [CrossRef]
  38. Caselli, C.; Prontera, C.; Liga, R.; De Graaf, M.A.; Gaemperli, O.; Lorenzoni, V.; Ragusa, R.; Marinelli, M.; Del Ry, S.; Rovai, D.; et al. Effect of Coronary Atherosclerosis and Myocardial Ischemia on Plasma Levels of High-Sensitivity Troponin T and NT-proBNP in Patients with Stable Angina. Arter. Thromb. Vasc. Biol. 2016, 36, 757–764. [Google Scholar] [CrossRef] [Green Version]
  39. Kanderian, A.S.; Francis, G.S. Cardiac troponins and chronic kidney disease. Kidney Int. 2006, 69, 1112–1114. [Google Scholar] [CrossRef] [Green Version]
  40. Gao, C.; Wang, Y.; Gu, X.; Shen, X.; Zhou, D.; Zhou, S.; Huang, J.A.; Cao, B.; Guo, Q. Association between cardiac injury and mortality in hospitalized patients infected with avian influenza a (H7N9) virus. Crit. Care Med. 2020, 48, 451–458. [Google Scholar] [CrossRef]
  41. Mitacchione, G.; Schiavone, M.; Gasperetti, A.; Forleo, G.B. Ventricular tachycardia storm management in a COVID-19 patient: A case report. Eur. Heart J. Case Rep. 2020. [Google Scholar] [CrossRef]
  42. Gasperetti, A.; Biffi, M.; Duru, F.; Schiavone, M.; Ziacchi, M.; Mitacchione, G.; Lavalle, C.; Saguner, A.; Lanfranchi, A.; Casalini, G.; et al. Arrhythmic safety of hydroxychloroquine in COVID-19 patients from different clinical settings. EP Eur. 2020. [Google Scholar] [CrossRef] [PubMed]
  43. Saleh, M.; Gabriels, J.; Chang, D.; Fishbein, J.; Qiu, M.; Mountantonakis, S.E.; Epstein, L.M. Safely Administering Potential QTc Prolonging Therapy Across a Large Healthcare System in the COVID-19 Era. Circ. Arrhythm. Electrophysiol. 2020. [Google Scholar] [CrossRef] [PubMed]
Figure 1. shows multivariate logistical regression analysis. Panel A: overall multivariate logistical regression for mortality. Panel B: stratification of in-hospital mortality between CCS and non-CCS patients. Panel C: overall multivariate logistical regression for myocardial injury. Panel D: stratification of myocardial injury between CCS and non-CCS patients. Abbreviations: CCS: chronic coronary syndromes; CKD: chronic kidney disease; COPD: chronic obstructive pulmonary disease; Hb: hemoglobin; HF: heart failure; P/F: PaO2/FiO2 ratio; ys: years.
Figure 1. shows multivariate logistical regression analysis. Panel A: overall multivariate logistical regression for mortality. Panel B: stratification of in-hospital mortality between CCS and non-CCS patients. Panel C: overall multivariate logistical regression for myocardial injury. Panel D: stratification of myocardial injury between CCS and non-CCS patients. Abbreviations: CCS: chronic coronary syndromes; CKD: chronic kidney disease; COPD: chronic obstructive pulmonary disease; Hb: hemoglobin; HF: heart failure; P/F: PaO2/FiO2 ratio; ys: years.
Jcm 09 03263 g001
Figure 2. Kaplan–Meier survival curves for CCS patients, no-CCS patients, and no-CCS patients developing myocardial injury during in-hospital stay. Abbreviations: CCS: chronic coronary syndromes.
Figure 2. Kaplan–Meier survival curves for CCS patients, no-CCS patients, and no-CCS patients developing myocardial injury during in-hospital stay. Abbreviations: CCS: chronic coronary syndromes.
Jcm 09 03263 g002
Figure 3. culprit mechanisms behind the development of myocardial injury in COVID-19. Abbreviations: CCS: chronic coronary syndromes; CO: cardiac output; Hb: hemoglobin.
Figure 3. culprit mechanisms behind the development of myocardial injury in COVID-19. Abbreviations: CCS: chronic coronary syndromes; CO: cardiac output; Hb: hemoglobin.
Jcm 09 03263 g003
Table 1. Baseline characteristics of the study cohort.
Table 1. Baseline characteristics of the study cohort.
Overall
(n = 674)
CCS
(n = 112)
No-CCS
(n = 562)
p
Age (years), mean ± s.d.60.8 ± 15.975.3 ± 10.158.0 ± 15.2<0.001
Sex (male), n (%)406 (60.2)75 (67)331 (58.9)0.111
Main cardiovascular risk factors, n (%)
Hypertension280 (41.5)89 (79.5)191 (31)<0.001
Diabetes101 (15.0)40 (35.7)61 (10.8)<0.001
Dyslipidemia145 (21.5)64 (57.1)81 (14.4)<0.001
Smoke130 (19.3)71 (63.4)59 (10.5)<0.001
Comorbidities, n (%)
Heart failure111 (16.5)76 (67.9)35 (6.2)<0.001
History of atrial fibrillation53 (7.9)26 (23.2)27 (4.8)<0.001
Chronic kidney disease85 (12.3)26 (23.1)59 (10.5)<0.001
Chronic obstructive pulmonary disease46 (6.8)16 (14.3)30 (5.3)<0.001
Cancer43 (6.4)15 (13.4)28 (5)<0.001
Drug therapy, n (%)
ACE-inhibitors102 (15.2)44 (39.3)58 (10.3)<0.001
ARBs111 (16.5)45 (40.2)66 (11.7)<0.001
Beta-blockers150 (22.3)78 (69.6)72 (12.8)<0.001
Calcium-antagonists73 (10.8)22 (19.6)51 (9.1)<0.001
Diuretics96 (14.2)46 (41.1)50 (8.9)<0.001
VKAs14 (2.1)7 (6.2)7 (1.3)<0.001
DOACs30 (4.4)11 (9.8)19 (3.4)0.003
Antiplatelets130 (19.3)108 (96.4)22 (3.9)<0.001
Statins156 (23.1)93 (83.0)63 (11.2)<0.001
Prior revascularization (PCI and/or CABG), n (%)86 (76.8)86 (78.6)NANA
Abbreviations: ACE: angiotensin-converting enzyme; ARBs: angiotensin II receptor blockers; CABG: coronary artery bypass graft; CCS: chronic coronary syndromes; DOAC: direct anticoagulants; NA: not available; PCI: percutaneous coronary intervention; s.d.: standard deviation; VKAs: vitamin k antagonists. Bold text indicates a statistically significant difference with a p-value <0.05.
Table 2. Characteristics on admission.
Table 2. Characteristics on admission.
Overall
(n = 674)
CCS
(n = 112)
No-CCS
(n = 562)
p
Symptoms, n (%)
Fever545 (80.9)68 (60.7)477 (84.9)<0.001
Cough500 (74.2)64 (57.1)436 (77.6)<0.001
Shortness of breath307 (45.5)58 (51.8)249 (44.3)0.147
Sore throat149 (22.1)11 (9.8)138 (24.6)<0.001
Myalgia96 (14.2)12 (10.7)84 (14.9)0.242
Laboratory findings, median [IQR]
WBC (109/L)5.91 [4.55–8.15]6.7 [4.98–10.2]5.8 [4.41–7.85]<0.001
Neutrophils (103/μL)4.1 [2.89–6.18]5 [3.4–7.49]4.01 [2.81–6]<0.001
Lymphocytes (103/μL)1 [0.70–1.42]0.8 [0.6–1.21]1.05 [0.74–1.46]<0.001
Monocytes (103/μL)0.43 [0.3–0.63]0.49 [0.3–0.7]0.42 [0.29–0.62]0.056
Hb (g/dl)13.8 [12.8–14.8]13 [11.5–14.1]13.9 [13–14.9]<0.001
Platelets (109/L)195 [154–259]197 [148–282]195 [154–255]0.809
Creatinine (mg/dl)0.93 [0.78–1.13]1.1 [0.9–1.6]0.9 [0.76–1.1]<0.001
Sodium (mmol/L)138 [136–140]139 [135–141]138 [136–140]0.09
Potassium (mmol/L)3.9 [3.6–4.2]3.9 [3.6–4.3]3.8 [3.5–4-2]0.04
CK (U/L)101 [60–187]98.5 [48–237]101 [61–181]0.698
LDH (U/L)311 [239–411]355 [286–490]304 [235–389]<0.001
ALT (U/L)29 [19–48]29 [19–54]29 [20–47]0.817
CRP (mg/L)25.4 [6.7–92.5]15.9 [7.5–50]30 [6.5–100]0.075
Chest radiograph severity scoring system (Taylor et. al), median [IQR]2 [2–3]3 [2–4]2 [2–3]<0.001
Symptom onset to admission (days), median [IQR]7 [3–10]7 [3–10]7 [3–10]0.98
Vital status
Heart rate (bpm), median [IQR]88 [75–100]78 [70–90]88 [78–100]<0.001
Respiratory rate (rpm), median [IQR]20 [20–22]20 [18–20]20 [20–23]<0.001
SBP (mmHg), mean± sd130 ± 20133 ± 22130 ± 180.133
DBP (mmHg), mean± sd77 ± 1276 ± 1478 ± 120.097
MBP (mmHg), mean± sd96 ± 19101 ± 3795 ± 130.002
Arterial blood gas analysis
SaO2 (%), mean± sd95 ± 193 ± 195 ± 1<0.001
pH, mean± sd7.45 ± 0.057.45 ± 0.057.46 ± 0.050.434
PaO2 (mmHg), median [IQR]77 [65–90]77 [62–89]77 [65–91]0.453
PaCO2 (mmHg), median [IQR]34 [31–37]33 [31–36]34 [31–37]0.573
PaO2/FiO2, median [IQR]329 [248–395]248 [136–342]333 [266–395]<0.001
Abbreviations: ALT: alanine aminotransferase; CCS: chronic coronary syndromes; CK: creatine kinase; CRP: C-reactive protein; DBP: diastolic blood pressure; FiO2: fraction of inspired oxygen; Hb: hemoglobin; IQR: interquartile range; LDH: lactate dehydrogenase; MBP: mean blood pressures; NA: not available; PaCO2: partial pressure of carbon dioxide in arterial blood; PaO2: partial pressure of oxygen in arterial blood; s.d.: standard deviation; SaO2: oxygen saturation; SBP: systolic blood pressure; WBC: white blood cells. Bold text indicates a statistically significant difference with a p-value <0.05.
Table 3. Drug therapy and clinical outcomes during hospital stay.
Table 3. Drug therapy and clinical outcomes during hospital stay.
Overall
(n = 674)
CCS
(n = 112)
No-CCS
(n = 562)
p
Drug therapy, n (%)
Antibiotics327 (48.5)58 (51.8)269 (47.9)0.448
Antivirals367 (54.4)56 (50)311 (55.3)0.3
Steroids87 (12.9)16 (14.3)71 (12.6)0.634
Hydroxychloroquine520 (77.1)86 (76.8)434 (77.2)0.92
Tocilizumab126 (18.7)13 (11.6)113 (20.1)0.035
Heparin294 (43.6)67 (59.8)227 (40.4)<0.001
Deaths, n (%)105(15.6)47 (42.0)58 (10.3)<0.001
Intensive care unit admission, n (%)46 (6.8)6 (5.4)40 (7.1)0.5
Mechanical ventilation, n (%)42 (6.2)6 (5.4)36 (6.4)0.675
Non-invasive ventilation, n (%)207 (30.7)49 (43.8)158 (28.1)<0.001
Acute respiratory distress syndrome, n (%)99 (14.7)46 (41.1)53 (9.4)<0.001
Hospital length of stay (days), median [IQR]10 [6–16]11 [7–17]10 [5–16]0.189
Myocardial injury, n (%)130 (19.3)49 (43.8)81 (14.4)<0.001
Cardiac troponin (ng/L), median [IQR]18 [8–40]42 [21–75]13 [6–27]<0.001
Abbreviations: CCS: chronic coronary syndromes; IQR: interquartile range. Bold text indicates a statistically significant difference with a p-value <0.05.

Share and Cite

MDPI and ACS Style

Schiavone, M.; Gasperetti, A.; Mancone, M.; Kaplan, A.V.; Gobbi, C.; Mascioli, G.; Busana, M.; Saguner, A.M.; Mitacchione, G.; Giacomelli, A.; et al. Redefining the Prognostic Value of High-Sensitivity Troponin in COVID-19 Patients: The Importance of Concomitant Coronary Artery Disease. J. Clin. Med. 2020, 9, 3263. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm9103263

AMA Style

Schiavone M, Gasperetti A, Mancone M, Kaplan AV, Gobbi C, Mascioli G, Busana M, Saguner AM, Mitacchione G, Giacomelli A, et al. Redefining the Prognostic Value of High-Sensitivity Troponin in COVID-19 Patients: The Importance of Concomitant Coronary Artery Disease. Journal of Clinical Medicine. 2020; 9(10):3263. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm9103263

Chicago/Turabian Style

Schiavone, Marco, Alessio Gasperetti, Massimo Mancone, Aaron V. Kaplan, Cecilia Gobbi, Giosuè Mascioli, Mattia Busana, Ardan M. Saguner, Gianfranco Mitacchione, Andrea Giacomelli, and et al. 2020. "Redefining the Prognostic Value of High-Sensitivity Troponin in COVID-19 Patients: The Importance of Concomitant Coronary Artery Disease" Journal of Clinical Medicine 9, no. 10: 3263. https://0-doi-org.brum.beds.ac.uk/10.3390/jcm9103263

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop