Next Article in Journal
A Single Session of Virtual Reality Improved Tiredness, Shortness of Breath, Anxiety, Depression and Well-Being in Hospitalized Individuals with COVID-19: A Randomized Clinical Trial
Next Article in Special Issue
Alzheimer’s Disease CSF Biomarker Profiles in Idiopathic Normal Pressure Hydrocephalus
Previous Article in Journal
Association between Statin Use and Risk of Parkinson’s Disease: Evidence from 18 Observational Studies Comprising 3.7 Million Individuals
Previous Article in Special Issue
MicroRNA-Target Interaction Regulatory Network in Alzheimer’s Disease
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Altered TIMP-3 Levels in the Cerebrospinal Fluid and Plasma of Patients with Alzheimer’s Disease

1
Department of Chronic Disease Convergence Research, Division of Brain Disease Research, Korea National Institute of Health, 187 Osongsaengmyeong2-ro, Osong-eup, Heungdeok-gu, Cheongju-si 28159, Korea
2
Departments of Neurology, Korea University Medical College, Ansan Hospital, 123 Jeokgeum-ro, Danwon-gu, Ansan-si 15355, Korea
3
Departments of Psychiatry, Korea University Medical College, Ansan Hospital, 123 Jeokgeum-ro, Danwon-gu, Ansan-si 15355, Korea
4
Department of Neurology, Pusan National University Hospital, 179 Gudeok-ro, Seo-gu, Busan 49241, Korea
5
Department of Forensic Medicine, Pusan National University School of Medicine, 49 Busandaehak-ro, Mulgeum-eup, Yangsan-si 50612, Korea
*
Author to whom correspondence should be addressed.
These authors contributed equally to this work.
Submission received: 28 March 2022 / Revised: 7 May 2022 / Accepted: 14 May 2022 / Published: 19 May 2022
(This article belongs to the Special Issue Molecular Biomarkers and Precision Medicine for Alzheimer)

Abstract

:
Tissue inhibitor of metalloproteinase-3 (TIMP-3) is a component of the extracellular environment and is suggested to play an indirect role in regulating Aβ production and the pathophysiology of Aβ deposition in brains. However, studies on the amount of TIMP-3 in bodily fluids of Alzheimer’s disease (AD) patients have not been conducted. Here, we investigated the relationship between fluid TIMP-3 levels and AD pathology. We first showed that the fluid levels of TIMP-3 were lower in AD dementia patients compared with in non-AD patients. ELISA results revealed that plasma levels of TIMP-3 in 65 patients with AD were significantly lower than those in 115 healthy control subjects and 71 mild cognitive impairment (MCI) subjects. Furthermore, we found that cerebrospinal fluid (CSF) level of TIMP-3 was decreased in AD compared with that in healthy control. These data suggest that fluid TIMP-3 levels negatively correlated with progress of cognitive decline. Collectively, our study suggests that alterations of fluid TIMP-3 levels might be associated with AD pathology.

1. Introduction

Alzheimer’s disease (AD) is a progressive neurodegenerative disease in which cognitive impairments are typically preceded by extracellular deposition of characteristic diffuse and insoluble plaques in the brain [1,2]. It is also one of the most common types of dementia and an important cause of mortality in elderly persons [3]. Since the major pathological hallmark of AD is the formation of neuritic plaques composed of amyloid-β (Aβ) peptides, clinical studies targeting Aβ have been reported over the past decades.
In recent years, metalloproteinases (MMPs) and a disintegrin and metalloproteinases (ADAMs) have been found to play a role in AD [4,5]. For instance, ADAM-10 and ADAM-17 have been reported to lead to increasing secretion of soluble amyloid precursor protein (APP) fragments and reduction of Aβ generation [6]. A recent study reported that fluid levels of ADAM-10 are increased in AD patients [7]. MMP-9 also has been extensively studied because of its potential role in amyloid clearance. It has been already reported that MMPs are elevated in the postmortem brains of AD patients [8,9].
Tissue inhibitors of metalloproteinases (TIMPs) are proteins that play an important role because they reversibly inhibit enzymes such as the zinc protease superfamily, predominantly MMPs and ADAMs [10]. Since altered regulation of MMPs can result in cancer, inflammatory diseases, and degenerative diseases [11,12,13,14], studies targeting TIMPs have also reported that TIMPs widely influence various disease pathologies. Many studies demonstrate that TIMPs can be used as biomarkers for various diseases including cancer and strokes [15,16,17]. Furthermore, plasma and CSF levels of MMPs (MMP-1, MMP-2, and MMP-9) and TIMPs (TIMP-1 and TIMP-2) were altered in various types of dementia [8,18,19].
Among the TIMP family, TIMP-3 is the only extracellular matrix (ECM)-bound TIMP [20], and it has broadest range of substrates, including all MMPs. Furthermore, TIMP-3 is the only member of the TIMP family that is capable of inhibiting ADAM-10 and ADAM-17 [21,22]. Therefore, TIMP-3 plays an indirect role in regulating the amyloidogenic pathway and Aβ production. Recent research indicates that TIMP-3 protein levels were increased in human AD brain and APP transgenic mice, suggesting that increased levels of TIMP-3 in AD may contribute to Aβ accumulation [23]. There have also been reports of a significantly increased TIMP-3 in aged/CAA leptomeningeal arteries, which indicate that regulation of the ECM is involved in the pathophysiology of Aβ deposition in the cerebral vessels [24]. Although many clinical studies have been conducted on the associations with various diseases by targeting fluid levels of TIMPs, the relationship between TIMP-3 and AD still remains unknown. In a previous study, we reported that the plasma levels of vascular growth factor receptor 2 (VEGFR-2) were altered in patients with AD [25]. As a major VEGFR-2 signal regulator, TIMP-3 has been reported to inhibit angiogenesis by decreasing VEGF-VEGFR-2 interaction [26].
Therefore, we hypothesized that TIMP-3 fluid levels may be altered in patients with AD. As little is known about the clinical significance of plasma levels of TIMP-3, we screened TIMP-3 levels in the plasma of subjects with mild cognitive impairment (MCI) as well as in AD patients and compared them with healthy controls. Furthermore, we evaluated whether TIMP-3 levels were altered in the CSF of patients with AD. Fluid TIMP-3 levels were negatively correlated with the progression of AD. These results highlight the importance of TIMP-3 as a potent biomarker for AD.

2. Material & Methods

2.1. Human Blood Samples

The subjects, including healthy controls, MCI, and dementia, participated in this study, designated from the population-based Ansan Geriatric (AGE) cohort, which was established to study common geriatric diseases in elderly Koreans aged 60 to 84 years [27,28,29]. The sampling protocol and design of the AGE study have been previously described [28,30]. Each patient with dementia met the criteria for the Diagnostic and Statistical Manual of Mental Disorders, fourth edition. Subjects with cognitive and memory impairment were assessed using the Korean version of the Consortium to Establish a Registry for Alzheimer’s Disease (CERAD-K) neuropsychological battery as previously described [31]. All dementia patients met the criteria for probable AD, as established by the National Institute of Neurological and Communicative Disorders and Stroke and the Alzheimer’s Disease and Related Disorders Association (NINCDS-ADRDA). The diagnosis of MCI was based on the Mayo Clinic criteria as previously described [32,33]. In total, blood samples from 251 subjects were collected, and the demographic and clinical variables of each participant are shown in Table 1. This study was approved by the Institutional Review Board (IRB) of the Korea Disease Control and Prevention Agency (KDCA) with approval number (2016-02-22-P-A, 2017-05-05-P-A, 2020-03-04-P-A). All the processes in this study were performed following the relevant guidelines and regulations.

2.2. CSF Sampling

Human CSF was obtained from and provided by the Pusan National University Hospital Brain Bank (PNUHBB). Each subject signed an informed consent form before their inclusion. All procedures were performed according to the relevant guidelines and regulations [34]. All participants were examined by a neurologist who specialized in neurodegenerative diseases, followed by a clinical interview, and a neurological examination [35]. Patients with MCI met both the NIA-AA core clinical criteria for MCI and the modified Petersen’s criteria [36]. All patients with AD dementia (ADD) satisfied the NIA-AA core clinical criteria for probable ADD [37].
For CSF collection, CSF samples from 30 subjects were collected as previously described [34]. CSF samples were analyzed at the Research Institute for Convergence of Biomedical Science and Technology at Pusan National University Yangsan Hospital (PNUYH). CSF Aβ1-42, total Tau, and pTau181 levels were measured with the INNOTEST ELISA kit (Fujirebio Diagnostics, Ghent, Belgium) following the manufacturer’s instructions [34].

2.3. Cell Cultures

Human iPSC-derived neuronal cells were obtained from Axol Biosciences (Little Chesterford, UK). The cells were differentiated into cerebral cortical neurons in approximately 7 days following the manufacturer’s protocol. Cells were cultured in a humidified atmosphere of 5% CO2 at 37 °C.

2.4. Animals

APPsw/PS1ΔE9 transgenic mice were used for this study, as previously reported [38]. All experiments were approved by the Institutional Animal Care and Use Committee (IACUC) of the KDCA and conducted in accordance with the guidelines for the care and use of laboratory animals by the KDCA.

2.5. Antibodies and Reagents

The anti-TIMP-3 antibody (AB6000) was purchased from EMD Millipore (Darmstadt, Germany). Anti-β-actin (A5316) antibody was purchased from Sigma-Aldrich (St. Louis, MO, USA). Anti-Aβ (6E10, SIG39300) was purchased from Convance (Denver, PA, USA). Alexa Fluor 488 goat anti-mouse IgG and Alexa Fluor 594 goat anti-rabbit IgG were obtained from Molecular Probes (Eugene, OR, USA).

2.6. Measurement of Blood Proteins by ELISA

All plasma samples were aliquoted and stored at −80 °C until assayed collectively by an investigator who was blinded to patient assignment. The levels of TIMP-3 were determined by the ELISA kit (USCN, Wuhan, China) following the recommended manufacturer’s protocol.

2.7. Western Blotting

The protein concentrations were measured with Bradford method (Bio-Rad, Hercules, CA, USA) protein assays following the manufacturer’s protocol. Proteins were resolved by 4–12% NuPAGE gel (Invitrogen) and transferred onto nitrocellulose membranes. Membranes were blocked in TBS with 5% nonfat dry milk and 0.1% Tween 20 and incubated with the primary antibody at 4 °C for overnight and washed. Membranes were incubated with horseradish peroxidase (HRP) anti-rabbit and anti-mouse secondary antibody. Protein bands were detected with a chemiluminescence kit (Amersham Pharmacia Biotech, Buckinghamshire, UK)

2.8. Real-Time Reverse Transcription Polymerase Chain Reaction

Real-time quantitative polymerase chain reaction (RT-PCR) analysis was performed with SYBR Green PCR core reagent in a two-step RT-PCR protocol according to the manufacturer’s protocol (Applied Biosystems, Warrington, UK). The primer sequences for the RT-PCR experiments were as follows: TIMP-3 sense 5′-CAAGATGCCCATGTGCAGT-3′ and antisense 5′-GCCATCATAGACGCGACCTG-3′. GAPDH sense 5′-CAGCCTCAAGATCATCAGCA-3′ and antisense 5′-TGTGGTCATGAGTCCTTCCA-3′. The relative TIMP-3 level was normalized to the GAPDH levels. PCR reactions were performed using ABI Prism 7900 SDS (Applied Biosystems, Warrington, UK).

2.9. Immunofluorescence Assay

Anesthetized mice were perfused with PBS, and tissues were harvested rapidly. Obtained brain tissues were fixed with 4% paraformaldehyde and then transferred to 30% sucrose solution. OCT compound-embedded brains were sectioned to 20 μm and mounted on glass slides. For the immunohistochemical analyses, each brain section was permeabilized with 0.03% Triton X-100 in PBS, blocked with 5% normal goat serum at room temperature, and incubated with the appropriate primary antibodies overnight. The next day, sections were washed and incubated with secondary antibodies. Labeled brain sections were visualized by fluorescence microscope (Zeiss, Germany).

2.10. Statistical Analyses

The results are expressed as mean ± SD and mean ± SEM. The Mann-Whitney U-test and the Kruskal-Wallis test were used to analyze the demographic and clinical variables within groups. Correlation between factors was checked using Spearman’s method. Statistical analyses of the present study were performed using SPSS 12.0 (IBM, Armonk, NY, USA). A p value less than 0.05 was considered statistically significant.

3. Results

We previously reported that TIMP-3 expression is increased by Aβ in vitro [25]. In particular, because TIMP-3 levels are elevated upon Aβ treatment, we wondered whether TIMP-3 expression was also altered in an AD mice brain. As shown in Figure 1A, we confirmed the increase of TIMP-3 in brain cortex regions of 20-month-old APP Swedish/PS1delE9 Tg (APP Tg) mice. To assess changes in TIMP-3 expression in AD mice, we also performed immunostaining with anti-TIMP-3 and anti-Aβ (6E10) in WT and APP Tg mice. We found that the deposition of TIMP-3 was enhanced in APP Tg mice (Figure 1B). Furthermore, we also monitored the plasma TIMP-3 levels in WT and APP Tg mice. The plasma concentration of TIMP-3 was decreased but not significantly in APP Tg mice compared with in WT mice (Figure 1C).
We then examined the TIMP-3 expression in human iPSC-derived neuronal cells from AD patients. Once the cells were differentiated to neurons, the TIMP-3 mRNA levels were slightly increased in AD patients compared with healthy controls (Figure 2).
Next, we investigated whether elevated TIMP-3 is correlated with bodily fluid levels. We first compared the levels of TIMP-3 in the plasma from 251 subjects with dementia, subjects with MCI, and healthy controls. The demographic and clinical variables of participants are shown in Table 1. The mean age of the normal control participants was 71.9 ± 0.43 years, and it was 73.05 ± 0.54 years for the subjects with MCI. The mean age of the dementia participants was 75.1 ± 0.75 years.
Dementia participants were less educated than the normal control participants. The MMSE score was lower in dementia groups but in the normal range in the control and MCI groups. Interestingly, the plasma concentrations of TIMP-3 were significantly lower in the dementia group (0.39 ± 0.05 ng/mL) compared with the control group (0.6 ± 0.06 ng/mL) in the Mann-Whitney U-test results (p = 0.029) (Figure 3). Analysis of clinical characteristics showed in Table 2 that plasma TIMP-3 levels were negatively correlated with CDR scores (r = −0.153; p = 0.015). Plasma TIMP-3 levels were also negatively correlated with LDL cholesterol (r = −0.142; p = 0.025) and glucose (r = −0.127; p = 0.046).
We also investigated the CSF levels of TIMP-3 to clarify whether fluid levels of TIMP-3 are related to clinically overt ADD. Patient characteristics are presented in Table 3.
Patients with ADD were older than the control and MCI groups. The mean age of the normal control participants (3 males, 7 females) was 63.8 ± 3.8 years, an in patients with MCI (3 males, 7 females), it was 63.6 ± 3.7 years; in patients with ADD (5 males, 5 females), it was 68.1 ± 3.3 years. Furthermore, concentrations of Aβ1-42, total Tau, and phosphorylated-Tau (pTau) were measured with ELISA. As expected, the CSF levels of Aβ1-42 were different among the three groups (p < 0.001; Kruskal-Wallis test). The CSF Aβ1-42 concentrations were lower in patients with ADD (401.3 ± 27.4 pg/mL) and MCI (766.3 ± 70.9 pg/mL) compared with the control subjects (1030.1 ± 32.6 pg/mL). The CSF pTau concentrations were higher in ADD subjects (81.5 ± 9.3 pg/mL) compared with control subjects (50.3 ± 2.4 pg/mL) and MCI subjects (41.2 ± 4.5 pg/mL) (Table 3). Immunoblot analysis revealed the CSF levels of TIMP-3 in the control, MCI, and ADD groups (Figure 4A). Levels of TIMP-3 were lower in the CSF of ADD patients compared with MCI patients and healthy controls (Figure 4B). We then investigated the relationships between TIMP-3 levels and other biomarkers, such as Aβ1-42, total Tau, and pTau in the CSF (Table 4). We observed positive correlations between TIMP-3 and Aβ1-42 levels in CSF (r = 0.515, p = 0.004). Moreover, TIMP-3 levels were also negatively correlated with pTau levels (r = −0.372, p = 0.047). Overall, these results suggest that CSF TIMP-3 is likely to be associated with Aβ and pTau, which indicate pathological progression of the disease.

4. Discussion

TIMP-3 is a component of the extracellular environment that plays diverse roles, including in matrix regulation, inflammation, angiogenesis, and potentially the pathogenesis of AD through indirect mechanisms [22]. The expression of TIMP-3 in AD has not been fully elucidated, and to the best of our knowledge, this is the first study investigating plasma and CSF levels of TIMP-3 in diagnostic groups (control, MCI, ADD). Notably, our results reveal that TIMP-3 levels in AD decreased not only in plasma but also in CSF. These results suggest that a change in the fluid levels of TIMP-3 may indicate AD progression. Previous studies have shown that TIMP-3 expression was increased in the brain of an AD mouse model and in a human AD brain [23]; the higher levels of TIMP-3 may thus contribute to increased conversion of APP to Aβ, contributing to the pathogenesis of AD. Therefore, we expected fluid TIMP-3 levels might be increased. However, our result showed that TIMP-3 fluid level is lower in AD patients.
TIMP fluid levels have been reported in patients with various diseases, but the levels of TIMPs are different depending on the disease condition. High levels of blood MMP-9 and TIMP-1 indicate worse prognoses in lung cancer [39] and breast cancer [40]. High levels of TIMP-1 have been found in infracted brain tissue [41] and in the blood of ischemic stroke patients [42]. Plasma TIMP-3 levels were lower in patients with oral squamous cell carcinoma [43] and higher among subjects who developed acute respiratory distress syndrome [44]. The serum levels of MMP-3 and TIMP-3 correlate with survival in ovarian cancer [45]. In AD patients, it has been shown to low CSF TIMP-1 levels [46]. Interestingly, ADAM-17 activity is increased in the CSF and plasma of AD patients [29]. In the non-amyloidogenic process, APP is cleaved by ADAM-17 as an α-secretase to release soluble N-terminal fragments of APP (sAPPα) and C83 fragments [47]. A recent study shows that ADAM-17 levels are elevated in the brains of patients with AD and have been shown to localize in amyloid plaques [48]. Considering the role of TIMP-3 as an inhibitor of ADAM-17, our result is interesting that TIMP-3 levels are increased in both in vitro and in vivo AD model but lower in the CSF and plasma of AD patients. Our findings also imply that increased ADAM-17 activity might be linked to the decrease of TIMP-3 in the CSF or plasma of AD.
Recent research indicated that TIMP-3 is also increased in the walls of the blood vessels of CAA [24], which commonly coexists in patients with AD [49,50,51]. Proteomic profiling of isolated leptomeningeal vessels of CAA identified enriched proteins, including TIMP-3 and clusterin [24]. Considering that amyloid deposits are frequently observed in brain vessels in AD, TIMP-3 might be involved in amyloid deposits in brain vessels. Moreover, elevated TIMP-3 was also observed in brain vessels of cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy (CADASIL) [52,53]. TIMP-3 forms complexes with NOTCH-3 and accumulates in the extracellular matrix of brain vessels of patients and mice with CADASIL, an inherited cerebral small vessel disease and a cause of stroke and dementia [52]. Given that TIMP-3 was co-localized with NOTCH-3 deposits in CADASIL [52], the recruitment of TIMP-3 to Aβ or NOTCH-3 aggregates may affect ADAM-17-mediated APP cleavage and contribute to AD pathology. Our observations imply that the reduced fluid levels of TIMP-3 in patients with AD might be associated with aggregates of TIMP-3 and Aβ.
We previously showed that Aβ reduced VEGFR-2 levels and increased TIMP-3 in endothelial cells [25]. It was reported that TIMP-3 reduced VEGF-mediated angiogenesis via blockage of VEGF binding to VEGFR-2. The pathophysiological role of blood TIMP-3 in AD patients is still unknown. It is possible that the decreased blood TIMP-3 levels in AD patients may lead to imbalance between MMPs and TIMP and then cause BBB damage [54]. Although, the regulation of TIMP-3 in the pathology of AD is still not fully understood, we found that TIMP-3 levels are significantly lower in the plasma and CSF of AD patients. Decreased TIMP-3 level might be important for understanding the progression of AD. Our result also showed a decrease in TIMP-3 levels in the CSF of the MCI group compared with the control. The close correlations between TIMP-3 and Aβ1-42 levels in MCI suggested that TIMP-3 might be associated with AD progression.
The present findings should be interpreted considering some limitations. The patients recruited for their plasma TIMP-3 levels have different age and gender distributions between the control, MCI, and AD groups because of the limited sample size of the AGE cohort. Therefore, more replication studies with more participants are needed in the future. In conclusion, however, and despite these limitations, we observed that the plasma and CSF levels of TIMP-3 in patients with AD were decreased and associated with disease progression, suggesting that alterations of TIMP-3 may contribute to the understanding of AD progression.

Author Contributions

Conceptualization, Y.H.K. and J.H.P., funding acquisition, Y.H.K., investigation, J.H.P. and S.-J.C., resources, C.H., M.H.P., G.Y.H., and E.-J.K.; writing—original draft preparation, J.H.P., writing—review and editing, Y.H.K. and C.J., supervision, Y.H.K. All authors have read and agreed to the published version of the manuscript.

Funding

This study was supported by grants 2016-NG62002-00, 2017-NI62001-00, and 2020-NI-024-00 from Research of Korea Disease Control and Prevention Agency to Y.H.K.

Institutional Review Board Statement

The study was approved by the Institutional Review Board of the Korea Disease Control and Prevention Agency (KDCA) (2016-02-22-P-A, 2017-05-05-P-A, 2020-03-04-P-A).

Informed Consent Statement

Informed consent was obtained from all subjects involved in the study.

Data Availability Statement

The data presented in this study are available on request from the corresponding author.

Conflicts of Interest

The authors declare no conflict of interest.

References

  1. Mudher, A.; Lovestone, S. Alzheimer’s Disease–Do tauists and baptists finally shake hands? Trends Neurosci. 2002, 25, 22–26. [Google Scholar] [CrossRef]
  2. Selkoe, D.J. Alzheimer’s disease: Genes, proteins, and therapy. Physiol. Rev. 2001, 81, 741–766. [Google Scholar] [CrossRef] [PubMed]
  3. Prince, M. Alzheimer’s disease facts and figures. Alzheimers Dement 2018, 14, 367–429. [Google Scholar]
  4. Lorenzl, S.; Albers, D.S.; Relkin, N.; Ngyuen, T.; Hilgenberg, S.L.; Chirichigno, J.; Cudkowicz, M.E.; Beal, M.F. Increased plasma levels of matrix metalloproteinase-9 in patients with Alzheimer’s disease. Neurochem. Int. 2003, 43, 191–196. [Google Scholar] [CrossRef]
  5. Jiang, T.; Chang, R.C.-C.; Rosenmann, H.; Yu, J.-T. Advances in Alzheimer’s disease: From bench to bedside. BioMed Res. Int. 2015, 2015, 202676. [Google Scholar] [CrossRef] [PubMed]
  6. Kojro, E.; Fahrenholz, F. The non-amyloidogenic pathway: Structure and function of α-secretases. Alzheimer’s Dis. 2005, 38, 105–127. [Google Scholar]
  7. Vatanabe, I.P.; Peron, R.; Grigoli, M.M.; Pelucchi, S.; De Cesare, G.; Magalhães, T.; Manzine, P.; Balthazar, M.F.; Di Luca, M.; Marcello, E.; et al. ADAM10 Plasma and CSF Levels Are Increased in Mild Alzheimer’s Disease. Int. J. Mol. Sci. 2021, 22, 2416. [Google Scholar] [CrossRef]
  8. Lorenzl, S.; Buerger, K.; Hampel, H.; Beal, M.F. Profiles of matrix metalloproteinases and their inhibitors in plasma of patients with dementia. Int. Psychogeriatr. 2008, 20, 67–76. [Google Scholar] [CrossRef]
  9. Backstrom, J.R.; Lim, G.P.; Cullen, M.J.; Tokes, Z.A. Matrix metalloproteinase-9 (MMP-9) is synthesized in neurons of the human hippocampus and is capable of degrading the amyloid-beta peptide (1–40). J. Neurosci. 1996, 16, 7910–7919. [Google Scholar] [CrossRef] [Green Version]
  10. Arpino, V.; Brock, M.; Gill, S.E. The role of TIMPs in regulation of extracellular matrix proteolysis. Matrix Biol. 2015, 44, 247–254. [Google Scholar] [CrossRef]
  11. Köhrmann, A.; Kammerer, U.; Kapp, M.; Dietl, J.; Anacker, J. Expression of matrix metalloproteinases (MMPs) in primary human breast cancer and breast cancer cell lines: New findings and review of the literature. BMC Cancer 2009, 9, 188. [Google Scholar] [CrossRef] [Green Version]
  12. Bauer, Y.; White, E.S.; de Bernard, S.; Cornelisse, P.; Leconte, I.; Morganti, A.; Roux, S.; Nayler, O. MMP-7 is a predictive biomarker of disease progression in patients with idiopathic pulmonary fibrosis. ERJ Open Res. 2017, 3, 00074-2016. [Google Scholar] [CrossRef] [Green Version]
  13. Halade, G.V.; Jin, Y.-F.; Lindsey, M.L. Matrix metalloproteinase (MMP)-9: A proximal biomarker for cardiac remodeling and a distal biomarker for inflammation. Pharmacol. Ther. 2013, 139, 32–40. [Google Scholar] [CrossRef] [Green Version]
  14. Kelly, P.J.; Morrow, J.D.; Ning, M.; Koroshetz, W.; Lo, E.H.; Terry, E.; Milne, G.L.; Hubbard, J.; Lee, H.; Stevenson, E. Oxidative stress and matrix metalloproteinase-9 in acute ischemic stroke: The Biomarker Evaluation for Antioxidant Therapies in Stroke (BEAT-Stroke) study. Stroke 2008, 39, 100–104. [Google Scholar] [CrossRef] [Green Version]
  15. Su, C.-W.; Lin, C.-W.; Yang, W.-E.; Yang, S.-F. TIMP-3 as a therapeutic target for cancer. Ther. Adv. Med. Oncol. 2019, 11, 1758835919864247. [Google Scholar] [CrossRef] [Green Version]
  16. Lorenzl, S.; Albers, D.; LeWitt, P.; Chirichigno, J.; Hilgenberg, S.; Cudkowicz, M.; Beal, M. Tissue inhibitors of matrix metalloproteinases are elevated in cerebrospinal fluid of neurodegenerative diseases. J. Neurol. Sci. 2003, 207, 71–76. [Google Scholar] [CrossRef]
  17. Walker, E.J.; Rosenberg, G.A. TIMP-3 and MMP-3 contribute to delayed inflammation and hippocampal neuronal death following global ischemia. Exp. Neurol. 2009, 216, 122–131. [Google Scholar] [CrossRef] [Green Version]
  18. Bjerke, M.; Zetterberg, H.; Edman, A.; Blennow, K.; Wallin, A.; Andreasson, U. Cerebrospinal fluid matrix metalloproteinases and tissue inhibitor of metalloproteinases in combination with subcortical and cortical biomarkers in vascular dementia and Alzheimer’s disease. J. Alzheimer’s Dis. 2011, 27, 665–676. [Google Scholar] [CrossRef]
  19. Tuna, G.; Yener, G.G.; Oktay, G.; Işlekel, G.H.; Kİrkalİ, F.G. Evaluation of Matrix Metalloproteinase-2 (MMP-2) and -9 (MMP-9) and Their Tissue Inhibitors (TIMP-1 and TIMP-2) in Plasma from Patients with Neurodegenerative Dementia. J. Alzheimer’s Dis. 2018, 66, 1265–1273. [Google Scholar] [CrossRef]
  20. Basu, R.; Fan, D.; Kandalam, V.; Lee, J.; Das, S.K.; Wang, X.; Baldwin, T.A.; Oudit, G.Y.; Kassiri, Z. Loss of Timp3 gene leads to abdominal aortic aneurysm formation in response to angiotensin II. J. Biol. Chem. 2012, 287, 44083–44096. [Google Scholar] [CrossRef] [Green Version]
  21. Gooz, M. ADAM-17: The enzyme that does it all. Crit. Rev. Biochem. Mol. Biol. 2010, 45, 146–169. [Google Scholar] [CrossRef] [Green Version]
  22. Dewing, J.M.; Carare, R.O.; Lotery, A.J.; Ratnayaka, J.A. The Diverse Roles of TIMP-3: Insights into degenerative diseases of the senescent retina and brain. Cells 2019, 9, 39. [Google Scholar] [CrossRef] [Green Version]
  23. Hoe, H.-S.; Cooper, M.J.; Burns, M.P.; Lewis, P.; Van Der Brug, M.; Chakraborty, G.; Cartagena, C.M.; Pak, D.T.S.; Cookson, M.R.; Rebeck, G.W. The metalloprotease inhibitor TIMP-3 regulates amyloid precursor protein and apolipoprotein E receptor proteolysis. J. Neurosci. 2007, 27, 10895–10905. [Google Scholar] [CrossRef] [Green Version]
  24. Manousopoulou, A.; Gatherer, M.; Smith, C.; Nicoll, J.; Woelk, C.H.; Johnson, M.; Kalaria, R.; Attems, J.; Garbis, S.; Carare, R.O. Systems proteomic analysis reveals that clusterin and tissue inhibitor of metalloproteinases 3 increase in leptomeningeal arteries affected by cerebral amyloid angiopathy. Neuropathol. Appl. Neurobiol. 2017, 43, 492–504. [Google Scholar] [CrossRef]
  25. Cho, S.-J.; Park, M.H.; Han, C.; Yoon, K.; Koh, Y.H. VEGFR2 alteration in Alzheimer′s disease. Sci. Rep. 2017, 7, 17713. [Google Scholar] [CrossRef] [Green Version]
  26. Qi, J.H.; Ebrahem, Q.; Moore, N.; Murphy, G.; Claesson-Welsh, L.; Bond, M.; Baker, A.; Anand-Apte, B. A novel function for tissue inhibitor of metalloproteinases-3 (TIMP3): Inhibition of angiogenesis by blockage of VEGF binding to VEGF receptor-2. Nat. Med. 2003, 9, 407–415. [Google Scholar] [CrossRef]
  27. Petersen, R.C.; Smith, G.E.; Waring, S.C.; Ivnik, R.J.; Tangalos, E.G.; Kokmen, E. Mild cognitive impairment: Clinical characterization and outcome. Arch. Neurol. 1999, 56, 303–308. [Google Scholar] [CrossRef]
  28. Han, C.; Jo, S.A.; Kim, N.H.; Jo, I.; Park, M.H. Study design and methods of the Ansan Geriatric Study (AGE study). BMC Neurol. 2009, 9, 10. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  29. Sun, Q.; Hampel, H.; Blennow, K.; Lista, S.; Levey, A.; Tang, B.; Li, R.; Shen, Y. Increased plasma TACE activity in subjects with mild cognitive impairment and patients with Alzheimer’s disease. J. Alzheimer’s Dis. 2014, 41, 877–886. [Google Scholar] [CrossRef] [Green Version]
  30. McKhann, G.; Drachman, D.; Folstein, M.; Katzman, R.; Price, D.; Stadlan, E.M. Clinical diagnosis of Alzheimer’s disease: Report of the NINCDS-ADRDA Work Group* under the auspices of Department of Health and Human Services Task Force on Alzheimer’s Disease. Neurology 1984, 34, 939. [Google Scholar] [CrossRef] [Green Version]
  31. Lee, J.H.; Lee, K.U.; Lee, D.Y.; Kim, K.W.; Jhoo, J.H.; Kim, J.H.; Lee, K.H.; Kim, S.Y.; Han, S.H.; Woo, J.I. Development of the Korean version of the Consortium to Establish a Registry for Alzheimer’s Disease Assessment Packet (CERAD-K): Clinical and neuropsychological assessment batteries. J. Gerontol. 2002, 57, 47–53. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  32. Jang, B.G.; Yun, S.-M.; Ahn, K.; Song, J.H.; Jo, S.A.; Kim, Y.-Y.; Kim, D.K.; Park, M.H.; Han, C.; Koh, Y.H. Plasma carbonic anhydrase II protein is elevated in Alzheimer’s disease. J. Alzheimer’s Dis. 2010, 21, 939–945. [Google Scholar] [CrossRef] [PubMed]
  33. Kim, J.; Park, M.H.; Kim, E.; Han, C.; Jo, S.A.; Jo, I. Plasma homocysteine is associated with the risk of mild cognitive impairment in an elderly Korean population. J. Nutr. 2007, 137, 2093–2097. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  34. Jung, N.-Y.; Kim, E.S.; Kim, H.-S.; Jeon, S.; Lee, M.J.; Pak, K.; Lee, J.-H.; Lee, Y.M.; Lee, K.; Shin, J.-H.; et al. Comparison of diagnostic performances between cerebrospinal fluid biomarkers and amyloid PET in a clinical setting. J. Alzheimer’s Dis. 2020, 74, 473–490. [Google Scholar] [CrossRef]
  35. Kang, Y.; Na, D.; Hahn, S. Seoul Neuropsychological Screening Battery; Human Brain Research & Consulting Co.: Incheon, Korea, 2003. [Google Scholar]
  36. Albert, M.S.; DeKosky, S.T.; Dickson, D.; Dubois, B.; Feldman, H.H.; Fox, N.C.; Gamst, A.; Holtzman, D.M.; Jagust, W.J.; Petersen, R.C.; et al. The diagnosis of mild cognitive impairment due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement. 2011, 7, 270–279. [Google Scholar] [CrossRef] [Green Version]
  37. McKhann, G.M.; Knopman, D.S.; Chertkow, H.; Hyman, B.T.; Jack, J.C.R.; Kawas, C.H.; Klunk, W.E.; Koroshetz, W.J.; Manly, J.J.; Mayeux, R. The diagnosis of dementia due to Alzheimer’s disease: Recommendations from the National Institute on Aging-Alzheimer’s Association workgroups on diagnostic guidelines for Alzheimer’s disease. Alzheimer’s Dement. 2011, 7, 263–269. [Google Scholar] [CrossRef] [Green Version]
  38. Cho, S.-J.; Yun, S.-M.; Jo, C.; Lee, D.-h.; Choi, K.J.; Song, J.C.; Park, S.I.; Kim, Y.-J.; Koh, Y.H. SUMO1 promotes Aβ production via the modulation of autophagy. Autophagy 2014, 11, 100–112. [Google Scholar] [CrossRef] [Green Version]
  39. Ylisirnio, S.; Hoyhtya, M.; Turpeenniemi-Hujanen, T. Serum matrix metalloproteinases -2, -9 and tissue inhibitors of metalloproteinases -1, -2 in lung cancer--TIMP-1 as a prognostic marker. Anticancer. Res. 2000, 20, 1311–1316. [Google Scholar]
  40. Wu, Z.-S.; Wu, Q.; Yang, J.-H.; Wang, H.-Q.; Ding, X.-D.; Yang, F.; Xu, X.-C. Prognostic significance of MMP-9 and TIMP-1 serum and tissue expression in breast cancer. Int. J. Cancer 2008, 122, 2050–2056. [Google Scholar] [CrossRef]
  41. Cuadrado, E.; Rosell, A.; Penalba, A.; Slevin, M.; Alvarez-Sabin, J.; Ortega-Aznar, A.; Montaner, J. Vascular MMP-9/TIMP-2 and neuronal MMP-10 up-regulation in human brain after stroke: A combined laser microdissection and protein array study. J. Proteome Res. 2009, 8, 3191–3197. [Google Scholar] [CrossRef]
  42. Jaroslav, P.; Christian, R.; Stefan, O.; Alexander, Z.; Zepper, P.; Holger, P.; Hans-Henning, E. Evaluation of serum biomarkers for patients at increased risk of stroke. Int. J. Vasc. Med. 2012, 2012, 1–6. [Google Scholar] [CrossRef] [Green Version]
  43. Su, C.-W.; Su, B.-F.; Chiang, W.-L.; Yang, S.-F.; Chen, M.-K.; Lin, C.-W. Plasma levels of the tissue inhibitor matrix metalloproteinase-3 as a potential biomarker in oral cancer progression. Int. J. Med. Sci. 2017, 14, 37–44. [Google Scholar] [CrossRef] [Green Version]
  44. Hendrickson, C.M.; Gibb, S.L.; Miyazawa, B.Y.; Keating, S.; Ross, E.; Conroy, A.S.; Calfee, C.S.; Pati, S.; Cohen, M.J. Elevated plasma levels of TIMP-3 are associated with a higher risk of acute respiratory distress syndrome and death following severe isolated traumatic brain injury. Trauma Surg. Acute Care Open 2018, 3, e000171. [Google Scholar] [CrossRef]
  45. Cymbaluk-Płoska, A.; Chudecka-Głaz, A.; Pius-Sadowska, E.; Machaliński, B.; Menkiszak, J.; Sompolska-Rzechuła, A. Suitability assessment of baseline concentration of MMP3, TIMP3, HE4 and CA125 in the serum of patients with ovarian cancer. J. Ovarian Res. 2018, 11, 1–9. [Google Scholar] [CrossRef] [Green Version]
  46. Stomrud, E.; Björkqvist, M.; Janciauskiene, S.; Minthon, L.; Hansson, O. Alterations of matrix metalloproteinases in the healthy elderly with increased risk of prodromal Alzheimer’s disease. Alzheimer’s Res. Ther. 2010, 2, 20. [Google Scholar] [CrossRef] [Green Version]
  47. Allinson, T.M.J.; Parkin, E.; Condon, T.P.; Schwager, S.L.U.; Sturrock, E.D.; Turner, A.J.; Hooper, N.M. The role of ADAM10 and ADAM17 in the ectodomain shedding of angiotensin converting enzyme and the amyloid precursor protein. JBIC J. Biol. Inorg. Chem. 2004, 271, 2539–2547. [Google Scholar] [CrossRef]
  48. Skovronsky, D.M.; Fath, S.; Lee, V.M.-Y.; Milla, M.E. Neuronal localization of the TNF? converting enzyme (TACE) in brain tissue and its correlation to amyloid plaques. J. Neurobiol. 2001, 49, 40–46. [Google Scholar] [CrossRef]
  49. Attems, J.; Lauda, F.; A Jellinger, K. Unexpectedly low prevalence of intracerebral hemorrhages in sporadic cerebral amyloid angiopathy. J. Neurol. 2008, 255, 70–76. [Google Scholar] [CrossRef]
  50. Mandybur, T.I. The incidence of cerebral amyloid angiopathy in Alzheimer’s disease. Neurology 1975, 25, 120-6. [Google Scholar] [CrossRef]
  51. Zarow, C.; Zaias, B.; A Lyness, S.; Chui, H. Cerebral amyloid angiopathy in Alzheimer disease is associated with apolipoprotein E4 and cortical neuron loss. Alzheimer Dis. Assoc. Disord. 1999, 13, 1–8. [Google Scholar] [CrossRef]
  52. Monet-Leprêtre, M.; Haddad, I.; Baron-Menguy, C.; Fouillot-Panchal, M.; Riani, M.; Domenga-Denier, V.; Dussaule, C.; Cognat, E.; Vinh, J.; Joutel, A. Abnormal recruitment of extracellular matrix proteins by excess Notch3ECD: A new pathomechanism in CADASIL. Brain 2013, 136, 1830–1845. [Google Scholar] [CrossRef] [Green Version]
  53. Zellner, A.; Scharrer, E.; Arzberger, T.; Oka, C.; Domenga-Denier, V.; Joutel, A.; Lichtenthaler, S.F.; Müller, S.A.; Dichgans, M.; Haffner, C. CADASIL brain vessels show a HTRA1 loss-of-function profile. Acta Neuropathol. 2018, 136, 111–125. [Google Scholar] [CrossRef]
  54. Jäkel, L.; Kuiperij, H.B.; Gerding, L.P.; Custers, E.E.M.; Berg, E.V.D.; Jolink, W.M.T.; Schreuder, F.H.B.M.; Küsters, B.; Klijn, C.J.M.; Verbeek, M.M. Disturbed balance in the expression of MMP9 and TIMP3 in cerebral amyloid angiopathy-related intracerebral haemorrhage. Acta Neuropathol. Commun. 2020, 8, 1–14. [Google Scholar] [CrossRef]
Figure 1. (A) Immunoblot analysis for TIMP-3 in the cerebral cortex of wild-type (WT) and APP Swedish/PS1dE9 transgenic (APP Tg) mice. β-actin was used as a loading control. (B) Detection of TIMP-3 in the parietal cortex of AD mice brains. Immunostainings of anti-TIMP-3 (Red) and anti-Aβ1-42 (Green) in the brain of WT and APP Tg mice (scale bar = 50 μm). (C) The plasma TIMP-3 levels of WT (n = 4) and TG (n = 4) were measured by ELISA assay. Each value is presented as the mean ± SD. TG, Transgenic; NS, not significant; TIMP-3, Tissue inhibitor of metalloproteinase-3; SD, Standard deviation.
Figure 1. (A) Immunoblot analysis for TIMP-3 in the cerebral cortex of wild-type (WT) and APP Swedish/PS1dE9 transgenic (APP Tg) mice. β-actin was used as a loading control. (B) Detection of TIMP-3 in the parietal cortex of AD mice brains. Immunostainings of anti-TIMP-3 (Red) and anti-Aβ1-42 (Green) in the brain of WT and APP Tg mice (scale bar = 50 μm). (C) The plasma TIMP-3 levels of WT (n = 4) and TG (n = 4) were measured by ELISA assay. Each value is presented as the mean ± SD. TG, Transgenic; NS, not significant; TIMP-3, Tissue inhibitor of metalloproteinase-3; SD, Standard deviation.
Jpm 12 00827 g001
Figure 2. Relative TIMP-3 mRNA levels in human iPSC-derived neuronal cells from an AD patient (n = 3) and a control (n = 3). Results are expressed as mean ± SD; statistical significance is indicated by p < 0.05. AD, Alzheimer’s Disease; SD, Standard deviation.
Figure 2. Relative TIMP-3 mRNA levels in human iPSC-derived neuronal cells from an AD patient (n = 3) and a control (n = 3). Results are expressed as mean ± SD; statistical significance is indicated by p < 0.05. AD, Alzheimer’s Disease; SD, Standard deviation.
Jpm 12 00827 g002
Figure 3. Analysis of TIMP-3 levels in human plasma. Plasma TIMP-3 concentrations were measured by ELISA. The differences in the relative amounts of TIMP-3 were compared between dementia, MCI, and controls using the Mann-Whitney U-test within different groups. NS = not significant.
Figure 3. Analysis of TIMP-3 levels in human plasma. Plasma TIMP-3 concentrations were measured by ELISA. The differences in the relative amounts of TIMP-3 were compared between dementia, MCI, and controls using the Mann-Whitney U-test within different groups. NS = not significant.
Jpm 12 00827 g003
Figure 4. (A) Levels of TIMP-3 in human CSF were estimated by immunoblot analysis. The CSF from healthy control (n = 10), MCI (n = 10), and ADD (n = 10) w probed with an anti-TIMP-3 antibody. (B) Relative expression levels of TIMP-3 are represented as mean ± SD, and statistical significance is indicated by p < 0.05 and p < 0.001. Mild cognitive impairment (MCI); Alzheimer’s Disease Dementia (ADD).
Figure 4. (A) Levels of TIMP-3 in human CSF were estimated by immunoblot analysis. The CSF from healthy control (n = 10), MCI (n = 10), and ADD (n = 10) w probed with an anti-TIMP-3 antibody. (B) Relative expression levels of TIMP-3 are represented as mean ± SD, and statistical significance is indicated by p < 0.05 and p < 0.001. Mild cognitive impairment (MCI); Alzheimer’s Disease Dementia (ADD).
Jpm 12 00827 g004
Table 1. Baseline characteristics of the population.
Table 1. Baseline characteristics of the population.
FeaturesControlMCIDementiap-Value
N (Male/Female)115 (48/67)71 (29/42)65 (16/49)
Age (years)71.9 ± 0.4373.05 ± 0.5475.1 ± 0.750.001
Education9.12 ± 0.476.18 ± 0.573.56 ± 0.55<0.001
MMSE27.21 ± 0.224.96 ± 0.3516.0 ± 0.73<0.001
CDR0.043 ± 0.010.26 ± 0.021.12 ± 0.09<0.001
Total CHOL195.6 ± 3.2190.3 ± 4.1201.4 ± 4.50.306
TG137.4 ± 7.2127.9 ± 7.7152.6 ± 11.50.287
HDL43.4 ± 0.8943.1 ± 1.4644.5 ± 1.20.371
LDL124.7 ± 3.0121.5 ± 3.4126.4 ± 3.80.599
Platelet253.3 ± 6.6268.0 ± 7.2266.2 ± 11.30.229
Glucose101.4 ± 2.0102.3 ± 2.5107.5 ± 5.10.483
vitB12790.6 ± 57.3699.2 ± 31.6717.1 ± 41.30.903
TIMP-3 (ng/mL)0.61 ± 0.060.40 ± 0.040.39 ± 0.05 a0.065
Values are mean ± SEM. MMSE, Mini-Mental State Examination; CDR, clinical dementia rating; SEM, standard error of the mean; Total CHOL, Total Cholesterol; TG, Triglycerides; HDL, High-density lipoprotein; LDL, Low-density lipoprotein; TIMP-3, Tissue inhibitor of metalloproteinase-3. p-values are for the Kruskal-Wallis test. Comparisons are assessed by Mann-Whitney U-tests. a Con: Dementia, p = 0.029.
Table 2. Correlations between plasma biomarkers and baseline characteristics.
Table 2. Correlations between plasma biomarkers and baseline characteristics.
FeaturesTIMP-3
Rhop-Value
Age−0.1120.075
Education0.0940.14
MMSE0.1040.099
CDR−0.1530.015
Total CHOL−0.1050.096
Tg0.0080.902
HDL−0.0490.442
LDL−0.1420.025
Platelet0.0380.55
Glucose−0.1270.046
VitB120.0790.21
The Spearman rank correlation coefficient test was used for assessment of correlation. Bold values are p < 0.05.
Table 3. CSF levels of Control Subjects, MCI and ADD patients.
Table 3. CSF levels of Control Subjects, MCI and ADD patients.
FeaturesControlMCIADDp-Value
TIMP-32.26 ± 0.261.40 ± 0.29 10.77 ± 0.110.004
1-42 (pg/mL)1030.1 ± 32.6766.3 ± 70.9 2401.3 ± 27.4 3<0.001
Total Tau (pg/mL)224.3 ± 25.6328.9 ± 69.5480.8 ± 100.70.092
pTau (pg/mL)50.3 ± 2.441.2 ± 4.581.5 ± 9.3 40.001
Baseline characteristics of the population. Values are mean ± SEM. MCI, mild cognitive impairment; SEM, standard error of the mean. p-values are for the Kruskal-Wallis test. Comparisons are assessed with the Mann-Whitney U-test. 1 Con: MCI, p = 0.043; 2 Con: MCI, p = 0.003; 3 ADD: MCI, p = 0.002; 4 ADD: MCI, p = 0.001.
Table 4. Correlation between CSF biomarkers and CSF TIMP-3 levels.
Table 4. Correlation between CSF biomarkers and CSF TIMP-3 levels.
FeaturesTIMP-3
Rhop-Value
Age−0.250.17
1-420.5150.004
Total Tau−0.3370.069
pTau−0.3720.047
The Spearman rank correlation coefficient test was used for assessment of correlation. Bold values are p < 0.05.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Park, J.H.; Cho, S.-J.; Jo, C.; Park, M.H.; Han, C.; Kim, E.-J.; Huh, G.Y.; Koh, Y.H. Altered TIMP-3 Levels in the Cerebrospinal Fluid and Plasma of Patients with Alzheimer’s Disease. J. Pers. Med. 2022, 12, 827. https://0-doi-org.brum.beds.ac.uk/10.3390/jpm12050827

AMA Style

Park JH, Cho S-J, Jo C, Park MH, Han C, Kim E-J, Huh GY, Koh YH. Altered TIMP-3 Levels in the Cerebrospinal Fluid and Plasma of Patients with Alzheimer’s Disease. Journal of Personalized Medicine. 2022; 12(5):827. https://0-doi-org.brum.beds.ac.uk/10.3390/jpm12050827

Chicago/Turabian Style

Park, Jung Hyun, Sun-Jung Cho, Chulman Jo, Moon Ho Park, Changsu Han, Eun-Joo Kim, Gi Yeong Huh, and Young Ho Koh. 2022. "Altered TIMP-3 Levels in the Cerebrospinal Fluid and Plasma of Patients with Alzheimer’s Disease" Journal of Personalized Medicine 12, no. 5: 827. https://0-doi-org.brum.beds.ac.uk/10.3390/jpm12050827

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop