Next Article in Journal
Ruthenium Complexes Induce HepG2 Human Hepatocellular Carcinoma Cell Apoptosis and Inhibit Cell Migration and Invasion through Regulation of the Nrf2 Pathway
Next Article in Special Issue
Functions of miRNAs during Mammalian Heart Development
Previous Article in Journal
Downregulation of Runx2 by 1,25-Dihydroxyvitamin D3 Induces the Transdifferentiation of Osteoblasts to Adipocytes
Previous Article in Special Issue
MicroRNA-19b Downregulates Gap Junction Protein Alpha1 and Synergizes with MicroRNA-1 in Viral Myocarditis
 
 
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Article

Predicting MicroRNA Biomarkers for Cancer Using Phylogenetic Tree and Microarray Analysis

Institute of Statistics, National Chiao Tung University, Hsinchu 30010, Taiwan
Int. J. Mol. Sci. 2016, 17(5), 773; https://0-doi-org.brum.beds.ac.uk/10.3390/ijms17050773
Submission received: 23 March 2016 / Revised: 13 May 2016 / Accepted: 16 May 2016 / Published: 19 May 2016
(This article belongs to the Special Issue MicroRNA Regulation)

Abstract

:
MicroRNAs (miRNAs) are shown to be involved in the initiation and progression of cancers in the literature, and the expression of miRNAs is used as an important cancer prognostic tool. The aim of this study is to predict high-confidence miRNA biomarkers for cancer. We adopt a method that combines miRNA phylogenetic structure and miRNA microarray data analysis to discover high-confidence miRNA biomarkers for colon, prostate, pancreatic, lung, breast, bladder and kidney cancers. There are 53 miRNAs selected through this method that either have potential to involve a single cancer’s development or to involve several cancers’ development. These miRNAs can be used as high-confidence miRNA biomarkers of these seven investigated cancers for further experiment validation. miR-17, miR-20, miR-106a, miR-106b, miR-92, miR-25, miR-16, miR-195 and miR-143 are selected to involve a single cancer’s development in these seven cancers. They have the potential to be useful miRNA biomarkers when the result can be confirmed by experiments.

Graphical Abstract

1. Introduction

MicroRNA (miRNA) is a short non-coding RNA around 22 nt, which suppresses gene expressions via translational suppression or involves mRNA degradation by binding to 3′-untranslated regions (3′UTR). It has been estimated that miRNAs regulate about 30% of human genes [1]. The first miRNA was discovered in 1993, which downregulates the levels of lin-14 during the development of C. elegans [2]. Previous studies indicated that miRNAs play a key role in biological processes, such as development, cell proliferation and cell death. Thus, altered miRNA expression is likely to contribute to human diseases [3]. As a result, miRNA expression may be a useful tool for disease detection [4].
Calin et al. [5] first linked miR-15 and miR-16 to cancer in 2002. After that, many studies have shown that the expression of miRNAs is altered in many cancer samples, and they can initiate carcinogenesis or drive progression [6]. In addition, studies revealed that miRNA could be used as diagnostic and prognostic biomarkers for patient stratification and also as therapeutic targets, such as miR-215, miR-299-5p, miR-411 and miR-452, which were selected as potential biomarkers for breast cancer detection [7].
To find cancer-related miRNAs, microarray data analysis is a useful method to analyze the difference between miRNA expression of normal tissues and those of tumor tissues. Several approaches have been established to investigate the relationship between miRNA expression profiles of normal tissues and those of tumor tissues [8,9].
In addition to using microarray expression to find miRNA biomarkers for cancer, in this study, we propose a method, using miRNA stem-loop sequence structure, to help improve miRNA biomarker prediction. From a biological perspective, it is reasonable to assume that miRNAs with a similar phylogenetic structure are more likely to regulate the same disease. Nucleotide substitution models and the phylogenetic tree are widely-used tools to classify DNA or RNA sequences and to explore the level of sequence similarity [10,11,12,13]. In this study, we adopt a phylogenetic tree to present the similarity level of different miRNA sequences. As a result, a method combining microarray analysis and phylogenetic trees is proposed to predict high-confidence miRNA biomarkers for cancers.

2. Results

We first introduce the data used in this study. Huang et al. (2007) published two datasets of miRNA and mRNA microarray expression profiles across 88 normal or cancerous tissue samples [14]. One is the expression profiles for 114 human miRNAs, and the other one is the expression profiles for 16,063 mRNAs. To discover miRNA target genes based on these datasets, the relative r-squared method (RRSM), was established to select high-confidence miRNA target genes [15,16,17]. This method is to adopt a regression model under a relative r-squared criterion to find the relationship between miRNA and miRNA targets, which is based on a relative instead of an absolute statistical point of view. To perform the RRSM, two thresholds for the p-value and the relative r-squared value need to be set in the RRSM. For more details of the method, refer to the website http://www.stat.nctu.edu.tw/hwang/website_wang%20new.htm. The data and RRSM codes can be also accessed on this website. In addition, an approach investigating miRNA-target interactions and tissue specificity through microarray data was proposed, and tissue specificity results are provided through a study based on these datasets [8].
Since the samples in these datasets involve tumor tissues, Wang (2014) adopted the RRSM approach to discover potential miRNA biomarkers of cancers based on one of these datasets. More details about adopting the datasets and methods in Wang (2014) are given in the Materials and Methods section. In this study, we propose using a phylogenetic tree method to classify these selected miRNA biomarkers [9] based on their stem-loop sequences. As a result, high-confidence miRNA biomarkers are selected using both the microarray data and sequence structure.
There are a total of 53 miRNAs that have been selected by the proposed method. The steps of implementing this method are given in the Materials and Methods section. The 53 miRNAs are classified into 28 sets according to this method by combining both the RRSM and the phylogenetic tree criteria. The results are presented in Table 1, which lists the selected miRNAs and their cancer targets. Figure 1 shows the numbers of miRNAs selected by the proposed method or the RRSM.
The miRNAs in each set have the potential to be involved in some particular cancers’ development. In these 28 sets, there are three sets of miRNAs discovered for the single bladder cancer. There are eight miRNAs in these three sets, including miR-17, miR-20, miR-106a, miR-106b miR-92, miR-25, miR-16 and miR-195. The reason that these eight miRNAs are separated into three sets is that they are clustered into three different branches in the phylogenetic tree. For miR-92, since it was recently described as a family, including miR-92a and miR-92b, in the phylogenetic analysis, the sequence used for miR-92 is based on the stem-loop sequence of hsa-mir-92a-1 accessed from miRBase [18,19]. The miRNAs in the same set have a more similar phylogenetic structure than the miRNAs, which are not in the same set. There is also one set of miRNAs discovered for the single pancreatic cancer, which only includes miR-143.
In addition to the bladder cancer and pancreatic cancer, we do not find other miRNAs that are only related to a single cancer in these seven cancers through the proposed method. The other selected miRNAs are related to more than one cancer. The two sets of miRNAs, including miR-125a, miR-125b, miR-200b, miR-23a and miR-23b, are involved all seven cancers. The next are miR-27a and miR-27b, which involve six cancers. The result reveals that bladder cancer involves more miRNAs than other cancers investigated in this study.
Part of the results in Table 1 can be validated by previous studies. The last column in Table 1 lists the studies related to the selected miRNAs and their target cancers. These studies, which show the strong relationship between these miRNAs and their target cancers either in a direct or an indirect way, can enhance the reliability of the proposed method.
The selected 53 miRNAs, which are chosen from both the phylogenetic structure and the microarray data analysis aspects, can be used as high-confidence biomarkers of these seven investigated cancers for further experiment validation. In addition, when an miRNA only involves one cancer’s development, this miRNA can be more useful as a biomarker of this cancer than other miRNAs that involve more than one cancer’s development, because we can more easily identify its cancer target. miR-17, miR-20, miR-106a, miR-106b, miR-92, miR-25, miR-16, miR-195 and miR-143 are selected to involve a single cancer’s development. They have potential to be useful miRNA biomarkers when the result can be confirmed by experiments.

3. Discussion

To provide a more confident validation of the selected results, we use the Human MicroRNA Disease Database (HMDD) [73] to demonstrate the advantage of the proposed method. The database HMDD provides experiment-supported evidence for human microRNA (miRNA) and disease associations, which is manually collected from publications [73]. To verify the adequacy of the method, we adopt the sensitivity and specificity criteria on HMDD to show that the results selected in this study are more accurate than the results selected by the method of only using the microarray analysis. The sensitivity measures the proportion of actual positives that are correctly identified as such, and the specificity measures the proportion of negatives that are correctly identified as such [74]. That is, the sensitivity is the ratio of the number miRNAs that are selected by the method and confirmed by HMDD to the number of miRNAs selected by the method; the specificity is the ratio of the number of miRNAs that are selected by the method, but not confirmed by HMDD, to the number of miRNAs that are not confirmed by HMDD.
The sensitivities and specificities of the proposed method for the seven cancers are presented in Table 2. Most of them are greater than 0.5 for six cancers, except the colon cancer, with a sensitivity 0.476 and a specificity 0.429, and the breast cancer with a specificity 0.429. Compared to the results presented in [9], which only adopted the microarray analysis, but were not associated with the phylogenetic tree method, the proposed method can increase both sensitivity and specificity. The results obtained by Procedure 1 in [9] have a sensitivity 0.405 and a specificity 0.347 for the colon cancer and a sensitivity 0.519 and a specificity 0.435 for the pancreatic cancer. In this study, we also use the data obtained by Procedure 1 in [9], but screen them again using the phylogenetic tree method. This shows that the microarray analysis combining the phylogenetic tree can increase the sensitivity from 0.405 to 0.476 and increase the specificity from 0.347 to 0.429 for colon cancer compared to the method only using microarray analysis. The sensitivity increase rate is (0.476 − 0.405)/0.405 = 17.28%, and the specificity increase rate is (0.429 − 0.347)/0.347 = 23.63%. For pancreatic cancer, it can increase the sensitivity from 0.519 to 0.586 and increase the specificity from 0.437 to 0.64, with a sensitivity increase rate (0.586 − 0.519)/0.519 = 12.9% and a specificity increase rate (0.64 − 0.437)/0.437 = 46.45%. All of these increase rates are greater than 10%, which shows the significant improvement of the proposed method. The sensitivities and specificities for the other five cancers were not presented in [9]. Therefore, we only compare the results for colon cancer and pancreatic cancer. The outcome reveals that the method combining the phylogenetic tree with the microarray analysis improves the method of only using the microarray analysis.

4. Materials and Methods

4.1. Microarray Approach

To predict target genes of miRNAs, many methods have been adopted to explore the relationship between miRNA expression microarray data and gene expression microarray data. One of the methods is the RRSM procedure, which is based on the regression model to discover high-confidence target genes for miRNAs [15,16,17]. This method has also been adopted to discover high-confidence miRNA biomarkers for cancers using the above-mentioned dataset [9]. We briefly describe the approach of applying RRSM to select high-confidence miRNA biomarkers for cancers in [9]. To select high-confidence miRNAs that are associated with a cancer’s development, first, we can apply the RRSM to find miRNA biomarkers using expression profiles in tumor tissues. To compare the expression profiles in tumor tissue to those in normal tissues, we can also apply the RRSM to select miRNA biomarkers in normal tissue. After obtaining miRNA biomarkers in tumor tissue and miRNA biomarkers in normal tissue, respectively, the biomarkers, which are selected using the tumor tissue, but are not selected using the normal tissue, are regarded as high-confidence miRNA biomarkers for a cancer.
Cancer-related miRNAs for seven cancers, including colon, prostate, pancreatic, lung, breast, bladder and kidney cancers, were revealed [9], which are summarized in Table 3. For example, miRNA-199b is related to kidney cancer, and miRNA-16 is related to bladder cancer. According to the miRNAs’ cancer targets in Table 3, we classify the miRNAs that are related to same cancers into the same group.
To classify the miRNAs subject to the results in Table 3, we applied a hierarchical tree method to group the results in Table 3 and explore the relationship between these groups. The results in Table 3 can be classified into 41 groups. The group number of an miRNA in Table 3 indicates that this miRNA belongs to the group corresponding to this group number in Figure 2. For example, Branch 1 of Figure 2 constitutes 4 miRNAs (miR-124a, miR-9, miR-182, miR-135); Branch 2 constitutes 6 miRNAs (miR-125b, miR-23b, miR-23a, miR-125a, miR-200b, miR-200c); Branch 3 constitutes 1 miRNA (miR-146). Figure 2 shows the clustering relationship between these 41 groups.
About the details of plotting the tree in Figure 2, for an miRNA, we need to assign a vector corresponding to this miRNA subject to its cancer targets listed in Table 3. For example, the vectors corresponding to miR-124a and miR-146 are (1, 1, 1, 1, 1, 1, 0) and (1, 0, 0, 1, 0, 1, 1), respectively. The steps of constructing a hierarchical tree method are first to calculate the pairwise distances for each pair of the 90 vectors and then to adopt a clustering approach to classify the miRNAs using the calculated pairwise distances. We adopt the Euclidean distance to calculate the pairwise distance between vectors. For the clustering approach used in the second step, we apply the unweighted pair-group method with arithmetic averages (UPGMA) to plot the tree. The MATLAB codes for plotting this tree are:
Y = pdist (data); Z = linkage (Y, ‘average’); dendrogram (Z)
where “data” is a 90 × 7 matrix obtained from Table 3. The hierarchical tree of miRNAs subject to their cancer targets is plotted in Figure 2.
The 90 miRNAs are classified into 41 groups. The last column of Table 3 shows the group numbers of these miRNAs.

4.2. Phylogenetic Tree

A phylogenetic tree is a widely-used tool for investigating evolutionary relationship between DNA sequences. In this study, we adopt the phylogenetic tree approach to cluster miRNAs in terms of their phylogenetic structure. The phylogenetic analysis cannot be used to analyze microarray data alone, because it can only be adopted to analyze sequence data. However, it can be used as an ancillary tool to find high-confidence miRNA biomarkers by combining it with a microarray analysis. To access miRNA sequences, miRBase is a useful database that provides most discovered miRNA sequences for many species [18,19]. In this study, the miRNA stem-loop sequences are accessed from miRBase and are used to build a phylogenetic tree. For example, the accession number of Homo sapiens miR-211 (has-mir-211) is MI0000287, and its stem-loop sequence is UCACCUGGCCAUGUGACUUGUGGGCUUCCCUUUGUCAUCCUUCGCCUAGGGCUCUGAGCAGGGCAGGGACAGCAAAGGGGUGCUCAGUUGUCACUUCCCACAGCACGGAG.
The stem-loop sequence of a precursor miRNA includes of a 5p mature miRNA sequence and a 3p mature miRNA sequence. It can provide more information of a miRNA than only using a mature miRNA sequence.
To plot the phylogenetic tree of these 90 miRNAs, we need to adopt a substitution model to calculate pairwise distances between sequences and adopt a hierarchical clustering distance method to build a tree. In this study, we first calculate the pairwise distances between sequences using the Jukes–Cantor substitution model method. After that, we use the nearest distance method (single linkage method) to plot the phylogenetic tree. The MATLAB codes for plotting the phylogenetic tree are:
distances = seqpdist (seqs, ‘Alphabet’, ‘NT’)
phylotree = seqlinkage (distances, ‘single’, seqs)
where seqs is the 90 miRNA stem-loop sequences. The phylogenetic tree of miRNAs subject to their stem-loop sequences is plotted in Figure 3.
The miRNAs in the same clade are considered to have a similar phylogenetic structure. For example, in Figure 3, miR-30a, miR-30b and miR-30e are in a clade, and miR-30a and miR-30d are in a nested clade.

4.3. Procedure of Discovering High-Confidence miRNA Biomarkers

In order to select high-confidence miRNA biomarkers for cancers, we propose a method combining the results of cancer target prediction and the phylogenetic tree. The first step of the method is to find miRNAs that are classified in the same sub-branch in Figure 3. For example, the 5 miRNAs, miR-30a, miR-30b, miR-30c, miR-30d and miR-30e, are in a clade. From Figure 2, these 5 miRNAs are also classified into the same group according to cancer target prediction. From both results, we have more confidence to believe that these 5 miRNAs are involved in pathological mechanism of some particular cancers. Combining the above two methods, we develop a method to classify miRNAs subject to cancer development. The steps of performing this method are given as follows.
Procedure of the proposed method:
Step 1.
Use the stem-loop sequences of miRNAs to build a phylogenetic tree.
Step 2.
Use RRSM or other microarray data analysis to select cancer-related miRNA. Cluster miRNAs into different groups subject to the cancer target prediction result; see Table 3.
Step 3.
Collect miRNAs in the same clade in the phylogenetic tree of Step 1. If miRNAs in the same clade belong to the same group of miRNAs that are clustered in Step 2, these miRNAs are selected to be high-confidence miRNA biomarkers for particular cancers.
Although the steps in this procedure are illustrated using the cancer-related miRNAs, this approach can be generally used to find miRNA biomarkers for other diseases. A flowchart of the method is provided in Figure 4.

5. Conclusions

In this study, we propose combining the phylogenetic tree analysis with the microarray analysis to increase the accuracy of miRNA biomarkers’ prediction. To analyze microarray data, the phylogenetic analysis cannot be used alone without combining a microarray analysis because the phylogenetic tree is used to cluster sequences, but not microarray data. Although the phylogenetic analysis cannot directly extract information from microarray data, the results in this study show that it can be a useful ancillary tool to select high-confidence miRNA biomarkers by combining it with a microarray analysis.

Acknowledgments

The author thanks the Editor and three reviewers for helpful comments. This work has been supported by: Ministry of Science and Technology 103-2118-M-009-001-MY2, Taiwan.

Author Contributions

Hsiuying Wang conceived of and performed the experiments, analyzed the data and wrote the paper.

Conflicts of Interest

The author declares no conflict of interest.

References

  1. Lewis, B.P.; Burge, C.B.; Bartel, D.P. Conserved seed pairing, often flanked by adenosines, indicates that thousands of human genes are microrna targets. Cell 2005, 120, 15–20. [Google Scholar] [CrossRef] [PubMed]
  2. Lee, R.C.; Feinbaum, R.L.; Ambros, V. The c-elegans heterochronic gene lin-4 encodes small RNAs with antisense complementarity to lin-14. Cell 1993, 75, 843–854. [Google Scholar] [CrossRef]
  3. Sassen, S.; Miska, E.A.; Caldas, C. Microrna: Implications for cancer. Virchows Arch. 2008, 452, 1–10. [Google Scholar] [CrossRef] [PubMed]
  4. Foldes-Papp, Z.; Konig, K.; Studier, H.; Buckle, R.; Breunig, H.G.; Uchugonova, A.; Kostner, G.M. Trafficking of mature miRNA-122 into the nucleus of live liver cells. Curr. Pharm. Biotechnol. 2009, 10, 569–578. [Google Scholar] [CrossRef] [PubMed]
  5. Calin, G.A.; Dumitru, C.D.; Shimizu, M.; Bichi, R.; Zupo, S.; Noch, E.; Aldler, H.; Rattan, S.; Keating, M.; Rai, K.; et al. Frequent deletions and down-regulation of micro-RNA genes miR15 and miR16 at 13q14 in chronic lymphocytic leukemia. Proc. Natl. Acad. Sci. USA 2002, 99, 15524–15529. [Google Scholar] [CrossRef] [PubMed]
  6. Croce, C.M. Causes and consequences of microRNA dysregulation in cancer. Nat. Rev. Genet. 2009, 10, 704–714. [Google Scholar] [CrossRef] [PubMed]
  7. Van Schooneveld, E.; Wouters, M.C.A.; van der Auwera, I.; Peeters, D.J.; Wildiers, H.; van Dam, P.A.; Vergote, I.; Vermeulen, P.B.; Dirix, L.Y.; van Laere, S.J. Expression profiling of cancerous and normal breast tissues identifies micrornas that are differentially expressed in serum from patients with (metastatic) breast cancer and healthy volunteers. Breast Cancer Res. 2012, 14, R34. [Google Scholar] [CrossRef] [PubMed]
  8. Hsieh, W.J.; Lin, F.M.; Huang, H.D.; Wang, H. Investigating microrna-target interaction-supported tissues in human cancer tissues based on miRNA and target gene expression profiling. PLoS ONE 2014, 9, e95697. [Google Scholar] [CrossRef] [PubMed]
  9. Wang, H. Predicting cancer-related miRNAs using expression profiles in tumor tissue. Curr. Pharm. Biotechnol. 2014, 15, 438–444. [Google Scholar] [CrossRef] [PubMed]
  10. Chen, W.S.; Wang, H. Variance estimation for nucleotide substitution models. Mol. Phylogenet. Evol. 2015, 93, 380–380. [Google Scholar] [CrossRef]
  11. Wang, H. Confidence intervals for the substitution number in the nucleotide substitution models. Mol. Phylogenet. Evol. 2011, 60, 472–479. [Google Scholar] [CrossRef] [PubMed]
  12. Wang, H.; Hung, S.L. Phylogenetic tree selection by the adjusted k-means approach. J. Appl. Stat. 2012, 39, 643–655. [Google Scholar] [CrossRef]
  13. Graur, D.; Li, W.-H. Fundamentals of Molecular Evolution, 2nd ed.; Sinauer Associates: Sunderland, MA, USA, 2000; p. 481. [Google Scholar]
  14. Huang, J.C.; Babak, T.; Corson, T.W.; Chua, G.; Khan, S.; Gallie, B.L.; Hughes, T.R.; Blencowe, B.J.; Frey, B.J.; Morris, Q.D. Using expression profiling data to identify human microRNA targets. Nat. Methods 2007, 4, 1045–1049. [Google Scholar] [CrossRef] [PubMed]
  15. Wang, H.; Li, W.H. Increasing microRNA target prediction confidence by the relative R2 method. J. Theor. Biol. 2009, 259, 793–798. [Google Scholar] [CrossRef] [PubMed]
  16. Hsieh, W.J.; Wang, H. Human microRNA target identification by RRSM. J. Theor. Biol. 2011, 286, 79–84. [Google Scholar] [CrossRef] [PubMed]
  17. Hsieh, W.J.; Wang, H. RRSM with a data-dependent threshold for miRNA target prediction. J. Theor. Biol. 2013, 337, 54–60. [Google Scholar] [CrossRef] [PubMed]
  18. Kozomara, A.; Griffiths-Jones, S. Mirbase: Integrating microRNA annotation and deep-sequencing data. Nucleic Acids Res. 2011, 39, D152–D157. [Google Scholar] [CrossRef] [PubMed]
  19. Kozomara, A.; Griffiths-Jones, S. Mirbase: Annotating high confidence microRNAs using deep sequencing data. Nucleic Acids Res. 2014, 42, D68–D73. [Google Scholar] [CrossRef] [PubMed]
  20. Zhou, X.J.; Zhang, X.; Yang, Y.M.; Li, Z.W.; Du, L.T.; Dong, Z.G.; Qu, A.L.; Jiang, X.M.; Li, P.L.; Wang, C.X. Urinary cell-free microRNA-106b as a novel biomarker for detection of bladder cancer. Med. Oncol. 2014, 31, 1–7. [Google Scholar] [CrossRef] [PubMed]
  21. Yoshino, H.; Seki, N.; Itesako, T.; Chiyomaru, T.; Nakagawa, M.; Enokida, H. Aberrant expression of microRNAs in bladder cancer. Nat. Rev. Urol. 2013, 10, 396–404. [Google Scholar] [CrossRef] [PubMed]
  22. Mengual, L.; Lozano, J.J.; Ingelmo-Torres, M.; Gazquez, C.; Ribal, M.J.; Alcaraz, A. Using microRNA profiling in urine samples to develop a non-invasive test for bladder cancer. Int. J. Cancer 2013, 133, 2631–2641. [Google Scholar] [PubMed]
  23. Adam, L.; Wszolek, M.F.; Liu, C.G.; Jing, W.; Diao, L.X.; Zien, A.; Zhang, J.T.D.; Jackson, D.; Dinney, C.P.N. Plasma microRNA profiles for bladder cancer detection. Urol. Oncol. Semin. Orig. 2013, 31, 1701–1708. [Google Scholar] [CrossRef] [PubMed]
  24. Zuo, W.; Wang, Z.Z.; Xue, J. Artesunate induces apoptosis of bladder cancer cells by miR-16 regulation of COX-2 expression. Int. J. Mol. Sci. 2014, 15, 14298–14312. [Google Scholar] [CrossRef] [PubMed]
  25. Itesako, T.; Seki, N.; Yoshino, H.; Chiyomaru, T.; Yamasaki, T.; Hidaka, H.; Yonezawa, T.; Nohata, N.; Kinoshita, T.; Nakagawa, M.; et al. The microrna expression signature of bladder cancer by deep sequencing: The functional significance of the miR-195/497 cluster. PLoS ONE 2014, 9, e84311. [Google Scholar] [CrossRef] [PubMed]
  26. Pham, H.; Rodriguez, C.E.; Donald, G.W.; Hertzer, K.M.; Jung, X.S.; Chang, H.H.; Moro, A.; Reber, H.A.; Hines, O.J.; Eibl, G. miR-143 decreases cox-2 mRNA stability and expression in pancreatic cancer cells. Biochem. Biophys. Res. Commun. 2013, 439, 6–11. [Google Scholar] [CrossRef] [PubMed]
  27. Hu, Y.; Ou, Y.; Wu, K.; Chen, Y.; Sun, W. miR-143 inhibits the metastasis of pancreatic cancer and an associated signaling pathway. Tumour Biol. 2012, 33, 1863–1870. [Google Scholar] [CrossRef] [PubMed]
  28. Gu, W.; Fang, S.R.; Gao, L.H.; Tan, Y.; Yang, Z.H. Clinic significance of microRNA-99a expression in human lung adenocarcinoma. J. Surg. Oncol. 2013, 108, 248–255. [Google Scholar] [CrossRef] [PubMed]
  29. Feng, B.; Wang, R.; Chen, L.B. miR-100 resensitizes docetaxel-resistant human lung adenocarcinoma cells (SPC-A1) to docetaxel by targeting Plk1. Cancer Lett. 2012, 317, 184–191. [Google Scholar] [CrossRef] [PubMed]
  30. Zhou, H.L.; Rigoutsos, I. miR-103a-3p targets the 5′ UTR of GPRC5A in pancreatic cells. RNA 2014, 20, 1431–1439. [Google Scholar] [CrossRef] [PubMed]
  31. Zhang, Z.; Zhang, L.; Yin, Z.Y.; Fan, X.L.; Hu, B.; Wang, L.Q.; Zhang, D. miR-107 regulates cisplatin chemosensitivity of a549 non small cell lung cancer cell line by targeting cyclin dependent kinase 8. Int. J. Clin. Exp. Pathol. 2014, 7, 7236–7241. [Google Scholar] [PubMed]
  32. Iliopoulos, D.; Rotem, A.; Struhl, K. Inhibition of miR-193a expression by Max and RXRα activates K-Ras and PLAU to mediate distinct aspects of cellular transformation. Cancer Res. 2011, 71, 5144–5153. [Google Scholar] [CrossRef] [PubMed]
  33. Leivonen, S.K.; Rokka, A.; Ostling, P.; Kohonen, P.; Corthals, G.L.; Kallioniemi, O.; Perala, M. Identification of miR-193b targets in breast cancer cells and systems biological analysis of their functional impact. Mol. Cell. Proteom. 2011, 10. [Google Scholar] [CrossRef] [PubMed]
  34. Song, M.X.; Yin, Y.; Zhang, J.W.; Zhang, B.B.; Bian, Z.H.; Quan, C.; Zhou, L.Y.; Hu, Y.L.; Wang, Q.F.; Ni, S.J.; et al. miR-139–5p inhibits migration and invasion of colorectal cancer by downregulating AMFR and NOTCH1. Protein Cell 2014, 5, 851–861. [Google Scholar] [CrossRef] [PubMed]
  35. Wiklund, E.D.; Bramsen, J.B.; Hulf, T.; Dyrskjot, L.; Ramanathan, R.; Hansen, T.B.; Villadsen, S.B.; Gao, S.; Ostenfeld, M.S.; Borre, M.; et al. Coordinated epigenetic repression of the miR-200 family and miR-205 in invasive bladder cancer. Int. J. Cancer 2011, 128, 1327–1334. [Google Scholar] [CrossRef] [PubMed]
  36. Krishnan, K.; Steptoe, A.L.; Martin, H.C.; Pattabiraman, D.R.; Nones, K.; Waddell, N.; Mariasegaram, M.; Simpson, P.T.; Lakhani, S.R.; Vlassov, A.; et al. miR-139–5p is a regulator of metastatic pathways in breast cancer. RNA 2013, 19, 1767–1780. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  37. Uchida, Y.; Chiyomaru, T.; Enokida, H.; Kawakami, K.; Tatarano, S.; Kawahara, K.; Nishiyama, K.; Seki, N.; Nakagawa, M. miR-133a induces apoptosis through direct regulation of GSTP1 in bladder cancer cell lines. Urol. Oncol. Semin. Orig. 2013, 31, 115–123. [Google Scholar] [CrossRef] [PubMed]
  38. Wang, H.; An, H.Y.; Wang, B.; Liao, Q.; Li, W.D.; Jin, X.J.; Cui, S.Z.; Zhang, Y.J.; Ding, Y.Q.; Zhao, L. miR-133a represses tumour growth and metastasis in colorectal cancer by targeting lim and SH3 protein 1 and inhibiting the mapk pathway. Eur. J. Cancer 2013, 49, 3924–3935. [Google Scholar] [CrossRef] [PubMed]
  39. Liu, P.; Tang, H.L.; Chen, B.; He, Z.M.; Deng, M.; Wu, M.Q.; Liu, X.P.; Yang, L.; Ye, F.; Xie, X.M. miR-26a suppresses tumour proliferation and metastasis by targeting metadherin in triple negative breast cancer. Cancer Lett. 2015, 357, 384–392. [Google Scholar] [CrossRef] [PubMed]
  40. Xu, Q.; Jiang, Y.; Yin, Y.; Li, Q.; He, J.; Jing, Y.; Qi, Y.T.; Xu, Q.; Li, W.; Lu, B.; et al. A regulatory circuit of miR-148a/152 and dnmt1 in modulating cell transformation and tumor angiogenesis through IGF-IR and IRS1. J. Mol. Cell Biol. 2013, 5, 3–13. [Google Scholar] [CrossRef] [PubMed]
  41. Bao, B.; Wang, Z.W.; Ali, S.; Ahmad, A.; Azmi, A.S.; Sarkar, S.H.; Banerjee, S.; Kong, D.J.; Li, Y.W.; Thakur, S.; et al. Metformin inhibits cell proliferation, migration and invasion by attenuating CSC function mediated by deregulating mirnas in pancreatic cancer cells. Cancer Prev. Res. 2012, 5, 355–364. [Google Scholar] [CrossRef] [PubMed]
  42. Zhang, Q.; Yu, L.; Qin, D.D.; Huang, R.; Jiang, X.C.; Zou, C.D.; Tang, Q.C.; Chen, Y.G.; Wang, G.Y.; Wang, X.S.; et al. Role of microRNA-30c targeting ADAM19 in colorectal cancer. PLoS ONE 2015, 10, e0120698. [Google Scholar] [CrossRef] [PubMed]
  43. Patnaik, S.K.; Kannisto, E.; Yendamuri, S. Overexpression of microRNA miR-30a or miR-191 in a549 lung cancer or BEAS-2B normal lung cell lines does not alter phenotype. PLoS ONE 2010, 5, e9219. [Google Scholar] [CrossRef] [PubMed]
  44. Li, L. Regulatory mechanisms and clinical perspectives of miR-34a in cancer. J. Cancer Res. Ther. 2014, 10, 805–810. [Google Scholar] [CrossRef] [PubMed]
  45. Misso, G.; di Martino, M.T.; de Rosa, G.; Farooqi, A.A.; Lombardi, A.; Campani, V.; Zarone, M.R.; Gulla, A.; Tagliaferri, P.; Tassone, P.; et al. miR-34: A new weapon against cancer? Mol. Ther. Nucleic Acids 2014, 3, e194. [Google Scholar] [CrossRef] [PubMed]
  46. Huang, L.L.; Wang, X.Y.; Wen, C.Y.; Yang, X.L.; Song, M.M.; Chen, J.X.; Wang, C.L.; Zhang, B.; Wang, L.; Iwamoto, A.; et al. Hsa-miR-19a is associated with lymph metastasis and mediates the TNF-α induced epithelial-to-mesenchymal transition in colorectal cancer. Sci. Rep. 2015, 5, 13350. [Google Scholar] [CrossRef] [PubMed]
  47. Yamamoto, K.; Ito, S.; Hanafusa, H.; Shimizu, K.; Ouchida, M. Uncovering direct targets of miR-19a involved in lung cancer progression. PLoS ONE 2015, 10, e0137887. [Google Scholar] [CrossRef] [PubMed]
  48. Hwang, W.L.; Jiang, J.K.; Yang, S.H.; Huang, T.S.; Lan, H.Y.; Teng, H.W.; Yang, C.Y.; Tsai, Y.P.; Lin, C.H.; Wang, H.W.; et al. MicroRNA-146a directs the symmetric division of snail-dominant colorectal cancer stem cells. Nat. Cell Biol. 2014, 16, 383–383. [Google Scholar] [CrossRef]
  49. Jiang, W.; Gu, W.; Qiu, R.; Shen, C.; YaohaoWu, E.Y.; Zhang, J.; Zhou, J.; Guo, Y.; Li, Z.; Deng, J.; et al. MiRNA-101 suppresses epithelial-to-mesenchymal transition by targeting HMGA2 in pancreatic cancer cells. Anti-Cancer Agents Med. Chem. 2016, 16, 432–439. [Google Scholar] [CrossRef]
  50. Cornett, A.L.; Lutz, C.S. Regulation of cox-2 expression by miR-146a in lung cancer cells. RNA 2014, 20, 1419–1430. [Google Scholar] [CrossRef] [PubMed]
  51. Smith, A.R.; Marquez, R.T.; Tsao, W.C.; Pathak, S.; Roy, A.; Ping, J.; Wilkerson, B.; Lan, L.; Meng, W.J.; Neufeld, K.L.; et al. Tumor suppressive microRNA-137 negatively regulates musashi-1 and colorectal cancer progression. Oncotarget 2015, 6, 12558–12573. [Google Scholar] [CrossRef] [PubMed]
  52. Xiu, Y.C.; Liu, Z.; Xia, S.Y.; Jin, C.J.; Yin, H.F.; Zhao, W.M.; Wu, Q. MicroRNA-137 upregulation increases bladder cancer cell proliferation and invasion by targeting PAQR3. PLoS ONE 2014, 9, e109734. [Google Scholar] [CrossRef] [PubMed]
  53. Selth, L.A.; Townley, S.L.; Bert, A.G.; Stricker, P.D.; Sutherland, P.D.; Horvath, L.G.; Goodall, G.J.; Butler, L.M.; Tilley, W.D. Circulating micrornas predict biochemical recurrence in prostate cancer patients. Br. J. Cancer 2013, 109, 641–650. [Google Scholar] [CrossRef] [PubMed]
  54. Zhang, J.; Zhao, C.Y.; Zhang, S.H.; Yu, D.H.; Chen, Y.; Liu, Q.H.; Shi, M.; Ni, C.R.; Zhu, M.H. Upregulation of miR-194 contributes to tumor growth and progression in pancreatic ductal adenocarcinoma. Oncol. Rep. 2014, 31, 1157–1164. [Google Scholar] [PubMed]
  55. Fan, Y.; Song, X.; Du, H.; Luo, C.; Wang, X.; Yang, X.; Wang, Y.; Wu, X. Down-regulation of miR-29c in human bladder cancer and the inhibition of proliferation in T24 cell via PI3K-AKT pathway. Med. Oncol. 2014, 31, 65. [Google Scholar] [CrossRef] [PubMed]
  56. Duhachek-Muggy, S.; Zolkiewska, A. Adam12-l is a direct target of the miR-29 and miR-200 families in breast cancer. BMC Cancer 2015, 15, 1. [Google Scholar] [CrossRef] [PubMed]
  57. Taylor, M.A.; Sossey-Alaoui, K.; Thompson, C.L.; Danielpour, D.; Schiemann, W.P. TGF-β upregulates miR-181a expression to promote breast cancer metastasis. J. Clin. Investig. 2013, 123, 150–163. [Google Scholar] [CrossRef] [PubMed]
  58. Liu, J.H.; Xu, D.; Wang, Q.G.; Zheng, D.T.; Jiang, X.Q.; Xu, L.J. LPS induced miR-181a promotes pancreatic cancer cell migration via targeting PTEN and MAP2K4. Dig. Dis. Sci. 2014, 59, 1452–1460. [Google Scholar] [CrossRef] [PubMed]
  59. Ji, S.; Shao, G.; Lv, X.; Liu, Y.; Fan, Y.; Wu, A.; Hu, H. Downregulation of miRNA-128 sensitises breast cancer cell to chemodrugs by targeting bax. Cell Biol. Int. 2013, 37, 653–658. [Google Scholar] [CrossRef] [PubMed]
  60. Jin, M.; Zhang, T.; Liu, C.; Badeaux, M.A.; Liu, B.; Liu, R.; Jeter, C.; Chen, X.; Vlassov, A.V.; Tang, D.G. miRNA-128 suppresses prostate cancer by inhibiting BMI-1 to inhibit tumor-initiating cells. Cancer Res. 2014, 74, 4183–4195. [Google Scholar] [CrossRef] [PubMed]
  61. Xia, B.; Yang, S.; Liu, T.; Lou, G. miR-211 suppresses epithelial ovarian cancer proliferation and cell-cycle progression by targeting cyclin d1 and cdk6. Mol. Cancer 2015, 14, 57. [Google Scholar] [CrossRef] [PubMed]
  62. Li, W.D.; Jin, X.J.; Zhang, Q.B.; Zhang, G.; Deng, X.B.; Ma, L. Decreased expression of miR-204 is associated with poor prognosis in patients with breast cancer. Int. J. Clin. Exp. Pathol. 2014, 7, 3287–3292. [Google Scholar] [PubMed]
  63. Doberstein, K.; Steinmeyer, N.; Hartmetz, A.K.; Eberhardt, W.; Mittelbronn, M.; Harter, P.N.; Juengel, E.; Blaheta, R.; Pfeilschifter, J.; Gutwein, P. MicroRNA-145 targets the metalloprotease ADAM17 and is suppressed in renal cell carcinoma patients. Neoplasia 2013, 15, 218–230. [Google Scholar] [CrossRef] [PubMed]
  64. Kou, B.; Gao, Y.; Du, C.; Shi, Q.; Xu, S.; Wang, C.Q.; Wang, X.Y.; He, D.L.; Guo, P. miR-145 inhibits invasion of bladder cancer cells by targeting PAK1. Urol. Oncol. Semin. Orig. 2014, 32, 846–854. [Google Scholar] [CrossRef] [PubMed]
  65. Yu, N.W.; Fu, S.; Liu, Y.B.; Xu, Z.H.; Liu, Y.; Hao, J.W.; Wang, B.C.; Zhang, A.M. miR-96 suppresses renal cell carcinoma invasion via downregulation of ezrin expression. J. Exp. Clin. Cancer Res. 2015, 34, 1. [Google Scholar] [CrossRef] [PubMed]
  66. Feng, J.; Yu, J.B.; Pan, X.L.; Li, Z.L.; Chen, Z.; Zhang, W.J.; Wang, B.; Yang, L.; Xu, H.; Zhang, G.X.; et al. HERG1 functions as an oncogene in pancreatic cancer and is downregulated by miR-96. Oncotarget 2014, 5, 5832–5844. [Google Scholar] [CrossRef] [PubMed]
  67. Tang, W.; Yu, F.; Yao, H.; Cui, X.; Jiao, Y.; Lin, L.; Chen, J.; Yin, D.; Song, E.; Liu, Q. miR-27a regulates endothelial differentiation of breast cancer stem like cells. Oncogene 2014, 33, 2629–2638. [Google Scholar] [CrossRef] [PubMed]
  68. Li, J.P.; Wang, Y.P.; Song, Y.L.; Fu, Z.M.; Yu, W.J. miR-27a regulates cisplatin resistance and metastasis by targeting RKIP in human lung adenocarcinoma cells. Mol. Cancer 2014, 13, 1. [Google Scholar] [CrossRef] [PubMed]
  69. Ferracin, M.; Bassi, C.; Pedriali, M.; Pagotto, S.; D’Abundo, L.; Zagatti, B.; Corra, F.; Musa, G.; Callegari, E.; Lupini, L.; et al. miR-125b targets erythropoietin and its receptor and their expression correlates with metastatic potential and ERBB2/HER2 expression. Mol. Cancer 2013, 12, 130. [Google Scholar] [CrossRef] [PubMed]
  70. Cortez, M.A.; Valdecanas, D.; Zhang, X.C.; Zhan, Y.A.; Bhardwaj, V.; Calin, G.A.; Komaki, R.; Giri, D.K.; Quini, C.C.; Wolfe, T.; et al. Therapeutic delivery of miR-200c enhances radiosensitivity in lung cancer. Mol. Ther. 2014, 22, 1494–1503. [Google Scholar] [CrossRef] [PubMed]
  71. Zhang, H.S.; Hao, Y.; Yang, J.Y.; Zhou, Y.; Li, J.; Yin, S.Y.; Sun, C.H.; Ma, M.; Huang, Y.Y.; Xi, J.J. Genome-wide functional screening of miR-23b as a pleiotropic modulator suppressing cancer metastasis. Nat. Commun. 2011, 2, 554. [Google Scholar] [CrossRef] [PubMed]
  72. Li, W.P.; Liu, Z.Y.; Chen, L.; Zhou, L.; Yao, Y.Q. MicroRNA-23b is an independent prognostic marker and suppresses ovarian cancer progression by targeting runt-related transcription factor-2. FEBS Lett. 2014, 588, 1608–1615. [Google Scholar] [CrossRef] [PubMed]
  73. Lu, M.; Zhang, Q.; Deng, M.; Miao, J.; Guo, Y.; Gao, W.; Cui, Q. An analysis of human microRNA and disease associations. PLoS ONE 2008, 3, e3420. [Google Scholar] [CrossRef] [PubMed]
  74. Wang, B.; Wang, X.F.; Xi, Y. Normalizing bead-based microrna expression data: A measurement error model-based approach. Bioinformatics 2011, 27, 1506–1512. [Google Scholar] [CrossRef] [PubMed]
Figure 1. The numbers of miRNA selected by the proposed method or the microarray analysis.
Figure 1. The numbers of miRNA selected by the proposed method or the microarray analysis.
Ijms 17 00773 g001
Figure 2. Ninety miRNA classifications subject to target cancer.
Figure 2. Ninety miRNA classifications subject to target cancer.
Ijms 17 00773 g002
Figure 3. Phylogenetic tree of 90 miRNAs.
Figure 3. Phylogenetic tree of 90 miRNAs.
Ijms 17 00773 g003
Figure 4. The flowchart of the method.
Figure 4. The flowchart of the method.
Ijms 17 00773 g004
Table 1. The classification of miRNAs that are selected by the proposed method subject to cancer development.
Table 1. The classification of miRNAs that are selected by the proposed method subject to cancer development.
MircoRNACancerValidation from Other References
miR-17, miR-20, miR-106a, miR-106bBladder[20,21]
miR-92, miR-25Bladder[22,23]
miR-16, miR-195Bladder[24,25]
miR-143Pancreatic[26,27]
miR-99a, miR-99b, miR-100Pancreatic, Lung[28,29]
miR-103, miR-107Pancreatic, Lung[30,31]
miR-193Colon, Breast[32,33]
miR-205Pancreatic, Bladder[34,35]
miR-139Colon, Breast, Bladder[34,36]
miR-133aColon, Pancreatic, Bladder[37,38]
miR-152, miR-148Lung, Breast, Bladder[39,40]
miR-26a, miR-26bPancreatic, Breast, Bladder[39,41]
miR-30a, miR-30b, miR-30c, miR-30d, miR-30eColon, Pancreatic, Lung, Bladder[42,43]
miR-34b, miR-34cColon, Lung, Breast, Kidney[44,45]
miR-19a, miR-19bColon, Lung, Breast, Bladder[46,47]
miR-101Colon, Pancreatic, Breast, Kidney[48,49]
miR-146Colon, Lung, Bladder, Kidney[48,50]
miR-137Colon, Pancreatic, Bladder, Kidney[51,52]
miR-194Prostate, Pancreatic, Lung, Bladder[53,54]
miR-29a, miR-29b, miR-29cProstate, Breast, Bladder, Kidney[55,56]
miR-181a, miR-181cPancreatic, Breast, Bladder, Kidney[57,58]
miR-128a, miR-128bProstate, Pancreatic, Breast, Bladder[59,60]
miR-204, miR-211Pancreatic, Breast, Bladder, Kidney[61,62]
miR-145Colon, Pancreatic, Breast, Bladder, Kidney[63,64]
miR-96Colon, Prostate, Pancreatic, Breast, Kidney[65,66]
miR-27a, miR-27bProstate, Pancreatic, Lung, Breast, Bladder, Kidney[67,68]
miR-125a, miR-125b, miR-200bColon, Prostate, Pancreatic, Lung, Breast, Bladder, Kidney[69,70]
miR-23a, miR-23bColon, Prostate, Pancreatic, Lung, Breast, Bladder, Kidney[71,72]
Table 2. Numbers of miRNA and the sensitivities and specificities of the proposed method. HMDD, Human MicroRNA Disease Database.
Table 2. Numbers of miRNA and the sensitivities and specificities of the proposed method. HMDD, Human MicroRNA Disease Database.
miRNAs Selected in [9]miRNAs Confirmed by HMDDmiRNAs Selected by the MethodmiRNAs Selected by the Method and Confirmed by HMDDSensitivitySpecificity
ABCDD/B(C − D)/(A − B)
Colon422119100.4760.429
Pancreatic542933170.5860.64
Prostate2421410.50.591
Lung413425200.5880.714
Breast494229260.6190.429
Bladder703442170.50.694
Kidney37102160.60.556
Table 3. Potential cancer-related miRNAs marked by “v”.
Table 3. Potential cancer-related miRNAs marked by “v”.
ColonProstatePancreaticLungBreastBladderKidneyGroup Number in Figure 2
miR-124avvvvvv 1
miR-9vvvvvv 1
miR-182vvvvvv 1
miR-135vvvvvv 1
miR-125bvvvvvvv2
miR-23bvvvvvvv2
miR-23avvvvvvv2
miR-125avvvvvvv2
miR-200bvvvvvvv2
miR-200cvvvvvvv2
miR-146v v vv3
miR-199vv v vv4
miR-1v v 5
miR-30bv vv v 6
miR-200av vv v 6
miR-30av vv v 6
miR-30dv vv v 6
miR-30cv vv v 6
miR-30ev vv v 6
miR-137v v vv7
miR-19av vvv 8
miR-19bv vvv 8
miR-203v vvvv 9
miR-155v vvvv 9
miR-33v vvvv10
miR-219v 11
miR-216v 11
miR-223v vvv12
miR-193v v 13
miR-29b v vvv14
miR-29c v vvv14
miR-29a v vvv14
miR-206v v v15
miR-218 vv vv 16
miR-128b vv vv 16
miR-128a vv vv 16
miR-34av vv v17
miR-34bv vv v17
miR-34cv vv v17
miR-194 vvv v 18
miR-138 vvv 19
miR-96vvv v v20
miR-27b vvvvvv21
miR-27a vvvvvv21
miR-99a vv 22
miR-100 vv 22
miR-107 vv 22
miR-103 vv 22
miR-99b vv 22
miR-181a v vvv23
miR-181b v vvv23
miR-204 v vvv23
miR-211 v vvv23
miR-181c v vvv23
miR-24v vvvvv24
miR-205 v v 25
miR-215 v vv26
miR-192 v vv26
miR-21vvv vv27
miR-190 v vv 28
miR-26a v vv 28
miR-144 v vv 28
miR-26b v vv 28
miR-183vvv vv 29
miR-22 vvvvv30
miR-145v v vvv31
miR-140v v 32
miR-139v vv 33
miR-143 v 34
miR-133av v v 35
miR-18 v 36
miR-101v v v v37
miR-152 vvv 38
miR-148 vvv 38
miR-141 vvv 38
miR-302 v v39
miR-93 v v39
miR-16 v 40
miR-92 v 40
miR-142 v 40
miR106a v 40
miR-17 v 40
miR-195 v 40
miR-20 v 40
miR-15a v 40
miR-153 v 40
miR-106b v 40
miR-25 v 40
miR-32 v 40
miR-199b v41

Share and Cite

MDPI and ACS Style

Wang, H. Predicting MicroRNA Biomarkers for Cancer Using Phylogenetic Tree and Microarray Analysis. Int. J. Mol. Sci. 2016, 17, 773. https://0-doi-org.brum.beds.ac.uk/10.3390/ijms17050773

AMA Style

Wang H. Predicting MicroRNA Biomarkers for Cancer Using Phylogenetic Tree and Microarray Analysis. International Journal of Molecular Sciences. 2016; 17(5):773. https://0-doi-org.brum.beds.ac.uk/10.3390/ijms17050773

Chicago/Turabian Style

Wang, Hsiuying. 2016. "Predicting MicroRNA Biomarkers for Cancer Using Phylogenetic Tree and Microarray Analysis" International Journal of Molecular Sciences 17, no. 5: 773. https://0-doi-org.brum.beds.ac.uk/10.3390/ijms17050773

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop