Next Article in Journal
Anti-Tumor Activity of Expanded PBMC-Derived NK Cells by Feeder-Free Protocol in Ovarian Cancer
Previous Article in Journal
Radiotherapy in the Treatment of Subcutaneous Melanoma
 
 
Search for Articles:
Title / Keyword
Author / Affiliation / Email
Journal
Article Type
 
 
Advanced Search
 
Section
Special Issue
Volume
Issue
Number
Page
 
Journals
Cancers
Volume 13
Issue 22
10.3390/cancers13225864
cancers-logo
Submit to this Journal Review for this Journal Propose a Special Issue
► Article Menu

Article Menu

share Share announcement Help format_quote Cite question_answer Discuss in SciProfiles thumb_up
...
Endorse textsms
...
Comment
first_page
settings
Order Article Reprints
Font Type:
Arial Georgia Verdana
Font Size:
Aa Aa Aa
Line Spacing:
Column Width:
Background:
Review

Radiomics Models for Predicting Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Radiomics Quality Score Assessment

by
Qiang Wang
1,2,*,
Changfeng Li
3,
Jiaxing Zhang
4,
Xiaojun Hu
5,6,
Yingfang Fan
6,7,
Kuansheng Ma
3,
Ernesto Sparrelid
8 and
Torkel B. Brismar
1,2
1
Division of Medical Imaging and Technology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, 14186 Stockholm, Sweden
2
Division of Radiology, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, Karolinska University Hospital, 14186 Stockholm, Sweden
3
Institute of Hepatobiliary Surgery, Southwest Hospital, Army Medical University (Third Military Medical University), Chongqing 400038, China
4
Department of Pharmacy, Guizhou Provincial People’s Hospital, Guiyang 550002, China
5
Hepatobiliary Surgery, The Fifth Affiliated Hospital, Southern Medical University, Guangzhou 510999, China
6
The Second School of Clinical Medicine, Southern Medical University, Guangzhou 510515, China
7
Hepatobiliary Surgery, Zhujiang Hospital, Southern Medical University, Guangzhou 510280, China
8
Division of Surgery, Department of Clinical Science, Intervention and Technology (CLINTEC), Karolinska Institutet, Karolinska University Hospital, 14186 Stockholm, Sweden
*
Author to whom correspondence should be addressed.
Cancers 2021, 13(22), 5864; https://0-doi-org.brum.beds.ac.uk/10.3390/cancers13225864
Submission received: 15 October 2021 / Revised: 13 November 2021 / Accepted: 17 November 2021 / Published: 22 November 2021
(This article belongs to the Section Systematic Review or Meta-Analysis in Cancer Research)
Browse Figures
Versions Notes

Abstract

:

Simple Summary

Microvascular invasion (MVI) is regarded as a sign of early metastasis in liver cancer and can be only diagnosed by a histopathology exam in the resected specimen. Preoperative prediction of MVI status may exert an effect on patient treatment management, for instance, to expand the resection margin. Radiomics can identify delicate imaging features from routinely used radiological images that are invisible to the naked eye and has been increasingly adopted to predict MVI. We reviewed the available radiomics models to evaluate their role in the prediction of MVI. The discriminative capacity of the models ranged from 0.69 to 0.94. Even though the studies were preliminary and the methodologic quality was suboptimal, radiomics models hold promise for the accurate and non-invasive prediction of MVI. In accordance with a standardized radiomics workflow, future prospective studies with external validation are expected to provide a reliable and robust prediction tool for clinical implementation.

Abstract

Preoperative prediction of microvascular invasion (MVI) is of importance in hepatocellular carcinoma (HCC) patient treatment management. Plenty of radiomics models for MVI prediction have been proposed. This study aimed to elucidate the role of radiomics models in the prediction of MVI and to evaluate their methodological quality. The methodological quality was assessed by the Radiomics Quality Score (RQS), and the risk of bias was evaluated by the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2). Twenty-two studies using CT, MRI, or PET/CT for MVI prediction were included. All were retrospective studies, and only two had an external validation cohort. The AUC values of the prediction models ranged from 0.69 to 0.94 in the test cohort. Substantial methodological heterogeneity existed, and the methodological quality was low, with an average RQS score of 10 (28% of the total). Most studies demonstrated a low or unclear risk of bias in the domains of QUADAS-2. In conclusion, a radiomics model could be an accurate and effective tool for MVI prediction in HCC patients, although the methodological quality has so far been insufficient. Future prospective studies with an external validation cohort in accordance with a standardized radiomics workflow are expected to supply a reliable model that translates into clinical utilization.

1. Introduction

Microvascular invasion (MVI) has been recognized as an independent predictor for early recurrence and poor prognosis after liver resection or transplantation in hepatocellular carcinoma (HCC) [1,2]. Its reported incidence ranges from 15% to 57% according to different diagnostic criteria and study population [3]. The diagnosis of MVI, however, is only made by a postoperative histopathology exam on the resected specimen, which exerts little or no influence on the patient treatment management, while with the knowledge of MVI, clinicians can optimize a patient treatment strategy, for example, to expand the resection margin in operation or to adopt an alternative treatment option. To implement personalized medicine, it is of utmost importance to preoperatively identify and stratify patients with MVI. Therefore, a reliable, noninvasive biomarker for preoperative prediction of MVI is urgently needed.
Medical imaging has evolved from a primarily diagnostic tool to an essential role in clinical decision making. Clinically, radiologists use pattern recognition after establishing links between radiological features at CT or MRI images and MVI [4,5], such as arterial peritumoral enhancement, non-smooth tumor margins, and rim arterial enhancement [2]. The Liver Imaging Reporting and Data System (LI-RADS) has recently been developed and has evolved as a comprehensive and standardized diagnostic algorithm for HCC imaging reporting [6]. LI-RADS has been proven to be an effective tool not only for HCC diagnosis but also for outcome prediction after liver resection, radiofrequency ablation, or liver transplantation [6,7,8], exerting an increasing influence on the treatment management of HCC. Previous studies have demonstrated the diagnostic value of LI-RADS in the prediction of MVI [9,10]. However, these qualitative features suffer from their subjectivity and high inter-observer variability [11].
Radiomics is an emerging field that can extract high-throughput imaging features from biomedical images and convert them into mineable data for quantitative analysis [12,13]. Its basic assumption lies on that the alterations and heterogeneity of the tumor on the micro scale (e.g., cell or molecular levels) can be reflected in the images [14]. Therefore, through radiomics analysis, the cancerous cell emboli (i.e., MVI) in the hepatic vasculature can be detected in the preoperative images, which holds promise for the preoperative prediction of MVI and personalized treatment. In recent years, a number of radiomics models for MVI prediction have emerged. However, there has not been any research systematically summarizing current radiomics research for MVI prediction, and the overall efficacy of the prediction model is still unknown. In addition, as radiomics research is a sophisticated process and consists of several steps, it is important to evaluate the methodological variability to obtain a reliable and reproducible model before translating it to clinical applications. The current systematic review therefore aims (1) to provide an overview of radiomics studies for MVI prediction in HCC patients and assess the efficacy of the prediction models and (2) to evaluate the methodologic quality in the radiomics workflow and the risk of bias in the research.

2. Materials and Methods

This study is registered at the PROSPERO website (https://www.crd.york.ac.uk/prospero/, No: CRD42021250082, (accessed on 20 May 2021)) and was conducted under the guidance of the Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) (Table S1).

2.1. Literature Research and Study Selection

Publications from databases of the PubMed, Embase, Web of Science, and Cochrane libraries were systematically retrieved by using the following key terms: “radiomics/texture analysis”, “microvascular invasion”, and “hepatocellular carcinoma”. Detailed searching queries in each database can be found in Table S2. The last updated date of the literature search is 29 May 2021.
Records satisfying the following criteria were considered as eligible: Inclusion criteria: (1) retrospective or prospective studies; (2) studies considering patients who were diagnosed with hepatocellular carcinoma by a pathology exam; (3) studies with radiomics features extracted from CT, MRI, or PET/CT images used as predictors for MVI, solely or as a variable in a model; (4) studies where MVI prediction is the main outcome or one of the main outcomes; (5) publications in English. Exclusion criteria: (1) publications in the form of a letter, conference abstract, editorial, review, or case report; (2) research considering only semantic radiological features used for MVI prediction; (3) research with operator-dependent imaging modalities, such as ultrasound-based studies; (4) deep-learning research not involving any textural features in the model; (5) studies only evaluating the predictive value of a single radiomics feature, without any combination into a multiple features prediction model; (6) studies with a sample size of less than 30.
Study selection was conducted by two reviewers (Q.W. and C.L.) by screening the title and abstract and then the full text. Any disagreement or uncertainty was resolved by two senior researchers (K.M. and T.B.) to reach a consensus. Reference lists of the enrolled studies as well as a pre-existing systematic review/meta-analysis were also searched manually to recruit any potentially eligible studies.

2.2. Data Extraction

A pre-defined table was used to extract the following information from each paper: (1) general study characteristics; (2) patient characteristics; (3) characteristics in development of a radiomics model, including imaging modalities, tumor segmentation, imaging preprocessing and feature extraction, and feature selection and modelling; (4) performance metrics of a radiomics model, including area under the receiver operating characteristic (ROC) curve (AUC), calibration statistics, and decision analysis. A typical radiomics research workflow for MVI prediction is illustrated in Figure 1.
If several prediction models were developed in one study, the one with the best performance in the test cohort was selected. For studies from the same medical center with subjects overlapped, if the same imaging modality was adopted, the latest study was included; if different modalities or different contrast media used in the same modality were applied, both studies were enrolled. Supplemental files of included studies were also screened to extract required data, if necessary.
The terms “test cohort” and “validation cohort” were unified in this study to avoid potential misunderstanding and confusion. A “test cohort” is a part of the model development cohort and usually refers to an “internal test cohort”. A “validation cohort” is independent from the model development cohort, be it temporal validation (data collected from a later period) or geographic validation (data sampled from another hospital or country) [15], and it is often called an “external validation cohort”.

2.3. Assessment of Radiomics Quality Score, Risk of Bias, and Research Type

The Radiomics Quality Score (RQS) is a scoring system proposed by Lambin in 2017 [16] and is commonly used for evaluating the methodologic quality of the radiomics research [17,18]. The RQS tool contains 16 key items to quantify the quality of the radiomics workflow and the reporting. Most items are designated to 0, 1, or 2 points, according to how well a study achieves the signaling question. To highlight the importance of some dimensions, a higher point is assigned; for example, 7 points is given to a prospective validation study, and 5 points is given to a study validated in three or more datasets. The ideal score of the RQS is 36 points, responding to a percentage of 100%. Table S3 provides a detailed description of the RQS items.
As the radiomics model is also used as a diagnostic tool, the risk of bias and the applicability concerns of the included studies were further assessed by using the revised Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool [19]. QUADAS-2 evaluates the risk of bias of a study in four domains: patient selection, index test, reference standard, and flow and timing. The results of each domain were marked as low, high risk, or unclear. Detailed description of QUADAS-2 is provided in Table S4.
An assessment of the RQS and QUADAS-2 was independently performed and cross-validated by two reviewers (Q.W. and C.L.). When discrepancy occurred, agreement was reached after discussion with two senior researchers (K.M. and T.B.).

3. Results

3.1. Literature Selection

The systematic literature search initially yielded 188 records from the four databases. After removing 82 duplicates, 50 inappropriate types of publications, and 34 ineligible studies, a total of 22 studies were included in this systematic review [20,21,22,23,24,25,26,27,28,29,30,31,32,33,34,35,36,37,38,39,40,41] (Figure 2).

3.2. General Characteristics and the Incidence of MVI

The included 22 studies were published between September 2017 and May 2021, with two thirds (15/22) within the last two years. All studies were retrospectively designed and, in total, included 5552 patients with a sample size varying from 69 to 637 patients (median: 174). Most studies (20/22) split the cohort into a training and a test cohort, while only two of them further validated their model using an independent external cohort [25,29]. Nine studies (8/22) focused on solitary HCC, among which five focused on HCC with a diameter of less than 5 cm.
The incidence of MVI ranged from 25.3% to 67.5% for an individual entire cohort, and 25.3% to 56.4% for HCC less than 5 cm. Around two thirds (16/22) of the studies explicitly stated their definition of MVI. Table 1 gives more details about the general characteristics of the reviewed studies.

3.3. RQS and Risk of Bias Assessment

The average RQS score of the included studies was 10, accounting for 28% of the total points. The highest RQS score was 15 points (42%), seen in only one study [16]. Around half of the studies were credited between 11 and 14 points, corresponding to 30–40% of total points (Figure 3A). As no research considered the items of “phantom study”, “prospective study”, “detect and discuss biological correlates”, “cost-effectiveness analysis”, or “open science and data”, these five items were assigned 0 points. Other poorly performed items include “imaging at multiple time points”, “cut-off analysis”, and “calibration statistics”, in which the average points for each item were less than 30% (Figure 3B). A detailed description and a summary of the RQS score are provided in Table S5.
The summary of the risk of bias and the applicability concerns evaluated by the QUADAS-2 tool are presented in Figure 4. Most studies showed a low or unclear risk of bias in each domain. Detailed description in each domain is provided in Table S6.

3.4. Study Characteristics

According to the typical radiomics workflow, the study characteristics is summarized as follows.

3.4.1. Imaging Acquisition

CT was applied in 10 studies, MRI in 10 studies, and both modalities in 1 [40], and only 1 used PET/CT [34]. Most studies (16/22) exploited more than one phase/sequence to construct their prediction model. The interval between the preoperative imaging exam and liver resection (for histopathological diagnosis of MVI) varied from 1 week to 3 months (median: 1 month).

3.4.2. Tumor Segmentation

A majority of studies performed 3D segmentation (20/22). In 15 of these studies, 3D segmentation was achieved manually; in 3, segmentation was semi-automatic [21,28,34]; in the remaining 2, it was achieved automatically [20,31]. Two studies manually delineated the tumor on the cross-section slice with the largest tumor diameter [24,28]. Nine studies expanded the segmented tumor with different distances, and the most common dilated distance was 10 mm from the tumor margin.

3.4.3. Imaging Preprocessing and Feature Extraction

As imaging may come from different centers, different manufacturers, and different scanners, imaging preprocessing prior to feature extraction is necessary to increase the reliability of the textural measurements. Six studies (6/22) resampled the images before feature extraction, most often to a voxel size of 1 × 1 × 1 mm3.
The most commonly used software to extract imaging features was pyradiomics (9/22), followed by MatLab or its related software (6/22). The number of radiomics features extracted from each phase/sequence ranged from 58 to 2932.

3.4.4. Feature Selection and Modelling

To avoid potential overfitting during development of a radiomics model, feature selection and dimensionality reduction is necessary, as the radiomics features often outnumbered the sample size. The most widely used algorithm was the Least Absolute Shrinkage and Selection Operator (LASSO) regression, which is an efficient method to select informative variables by introducing L1 regularization (15/22). The number of imaging features included in the radiomics model ranged from 2 to 74 (median: 15), and the event/feature ratio ranged from 0.7 to 35.5 (median: 4.2). Nine studies further included clinical risk factors into a combined prediction model. High alpha-fetoprotein (AFP) (9/22) and a large tumor size (4/22) were both frequently detected clinical risk factors for MVI prediction.
It is worth mentioning that the reproducibility evaluation of imaging features can also be used for feature selection. Among the 10 studies that performed interclass correlation coefficient (ICC) analysis, 4 of them set a threshold of 0.8 for robust features and selected those for further analysis [32,38,40,41].

3.4.5. Performance of the Prediction Model

A majority of studies (20/22) split the subjects into training and test subsets. The median AUC in the test cohort was 0.79, ranging from 0.69 to 0.94. Two studies validated their models using an independent cohort with AUCs of 0.84 and 0.80 [29,31]. Only five studies reported the cut-off value when presenting the performance metrics [21,26,32,34,41]. Nine studies (9/22) evaluated the calibrated ability of their model in the form of a calibration curve and clinical usefulness of the model in the form of decision curve analysis.
The abovementioned characteristics of the radiomics workflow has been provided in detail in Table 2 and Table S7.

4. Discussion

The present study identified an ever-growing number of studies performing radiomics analysis of HCC for MVI prediction, mostly published in the last two years. The added value of radiomics in imaging modalities used in clinical routines has been explored extensively, with an AUC as high as 0.80–0.84 in two independent validation cohorts, shedding light on the management and prognosis prediction of HCC patients. Although the initial results are promising and encouraging, the methodological variability of the research is considerable, and the reporting quality is insufficient. Before translating the radiomics model to clinical applications, it is urgent to standardize the reporting norms to make the prediction models reproducible and reliable and to validate the models in external cohorts.
Radiomics research is a complex, interdisciplinary, multi-step project, involving image processing, big data handling, algorithm operating, model construction, and validation. Each step in the radiomics workflow can be achieved by several different strategies and approaches, which induces substantial methodological heterogeneity among radiomics studies. The variability started with different imaging modalities, followed by different tumor segmentation strategies and different categories of radiomics features, as well as different algorithms and classifiers used for feature selection and modelling. Moreover, variability existed even in the same imaging modality; e.g., MRI acquisition may vary in terms of the manufacturers, scanning protocols, contrast media, and sequence/phase used, and the various software and tools applied for feature extraction inevitably resulted in radiomics features with different nomenclatures. Therefore, it seems hard to pool data across studies and to enable a robust meta-analysis. Given that the radiomics workflow involves multiple steps, it poses a challenge for other researchers to reproduce findings when the original study does not supply sufficient detail. Instead, improving the reporting quality seems to be a practical approach to validating the findings and translating them into clinical utility. However, the present review has highlighted the insufficient reporting quality of current radiomics HCC-MVI research, which was reflected by an average RQS score of 10 (28% of the total points). This finding is similar to the result of a recent systematic review that evaluated radiomics research quality in the area of HCC, with a mean RQS score of 8.4 [42].
Five items of the RQS in which all included studies performed poorly are “prospective study”, “phantom study”, “biological correlates”, “cost-effectiveness analysis”, and “openness of data and code”. A well-designed prospective study can reduce and minimize the potential confounding factors, representing a higher level of evidence for the quality validity. Thus, prospective studies are given the highest weighting in the RQS tool (7 points, accounting for around 20% of the full scale). However, to date, no prospective radiomics MVI research has been performed. A phantom study’s purpose is to detect potential feature variability among different scanners and manufacturers. This is of great importance, as the evaluated cohorts often involve many scanners or even different medical centers. The phantom study process ensures that only robust features are included in the following radiomics analysis. Biological correlates aim to link imaging findings with gene or molecular signatures. However, none of the reviewed studies evaluated the gene or molecular levels of the tumor samples. Previous studies have detected a 91-gene signature that highly correlates with vascular invasion in HCC [43]. Based on this finding, a contrast-enhanced CT imaging biomarker, i.e., radiogenomic venous invasion (RVI), which includes three imaging features (internal arteries, a hypo-dense halo, and a tumor-liver difference), has been shown to be an accurate predictor of MVI [44]. Future studies are required to explore and verify the correlations between radiomics features and gene expressions. A cost-effectiveness analysis can evaluate a radiomics prediction model in terms of health economics when applied in clinical routines. It assumes that a novel predictor should not be more expensive than currently available predictors when accuracy is comparable. It also compares the health effect of a radiomics predictor with a condition without a radiomics predictor, such as a quality-adjusted life year analysis. We think that evaluating this point seems less urgent, given that the methodological standardization and clinical/biological validation of current radiomics models are still lacking. Data and code openness aims to repeat and reproduce results and findings and to further validate and promote the prediction model in other centers. Though some initiatives have been proposed in an attempt to remove the obstacles in data sharing, other factors, such as legal/privacy issues, culture/language barriers, and insufficient staff/time, still exist [10]. None of the studies shared their codes or imaging data publicly.
Regarding the items of “imaging at multiple time points” and “multiple segmentations”, both aim to select stable imaging features for modelling considering subjective and temporal variations. However, less than half of the studies performed ICC analysis and seldom explicitly stated that imaging features from different phases/sequences were evaluated during that analysis (i.e., test–retest analysis). Furthermore, there is no generally accepted ICC threshold at which radiomics features can be considered robust. Generally, when reporting ICC, values of 0.75–0.90 are regarded as indicating good reliability, and values higher than 0.9 are regarded as excellent [45]. However, among the studies that calculated ICC, the applied threshold varied among 0.75, 0.80, and 0.9. A future study should be applied to determine the proper threshold at which robust radiomics features for modelling can be defined. Interestingly, some of the studies reported here did not rule out features with low ICC and constructed their model using only the full features extracted from their images.
When evaluating the performance and clinical utility of the radiomics model considering the items of “cut-off analysis”, “calibration statistics”, “comparison with gold-standard”, “potential clinical utility”, and “validation”, the included studies again were insufficient. The performance metrics of a model, such as the sensitivity and specificity, are often determined by a specified cut-off value, and this value can further classify a patient cohort into high and low risk groups for a certain condition. A cut-off value is also one of the prerequisites for reproducing the results of previous research. However, only five studies reported their cut-off values. Regarding calibration analysis, which evaluates the agreement between predictions and the actual events, less than half of the studies performed one. Regarding the comparison with “gold-standard”, there is currently no surrogate that can serve as a “gold-standard” for MVI prediction. As the value of semantic imaging features have been extensively explored for MVI prediction, we therefore defined conventional imaging features as the “gold-standard”. Among the 10 studies that compared prediction performance between radiomics and radiologist models, all declared that the radiomics models outperformed the radiologists’ semantic models (Table S7). However, the publishing bias should be borne in mind when interpreting these results. Only two studies validated their models using independent external cohorts. However, one of them validated their model in only 18 patients, which is not a sufficiently large validation cohort according to the “10-EPV” principle (at least 10 events per variable) [16,46]. When developing a prediction model, the ratio of event and variable should be maintained at a certain level to avoid potential overfitting or underfitting. Among the 16 studies with an EPV ratio available, the median EPV (MVI positive cases/features) ratio was 4.2, indicating a potential risk of overfitting. Therefore, it is assumed that, before translating these models into a clinical routine utility, some practical issues should be well addressed, such as the reproducibility of the radiomics model, the standardization of imaging protocols, model overfitting, and the external validation of the prediction models.
Though the RQS tool aims for high-quality radiomics research, there are concerns that should be optimized in future revisions. The current RQS is mainly focused on radiomics itself and ignores non-radiomics components during radiomics model/predictor development, such as blindness to outcomes and measurement, intervals between the index test and reference standard (in the case of MVI, the time between imaging and liver resection), and the influence of sample size and enrollment of study subjects. All these factors may also introduce bias. Under this context, the tool of QUADAS-2 can serve as a vital supplement to RQS when evaluating the quality of radiomics research. Most of the studies reported in this systematic search showed a low or unclear risk in the four domains of risk of bias evaluation. The missing or unclear parts observed using the RQS and QUADAS-2 tools were obvious, which implies that these tools might not be so well known or adopted. Future researchers will ideally apply the RQS or QUADAS-2 as a checklist to improve the quality of their reports. In fact, a specified checklist, i.e., CLAIM (Checklist for Artificial Intelligence in Medical Imaging) for artificial intelligence research [47], and a general guideline for diagnostic/prognostic prediction, i.e., TRIPOD (Transparent Reporting of a multivariable prediction model for Individual Prognosis Or Diagnosis) [15], have already been proposed.
This systematic review has some limitations. Firstly, high-level evidence from studies with a prospective design and an independent external validation cohort is lacking, so a definitive and convincing conclusion about the efficacy of the radiomics model for MVI prediction cannot be drawn. Secondly, we did not synthesize the performance metrics of the prediction model, given the high methodological heterogeneity of each study. Therefore, model performance comparisons between semantic-feature-based models and radiomics models, between CT-based models and MRI-based models, and between dilated-VOI-based models and non-dilated models could not be performed. Thirdly, we did not evaluate the specific radiomics features shared among different models due to the variability of imaging modalities and the extraction software used.

5. Conclusions

Even though current studies were preliminary and the methodological quality was insufficient, the radiomics model has the potential to provide an accurate and effective tool to preoperatively predict MVI presence in patients with HCC. Future prospective studies with an external validation cohort in accordance with a standardized radiomics workflow and reporting norms are expected to supply a reliable, reproducible, and accurate radiomics model for clinical implementation.

Supplementary Materials

The following are available online at https://0-www-mdpi-com.brum.beds.ac.uk/article/10.3390/cancers13225864/s1, Table S1: Preferred Reporting Items for a Systematic Review and Meta-analysis of Diagnostic Test Accuracy Studies (PRISMA-DTA) Checklist. Table S2: Literature searching strategy in the PubMed, Web of Science, Embase, and Cochrane library databases. Table S3: Description of the Radiomics Quality Score (RQS) tool. Table S4: Description of the revised Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2) tool. Table S5: Methodological quality assessment of each study by the RQS tool. Table S6: Methodological quality assessment of each study by QUADAS-2. Table S7: Characteristics of the radiomics studies on the prediction of microvascular invasion in hepatocellular carcinoma.

Author Contributions

Conceptualization: Q.W., K.M. and T.B.B.; Methodology: Q.W., J.Z. and X.H.; Validation: C.L., K.M. and T.B.B.; Writing—original draft preparation: Q.W., X.H. and C.L.; Writing—review and editing: Y.F., K.M., E.S. and T.B.B.; Supervision: Y.F., K.M., E.S. and T.B.B.; Funding acquisition, Q.W. All authors have read and agreed to the published version of the manuscript.

Funding

Qiang Wang received a scholarship from the China Scholarship Council (CSC, No. 201907930009).

Conflicts of Interest

The authors have declared that there is no conflict of interest.

References

  1. Sheng, X.; Ji, Y.; Ren, G.P.; Lu, C.L.; Yun, J.P.; Chen, L.H.; Meng, B.; Qu, L.J.; Duan, G.J.; Sun, Q.; et al. A standardized pathological proposal for evaluating microvascular invasion of hepatocellular carcinoma: A multicenter study by LCPGC. Hepatol. Int. 2020, 14, 1034–1047. [Google Scholar] [CrossRef] [PubMed]
  2. Hong, S.B.; Choi, S.H.; Kim, S.Y.; Shim, J.H.; Lee, S.S.; Byun, J.H.; Park, S.H.; Kim, K.W.; Kim, S.; Lee, N.K. MRI Features for Predicting Microvascular Invasion of Hepatocellular Carcinoma: A Systematic Review and Meta-Analysis. Liver Cancer 2021, 10, 94–106. [Google Scholar] [CrossRef] [PubMed]
  3. Lei, Z.; Li, J.; Wu, D.; Xia, Y.; Wang, Q.; Si, A.; Wang, K.; Wan, X.; Lau, W.Y.; Wu, M.; et al. Nomogram for Preoperative Estimation of Microvascular Invasion Risk in Hepatitis B Virus-Related Hepatocellular Carcinoma Within the Milan Criteria. JAMA Surg. 2016, 151, 356–363. [Google Scholar] [CrossRef] [PubMed]
  4. Lee, S.; Kim, S.H.; Lee, J.E.; Sinn, D.H.; Park, C.K. Preoperative gadoxetic acid-enhanced MRI for predicting microvascular invasion in patients with single hepatocellular carcinoma. J. Hepatol. 2017, 67, 526–534. [Google Scholar] [CrossRef] [PubMed]
  5. Zhang, T.; Pandey, G.; Xu, L.; Chen, W.; Gu, L.; Wu, Y.; Chen, X. The Value of TTPVI in Prediction of Microvascular Invasion in Hepatocellular Carcinoma. Cancer Manag. Res. 2020, 12, 4097–4105. [Google Scholar] [CrossRef] [PubMed]
  6. Centonze, L.; Di Sandro, S.; Lauterio, A.; De Carlis, R.; Frassoni, S.; Rampoldi, A.; Tuscano, B.; Bagnardi, V.; Vanzulli, A.; De Carlis, L. Surgical Resection vs. Percutaneous Ablation for Single Hepatocellular Carcinoma: Exploring the Impact of Li-RADS Classification on Oncological Outcomes. Cancers 2021, 13, 1617. [Google Scholar] [CrossRef]
  7. Centonze, L.; Di Sandro, S.; Lauterio, A.; De Carlis, R.; Sgrazzutti, C.; Ciulli, C.; Vella, I.; Vicentin, I.; Incarbone, N.; Bagnardi, V.; et al. A retrospective single-centre analysis of the oncological impact of LI-RADS classification applied to Metroticket 2.0 calculator in liver transplantation: Every nodule matters. Transpl. Int. 2021, 34, 1712–1721. [Google Scholar] [CrossRef]
  8. Cunha, G.M.; Tamayo-Murillo, D.E.; Fowler, K.J. LI-RADS and transplantation: Challenges and controversies. Abdom Radiol. 2021, 46, 29–42. [Google Scholar] [CrossRef]
  9. Zhou, H.; Sun, J.; Jiang, T.; Wu, J.; Li, Q.; Zhang, C.; Zhang, Y.; Cao, J.; Sun, Y.; Jiang, Y.; et al. A Nomogram Based on Combining Clinical Features and Contrast Enhanced Ultrasound LI-RADS Improves Prediction of Microvascular Invasion in Hepatocellular Carcinoma. Front. Oncol. 2021, 11, 699290. [Google Scholar] [CrossRef]
  10. Chen, J.; Zhou, J.; Kuang, S.; Zhang, Y.; Xie, S.; He, B.; Deng, Y.; Yang, H.; Shan, Q.; Wu, J.; et al. Liver Imaging Reporting and Data System Category 5: MRI Predictors of Microvascular Invasion and Recurrence After Hepatectomy for Hepatocellular Carcinoma. AJR Am. J. Roentgenol. 2019, 213, 821–830. [Google Scholar] [CrossRef]
  11. Yang, L.; Gu, D.; Wei, J.; Yang, C.; Rao, S.; Wang, W.; Chen, C.; Ding, Y.; Tian, J.; Zeng, M. A Radiomics Nomogram for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma. Liver Cancer 2019, 8, 373–386. [Google Scholar] [CrossRef]
  12. Lambin, P.; Rios-Velazquez, E.; Leijenaar, R.; Carvalho, S.; van Stiphout, R.G.; Granton, P.; Zegers, C.M.; Gillies, R.; Boellard, R.; Dekker, A.; et al. Radiomics: Extracting more information from medical images using advanced feature analysis. Eur. J. Cancer 2012, 48, 441–446. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  13. Gillies, R.J.; Kinahan, P.E.; Hricak, H. Radiomics: Images Are More than Pictures, They Are Data. Radiology 2016, 278, 563–577. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  14. Tomaszewski, M.R.; Gillies, R.J. The Biological Meaning of Radiomic Features. Radiology 2021, 299, E256. [Google Scholar] [CrossRef]
  15. Collins, G.S.; Reitsma, J.B.; Altman, D.G.; Moons, K.G. Transparent reporting of a multivariable prediction model for individual prognosis or diagnosis (TRIPOD): The TRIPOD Statement. BMC Med. 2015, 13, g7594. [Google Scholar] [CrossRef] [Green Version]
  16. Lambin, P.; Leijenaar, R.T.H.; Deist, T.M.; Peerlings, J.; de Jong, E.E.C.; van Timmeren, J.; Sanduleanu, S.; Larue, R.; Even, A.J.G.; Jochems, A.; et al. Radiomics: The bridge between medical imaging and personalized medicine. Nat. Rev. Clin. Oncol. 2017, 14, 749–762. [Google Scholar] [CrossRef] [PubMed]
  17. Zhong, J.; Hu, Y.; Si, L.; Jia, G.; Xing, Y.; Zhang, H.; Yao, W. A systematic review of radiomics in osteosarcoma: Utilizing radiomics quality score as a tool promoting clinical translation. Eur. Radiol. 2021, 31, 1526–1535. [Google Scholar] [CrossRef]
  18. Park, J.E.; Kim, D.; Kim, H.S.; Park, S.Y.; Kim, J.Y.; Cho, S.J.; Shin, J.H.; Kim, J.H. Quality of science and reporting of radiomics in oncologic studies: Room for improvement according to radiomics quality score and TRIPOD statement. Eur. Radiol. 2020, 30, 523–536. [Google Scholar] [CrossRef]
  19. Whiting, P.F.; Rutjes, A.W.; Westwood, M.E.; Mallett, S.; Deeks, J.J.; Reitsma, J.B.; Leeflang, M.M.; Sterne, J.A.; Bossuyt, P.M.; Group, Q. QUADAS-2: A revised tool for the quality assessment of diagnostic accuracy studies. Ann. Intern. Med. 2011, 155, 529–536. [Google Scholar] [CrossRef]
  20. Zheng, J.; Chakraborty, J.; Chapman, W.C.; Gerst, S.; Gonen, M.; Pak, L.M.; Jarnagin, W.R.; DeMatteo, R.P.; Do, R.K.G.; Simpson, A.L.; et al. Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma Using Quantitative Image Analysis. J. Am. Coll. Surg. 2017, 225, 778–788. [Google Scholar] [CrossRef]
  21. Peng, J.; Zhang, J.; Zhang, Q.; Xu, Y.; Zhou, J.; Liu, L. A radiomics nomogram for preoperative prediction of microvascular invasion risk in hepatitis B virus-related hepatocellular carcinoma. Diagn. Interv. Radiol. 2018, 24, 121–127. [Google Scholar] [CrossRef] [Green Version]
  22. Ma, X.; Wei, J.; Gu, D.; Zhu, Y.; Feng, B.; Liang, M.; Wang, S.; Zhao, X.; Tian, J. Preoperative radiomics nomogram for microvascular invasion prediction in hepatocellular carcinoma using contrast-enhanced CT. Eur. Radiol. 2019, 29, 3595–3605. [Google Scholar] [CrossRef]
  23. Feng, S.T.; Jia, Y.; Liao, B.; Huang, B.; Zhou, Q.; Li, X.; Wei, K.; Chen, L.; Li, B.; Wang, W.; et al. Preoperative prediction of microvascular invasion in hepatocellular cancer: A radiomics model using Gd-EOB-DTPA-enhanced MRI. Eur. Radiol. 2019, 29, 4648–4659. [Google Scholar] [CrossRef]
  24. Ni, M.; Zhou, X.; Lv, Q.; Li, Z.; Gao, Y.; Tan, Y.; Liu, J.; Liu, F.; Yu, H.; Jiao, L.; et al. Radiomics models for diagnosing microvascular invasion in hepatocellular carcinoma: Which model is the best model? Cancer Imaging 2019, 19, 60. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  25. Zhang, R.; Xu, L.; Wen, X.; Zhang, J.; Yang, P.; Zhang, L.; Xue, X.; Wang, X.; Huang, Q.; Guo, C.; et al. A nomogram based on bi-regional radiomics features from multimodal magnetic resonance imaging for preoperative prediction of microvascular invasion in hepatocellular carcinoma. Quant. Imaging Med. Surg. 2019, 9, 1503–1515. [Google Scholar] [CrossRef] [PubMed]
  26. Zhu, Y.J.; Feng, B.; Wang, S.; Wang, L.M.; Wu, J.F.; Ma, X.H.; Zhao, X.M. Model-based three-dimensional texture analysis of contrast-enhanced magnetic resonance imaging as a potential tool for preoperative prediction of microvascular invasion in hepatocellular carcinoma. Oncol. Lett. 2019, 18, 720–732. [Google Scholar] [CrossRef] [PubMed]
  27. Nebbia, G.; Zhang, Q.; Arefan, D.; Zhao, X.; Wu, S. Pre-operative Microvascular Invasion Prediction Using Multi-parametric Liver MRI Radiomics. J. Digit. Imaging 2020, 33, 1376–1386. [Google Scholar] [CrossRef]
  28. Liu, Q.P.; Xu, X.; Zhu, F.P.; Zhang, Y.D.; Liu, X.S. Prediction of prognostic risk factors in hepatocellular carcinoma with transarterial chemoembolization using multi-modal multi-task deep learning. EClinicalMedicine 2020, 23, 100379. [Google Scholar] [CrossRef] [PubMed]
  29. Zhang, X.; Ruan, S.; Xiao, W.; Shao, J.; Tian, W.; Liu, W.; Zhang, Z.; Wan, D.; Huang, J.; Huang, Q.; et al. Contrast-enhanced CT radiomics for preoperative evaluation of microvascular invasion in hepatocellular carcinoma: A two-center study. Clin. Transl. Med. 2020, 10, e111. [Google Scholar] [CrossRef]
  30. Jiang, Y.Q.; Cao, S.E.; Cao, S.; Chen, J.N.; Wang, G.Y.; Shi, W.Q.; Deng, Y.N.; Cheng, N.; Ma, K.; Zeng, K.N.; et al. Preoperative identification of microvascular invasion in hepatocellular carcinoma by XGBoost and deep learning. J. Cancer Res. Clin. Oncol. 2021, 147, 821–833. [Google Scholar] [CrossRef]
  31. He, M.; Zhang, P.; Ma, X.; He, B.; Fang, C.; Jia, F. Radiomic Feature-Based Predictive Model for Microvascular Invasion in Patients With Hepatocellular Carcinoma. Front. Oncol. 2020, 10, 574228. [Google Scholar] [CrossRef]
  32. Chong, H.H.; Yang, L.; Sheng, R.F.; Yu, Y.L.; Wu, D.J.; Rao, S.X.; Yang, C.; Zeng, M.S. Multi-scale and multi-parametric radiomics of gadoxetate disodium-enhanced MRI predicts microvascular invasion and outcome in patients with solitary hepatocellular carcinoma ≤ 5 cm. Eur. Radiol. 2021, 31, 4824–4838. [Google Scholar] [CrossRef]
  33. Chen, Y.; Xia, Y.; Tolat, P.P.; Long, L.; Jiang, Z.; Huang, Z.; Tang, Q. Comparison of Conventional Gadoxetate Disodium-Enhanced MRI Features and Radiomics Signatures With Machine Learning for Diagnosing Microvascular Invasion. AJR Am. J. Roentgenol. 2021, 216, 1510–1520. [Google Scholar] [CrossRef]
  34. Li, Y.; Zhang, Y.; Fang, Q.; Zhang, X.; Hou, P.; Wu, H.; Wang, X. Radiomics analysis of [(18)F]FDG PET/CT for microvascular invasion and prognosis prediction in very-early- and early-stage hepatocellular carcinoma. Eur. J. Nucl. Med. Mol. Imaging 2021, 48, 2599–2614. [Google Scholar] [CrossRef]
  35. Song, D.; Wang, Y.; Wang, W.; Wang, Y.; Cai, J.; Zhu, K.; Lv, M.; Gao, Q.; Zhou, J.; Fan, J.; et al. Using deep learning to predict microvascular invasion in hepatocellular carcinoma based on dynamic contrast-enhanced MRI combined with clinical parameters. J. Cancer Res. Clin. Oncol. 2021, 147, 3757–3767. [Google Scholar] [CrossRef]
  36. Dai, H.; Lu, M.; Huang, B.; Tang, M.; Pang, T.; Liao, B.; Cai, H.; Huang, M.; Zhou, Y.; Chen, X.; et al. Considerable effects of imaging sequences, feature extraction, feature selection, and classifiers on radiomics-based prediction of microvascular invasion in hepatocellular carcinoma using magnetic resonance imaging. Quant. Imaging Med. Surg. 2021, 11, 1836–1853. [Google Scholar] [CrossRef] [PubMed]
  37. Liu, P.; Tan, X.Z.; Zhang, T.; Gu, Q.B.; Mao, X.H.; Li, Y.C.; He, Y.Q. Prediction of microvascular invasion in solitary hepatocellular carcinoma ≤ 5 cm based on computed tomography radiomics. World J. Gastroenterol. 2021, 27, 2015–2024. [Google Scholar] [CrossRef] [PubMed]
  38. Zhang, S.; Xu, G.; Duan, C.; Zhou, X.; Wang, X.; Yu, H.; Yu, L.; Li, Z.; Gao, Y.; Zhao, R.; et al. Radiomics Analysis of MR Imaging with Gd-EOB-DTPA for Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma: Investigation and Comparison of Different Hepatobiliary Phase Delay Times. Biomed Res. Int. 2021, 2021, 6685723. [Google Scholar] [CrossRef] [PubMed]
  39. Zhang, W.; Yang, R.; Liang, F.; Liu, G.; Chen, A.; Wu, H.; Lai, S.; Ding, W.; Wei, X.; Zhen, X.; et al. Prediction of Microvascular Invasion in Hepatocellular Carcinoma With a Multi-Disciplinary Team-Like Radiomics Fusion Model on Dynamic Contrast-Enhanced Computed Tomography. Front. Oncol. 2021, 11, 660629. [Google Scholar] [CrossRef] [PubMed]
  40. Meng, X.P.; Wang, Y.C.; Zhou, J.Y.; Yu, Q.; Lu, C.Q.; Xia, C.; Tang, T.Y.; Xu, J.; Sun, K.; Xiao, W.; et al. Comparison of MRI and CT for the Prediction of Microvascular Invasion in Solitary Hepatocellular Carcinoma Based on a Non-Radiomics and Radiomics Method: Which Imaging Modality Is Better? J. Magn. Reson. Imaging 2021, 54, 526–536. [Google Scholar] [CrossRef]
  41. Zhang, Y.; Shu, Z.; Ye, Q.; Chen, J.; Zhong, J.; Jiang, H.; Wu, C.; Yu, T.; Pang, P.; Ma, T.; et al. Preoperative Prediction of Microvascular Invasion in Hepatocellular Carcinoma via Multi-Parametric MRI Radiomics. Front. Oncol. 2021, 11, 633596. [Google Scholar] [CrossRef]
  42. Wakabayashi, T.; Ouhmich, F.; Gonzalez-Cabrera, C.; Felli, E.; Saviano, A.; Agnus, V.; Savadjiev, P.; Baumert, T.F.; Pessaux, P.; Marescaux, J.; et al. Radiomics in hepatocellular carcinoma: A quantitative review. Hepatol. Int. 2019, 13, 546–559. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  43. Segal, E.; Sirlin, C.B.; Ooi, C.; Adler, A.S.; Gollub, J.; Chen, X.; Chan, B.K.; Matcuk, G.R.; Barry, C.T.; Chang, H.Y.; et al. Decoding global gene expression programs in liver cancer by noninvasive imaging. Nat. Biotechnol. 2007, 25, 675–680. [Google Scholar] [CrossRef] [PubMed]
  44. Banerjee, S.; Wang, D.S.; Kim, H.J.; Sirlin, C.B.; Chan, M.G.; Korn, R.L.; Rutman, A.M.; Siripongsakun, S.; Lu, D.; Imanbayev, G.; et al. A computed tomography radiogenomic biomarker predicts microvascular invasion and clinical outcomes in hepatocellular carcinoma. Hepatology 2015, 62, 792–800. [Google Scholar] [CrossRef]
  45. Koo, T.K.; Li, M.Y. A Guideline of Selecting and Reporting Intraclass Correlation Coefficients for Reliability Research. J. Chiropr. Med. 2016, 15, 155–163. [Google Scholar] [CrossRef] [PubMed] [Green Version]
  46. Riley, R.D.; Ensor, J.; Snell, K.I.E.; Harrell, F.E., Jr.; Martin, G.P.; Reitsma, J.B.; Moons, K.G.M.; Collins, G.; van Smeden, M. Calculating the sample size required for developing a clinical prediction model. BMJ 2020, 368, m441. [Google Scholar] [CrossRef] [Green Version]
  47. Mongan, J.; Moy, L.; Kahn, C.E., Jr. Checklist for Artificial Intelligence in Medical Imaging (CLAIM): A Guide for Authors and Reviewers. Radiol. Artif. Intell. 2020, 2, e200029. [Google Scholar] [CrossRef] [Green Version]
Cancers 13 05864 g001 550
Figure 1. A typical workflow of radiomics research for microvascular invasion (MVI) prediction in hepatocellular carcinoma.
Figure 1. A typical workflow of radiomics research for microvascular invasion (MVI) prediction in hepatocellular carcinoma.
Cancers 13 05864 g001
Cancers 13 05864 g002 550
Figure 2. Flow chart of the study selection.
Figure 2. Flow chart of the study selection.
Cancers 13 05864 g002
Cancers 13 05864 g003 550
Figure 3. Methodological quality evaluated by using the Radiomics Quality Score (RQS) tool. (A). Proportion of studies with different RQS percentage score. (B). Average scores of each RQS item (gray bars stand for the full points of each item, and red bars show actual points).
Figure 3. Methodological quality evaluated by using the Radiomics Quality Score (RQS) tool. (A). Proportion of studies with different RQS percentage score. (B). Average scores of each RQS item (gray bars stand for the full points of each item, and red bars show actual points).
Cancers 13 05864 g003
Cancers 13 05864 g004 550
Figure 4. Grouped bar charts of the risk of bias (A) and applicability concerns (B) of the included studies assessed by using a revised tool for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2).
Figure 4. Grouped bar charts of the risk of bias (A) and applicability concerns (B) of the included studies assessed by using a revised tool for the Quality Assessment of Diagnostic Accuracy Studies (QUADAS-2).
Cancers 13 05864 g004
Table
Table 1. Study and patient characteristics.
Table 1. Study and patient characteristics.
First AuthorYearStudy DesignNo. of Patients
(Train vs. Test Cohort)		Independent Validation CohortAge (Mean/Median)Gender (M/F, %)IndicationMVI Incidence
Jian Zheng [20]2017R#120 (NA)No7073/27HCC44%
Jie Peng [21]2018R304 (184:120)No53 vs. 55 †85/15HCC (solitary)66%
Xiaohong Ma [22]2018R157 (110:47)No53 vs. 55 †85/15HCC (≤6 cm, solitary)35%
ShiTing Feng [23]2019R160 (110:50)No54.891/9HCC38.8%
Ming Ni [24]2019R206 (148:58)No57 vs. 59 †NAHCC (>1 cm)42.7%
Rui Zhang [25]2019R267 (194:73)No57.986/14HCC (solitary)33.7%
Yong-Jian Zhu [26]2019R142 (99:43)No5787/13HCC (<5 cm, solitary)37.3%
Giacomo Nebbia [27]2020R99 (NA)No51 vs. 54
(MVI vs. non-MVI)		84/16HCC61.6%
Qiu-ping Liu [28]2020R494 (346:148)NoNA84/16HCC30.2%
Xiuming Zhang [29]2020R637 (451:111)Yes
(75, external)		57.5 vs. 56.2 vs. 60.7 §86/14HCC40%
Yi-quan Jiang [30]2020R405 (324:81)No48.585/15HCC54.3%
Mu He [31]2020R163 (101:44)Yes
(18, internal)		50.0 vs. 47.5 vs. 52.0 §82/18HCC67.5%
Huan-Huan Chong [32]2021R356 (250:106)No54.285/15HCC (≤5 cm)25.3%
Yidi Chen [33]2021R269 (188:81)No51.581/19HCC41.3%
Youcai Li [34]2021R80 (50:30)NoNA91/9HCC (BCLC 0/A)45%
Danjun Song [35]2021R601 (461:140)No56.582/18HCC (solitary)37.40%
Houjiao Dai [36]2021R69 (LOOCV)No52.796/4HCC (solitary)42.0%
Peng Liu [37]2021R185 (124:61)No54 vs. 52 †84/26HCC (≤5 cm, solitary)34.1%
Shuai Zhang [38]2021R130 (91:39)No57.8 vs. 58.6 †68/32HCC (>1 cm)61.5%
Wanli Zhang [39]2021R111 (88:23)NoNA88/12HCC51.4%
Xiang-pan Meng [40]2021R402 (300:102)No57 vs. 57 †85/15HCC (solitary)40%
Yang Zhang [41]2021R195 (136:59)No57.788/12HCC (≤5 cm)56.4%
Note: #, respective study; †, train vs. test cohort; §, train vs. test vs. validation cohort; BCLC, the Barcelona Clinic Liver Cancer staging system; HCC, hepatocellular carcinoma; LOOCV, leave-one-out cross validation; MVI, microvascular invasion; NA, not applicable.
Table
Table 2. Characteristics of the radiomics research for microvascular invasion (MVI) prediction.
Table 2. Characteristics of the radiomics research for microvascular invasion (MVI) prediction.
Study IDImaging ModalityPhase/SequenceSegmentationExtension of VOIFeature SelectionNumber of Imaging Features Included in the ModelEvent/Feature Ratio during Model DevelopmentClinical Variables for ModelingAUC in Test Cohort
Zheng 2017CE-CTPVP2D; autoYes
(5-pixel)		univariable logistic regression211.6AFP, tumor size, hepatitisNA
Peng 2018CE-CTAP, PVP, DP3D; semi-autoNoLASSO815.9AFP, non-smooth tumor margin, internal arteries, hypoattenuating halos0.84
Ma 2018CE-CTAP, PVP, DP3D; manually NoICC/CCC, LASSO75.3Age, tumor size, hepatitis B0.80
Feng 2019Gd-EOB-DTPA MRIHBP3D; manually Yes
(10 mm)		LASSO104.2NA0.84
Ni 2019CE-CTPVP2D; manually NoLASSO, neighbourhood rough set, PCAUnclearNANANA
R. Zhang 2019Multimodel MRIAP, PVP, EP, T1, T2, DWI3D; manually Yes
(10 mm)		mRMR125.3AFP, arterial peritumoral enhancement0.86
Zhu 2019CE-MRIAP, PVP3D; manually NoKruskal-Wallis test; Pearson correlation49.3AFP, tumor size, differentiation0.79
Nebbia 2020CE-MRIAP, PVP, T1, T2, DWI3D; manually Yes
(10 pixel)		LASSO173.6NANA
Q. Liu 2020CE-CTAP, PVP3D;semiautoNoICC, RF285.3NA0.79
X. Zhang 2020CE-CTDP3D; manually Yes
(10 mm)		LASSO444.0Age, AFP0.80 (0.80 in the validation cohort)
Jiang 2020CE-CTAP, PVP, DP3D; manually Yes
(10 mm)		Xgboost/3D-CNNUnclearNAAFP0.91
He 2020CE-CTPVP3D; autoNoLASSO235.5AFP, neutrophilic granulocytes, hemoglobin0.71 (0.84 in the validation cohort)
Chong 2021Gd-EOB-DTPA MRIAP, PVP, HBP, DWI3D; manually Yes
(5 mm,10 mm, 50%)		ICC, LASSO, Univariate Feature Selection740.9AFP, TBIL, capsule enhancement, peritumoral enhancement0.92
Chen 2021Gd-EOB-DTPA MRIAP, PVP, HBP, T1, T2, DWI3D; manually NoLASSO21NANA0.94
Li 2021PET/CT[18F]FDG PET/CT3D; semiautoNoLASSO110.7NA0.69
Song 2021CE-MRIAP, PVP, DP, T1,T2, ADC, DWI3D; manually NoPCA, analysis of varianceUnclearNANA0.73
Dai 2021Gd-EOB-DTPA MRIAP, PVP, HBP, T13D; manually NoLASSO-RFE, LASSO, mRMR, SVM-RFE55.8NA0.90 (LOOCV)
P. Liu 2021CE-CTAP3D; manually NoICC, LASSO104.2NA0.75
Sh. Zhang 2021Gd-EOB-DTPA MRIHBP (5, 10, 15 min)3D; manually NoLASSO14NANANA
W. Zhang 2021CE-CTEAP, LAP, PVP, EP3D; manually 2, 4, 6, 8, 10, 12, 14 mm15 methods (Fisher score, t score, etc.)UnclearNANA0.81
Meng 2021Multiparametric MRI & multiphasic CTAP, PVP, T2, DWI (MRI)/AP, PVP (CT)3D; manually Yes
(3 mm)		ICC, univariate analysis, feature reduction, LASSO16/168.1/1.9 #NA0.80
Y. Zhang 2021Multiparametric MRIAP, PVP, DP, T2, DWI, ADC3D; manually NoICC, analysis of variance, Mann-Whitney U-test, correlation analysis, LASSO471.6Age, AFP, tumor size0.84
Note: # for CT and MRI model respectively. 3D-CNN, 3D-convolutional neural network; ADC, apparent diffusion coefficient; AFP, alpha-fetoprotein; AP, arterial phase; CCC, concordance correlation coefficient; CE-CT, contrast enhanced-CT; CE-MRI, contrast enhanced-MRI; DP, delay phase; DWI, diffusion-weighted imaging; EAP, early arterial phase; EP, equilibrium phase; HBP, hepatobiliary phase; ICC, interclass correlation coefficient; LASSO, least absolute shrinkage and selection operator; LOOCV, leave-one out cross validation; mRMR, minimum redundancy-maximum relevance; NA, not applicable; PCA, principal component analysis; PVP, portal vein phase; RFE, recursive feature elimination; SVM, Support vector machine; TBIL, total bilirubin; VOI, volume of interest.
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Share and Cite

MDPI and ACS Style

Wang, Q.; Li, C.; Zhang, J.; Hu, X.; Fan, Y.; Ma, K.; Sparrelid, E.; Brismar, T.B. Radiomics Models for Predicting Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Radiomics Quality Score Assessment. Cancers 2021, 13, 5864. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers13225864

AMA Style

Wang Q, Li C, Zhang J, Hu X, Fan Y, Ma K, Sparrelid E, Brismar TB. Radiomics Models for Predicting Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Radiomics Quality Score Assessment. Cancers. 2021; 13(22):5864. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers13225864

Chicago/Turabian Style

Wang, Qiang, Changfeng Li, Jiaxing Zhang, Xiaojun Hu, Yingfang Fan, Kuansheng Ma, Ernesto Sparrelid, and Torkel B. Brismar. 2021. "Radiomics Models for Predicting Microvascular Invasion in Hepatocellular Carcinoma: A Systematic Review and Radiomics Quality Score Assessment" Cancers 13, no. 22: 5864. https://0-doi-org.brum.beds.ac.uk/10.3390/cancers13225864

Note that from the first issue of 2016, this journal uses article numbers instead of page numbers. See further details here.

Article Metrics

Back to TopTop