- Research article
- Open Access
Better efficacy in differentiating WHO grade II from III oligodendrogliomas with machine-learning than radiologist’s reading from conventional T1 contrast-enhanced and fluid attenuated inversion recovery images
BMC Neurology volume 20, Article number: 48 (2020)
The medical imaging to differentiate World Health Organization (WHO) grade II (ODG2) from III (ODG3) oligodendrogliomas still remains a challenge. We investigated whether combination of machine leaning with radiomics from conventional T1 contrast-enhanced (T1 CE) and fluid attenuated inversion recovery (FLAIR) magnetic resonance imaging (MRI) offered superior efficacy.
Thirty-six patients with histologically confirmed ODGs underwent T1 CE and 33 of them underwent FLAIR MR examination before any intervention from January 2015 to July 2017 were retrospectively recruited in the current study. The volume of interest (VOI) covering the whole tumor enhancement were manually drawn on the T1 CE and FLAIR slice by slice using ITK-SNAP and a total of 1072 features were extracted from the VOI using 3-D slicer software. Random forest (RF) algorithm was applied to differentiate ODG2 from ODG3 and the efficacy was tested with 5-fold cross validation. The diagnostic efficacy of radiomics-based machine learning and radiologist’s assessment were also compared.
Nineteen ODG2 and 17 ODG3 were included in this study and ODG3 tended to present with prominent necrosis and nodular/ring-like enhancement (P < 0.05). The AUC, ACC, sensitivity, and specificity of radiomics were 0.798, 0.735, 0.672, 0.789 for T1 CE, 0.774, 0.689, 0.700, 0.683 for FLAIR, as well as 0.861, 0.781, 0.778, 0.783 for the combination, respectively. The AUCs of radiologists 1, 2 and 3 were 0.700, 0.687, and 0.714, respectively. The efficacy of machine learning based on radiomics was superior to the radiologists’ assessment.
Machine-learning based on radiomics of T1 CE and FLAIR offered superior efficacy to that of radiologists in differentiating ODG2 from ODG3.
Oligodendrogliomas (ODGs), predominantly occur in adults with a peak between 40 and 60 years of age, constitute 5–20% of all gliomas . Patients with low-grade (ODG2) are slightly younger than those with high-grade, anaplastic tumors (ODG3) . The co-deletion of the short arm of chromosome 1 (1p) and the long arm of chromosome 19 (19q)  occursin about 60–90% of ODGs, thus making it the molecular hallmark for ODGs .
Calcification [4, 5] and the cortical-subcortical location [5, 6], most commonly in the frontal lobe , are regarded as the characteristic features of ODGs. In contrast to other low-grade gliomas (LGG), minimal to moderate enhancement and moderately increased perfusion are commonly seen in ODGs, making the differentiation of OGD2 from OGD3 difficult. Besides, ODG3 often shares the imaging features with ODG2 on conventional MRI, leading to unreliable tumor grade prediction. Edema, haemorrhage, cystic degeneration and contrast enhancement are more commonly seen in ODG3, but may also be seen in ODG2 . Thus, a new medical imaging diagnostic strategy for differentiation of ODG2 from ODG3 needs to be developed.
Advanced imaging techniques, including DWI, perfusion imaging, MR spectroscopy and PET, are employed to obtain more sensitive diagnostic markers, however with unsatisfying efficacy. Diffusion restriction is seldom observed in ODG2 . Averaged ADC values are reported to be lower in high grade glioma (HGG) than in LGG, however, ADC values of ODG3 are overlapped with that of ODG2, making DWI unreliable maker to distinguish them . Using the cut-off value of 1.75 for relative cerebral blood volume (rCBV) ratio, HGG can be differentiated from LGG with a sensitivity of 95% . Unfortunately, these findings may not be suitable for differentiating ODGs, because markedly elevated rCBV can also be observed in ODG2, thus, a reliable distinction can’t be easily achieved [7, 9, 10]. This is due to the presence of the short capillary segments in ODGs  which may contribute to the relatively low specificity (70%) reported by Law et al. . Therefore, focally elevated rCBV does not necessarily indicate ODG3. Besides, correlation of Ktrans with tumor grade is even poorer than that of rCBV, and it is more commonly used to assess the treatment effects . Taking together, the efficacies of advanced MRI techniques in differentiating ODG2 from ODG3 are limited.
Combining quantitative image features extracted from conventional T1-weighted contrast-enhanced (T1 CE) and fluid attenuated inversion recovery (FLAIR) images with machine learning algorithms, radiomics can provide comprehensive information that is difficult to perceive with visual inspection [12, 13] and is commonly used in tumor diagnosis, staging and prognosis of tumors [14,15,16,17,18,19,20]. However, most previous studies were mainly focused on advanced MR techniques, the varied post-processing models, varied interpretation and evaluation criteria restricted their clinical applications. Except for their limited diagnostic powers, these advanced MRI techniques are not commonly available in some rural areas. However, the T1 CE and FLAIR are widely-used in almost all hospitals as the image routine sequences for glioma diagnosis and staging. It is thus feasible to combine radiomics with T1 CE and FLAIR to establish a practical and economical imaging solution for differentiating ODG2 from ODG3.
In this study, we aimed to evaluate the diagnostic power of machine-learning based on T1 CE and FLAIR imaging radiomics in comparison with the radiologists’ performance in differentiating ODG2 from ODG3.
This study was approved by our institutional review board and the requirement for informed consent was waived based on its retrospective nature. From January 2015 to July 2017, patients with confirmed ODGs were retrospectively and consecutively recruited. Tumors were classified according to 2007 WHO classification or 2016 WHO guidelines when enough information was available. The including criteria were, 1. patients underwent preoperative conventional MRI scan. 2. patients underwent gross total or subtotal tumor resection and a confirmative pathological diagnosis was made. Thirty-six patients with T1CE were included (19 men, 17 women; mean age = 45 years; age range = 9–65 years) and classified into two groups: ODG2 (n = 19; mean age = 46 years, age range = 10–65 years) and ODG3 (n = 17; mean age = 44 years, age range = 9–65 years). Thirty-three out of the above 36 patients with FLAIR were enrolled (18 men, 15 women; mean age = 45 years; age range = 9–65 years) and classified into two groups: ODG2 (n = 17; mean age = 45 years, age range = 10–65 years) and ODG3 (n = 16; mean age = 45 years, age range = 9–65 years). The patient selection is summarized in Fig. 1.
MRI data acquisition
All patients underwent 3-T MR scanning (Discovery MR750, General Electric Medical System, Milwaukee, WI, USA) with an 8-channel head coil (General Electric Medical System). The initial routine scan sequences for each patient included T1-weighted imaging (T1WI) performed before and after contrast enhancement, an axial T2-weighted imaging (T2WI), and a transverse FLAIR to assist with diagnosis.
The parameters of the conventional MRI sequences were as the follows: T1WI with gradient echo (TR/TE, 1750 ms/24 ms; matrix size, 256 × 256; FOV, 24 × 24 cm; number of excitation, 1; slice thickness, 5 mm; gap, 1.5 mm), T2WI with turbo spin-echo (TR/TE, 4247 ms/93 ms; matrix size, 512 × 512; FOV, 24 × 24 cm; number of excitation, 1; slice thickness, 5 mm; gap, 1.5 mm) and sagittal T2WI (TR/TE, 10,639 ms/96 ms; matrix size, 384 × 384; FOV, 24 × 24 cm; number of excitation, 2; slice thickness, 5 mm; gap, 1.0 mm). We obtained axial FLAIR with the following parameters: TR/TE, 8000 ms/165 ms; matrix size, 256 × 256; FOV, 24 × 24 cm; number of excitations, 1; slice thickness, 5 mm; gap, 1.5 mm.
Finally, T1 CE were performed after intravenous bolus injection of gadodiamide (Omniscan; GE Healthcare, Co. Cork, Ireland), at a dose of 0.1 mmol/kg body weight. The parameters of T1 CE with volumetric interpolated breath-hold examination (VIBE) were as the follows: TR/TE, 8.2 ms/3.2 ms; T1, 450 ms; flip angle 12°; section thickness, 1.2 mm; FOV, 24 × 24 cm; matrix size, 256 × 256; number of excitations, 1; image number, 140.
Tumor segmentation or delineation
Two neuroradiologists (S.S.Z with 8 years of experience and L.F.Y, with 12 years of experience in neuro-oncology imaging) independently reviewed all images. A third senior neuroradiologist (G.B.C, with 25 years of experience in euro-oncology imaging) re-examined the images and determined the final imaging diagnoses when inconsistency occurred. The preoperative conventional image features of tumor were retrieved based on the criteria outlined in Additional file 1: Table S1 (online).
The volumes of interest (VOIs) were semi-automatically segmented using ITK-SNAP (version3.6, http://www.itk-snap.org) by two neuroradiologists (S.S. Z and L.F.Y). The VOIs covering the enhanced lesion were drawn slice by slice on T1 CE and co-registered to and FLAIR images, avoiding the regions of macroscopic necrosis, cyst, edema and non-tumor macrovessels .
Texture features include 162 first-order logic features, 216 Gy level co-occurrence matrix (GLCM) features, 144 Gy level run length matrix (GLRLM) features, 144 Gy level size zone matrix (GLSZM) features, 126 grey level difference matrix (GLDM) features, 45 neighborhood grey-tone difference matrix (NGTDM) features and 14 shape Features. A total of 1072 features were extracted from the T1 CE and FLAIR images using 3D-slicer software. We used the aforementioned features because these features were found to be relevant for distinguishing ODG2 from ODG3 in our previous studies by using MR imaging .
After being centered and scaled, the highly redundant and correlated features were subjected to a two-step feature selection procedure. First, highly correlated features were eliminated using Pearson correlation analysis, with the r threshold of 0.75. Then, a random forest (RF) classifier consisting of a number of decision trees was used to rank the feature importance. Every node in the decision trees is a condition on a single feature, designed to split the dataset into two so that similar response values end up in the same set. The measurement based on which optimal condition is chosen is called impurity. For classification, it is typically either Gini impurity or information gain/entropy. Thus, when training a tree, it can be computed how much each feature decreases the weighted impurity in a tree. To build the RF, the impurity decrease from each feature can be averaged and the features are ranked according to this measurement. In our study, Gini impurity decrease was used as the criterion to indicate the feature importance.
Radiomics model building
The 30 most important features were fed into a Conditional Inference RF classifier to build model . Five-fold cross validation was employed for tuning hyper-parameter number of RF trees. Five-fold cross validation including pre-processing, feature selection and model construction were performed 3 times in order to avoid bias and overfitting as much as possible. The final results were the average from 3 performances. There was no feature selection in the combination of T1 CE and FLAIR throughout the model building. Accuracy, sensitivity and specificity were computed to evaluate the classifying performance. The receiver operating characteristic (ROC) curve was also built to provide the area under the ROC curve (AUC). The larger the AUC, the better the classification . The whole procedure of feature extraction and machine learning was described in Fig. 2.
To compare the efficacies of neuroradiologist and machine learning in differentiating ODG2 from ODG3, the images were also independently assess by three junior neuroradiologists (X.L.F, G. X and Y. H with 6, 7 and 7 years of neuroradiology experience, respectively). The neuroradiologists were blinded to the clinical information, but were aware that the tumors were either ODG2 or ODG3, without knowing the exact number of patients with each entity. The three readers assessed only conventional MR images (T1WI, T2WI, FLAIR and T1 CE), and recorded the final diagnosis using a 4-point scale (1 = definite ODG2; 2 = likely ODG2; 3 = likely ODG3; and 4 = definite ODG3) .
Fisher exact test or the Chi-square test were used for the categorical variables and unpaired Student t test was used for continuous variable between ODG2 and ODG3 groups. The statistical analyses of clinical characteristics were performed by using SPSS 20.0 software (SPSS Inc., Chicago, IL, USA).
The statistical analyses of machine-learning were performed using R version 3. 4. 2 (R Foundation for Statistical Computing). A RF analysis was performed to train the machine-learning classifier. The goal of machine learning was to build the model to differentiate ODG2 from ODG3 based on radiomics features of T1 CE and FLAIR images. The following R packages were used: the random forest package was used for feature ranking; the caret and unbalanced packages were used for RF classification. Classifier performance was determined by using accuracy, sensitivity and specificity. The AUC values were also calculated for three readers and compared with that of the radiomics classifier. P value < 0.05 was considered as statistical significance.
The main clinical characteristics and conventional MRI features of the 36 patients (ODG2 and ODG3) were summarized in Table 1. Tumor necrosis was more frequent in ODG3 than in ODG2 groups (P = 0.044), reflecting the hypoxia as a result of the rapid tumor growth. In addition, ODG3 were related to the nodular/ring-like enhancement patterns (P = 0.002). Besides, 10/19 (52.6%) of ODG2 and 10/17 (58.8%) of ODG3 situated in the frontal lobe, indicating no significant group difference. No significant difference of other clinical characteristics (gender, age) or imaging paradigms was observed between ODG2 and ODG3 patients.
Quantitative MR histogram and texture features analysis
The relative importance of features computed by using the Gini index to differentiate ODG2 from ODG3 was depicted in Fig. 3. It can be seen that if all the high-throughput features were put into the RF classifiers, the classification performance could not be significantly improved because of the feature redundancy.
The strong relationship between radiomic features to differentiate ODG2 from ODG3 was also indicated in the radiomic heat map (Fig. 4). The RF based feature selection strategy improved the performance of RF classifier. After RF feature selection, 30 optimal features were selected to differentiate ODG2 from ODG3, with comparable efficacy to that of using all features.
Evaluation of principal components
When ODG2 and ODG3 were differentiated by using principal components, similar tumor tissue formed characteristic clusters. These clusters, although heterogeneous, defined a specific VOI (eg, Fig. 5) and were separable from other tumors (clusters). More important, the calculated principal components of the VOIs from ODG2 and ODG3 allowed clear separation of these two important regions.
Diagnostic performance of radiomics and radiologists
The performance of radiomics and 3 radiologists in differentiating ODG2 from ODG3 was also compared. Table 2 and Fig. 6 summarized the diagnostic performance of the radiomic features derived by using MR images from T1 CE, FLAIR and their combination to distinguish ODG2 from ODG3. Radiomic features from their combination showed significantly better diagnostic performance than that of FLAIR or T1 CE. Violin plots graphed for the first 9 radiomic features derived from T1 CE, FLAIR and their combination were presented in Fig. 6. The AUC, sensitivity, specificity and accuracy of radiomics were 0.798 (95%CI 0.699–0.896), 0.672, 0.789, 0.735 for T1 CE, 0.774 (95%CI 0.671–0.877), 0.700, 0.683, 0.689 for FLAIR, and 0.861 (95%CI 0.783–0.940), 0.778, 0.783, 0.781 for their combination, respectively. The AUCs of the three radiologists were 0.700 (95%CI 0.519–0.880), 0.687 (95%CI 0.507–0.867) and 0.714 (95%CI 0.545–0.883) for readers 1, 2 and 3, respectively. The radiomics classifier performed superior to the 3 junior radiologists. The representative cases of ODG2 and ODG3 were presented in Fig. 7. The clinical application of radiomics-based machine learning could be justified based on our findings.
Radiomics is an emerging field that treats images as data rather than pictures and analyzes a large number of features extracted from 1 image in relation to clinical variables of interest. A few studies on radiomics analyses of glioma have been published over the last years and advocated for machine learning models in predicting tumor histology and grade . Radiomics has been suggested as a robust strategy to noninvasively classify lesions [14, 26]. This work suggested that radiomics from T1 CE and FLAIR can be useful for differentiating ODG2 from ODG3, with the superior efficacy to that of radiologists, thus, its clinical application could be justified based on the current study.
From the angle of experiment design, there are three aspects worthy noting in this study. First, the ‘real world’ data were used to test our scientific hypothesis. Second, all images analyzed in the current study were taken exclusively from routine clinical diagnostic scans. Third, based on the social-economic consideration, the levels of accuracy were based on the radiomics of commonly available T1 CE and FLAIR images, without an acquisition of spectroscopy, CBV or perfusion information, all of which would prolong the scanning time and increase economic burden to patients. Upon our expectation, the radiomic strategy performed superior to that of radiologists.
The reasons for the improved diagnostic performance of radiomics are as the following. First, radiomic methods, given their ability to discern patterns and combine information in a way that humans cannot, showed substantial promise for the future of radiology and precision medicine . However, radiologists distinguished ODG2 from ODG3 by visual diagnosis using rough information from T1 CE and FLAIR. Second, it has been reported that the performance of an SVM classifier can be significantly reduced by the inclusion of redundant features and this effect is more obvious for a small training set . In this study, it was found that the combination of conventional T1 CE and FLAIR features provided lower classification error than features of individual sequence, which may thus emphasize the importance of using a multiparametric approach. In addition, highly correlated features were eliminated using Pearson correlation analysis, which was also further ranked by using the random forest classifier consisting of a number of decision trees. This indicated that redundant features removed can have a contribution to the classification of ODG2 and ODG3.
Radiomic strategy not only performed superior to radiologists, but also could be used as an auxiliary means to overcome some problems attained to radiologists. First of all, the frequency of interruptions during a reporting session is associated with up to 13% increase in time for reporting and an increased potential for errors . Then, fatigue adversely impacts the visual system including: worse accommodation, decreased saccadic velocity and reduced gaze volume and coverage . At last, a number of cognitive biases may adversely affect the accuracy of a radiologists report of a glioma . In order to reduce reporting time and cognitive biases, both of which may lead to reporting and diagnostic errors, radiomics offers a significant advantage , particularly in the context of general radiologists who may lack expertise in neuro-oncology. Nevertheless, the current radiomic strategy involves too much pre- and post-process before the suitable machine learning model is established, more studies focusing on the efficacy-cost balance of such a machine learning system should be further conducted before its clinical application.
Furthermore, a few limitations of this study should be noticed. In the first place, sample number of the patients is relatively small. Although current results of 5-fold cross validation showed that the evaluation of diagnostic efficacy were robust despite the relatively small sample size, which did not cause the classifier to be skewed towards a particular class. It is desirable to verify the classifier on a larger data size in the future. Besides, this radiomic method incorporated vessel removal in its methodology, this method may fail for certain cases that were non-tumor vessels intertwined with tumor vessels. Signal intensity curves of prominent vessels can be used as a differentiating feature for such cases.. The last, a continuous effort on enlarging the dataset so as to test its external validation is required.
In conclusion, this study demonstrates our findings that use of a machine learning algorithm, derived from ‘real word’ T1 CE and FLAIR images, which can differentiate ODG2 from ODG3 in newly diagnosed gliomas with a superior efficacy to that of radiologists. The RF selected features can reduce the labor in applying this strategy, and the strategy can be applied clinic based on our findings.
Availability of data and materials
The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.
Brain Blood Barrier
Fluid-Attenuated Inversion ecovery
High Grade Glioma
Low Grade Glioma
Relative Cerebral Blood Volume
- T1 CE:
T1-weighted contrast-enhanced image
Van Den Bent MJ, Bromberg JE, Buckner J. Low-grade and anaplastic oligodendroglioma. Handb Clin Neurol. 2016;134:361–80. https://doi.org/10.1016/B978-0-12-802997-8.00022-0.
Bromberg JE, van den Bent MJ. Oligodendrogliomas: molecular biology and treatment. Oncologist. 2009;14(2):155–63. https://doi.org/10.1634/theoncologist.2008-0248.
Jenkins RB, Blair H, Ballman KV, et al. A t (1;19)(q10;p10) mediates the combined deletions of 1p and 19q and predicts a better prognosis of patients with oligodendroglioma. Cancer Res. 2006;66(20):9852–61. https://doi.org/10.1158/0008-5472.CAN-06-1796.
Koeller KK, Rushing EJ. From the archives of the AFIP: Oligodendroglioma and its variants: radiologic-pathologic correlation. Radiographics. 2005;25(6):1669–88. https://doi.org/10.1148/rg.256055137.
Louis DN, Ohgaki H, Wiestler OD, et al. The 2007 WHO classification of tumours of the central nervous system. Acta Neuropathol. 2007;114(2):97–109. https://doi.org/10.1007/s00401-007-0243-4.
Osborn AG. Osborn's brain: imaging, pathology, and anatomy (1st edition). Salt Lake City, UT: Amirsys, Inc.; 2012.
Al-Okaili RN, Krejza J, Wang S, Woo JH, Melhem ER. Advanced MR imaging techniques in the diagnosis of intraaxial brain tumors in adults. Radiographics. 2006;26(Suppl 1):S173–89. https://doi.org/10.1148/rg.26si065513.
Law M, Yang S, Wang H, et al. Glioma grading: sensitivity, specificity, and predictive values of perfusion MR imaging and proton MR spectroscopic imaging compared with conventional MR imaging. AJNR Am J Neuroradiol. 2003;24(10):1989–98. http://doi.org.
Lev MH, Ozsunar Y, Henson JW, et al. Glial tumor grading and outcome prediction using dynamic spin-echo MR susceptibility mapping compared with conventional contrast-enhanced MR: confounding effect of elevated rCBV of oligodendrogliomas [corrected]. AJNR Am J Neuroradiol. 2004;25(2):214–21. http://doi.org.
Chawla S, Wang S, Wolf RL, et al. Arterial spin-labeling and MR spectroscopy in the differentiation of gliomas. AJNR Am J Neuroradiol. 2007;28(9):1683–9. https://doi.org/10.3174/ajnr.A0673.
Lacerda S, Law M. Magnetic resonance perfusion and permeability imaging in brain tumors. Neuroimaging Clin N Am. 2009;19(4):527–57. https://doi.org/10.1016/j.nic.2009.08.007.
Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, They Are Data. Radiology. 2016;278(2):563–77. https://doi.org/10.1148/radiol.2015151169.
Prasanna P, Patel J, Partovi S, Madabhushi A, Tiwari P. Radiomic features from the peritumoral brain parenchyma on treatment-naive multi-parametric MR imaging predict long versus short-term survival in glioblastoma multiforme: Preliminary findings. 2017;27(10):4188–97. https://doi.org/10.1007/s00330-016-4637-3.
Huang YQ, Liang CH, He L, et al. Development and validation of a Radiomics Nomogram for preoperative prediction of lymph node metastasis in colorectal Cancer. J Clin Oncol. 2016;34(18):2157–64. https://doi.org/10.1200/JCO.2015.65.9128.
Horvat N, Veeraraghavan H, Khan M, et al. MR Imaging of Rectal Cancer: Radiomics Analysis to Assess Treatment Response after Neoadjuvant Therapy. 2018;287(3):833–43. https://doi.org/10.1148/radiol.2018172300.
Tian Q, Yan LF, Zhang X. Radiomics strategy for glioma grading using texture features from multiparametric MRI; 2018. https://doi.org/10.1002/jmri.26010.
Kalinli A, Sarikoc F, Akgun H, Ozturk F. Performance comparison of machine learning methods for prognosis of hormone receptor status in breast cancer tissue samples. Comput Methods Prog Biomed. 2013;110(3):298–307. https://doi.org/10.1016/j.cmpb.2012.12.005.
Parmar C, Grossmann P, Bussink J, Lambin P, Aerts HJ. Machine learning methods for quantitative Radiomic biomarkers. Sci Rep. 2015;5:13087. https://doi.org/10.1038/srep13087.
Chae HD, Park CM, Park SJ, Lee SM, Kim KG, Goo JM. Computerized texture analysis of persistent part-solid ground-glass nodules: differentiation of preinvasive lesions from invasive pulmonary adenocarcinomas. Radiology. 2014;273(1):285–93. https://doi.org/10.1148/radiol.14132187.
Vamvakas A, Williams SC, Theodorou K, et al. Imaging biomarker analysis of advanced multiparametric MRI for glioma grading. Phys Med. 2019;60:188–98. https://doi.org/10.1016/j.ejmp.2019.03.014.
Yushkevich PA, Yang G, Gerig G. ITK-SNAP: an interactive tool for semi-automatic segmentation of multi-modality biomedical images. Conf Proc IEEE Eng Med Biol Soc. 2016;2016:3342–5. https://doi.org/10.1109/EMBC.2016.7591443.
Tagliamonte SA, Baayen RH. Models, forests and trees of York English: was/were variation as a case study for statistical practice. Language Variation & Change. 2012;24(2):135–78. https://doi.org/10.1017/S0954394512000129..
Cui Z, Xia Z, Su M, Shu H, Gong G. Disrupted white matter connectivity underlying developmental dyslexia: a machine learning approach. Hum Brain Mapp. 2016;37(4):1443–58. https://doi.org/10.1002/hbm.23112.
Suh HB, Choi YS, Bae S, et al. Primary central nervous system lymphoma and atypical glioblastoma: differentiation using radiomics approach. Eur Radiol. 2018;28(9):3832–9. https://doi.org/10.1007/s00330-018-5368-4.
Takahashi S, Takahashi W, Tanaka S, et al. Radiomics analysis for Glioma malignancy evaluation using diffusion kurtosis and tensor imaging. Int J Radiat Oncol Biol Phys. 2019;105(4):784–791. https://doi.org/10.1016/j.ijrobp.2019.07.011.
Aerts HJ, Velazquez ER, Leijenaar RT, et al. Decoding tumour phenotype by noninvasive imaging using a quantitative radiomics approach. Nat Commun. 2014;5:4006. https://doi.org/10.1038/ncomms5006.
Rudie JD, Rauschecker AM, Bryan RN, Davatzikos C, Mohan S. Emerging applications of artificial intelligence in Neuro-oncology. Radiology. 2019;290(3):607–18. https://doi.org/10.1148/radiol.2018181928.
Sengupta A, Ramaniharan AK, Gupta RK, Agarwal S, Singh A. Glioma grading using a machine-learning framework based on optimized features obtained from T1 perfusion MRI and volumes of tumor components. J Magn Reson Imaging. 2019;50(4):1295–306. https://doi.org/10.1002/jmri.26704.
Williams LH, Drew T. Distraction in diagnostic radiology: how is search through volumetric medical images affected by interruptions? Cogn Res Princ Implic. 2017;2(1):12. https://doi.org/10.1186/s41235-017-0050-y.
Waite S, Kolla S, Jeudy J, et al. Tired in the Reading room: the influence of fatigue in radiology. J Am Coll Radiol. 2017;14(2):191–7. https://doi.org/10.1016/j.jacr.2016.10.009.
Lee CS, Nagy PG, Weaver SJ, Newman-Toker DE. Cognitive and system factors contributing to diagnostic errors in radiology. AJR Am J Roentgenol. 2013;201(3):611–7. https://doi.org/10.2214/AJR.12.10375.
Thrall JH, Li X, Li Q, et al. Artificial Intelligence and Machine Learning in Radiology: Opportunities, Challenges, Pitfalls, and Criteria for Success. J Am Coll Radiol. 2018;15(3 Pt B):504–8. https://doi.org/10.1016/j.jacr.2017.12.026.
We would like to thank Drs Xue-Bin Lei, Sai Wang, Jin Zhang, Ying Yu, Qian Sun from Department of Radiology, Tangdu Hospital and Dr. Xiao-Cheng Wei from GE healthcare for their great contribution to this work.
This study received financial support from the National key research and development program of China (No. 2016YFC0107105 to Dr. Cui G.B.), the Science and Technology Development of Shaanxi Province (No. 2014JZ2–007 to Dr. Cui G.B; 2015kw-039 to Dr. Wang W) and Innovation and Development Foundation of Tangdu Hospital (No. 2016LCYJ001 to Dr. Cui G.B.) and Intramural Grant of Tangdu Hospital (Drs. Yan LF and Wang W). The funding body played no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.
Ethics approval and consent to participate
This is a retrospective study that does not require the approval of the ethics committee. (Not applicable).
Consent for publication
Our manuscript does not contain any individual person’s data. (Not applicable).
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Zhao, SS., Feng, XL., Hu, YC. et al. Better efficacy in differentiating WHO grade II from III oligodendrogliomas with machine-learning than radiologist’s reading from conventional T1 contrast-enhanced and fluid attenuated inversion recovery images. BMC Neurol 20, 48 (2020). https://doi.org/10.1186/s12883-020-1613-y
- Machine learning
- Random forest (RF)
- Magnetic resonance imaging (MRI)