Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platformCitation formats

  • External authors:
  • Isabella Fornacon-Wood
  • Christoph J. Ackermann
  • Andrew Mcpartlin
  • Gareth Price

Standard

Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform. / Fornacon-Wood, Isabella; Mistry, Hitesh; Ackermann, Christoph J.; Blackhall, Fiona; Mcpartlin, Andrew; Faivre-Finn, Corinne; Price, Gareth; O'Connor, James.

In: European Radiology, 17.04.2020.

Research output: Contribution to journalArticlepeer-review

Harvard

APA

Vancouver

Author

Bibtex

@article{41485fc339754871ac07679cb5698490,
title = "Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform",
abstract = "ObjectiveTo investigate the effects of Image Biomarker Standardisation Initiative (IBSI) compliance, harmonisation of calculation settings and platform version on the statistical reliability of radiomic features and their corresponding ability to predict clinical outcome.MethodsThe statistical reliability of radiomic features was assessed retrospectively in three clinical datasets(patient numbers: 108 head and neck cancer, 37 small cell lung cancer, 47 non-small cell lung cancer).Features were calculated using four platforms (PyRadiomics, LIFEx, CERR and IBEX).PyRadiomics, LIFEx and CERR are IBSI-compliant, whereas IBEX is not. The effect of IBSI compliance, user defined calculation settings and platform version were assessed by calculating intraclass correlation coefficients and confidence intervals. The influence of platform choice on the relationship between radiomic biomarkers and survival was evaluated using univariable coxregression in the largest dataset.ResultsThe reliability of radiomic features calculated by the different software platforms was only excellent(ICC > 0.9) for 4/17 radiomic features when comparing all four platforms. Reliability improved toICC > 0.9 for 15/17 radiomic features when analysis was restricted to the three IBSI-compliant platforms. Failure to harmonise calculation settings resulted in poor reliability, even across the IBSI compliant platforms. Software platform version also had a marked effect on feature reliability inCERR and LIFEx. Features identified as having significant relationship to survival varied between platforms, as did the direction of hazard ratios.Conclusion IBSI compliance, user defined calculation settings and choice of platform version all influence the statistical reliability and corresponding performance of prognostic models in radiomics.",
keywords = "Reliability of Results, Biomarkers, Prognosis, Tomography, X-ray computed",
author = "Isabella Fornacon-Wood and Hitesh Mistry and Ackermann, {Christoph J.} and Fiona Blackhall and Andrew Mcpartlin and Corinne Faivre-Finn and Gareth Price and James O'Connor",
year = "2020",
month = apr,
day = "17",
language = "English",
journal = "European Radiology",
issn = "0938-7994",
publisher = "Springer Nature",

}

RIS

TY - JOUR

T1 - Reliability and prognostic value of radiomic features are highly dependent on choice of feature extraction platform

AU - Fornacon-Wood, Isabella

AU - Mistry, Hitesh

AU - Ackermann, Christoph J.

AU - Blackhall, Fiona

AU - Mcpartlin, Andrew

AU - Faivre-Finn, Corinne

AU - Price, Gareth

AU - O'Connor, James

PY - 2020/4/17

Y1 - 2020/4/17

N2 - ObjectiveTo investigate the effects of Image Biomarker Standardisation Initiative (IBSI) compliance, harmonisation of calculation settings and platform version on the statistical reliability of radiomic features and their corresponding ability to predict clinical outcome.MethodsThe statistical reliability of radiomic features was assessed retrospectively in three clinical datasets(patient numbers: 108 head and neck cancer, 37 small cell lung cancer, 47 non-small cell lung cancer).Features were calculated using four platforms (PyRadiomics, LIFEx, CERR and IBEX).PyRadiomics, LIFEx and CERR are IBSI-compliant, whereas IBEX is not. The effect of IBSI compliance, user defined calculation settings and platform version were assessed by calculating intraclass correlation coefficients and confidence intervals. The influence of platform choice on the relationship between radiomic biomarkers and survival was evaluated using univariable coxregression in the largest dataset.ResultsThe reliability of radiomic features calculated by the different software platforms was only excellent(ICC > 0.9) for 4/17 radiomic features when comparing all four platforms. Reliability improved toICC > 0.9 for 15/17 radiomic features when analysis was restricted to the three IBSI-compliant platforms. Failure to harmonise calculation settings resulted in poor reliability, even across the IBSI compliant platforms. Software platform version also had a marked effect on feature reliability inCERR and LIFEx. Features identified as having significant relationship to survival varied between platforms, as did the direction of hazard ratios.Conclusion IBSI compliance, user defined calculation settings and choice of platform version all influence the statistical reliability and corresponding performance of prognostic models in radiomics.

AB - ObjectiveTo investigate the effects of Image Biomarker Standardisation Initiative (IBSI) compliance, harmonisation of calculation settings and platform version on the statistical reliability of radiomic features and their corresponding ability to predict clinical outcome.MethodsThe statistical reliability of radiomic features was assessed retrospectively in three clinical datasets(patient numbers: 108 head and neck cancer, 37 small cell lung cancer, 47 non-small cell lung cancer).Features were calculated using four platforms (PyRadiomics, LIFEx, CERR and IBEX).PyRadiomics, LIFEx and CERR are IBSI-compliant, whereas IBEX is not. The effect of IBSI compliance, user defined calculation settings and platform version were assessed by calculating intraclass correlation coefficients and confidence intervals. The influence of platform choice on the relationship between radiomic biomarkers and survival was evaluated using univariable coxregression in the largest dataset.ResultsThe reliability of radiomic features calculated by the different software platforms was only excellent(ICC > 0.9) for 4/17 radiomic features when comparing all four platforms. Reliability improved toICC > 0.9 for 15/17 radiomic features when analysis was restricted to the three IBSI-compliant platforms. Failure to harmonise calculation settings resulted in poor reliability, even across the IBSI compliant platforms. Software platform version also had a marked effect on feature reliability inCERR and LIFEx. Features identified as having significant relationship to survival varied between platforms, as did the direction of hazard ratios.Conclusion IBSI compliance, user defined calculation settings and choice of platform version all influence the statistical reliability and corresponding performance of prognostic models in radiomics.

KW - Reliability of Results

KW - Biomarkers

KW - Prognosis

KW - Tomography

KW - X-ray computed

M3 - Article

JO - European Radiology

JF - European Radiology

SN - 0938-7994

ER -