From the Journals
Commentary & Perspectives
Are AI Models Cheating in Biomarker Predictions?
Study finds image-based predictions often reflect confounding factors rather than true molecular signals
A multi-cohort analysis involving 8,221 cancer patients assessed the efficacy of deep learning models in predicting cancer biomarkers from histology images. The study highlighted that while AI systems exhibited high accuracy, their performance was often influenced by unrelated factors such as tumor grade and mutation burden, rather than the biomarkers themselves. Published in Nature Biomedical Engineering, the findings emphasize the need for stricter evaluation protocols in AI development to distinguish genuine predictive capabilities from simpler grade-based correlations. This underscores the importance of molecular testing in treatment decisions.
1. AI can predict tumor biomarkers, but often confounded by unrelated factors. 2. Study included 8,221 patients with various cancers. 3. High accuracy noted, but depends on tumor grade and mutation burden. 4. Simple models matched AI performance sometimes. 5. Bias-aware strategies recommended for AI deployment. 6. Confirmatory molecular testing remains crucial for treatment decisions.