Deep learning models trained on a dataset lacking racial diversity could hinder the detection of pathology in underrepresented minority patients.
A study presented at the Radiological Society of North America (RSNA) 2021 Annual Meeting demonstrates the importance of using racially diverse datasets while training artificial intelligence (AI) systems to ensure fair outcomes.
“As the rapid development of deep learning in medicine continues, there are concerns of potential bias when interpreting radiological images,” the authors wrote. “As future medical AI systems are approved by regulators, it is crucial that model performance on different racial/ethnic groups is shared to ensure that safe and fair systems are being implemented.”
The findings were presented by Brandon Price, a medical student at Florida State University College of Medicine in Tallahassee.
Many studies have shown that deep learning systems are subjective in their interpretation of data. Bias is often accidentally introduced into the training data, or a racial or ethnic group is under sampled causing susceptible models to develop bias. In this study, the researchers investigated how a deep learning model trained on a dataset lacking racial diversity could impede the detection of pathology in underrepresented minority patients.
The researchers used a dataset with over 300,000 chest X-ray images and 14 labeled findings. A low sample size of other races/ethnicities meant that only images of Black and White patients were included. One training dataset included only White patients and the other training dataset comprised 26% Black and 74% White patients. An equal distribution of labeled findings was shared between the datasets and a DenseNet model was trained on each dataset 25 times. The receiver operating characteristics (ROC) area under the curve (AUC) and sensitivity, with a specificity threshold of 0.75, were compared for each of the 14 labeled findings.
Compared with a model trained on only White patients, the model trained with a diverse dataset had a significantly better ROC-AUC performance at identifying six of the 14 labeled findings in a test dataset of only Black patients (P <0.05). Additionally, compared with a model trained on only White patients, the model trained with a diverse dataset found a significant increase in sensitivity performance for six of the 14 labeled findings on a test dataset of only Black patients (P <0.05).
“As more AI systems are developed, it is imperative that they are fair and perform equally well with groups that have been historically underserved,” the authors wrote.
For more coverage of RSNA 2021, click here.
SNMMI: Can 18F-Fluciclovine PET/CT Bolster Detection of PCa Recurrence in the Prostate Bed?
June 24th 2025In an ongoing prospective study of patients with biochemical recurrence of PCa and an initial negative PSMA PET/CT, preliminary findings revealed positive 18F-fluciclovine PET/CT scans in over 54 percent of the cohort, according to a recent poster presentation at the SNMMI conference.
SNMMI: Can Multimodal Monitoring Bolster Outcomes with Pluvicto in Treating mCRPC?
June 22nd 2025Multimodal treatment monitoring, including SPECT/CT exams 24 hours after treatment with Lu-177 PSMA-617, may have facilitated significantly shorter therapy durations and reduced side effects in patients with mCRPC, according to a two-year study presented at the Society for Nuclear Medicine and Molecular Imaging (SNMMI) conference.
GE HealthCare Unveils Enhanced LesionID Pro at SNMMI Conference
Published: June 21st 2025 | Updated: June 21st 2025Emphasizing a zero-click experience, the updated LesionID Pro software, to be introduced at the SNMMI conference, reportedly provides AI-powered automated insights into whole-body tumor burden with PET and SPECT imaging.