Radiologists may be adept at rejecting hundreds of false positives flagged by computer-aided detection software, but they also have a strong tendency to dismiss correctly identified cancers, mistakenly believing the findings are benign, according to new research.
Radiologists may be adept at rejecting hundreds of false positives flagged by computer-aided detection software, but they also have a strong tendency to dismiss correctly identified cancers, mistakenly believing the findings are benign, according to new research.
Radiologists dismissed 70% of correct CAD markings in a University of Chicago study, according to Dr. Robert Nishikawa, who presented the results at the 2006 RSNA meeting. He called for further research to explain the dismissive tendency.
The Chicago study involved 300 cases, including 66 patients with 69 cancers. Eight radiologists reviewed the studies and assigned a BI-RADS rating, then checked the findings of a CAD system that was state of the art in 2003 and regraded the studies.
They were twice as likely to reject correct prompts when the finding was visible in two views but marked by CAD on only one view. The cancers in these cases are often very subtle, and the radiologist may believe they are insignificant and do not need to be worked up. Cancers marked on both views tend to be more conspicuous, so they are more readily recognized when flagged by the computer.
"We need to improve [software] algorithms to have correlation in two views," said Nishikawa, an associate professor of radiology.
Consistent with other studies, the Chicago research showed that CAD increased sensitivity by about 10%, from 58% to 64%, and boosted recall rates by roughly the same amount.
"Radiologists' performance was higher when they used the computer," Nishikawa said.
If they would heed CAD's correct advice more often, radiologists could significantly reduce misses and boost sensitivity, he said. Performance would improve if CAD also played more of a diagnostic role by providing an indication of likelihood of malignancy. Such software has been developed and submitted to the FDA for approval.
Each case in the study averaged about two incorrect prompts, totaling 600 overall, most of which were correctly ignored. Of the 234 normal cases, CAD would have spurred a re-call of 85 patients, versus 76 without CAD.
In another study of CAD with full-field digital mammography, 65% of masses were marked on only one view, said Dr. Stamatia Destounis, who presented results at the RSNA meeting.
If radiologists see something on one mammographic view and are undecided, CAD may influence the decision against a workup, said Destounis, a radiologist at the Elizabeth Wende Breast Clinic in Rochester, New York. Consequently, radiologists must be aware that CAD sometimes marks cancers, particularly masses, in only one view, and they should not be too hasty in dismissing such findings. It is sometimes helpful in these cases to review prior mammograms or obtain an extra mammographic view.
Destounis' team evaluated CAD in 202 biopsy-proven lesions in 201 patients who underwent screening or diagnostic mammography. Overall, CAD picked up 74% of cancerous findings. It performed best in detection of calcifications, with 90% sensitivity and 75% of cases marked on two views. But CAD's abilities elsewhere fell short, as the software picked up only 61% of masses and 44% of cases of architectural distortion. Not surprisingly, performance varied depending on breast density, with sensitivity dropping from 79% in fatty breasts to 76% in heterodense breasts and 67% in dense breasts.
"In heterodense and dense breasts, CAD is much like the human eye," Destounis said.
Is the Kaiser Score More Effective than BI-RADS for Assessing Contrast-Enhanced Mammography and MRI?
October 14th 2024For women with breast-enhanced masses, Kaiser scoring (KS) demonstrated a 20 percent higher AUC than BI-RADS classification for contrast-enhanced mammography (CEM) and was comparable to KS for breast MRI.
FDA Clears New Features in AI-Powered Mammography Software Suite
October 11th 2024Therapixel’s MammoScreen suite has received 510(k) FDA clearances for a breast density assessment feature and updated software that includes automated pre-reporting, which reportedly expedites reporting of mammography findings.
Multicenter Study Identifies Key Factors Associated with Mammogram-Occult Ipsilateral Breast Cancer
October 9th 2024A symptomatic first breast cancer diagnosis, prevailing breast density at a second breast cancer diagnosis and trabecular thickening on surveillance mammography were linked to mammogram-occult ipsilateral breast cancer, according to new research.
Radiology Experience, Breast Density and Screening Mammography: What New Research Reveals
October 4th 2024In a study looking at the impact of experience and case volume of breast screening radiologists, researchers found that reviewing more than 150 cases per week was necessary to achieve an 80 percent rate of true-positive assessments for malignant calcifications.