Radiologists prove hasty in dismissing breast CAD

Radiologists may be adept at rejecting hundreds of false positives flagged by computer-aided detection software, but they also have a strong tendency to dismiss correctly identified cancers, mistakenly believing the findings are benign, according to new research.

Radiologists dismissed 70% of correct CAD markings in a University of Chicago study, according to Dr. Robert Nishikawa, who presented the results at the 2006 RSNA meeting. He called for further research to explain the dismissive tendency.

The Chicago study involved 300 cases, including 66 patients with 69 cancers. Eight radiologists reviewed the studies and assigned a BI-RADS rating, then checked the findings of a CAD system that was state of the art in 2003 and regraded the studies.

They were twice as likely to reject correct prompts when the finding was visible in two views but marked by CAD on only one view. The cancers in these cases are often very subtle, and the radiologist may believe they are insignificant and do not need to be worked up. Cancers marked on both views tend to be more conspicuous, so they are more readily recognized when flagged by the computer.

"We need to improve [software] algorithms to have correlation in two views," said Nishikawa, an associate professor of radiology.

Consistent with other studies, the Chicago research showed that CAD increased sensitivity by about 10%, from 58% to 64%, and boosted recall rates by roughly the same amount.

"Radiologists' performance was higher when they used the computer," Nishikawa said.

If they would heed CAD's correct advice more often, radiologists could significantly reduce misses and boost sensitivity, he said. Performance would improve if CAD also played more of a diagnostic role by providing an indication of likelihood of malignancy. Such software has been developed and submitted to the FDA for approval.

Each case in the study averaged about two incorrect prompts, totaling 600 overall, most of which were correctly ignored. Of the 234 normal cases, CAD would have spurred a re-call of 85 patients, versus 76 without CAD.

In another study of CAD with full-field digital mammography, 65% of masses were marked on only one view, said Dr. Stamatia Destounis, who presented results at the RSNA meeting.

If radiologists see something on one mammographic view and are undecided, CAD may influence the decision against a workup, said Destounis, a radiologist at the Elizabeth Wende Breast Clinic in Rochester, New York. Consequently, radiologists must be aware that CAD sometimes marks cancers, particularly masses, in only one view, and they should not be too hasty in dismissing such findings. It is sometimes helpful in these cases to review prior mammograms or obtain an extra mammographic view.

Destounis' team evaluated CAD in 202 biopsy-proven lesions in 201 patients who underwent screening or diagnostic mammography. Overall, CAD picked up 74% of cancerous findings. It performed best in detection of calcifications, with 90% sensitivity and 75% of cases marked on two views. But CAD's abilities elsewhere fell short, as the software picked up only 61% of masses and 44% of cases of architectural distortion. Not surprisingly, performance varied depending on breast density, with sensitivity dropping from 79% in fatty breasts to 76% in heterodense breasts and 67% in dense breasts.

"In heterodense and dense breasts, CAD is much like the human eye," Destounis said.