With the release of the iPhone 4S and Siri, Apple has introduced speech recognition (SR) technology to the masses. Apple bills and markets Siri as a “humble personal assistant.” However, I doubt many radiologists, who have been working with SR technology for multiple years, would describe their SR software systems this way.
With the release of the iPhone 4S and Siri, Apple has introduced speech recognition (SR) technology to the masses. Apple bills and markets Siri as a “humble personal assistant.” However, I doubt many radiologists, who have been working with SR technology for multiple years, would describe their SR software systems this way.
Radiologists who use SR software to dictate their reports often describe the experience as frustrating. Much of this frustration, I believe, stems from the introduction of SR before its maturity.
Apple is renowned for their elegant consumer gadgets. They delay release of their products until their engineers believe that a technology has improved to a point where its implementation will not cause undue frustration on the part of their users. Case in point, while the tablet computer existed long before the iPad, Jobs and Co. at Apple realized that it would not be readily embraced by the average user until the product could be very thin, very responsive, and light. Apparently the “magic” (to borrow a term Jobs liked to throw around) year when technology was robust enough to accomplish this was 2010.
Now that Apple has determined SR technology to be mature enough to incorporate it into its iconic iPhone, should radiologists stop their grumbling?
Speech recognition software, which facilitates radiology dictations, has many proven benefits. Last year in AJR I wrote about our experience at UNC Hospitals incorporating SR software into the radiologist’s workflow. We noticed substantial improvements in report turn around time similar to what other observers had demonstrated, but also found that improvements in turn around time varied significantly between users due predominately to different work habits. Users who spent greater time training the system to recognize their voice and adding and revising terms in the vocabulary library, for example, benefited the most.
If you read between the lines of Apple’s marketing onslaught you will realize that they advise the same type of behavior to improve Siri (the more you use it, the better it will get). Additional benefits of SR driven dictation systems include the ability to leverage templates, mini macros, and structured reporting to improve accuracy, consistency, and billing. Moreover, advances in natural language processing coupled to SR software may allow for the ability to integrate targeted radiology decision support at the time of dictation, the ability to structure unstructured reports, and identify key content and highlight critical findings.
However, despite these benefits SR software has potential drawbacks. Most notably errors can result from incorrect capture of a radiologist’s voice and more important, the intent of their language. Most recently Sarah Basma and her group at Women’s College Hospital in Toronto, found an alarmingly high rate of errors using SR software vis a vis traditional transcriptionists for breast imaging reports. After correcting for multiple variables Basma’s group found that reports generated with SR were eight times more likely to contain major errors than those generated by traditional transcription.
The conflicting reports on SR software should give us pause as we move forward. The companies producing SR software have improved their products significantly over the last few years. Despite these improvements, a recent Diagnostic Imaging poll shows that while 80 percent of users use SR software, 30 percent still find it hard to use and not as accurate as traditional transcription services.
Apple believes the technology is ready for prime time. However as in most things tech, what is good enough for the average consumer product doesn’t necessarily stand up to the rigorous standards of healthcare. If Siri misinterprets your request for the weather forecast, you may get rained on. However, if a radiologist’s breast imaging report is recorded incorrectly the potential consequences are much more substantial.
Leading Breast Radiologists Discuss the USPSTF Breast Cancer Screening Recommendations
May 17th 2024In recognition of National Women’s Health Week, Dana Bonaminio, MD, Amy Patel, MD, and Stacy Smith-Foley, MD, shared their thoughts and perspectives on the recently updated breast cancer screening recommendations from the United States Preventive Services Task Force (USPSTF).
Multicenter CT Study Shows Benefits of Emerging Diagnostic Model for Clear Cell Renal Cell Carcinoma
May 15th 2024Combining clinical and CT features, adjunctive use of a classification and regression tree (CART) diagnostic model demonstrated AUCs for detecting clear cell renal cell carcinoma (ccRCC) that were 15 to 22 percent higher than unassisted radiologist assessments.
CT Study: AI Algorithm Comparable to Radiologists in Differentiating Small Renal Masses
May 14th 2024An emerging deep learning algorithm had a lower AUC and sensitivity than urological radiologists for differentiating between small renal masses on computed tomography (CT) scans but had a 21 percent higher sensitivity rate than non-urological radiologists, according to new research.