In recent video interviews, Tessa Cook, MD, PhD, Nina Kottler, MD, MS, and Sonia Gupta, MD shared their insights and perspective on potential benefits and drawbacks of ChatGPT in radiology.
ChatGPT may have considerable potential for streamlining radiology workflows and reporting but concerns over optimal prompt engineering and hallucination effects may curtail the use of the artificial intelligence (AI) chatbot in radiology for the time being.
In recent video interviews. Nina Kottler, M.D., MS, Tessa Cook, M.D., Ph.D, and Sonia Gupta, M.D., discussed the potential capabilities of ChatGPT for radiologists and cautioned about current drawbacks of the technology.
Dr. Kottler suggested that ChatGPT could help remedy the frustration of receiving incomplete patient histories.
“We’ve never (received) great (clinical) histories. That decreases the quality of our output and causes us to hedge a lot,” notes Dr. Kottler, associate chief medical officer of Clinical AI and vice-president of Clinical Operations at Radiology Partners. “ChatGPT could either summarize information from the EMR (electronic medical record) and provide us with that robust patient history or summarize prior reports for us so we get that history and the pathology that we’re finding.”
Another potential benefit of ChatGPT could be converting patient summaries of radiology reports into different languages and possibly expanding access to care, suggested Dr. Gupta, the chief medical officer of Change Healthcare and a board member of the American Board of Artificial Intelligence.
(Editor’s note: For related content, see “Emerging Insights on Improving Radiology Workflows,” “Assessing the Value Proposition of AI in Radiology” and “Emerging Trends with AI in Radiology in 2023.”)
However, Dr. Kottler noted that the quality of the prompt input has a strong effect on the results one gets with ChatGPT. Drs. Cook, Gupta and Kottler all emphasize having appropriate safeguards in place to ensure the accuracy and verifiable referencing of information provided by ChatGPT. While Dr. Cook noted use cases with ChatGPT that have provided a synthesis of literature on a given topic, she said other cases have demonstrated “hallucination effects” in which there has been rewritten history or the “invention of citations that don’t exist.”
“Just because ChatGPT is far more fluent than any other chatbot we might have encountered in the past doesn’t necessarily mean it is not fallible in some way as well,” cautioned Dr. Cook, an associate professor of radiology, and director of the Center for Practice Transformation in Radiology at the Hospital of the University of Pennsylvania.
For more insights from Drs. Cook, Gupta and Kottler, watch the video below.
AI Radiology ROI Calculator Study Projects 451 Percent ROI Over Five Years
March 18th 2024Incorporating an artificial intelligence (AI) platform into the radiology workflow at a stroke management-accredited hospital may lead to projected savings of 78 days in triage time and 41 days in reporting time for radiologists over a five-year period, according to new research.
What New Research Reveals About ChatGPT and Ultrasound Detection of Thyroid Nodules
March 13th 2024In a comparison of image-to-text large language models (LLMs), ChatGPT 4.0 offered a 95 percent sensitivity rate and an 83 percent AUC that were comparable to that of two senior radiologists and one junior radiologist interacting with LLM to differentiate between malignant and benign thyroid nodules on ultrasound.
ECR Study Finds Mixed Results with AI on Breast Ultrasound
March 6th 2024While adjunctive use of AI led to significantly higher specificity and accuracy rates in detecting cancer on breast ultrasound exams in comparison to unassisted reading by breast radiologists, researchers noted that 12 of 13 BI-RADS 3 lesions upgraded by AI were ultimately benign, according to research presented at the European Congress of Radiology.