New Commentary: “Large Language Models—Misdiagnosing Diagnostic Excellence?”
JAMA Network Open features CoDEx Director Sumant Ranji’s invited commentary on the popular results of the Goh et al. study, “Influence of a Large Language Model on Diagnostic Reasoning: A Randomized Clinical Vignette Study.”
The findings from the recently published “Influence of a Large Language Model on Diagnostic Reasoning: A Randomized Clinical Vignette Study” by Goh et al. have been gaining widespread attention* in the diagnostic excellence, patient safety, and artificial intelligence communities – and for good reason.
It raises urgent questions, such as what do demonstrations like this of the diagnostic capabilities of large language models (LLM) mean for clinicians? And will LLMs ultimately be capable of preventing harm from diagnostic errors?
In his invited commentary for JAMA Network Open, Sumant Ranji, MD, director of UCSF CoDEx, explores the nuances of the questions that followed the study and the potential path ahead for integrating LLMs to achieve diagnostic excellence.
“…the result that prompted consternation was the performance of the LLM alone, which scored significantly higher than either group of physicians. On hearing these results, more than one audience member wondered aloud, ‘Are we going to be out of a job?’”
From “Large Language Models—Misdiagnosing Diagnostic Excellence?”
Click below to read “Large Language Models—Misdiagnosing Diagnostic Excellence?”, published on October 28, 2024.
*For example, see Erik Horvitz's LinkedIn post and Ethan Mollick's LinkedIn post.
___
About Sumant Ranji, MD
Director, UCSF Coordinating Center for Diagnostic Excellence (CoDEx)
Professor of Clinical Medicine, Zuckerberg San Francisco General Hospital Division of Hospital Medicine
Dr. Ranji brings more than 20 years of experience in patient safety, quality improvement, and medical education to CoDEx. He first joined UCSF as a fellow in hospital medicine and clinical research, then went on to become a faculty member in the Division of Hospital Medicine at UCSF Health, where he held multiple leadership positions. Dr. Ranji then assumed the position of chief of the Division of Hospital Medicine (DHM) at the Zuckerberg San Francisco General Hospital (ZSFG) from 2016-2023. He now concurrently serves as the director of quality improvement and patient safety.
Learn more about Dr. Ranji here.
About the UCSF Coordinating Center for Diagnostic Excellence (CoDEx)
Launched in January 2024, CoDEx will lead change in the field of diagnostic excellence by facilitating activities that result in measurable improvement in diagnostic accuracy, safety, and equity.
About the UCSF Division of Clinical Informatics and Digital Transformation (DoC-IT)
DoC-IT, a newly formed division at UCSF, serves as the academic home for applied clinical informatics researchers in the UCSF Department of Medicine and acts as the coordinating entity with key internal and external digital stakeholders across all UCSF mission areas, schools, departments, and divisions.
Contact
Mika Rivera, Director of Communications
Follow Us
Twitter: @UCSF_CoDEx
LinkedIn: https://www.linkedin.com/company/ucsfcodex