04/23/26

The effect of medical explanations from large language models on diagnostic accuracy in radiology.

Spitzer, Philipp; Hendriks, Daniel; Rudolph, Jan; Schlaeger, Sarah; Ricke, Jens; Kühl, Niklas; Hoppe, Boj Friedrich; Feuerriegel, Stefan. NPJ Digital Med.

Summary

LLMs are increasingly used for diagnostic support, yet the ideal format for their explanations remains unclear. In this large-scale vignette German study, explanation format significantly influenced diagnostic accuracy. Requesting "chain of thought" output for a diagnosis helped physicians identify and correct potential errors in LLM predictions, improving decision-making. These findings highlight the importance of explanation design in clinical AI.
Spitzer P, Hendriks D, Rudolph J, et al. The effect of medical explanations from large language models on diagnostic accuracy in radiology. NPJ Digital Med. 2026;9(1).