10/22/26

Sequential diagnosis with language models.

Nori, Harsha; Daswani, Mayank; Kelly, Christopher; Lundberg, Scott; Ribeiro, Marco Tulio; Wilson, Marc; Liu, Xiaoxuan; Sounderajah, Viknesh; Carlson, Jonathan M; Lungren, Matthew P; Gross, Bay; Hames, Peter; Suleyman, Mustafa; King, Dominic; Horvitz, Eric. Science

Summary

Diagnostic reasoning unfolds over time as clinicians gather information and revise hypotheses. This model evaluation examines frontier language models on consecutive diagnostic tasks, introducing a benchmark designed to examine performance across evolving clinical information rather than isolated questions. The work offers a more process-oriented approach to AI evaluation and suggests benchmark performance alone cannot improve patient outcomes or safety in clinical practice. Prospective comparisons with clinicians and real-world workflow testing are noted as important next steps
Nori H, Daswani M, Kelly C, et al. Sequential diagnosis with language models. Science. 2026;394(6822):423-428.