Certified large language model-based diagnostic decision support in rheumatology: the ALLIANCE multicentre randomised controlled trial.

Faster diagnostic work does not necessarily mean better diagnosis. This preprint reports on a German, multicenter randomized controlled trial, in which 82 physicians used conventional resources with or without Prof. Valmed, the first LLM-based decision-support system to receive European Conformity certification as a medical device. The results show that AI substantially reduced case-processing time on three rheumatology cases but did not improve diagnostic accuracy. The authors highlight that overconfidence and AI over-reliance remain concerns in the use of such systems.