.Nature Medicine, Posted online: 26 July 2024 doi:10.1038/ s41591-024-03181-6Although big language models (LLMs) show promise in measured settings, a research study currently exposes their constraints in real-world professional requests and points the way in the direction of robust analysis and also benchmarking before professional make use of.