MedUPS: Towards Diagnostic Assistance in Uncommon Medical Cases with Large Language Models

AI 中文解读

1. 核心亮点：医疗AI终于不再只盯着“最终诊断”，而是学会像医生一样在病情不明确时一步步判断“下一步该做什么”，让罕见病和疑难杂症的辅助决策更靠谱。 2. 通俗解读：以前的医疗AI考试，只考最后能不能答对病症名称，但真实看病不是这样——医生是边查边想：先做哪个检查？该请哪个科室？这些中途判断才是关键。研究人员从五千多份真实病例中挖出两万多个“决策点”，让AI像住院医生一样随着病情资料一点点积累，不断推测下一步行动，而不是急着下结论。这套新方法在多个AI模型上测试，成绩明显提升，甚至有些小模型靠这套训练法超过了更大的模型，说明“学会过程”比“模型够大”更重要。 3. 实际影响：对普通人来说，这意味着未来用AI辅助看病时，它不会一上来就武断地给个诊断，而是更像一位沉稳的医生，帮医生和患者理清思路：先排除什么、再查什么、该找哪位专家。尤其在罕见病和复杂病例中，AI能提供更多合理的下一步选项，减少误诊漏诊，让医疗决策更稳健、更人性化。当然，这仍是辅助工具，最终判断还得靠真正的医生。

Uncommon and off-guideline cases are difficult for clinical decision support, because physicians must make a series of management decisions under diagnostic uncertainty and rarely see the full case at once. Most large language model (LLM) benchmarks for medicine score only the final diagnosis, yet much of clinical care turns on the next appropriate action: the next test to order, the imaging study to obtain, the specialist to involve, or the differential to pursue. We introduce MedUPSQA, a dataset of 21,874 mid-stream clinical decision points built from 5,535 real case reports, and MedUPS, an alignment framework that supervises models on these intermediate decisions as they unfold along a patient's trajectory. We segment free-text case presentations into chronologically ordered, accumulating clinical chunks and align models to predict the next step with reinforcement learning (GRPO), using an external LLM-as-a-Judge reward. This objective mirrors how clinicians actually meet patients, reasoning forward from accumulating evidence toward the next decision, rather than committing to a final label. Across three backbones, mid-stream alignment raises next-step accuracy from 55.2 to 66.7 for Qwen3.6-27B, from 47.2 to 57.8 for Qwen3.5-9B, and from 37.8 to 44.4 for HuatuoGPT-3-8B, with 95% CI. In several model scales we test the objective improves accuracy more than scale, with smaller models surpassing larger, frontier models we evaluate. We further train supervised fine-tuning (SFT) baselines on the mid-stream task, SFT improves all backbones above base, indicating the target framwork carries signal independently of the optimizer. We release the dataset, code, and aligned checkpoints.