Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
arXiv Machine Learning · 2026/7/30 17:05:20
ScaFE: Data-Efficient Scar Classification with LLM-Generated Clinical Feature Programs
AI 中文解读
ScaFE这项研究最吸引人的地方,是它没有让AI直接“看”照片诊断疤痕,而是让AI把医生的临床经验转化成一套可执行的“检查清单”,既保护了患者隐私,又大幅提升了诊断准确率。
通俗来说,过去AI看病需要大量标注好的图片,而且不同医院的拍摄条件不同,模型容易“水土不服”。ScaFE的做法是,先用大语言模型检索医学知识,生成一系列测量疤痕颜色、凸起程度等特征的程序,然后在本地电脑上运行,原始图片始终不离开医院。最后用简单的机器学习模型根据这些特征做判断,就像医生用尺子量、用眼观察一样,每一步都可追溯、可审核。
这项技术最实际的意义在于,基层医院或数据较少的机构也能用上可靠的AI辅助诊断,不再需要海量数据积累。同时,所有分析都在本地完成,不用担心患者照片被上传到云端。未来类似方法还可能推广到其他医学影像领域,让AI在保护隐私的前提下,帮助医生更精准地鉴别疤痕类型,为患者制定更合适的治疗方案。
Classifying pathological scars from clinical photographs requires distinguishing keloids from hypertrophic scars despite limited expert-labeled data and substantial acquisition variation across hospitals. End-to-end image models remain data-dependent, whereas sending photographs to a hosted vision-language model (VLM) may conflict with local data-governance requirements and yields decisions that are difficult to reproduce and audit. We introduce ScaFE (Scar Feature Engineering), which transfers clinical knowledge from a large language model (LLM) into deterministic, executable feature programs instead of asking the model to diagnose images. A web-enabled LLM retrieves clinical evidence and synthesizes programs that measure visually assessable scar attributes. Candidate programs execute in a restricted local environment, and only aggregate validation statistics and feature-level SHAP summaries are returned for iterative repair and refinement; raw images and patient-level outputs remain local. A lightweight Random Forest then operates on the resulting structured representation. On 600 photographs from three hospitals under leave-one-site-out evaluation, ScaFE achieves 81.0% site-macro balanced accuracy, exceeding the strongest baseline, BiomedCLIP, by 10.0 percentage points. With only 10% of the development data, ScaFE retains 72.0% balanced accuracy and an 11.8-point lead. Iterative refinement also raises the executable-program rate from 66.7% to 95.0%, with verified evidence for 91.7% of the final features. These results show that LLM knowledge can support data-efficient, cross-site medical image classification through local and auditable feature programs rather than direct VLM decisions.
分享
阅读原文 ↗