RoCo-ACE: Rollout-Conditioned Online Distillation for Retention-Aware Knowledge Injection

AI 中文解读

RoCo-ACE来了！这项新方法解决了AI学新知识时容易“忘旧”的老大难问题。传统做法是让AI直接死记硬背正确答案，结果学完新东西，原本会的技能反而变差了。RoCo-ACE的思路很聪明：它让AI在生成回答的过程中，对与正确答案匹配的部分给予更多“学习权重”，而对没涉及的部分不再强行灌输，而是通过少量修正来弥补。这样既学到了新知识，又保留了原有的能力。这意味着以后你用的AI助手在更新知识库时会更可靠。比如你问它最新医疗指南，它不会因此忘记怎么帮你查天气。企业部署的AI模型也能在注入行业新知识时保持稳定，不会出现学了新内容就变笨的情况。这项技术让AI的“终身学习”迈出了一大步，减少了反复训练的麻烦，对普通用户来说就是更聪明的AI、更少的突发故障。

arXiv:2607.24771v1 Announce Type: new Abstract: Knowledge injection updates pretrained MLLMs with new factual or domain-specific knowledge, but fitting full authoritative answers can cause drift in non-updated behavior. Online distillation mitigates this drift by training on model-generated rollouts, yet uniform reference-conditioned distillation provides coarse supervision: it can under-emphasize reference-supported rollout tokens and supervise omitted facts only indirectly. We introduce RoCo-ACE, a rollout-conditioned online distillation objective for knowledge injection. RoCo uses same-rollout reference-free/reference-conditioned likelihood contrast to reallocate additional distillation weight to reference-supported rollout tokens, while ACE adds sparse reference-side anchored correction for authoritative anchors omitted from the rollout without full-answer imitation. Across three knowledge-injection settings, six retention benchmarks, multiple baselines, and multiple base models, RoCo-ACE achieves the best injected-knowledge accuracy among compared methods while keeping evaluated retention close to the base model.