Evidence-Ledger Adjudication for Claim-Evidence Traceability

AI 中文解读

AI写作有个老大难问题：文章里的每句话都有出处，但这些出处真的支持那句话吗？人眼核对太慢，AI又常“瞎编”。这项新研究给AI配了个“证据账本”，让它一边写一边自动核对每句话和引用的材料是否对得上，发现对不上、有矛盾或者证据不足的，就直接打回重写。测试中，这个“AI审查员”识别准确率大幅领先传统方法，还能把超过八成有问题的句子精准挑出来。这技术一旦成熟，对普通人最直接的影响就是：以后AI帮你写文章、写报告、查资料，不再只是“看起来专业”，而是真正引经据典、每个结论都有扎实依据，可信度高得多。无论是学生写论文、打工人做汇报，还是日常阅读海量信息，都省心又放心，再也不用担心被AI引用的一堆“权威文献”误导了。

arXiv:2607.26512v1 Announce Type: new Abstract: AI agents can draft claims faster than authors can check whether the cited or retrieved evidence supports them. We study evidence-ledger adjudication: a claim-evidence traceability workflow that pairs each claim with an evidence packet, assigns a support relation, and routes unsupported, contradicted, or mixed-evidence claims back to the author. The empirical core is a 2,335-row blind benchmark built from independent external labels in AVeriTeC, CLIMATE-FEVER, and SciFact. Gold relations and source evidence labels are hidden during prediction and joined only for scoring. On this benchmark, the agent evidence-ledger condition achieves 0.676 relation accuracy and 0.601 macro-F1, compared with 0.383 accuracy and 0.303 macro-F1 for the best non-agent baseline. It also routes 1270/1435 claims whose gold labels indicate contradiction, missing evidence, or mixed evidence, while routing 295/900 supported claims. These results show that evidence-ledger adjudication can turn heterogeneous evidence packets into an auditable traceability layer for AI-assisted writing.