Calibrated Selective Fact-Checking via Evidence Chain Evaluation

AI 中文解读

让AI学会说“不确定”，反而让事实核查更靠谱了！这篇来自arXiv的最新研究提出一种名为“证据链评估”（ECE）的核查框架，它不再强制AI对每条信息都给出真或假的判断，而是允许在证据不足时选择“不确定”。实验中，这套系统回答问题的准确率高达97.8%，只有在证据极其单薄的情况下才会选择放弃回答，放弃的比例只有6.3%。这种“宁缺毋滥”的策略，有效避免了AI硬撑着给出错误结论。过去，AI在做事实核查时就像个“拼命三郎”，就算手头证据零零散散，也要硬猜个结果出来，容易让人信以为真。ECE的做法更像一位严谨的侦探：它会通过网络搜索、学术搜索等多种工具收集证据，再评估证据链是否完整、一致。如果证据不够可靠，就坦承“不确定”，而不是强行给出虚假判断。这项技术对普通人最大的影响是——以后你再用AI查新闻、查健康信息或法律条款时，AI会变得更诚实。遇到它没把握的疑问，它会主动告诉你“这个我不确定”，而不是胡乱编造一个答案骗你。这能大大降低AI传谣的风险，尤其适合医疗、金融等对准确性要求极高的场景。简单说，AI学会“不知道”，反而让我们更放心。

arXiv:2607.18240v1 Announce Type: new Abstract: Large language models (LLMs) can achieve strong fact-checking accuracy, yet forced binary decisions conceal a critical reliability problem: systems may issue confident verdicts even when supporting evidence is weak, sparse, or internally inconsistent. We address this issue through Evidence Chain Evaluation (ECE), a selective fact-checking framework that permits abstention via an uncertain verdict instead of requiring a true/false decision for every claim. The evaluated system is a tool-using verification agent that gathers evidence through web search, scholarly search, and executable checks, and then returns a structured verdict with confidence and source-level metadata. On ECE-Bench, ECE achieves 91.6% standard accuracy, 93.7% coverage, and 97.8% selective accuracy on answered claims. Although ECE does not outperform the strongest retrieval baseline on aggregate calibration metrics such as Expected Calibration Error, Brier score, or AURC, it delivers a clear selective-prediction trade-off: the system maintains very high accuracy on answered claims while deferring 6 of 95 cases. These deferred cases are concentrated in lower-reliability evidence settings (5/6 at source level L4), supporting the view that abstention functions as a safety-oriented mechanism for handling epistemically weak evidence. Code is available at https://github.com/ cheshireyang/ECE.git