Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
arXiv AI · 2026/7/31 04:00:00
Do Latent Channels Actually Communicate? A Causal Audit of Latent Multi-Agent LLM
AI 中文解读
AI之间的“悄悄话”真的有用吗?一篇新研究给这种内部交流做了次“体检”,结果让人意外:表面上的成绩提升,可能只是假象。以往我们总以为AI之间直接传递“内心想法”比打字交流更高效,但研究发现,模型整体表现的好坏,并不能证明这些“悄悄话”真被对方用上了。研究人员设计了一套“换话术”的测试方法,好比把发给接收者的消息偷偷换成别的内容,看它反应变不变,从而拆解出哪些信息真正起作用。用两个不同型号的Qwen模型在数学题等任务上测试发现,有时看起来涨了15分,其实大部分功劳属于“套路性内容”,真正针对题目的有效信息只占一小半;甚至模型越大,效果反转越明显。这项研究的意义在于,它提醒我们:衡量AI协作能力不能只看最终分数,否则可能被“虚假繁荣”误导。未来,当多个AI合作完成复杂任务时,这种审计方法能帮我们找出沟通中的“废话”和“干货”,让AI之间的配合更透明、更可靠,最终用起来也更让人放心。
arXiv:2607.26773v1 Announce Type: new
Abstract: Latent communication in large language model (LLM)-based multi-agent systems (MAS) transmits continuous internal representations instead of text, but greater representational capacity does not establish that the receiver uses task-relevant information. End-task performance alone also cannot reveal whether an observed effect depends on message presence, content generated for the evaluated example, or information supplied by a separate agent. We introduce a causal audit that applies controlled message replacements at the boundary where the sender-produced representation enters the receiver. Four message settings support five measurements of encoded sender information, receiver sensitivity to message presence and identity, the task value of example-specific content, and the additional value supplied by a separate agent. We apply the audit to latent relay with Qwen3-4B and Qwen3-8B on GSM8K, ARC-C, and MATH-500. On GSM8K, the Qwen3-4B overall performance effect of -1.00 percentage point decomposes into a -6.17-point effect retained by an other-example message and a +5.17-point effect attributable to example-specific content; both component directions reverse at 8B. On MATH-500, the Qwen3-4B gain of 15.00 points comprises 8.33 points retained by an other-example message and 6.67 points attributable to example-specific content, while the 8B gain is dominated by the former component. Self-substitution comparisons further show that example-specific content and other-agent value are distinct. These results show that aggregate accuracy does not identify how a latent message affects the receiver and motivate controlled message comparisons as a standard evaluation for latent communication.
分享
阅读原文 ↗