Daily Tech Briefing
AI 科技速览

每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。

AI 快讯
arXiv AI · 2026/8/4 15:50:26

MAFIA: Query-Only Memory Attacks via Probing and Factual Injection against Audited LLM Agents

AI 中文解读
核心亮点:黑客不用碰你的聊天记录,光靠“提问”就能往AI记忆里塞假信息,成功率高达90%,还能躲过审查。 通俗解读:现在很多AI助手会“记住”之前的对话,方便下次接着聊。但研究人员发现,有人能通过精心设计的提问,悄悄把错误信息“喂”给AI的记忆库,比如植入“某药品无效”这类假事实。更厉害的是,这套攻击手法能绕过现有的安全过滤,就像在安检眼皮底下藏违禁品,AI还会一本正经地用这些假信息回答你。 实际影响:如果你常用AI查资料、做决策,得留个心眼——AI给出的答案可能被暗中篡改过。尤其对依赖AI辅助医疗、法律或金融建议的用户,这类漏洞可能误导判断。好消息是,研究团队已公开攻击代码,倒逼厂商赶紧修补,未来AI的记忆功能会更安全,但短期内建议对AI的“权威回答”保持基本怀疑。
Memory-augmented LLM agents rely on rich context for long-horizon reasoning and acting, yet their memory modules expose a persistent attack surface for malicious records, making the study of memory poisoning threats imperative. However, existing query-only attacks often fail to remain effective in two realistic and prevalent settings: large-scale benign memory pools and active input auditing. Consequently, current approaches fall short when facing the dual challenges of high retrieval competitiveness and rigorous semantic checks. To overcome these limitations, we propose MAFIA, a query-only Memory Attack framework via probing and Factual Injection against Audit, tailored to this extended threat model. Specifically, MAFIA introduces: (1) a placement strategy that ensures retrieval-competitive injection via memory probing, budget allocation, and scheduling; and (2) a payload design that bypasses audits using compact factual cloaks, preserving malicious effects while maintaining high semantic similarity. Extensive evaluations reveal that MAFIA achieves up to a 90.7% attack success rate while suppressing audit detection from a peak of 83.3% to at most 7.4%, exposing critical vulnerabilities across agentic memory systems. Code will be made publicly available at https://github.com/JiamingChen1234/MAFIA.
分享
阅读原文