Daily Tech Briefing
AI 科技速览

每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。

AI 快讯
arXiv Machine Learning · 2026/8/4 15:48:55

Sensitivity, Causality, and Repair Dissociate: A Layer-Wise Analysis of Perturbation Robustness and Its Scaling

AI 中文解读
核心亮点:AI模型出错时,我们终于知道该修哪一层了,但研究却发现,直觉上该修的地方反而最不该动。 通俗解读:科学家用错别字、语音干扰等方式“折腾”大语言模型,想找出模型内部哪个环节最需要修复。结果发现,模型内部有三套完全不同的“责任地图”:最敏感的地方、真正导致出错的地方、以及能补救的地方,它们互不重合。更反直觉的是,在能修复错误的位置加装“补丁”,反而会破坏模型原本正常的后续计算,让表现更差。这就像修水管时,拧紧漏水点旁边的阀门,结果把整栋楼的水都断了。 实际影响:这项发现给AI开发者提了个醒——盲目修复模型“敏感点”可能适得其反。未来训练更抗干扰的AI时,得先做低成本预筛选,并优先在深层而非浅层做调整。对普通人来说,这意味着以后用AI处理带错别字的文档或嘈杂语音时,模型会更稳定,但短期内AI“越修越坏”的问题也提醒我们,技术优化仍需谨慎。
When a language model fails on surface-perturbed input (typos, OCR noise, homophones), "which layer is responsible" has three natural operationalizations: where representations diverge most (sensitivity), where restoring clean activations recovers the prediction (causality), and where a small adapter can repair the damage (compensatory capacity) - and we show these three layer maps dissociate. Across a five-model panel we identify two propagation regimes - spike-and-suppress (Phi-3.5, Gemma-2-9B) and late-accumulation (Llama-3, Mistral, Qwen2.5-7B) - and on the two models meeting an 80% identity-patch gate, sensitivity and causality are anti-correlated (rho = -0.72 to -0.88). Within-family scaling on Qwen2.5 (1.5B to 14B) shows the late-accumulation signature strengthening monotonically with scale, corroborated on a second family. We propose cascade disruption as the mechanism behind the dissociation: adapters placed at causally implicated early layers break intact downstream computation, making diagnostic-flagged sites the worst adapter placements. A fixed-harness layer sweep across four models (3.8-8B) confirms the core prediction on chain-of-thought GSM8K - the flagged sites are the most damaging adapter windows on every adjudicable model - and is sign-consistent but strongly attenuated on a multiple-choice control, consistent with damage that compounds with generation length. The sweep yields practical guidance: a training-free LRD pre-screen and a default-deepest placement rule, though absolute gains over no-adapter baselines remain small. Finally, apparent gains from a representation-stability loss reverse under an adequate generation budget - truncated chain-of-thought had been scored as empty - a methodological warning for any intervention evaluated on chain-of-thought tasks.
分享
阅读原文