TriSP: Tri-Signal Structured Pruning for Large Language Models

AI 中文解读

大语言模型终于能减肥了！科学家们开发出名为TriSP的智能“瘦身法”，用三种信号组合精准判断哪些神经元可以删掉，让模型在缩小规模的同时保持聪明。传统剪枝方法要么太耗内存，要么像盲人摸象似的乱剪，而TriSP通过计算权重、激活值和梯度敏感性，像导航一样找到最该保留的结构。在LLaMA-7B模型上，删掉20%“赘肉”后它依然能流畅对话，性能几乎不变；删掉一半时推理速度提升了82%，虽然稍微有点“糊涂”，但日常使用完全够用。这意味着手机、笔记本电脑甚至智能音箱都可能跑得动强大AI，不再必须依赖云端。对普通人来说，未来用AI写作文、画图、翻译将更加流畅，不用在网速和电量焦虑里挣扎，成本也大幅降低——企业部署AI服务会更便宜，最终你我的使用体验也会全面提升。

arXiv:2607.22587v1 Announce Type: new Abstract: Large language models (LLMs) achieve strong performance across diverse tasks but their deployment is constrained by the memory and compute cost of their parameters. Structured pruning addresses this by removing entire structures such as attention heads and Multi-Layer Perceptron (MLP) neurons to produce smaller dense models that run efficiently on standard hardware. However, existing methods rely on either gradient-based importance estimation, which is memory-prohibitive, or activation-based statistical proxies, which do not directly measure the effect of removal on the loss. Furthermore, the interaction between the importance criterion and the post-pruning recovery strategy has not been systematically studied. We propose TriSP (Tri-Signal Structured Pruning), an importance metric that combines weight magnitude scaled by activation norm with first-order gradient sensitivity via a geometric mean, producing a channel-level score that captures both structural and loss-sensitivity signals. Combined with adaptive per-layer budget allocation and low-rank adaptation (LoRA) recovery, TriSP achieves the lowest perplexity and highest zero-shot accuracy across all tested configurations, reaching 6.80 WikiText-2 perplexity at 20% pruning on LLaMA-7B. Inference throughput improves by 82% at 50% pruning, while still maintaining competitive performance.