Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
arXiv Machine Learning · 2026/8/3 15:11:21
Faster-WAM: Do World Action Models Need Deep Action Modules?
AI 中文解读
核心亮点:给机器人视频大脑装上一个轻巧的动作输出模块,让它在几乎不损失性能的前提下,推理速度直接快了3倍多。
通俗解读:过去AI机器人“看”视频和“做”动作用的是同一个厚重系统,动作模块必须跟着大模型一起深度计算,反应很慢。这项新研究把视频理解模型当成一个公共大脑,动作模块只做一个“外接小插件”,通过巧妙接口直接读取大脑各层的理解,不用重复计算。就像给经验丰富的老师傅配了个传话员,老师傅只需看一眼,传话员就能快速报出该怎么做,省时省力。
实际影响:这项技术意味着机器人能更快更灵活地应对现实场景,比如在厨房帮你拿东西、在工厂分拣零件时,反应不再迟滞笨拙。同时计算成本降低,未来智能机器人有望更便宜、更普及,走进家庭和办公室,成为人们日常生活中的得力助手。
World Action Models (WAMs) couple robot action prediction with video world models. Existing WAMs with shared-backbone and Mixture-of-Transformers designs generally tie the depth of the action module to that of the video backbone, resulting in substantial computational overhead and high inference latency. To address this limitation, we introduce Dock of Transformer (DoT), a video-centric design principle that treats a pretrained video Transformer as a representation hub and connects lightweight output-heads through docking interfaces. This enables flexible output-head design while providing direct access to representations from all layers of the backbone. We then introduce \textbf{Faster-WAM}, an instantiation of DoT for WAMs, which docks a single-layer action head onto a 30-layer video backbone. The docking interface fuses keys and values from all video layers and applies RoPE realignment. Without additional embodied pretraining, Faster-WAM achieves competitive performance on LIBERO and RoboTwin 2.0 while demonstrating strong out-of-distribution generalization on LIBERO-Plus. Faster-WAM also achieves the lowest end-to-end latency in our controlled comparison, requiring only 66.5 ms per inference --- a \(3.2\times\) speedup over Fast-WAM. Overall, these results demonstrate that the video-centric DoT architecture supports flexible task-specific head design while delivering low inference latency, strong action-prediction performance, and robust generalization.
分享
阅读原文 ↗