Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
MarkTechPost · 2026/7/26 17:50:23
Black Forest Labs Releases FLUX 3: A Multimodal Flow Model for Image, Video, Audio and Robot Action Prediction
AI 中文解读
Black Forest Labs发布了FLUX 3,一个能同时处理图像、视频、音频甚至机器人动作的“全能AI模型”,让不同感官信息在同一套系统中互相验证、生成更真实的结果。
简单来说,以前AI往往各自专攻一项——有的会画画,有的会写歌,有的会做视频。FLUX 3打破了这种割裂,把图像、声音和动态放在一个“大脑”里一起学。比如它生成一段汽车鸣笛视频,画面里汽车的动作和声音必须同步,撞击声和物体形变也得匹配,因为模型从训练时就知道“声音必须符合物理碰撞”。技术上它用了自监督学习方法,让不同模态的数据互相约束,就像我们人看视频时既看画面也听声音,自然能理解因果关系。
这对普通人意味着什么?以后你用AI做视频,不用再分两步生成画面再配音,FLUX 3能一次输出长达20秒的带原生音频的片段,表情和动作都更逼真。无论是做短视频、动画、游戏特效,还是让机器人理解“看到锤子落下就要预测声音”,这个模型都能省下大量后期工作。测试中用户更喜欢它生成的视频,胜过市面上多款主流产品。多模态AI正在从“单科优秀”走向“全能选手”,我们离真正像人一样感知世界的AI又近了一步。
Black Forest Labs (BFL) has released FLUX 3, a multimodal foundation model that learns from images, videos and audio inside a single architecture. It is also the first FLUX model to ship video, audio and action prediction from one set of weights.
The Black Forest Labs (BFL) research team argues that no single modality gives a complete description of the world. Images capture spatial structure at one instant. Video restores time and exposes physical dynamics. Audio reveals causal relationships between mechanical events and sound. Each is treated as a lossy projection of the same underlying reality.
Training on all of them at once means the modalities constrain each other. The sound has to match the impact. The motion has to obey the mass. The research team calls FLUX 3 its first model built entirely on that principle.
The method underneath: Self-Flow
FLUX 3 builds on Self-Flow, BFL’s method for aligning multimodal generation and understanding in one architecture. Self-Flow combines the flow matching objective with a self-supervised feature reconstruction objective. The reference implementation on GitHub is Apache-2.0 and uses SiT-XL/2 with per-token timestep conditioning. It trains with a 25% per-token mask ratio and self-distillation from an EMA teacher at layer 20 to a student at layer 8.
That released checkpoint is an ImageNet 256×256 research model, not FLUX 3. BFL states that it ‘significantly scaled up compute and data resources’ on the same approach to train FLUX 3 across video, images and audio simultaneously. Self-Flow itself was introduced in March 2026, so it is not new to this launch. What is new is the scale.
What FLUX 3 Video does
FLUX 3 Video generates clips up to 20 seconds long in a single generation, with native audio. The supported modes cover text-to-video, image-to-video, video-to-video from a reference clip, keyframe-to-video for controlled transitions, and generative video-audio continuation from input video and audio.
BFL also lists multilingual dialogue, agentic chaining of clips into multi-shot sequences, and strong typography generation with animated designs. The BFL team reports particular strength in human facial expressions and in associating sounds with physical events.
Performance
BFL team published preliminary human preference results. The setup was 10-second text-to-video clips at 720p with audio. FLUX 3 was preferred over Luma Ray 3.2 in 93% of comparisons and over Runway Gen-4.5 in 77%. Against Grok Imagine Video the figure is up to 69%, then Kling v3 Pro at 60%, Happy Horse v1 at 59% and Happy Horse 1.1 at 57%. Against Seedance 2.0 and Gemini Omni Flash the result is 52%, close to a coin flip.
Interactive Explorer
:root{
--bg:#0a0a0a; --panel:#121212; --panel2:#181818; --line:#282828;
--fg:#f4f4f4; --dim:#8b8b8b; --orange:#ff7a18; --orange2:#ffab5e; --orange-dim:#7a3a08;
--mono: ui-monospace, "JetBrains Mono", "SFMono-Regular", Menlo, Consolas, "Liberation Mono", monospace;
}
*{box-sizing:border-box;}
html,body{margin:0;padding:0;background:transparent;}
body{font-family:var(--mono);}
#mtp-flux3-term{
background:var(--bg); color:var(--fg); border:1px solid var(--line);
border-radius:10px; overflow:hidden; font-family:var(--mono);
font-size:13.5px; line-height:1.55; max-width:100%;
}
/* title bar */
.tbar{display:flex;align-items:center;gap:10px;padding:9px 14px;background:var(--panel2);border-bottom:1px solid var(--line);}
.dots{display:flex;gap:6px;}
.dot{width:10px;height:10px;border-radius:50%;background:#333;}
.dot.a{background:var(--orange);}
.tbar .path{color:var(--dim);font-size:12px;letter-spacing:.02em;}
.tbar .path b{color:var(--fg);font-weight:600;}
.tbar .tag{margin-left:auto;font-size:10.5px;letter-spacing:.12em;text-transform:uppercase;color:var(--orange);border:1px solid var(--orange-dim);padding:2px 7px;border-radius:3px;}
.wrap{display:grid;grid-template-col
分享
阅读原文 ↗