Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
Simon Willison · 2026/8/4 19:10:09
PipeNetwork/minimax-h3-mlx
AI 中文解读
MiniMax-H3来了,一个能“看图说话”的AI模型,给它一段文字,它能生成15秒带声音的视频片段。更酷的是,有人把它移植到了苹果电脑上,让普通用户也能在本地跑起来,不用依赖云端服务器。不过想玩可不容易:先要下载115GB的模型文件,相当于几十部高清电影;生成一个几秒的视频,足足等了45分钟。实际效果嘛,画面挺惊艳——比如输入“一只彩虹色的臭鼬在超市里跳过长满苔藓的原木”,生成的视频像模像样;但声音部分因为没按提示指南写,变成了一堆怪异的
<p><strong><a href="https://github.com/PipeNetwork/minimax-h3-mlx">PipeNetwork/minimax-h3-mlx</a></strong></p>
MiniMax released <a href="https://huggingface.co/MiniMaxAI/MiniMax-H3">MiniMax-H3</a> two days ago - they describe it as a "a general-purpose, omni-modal generative system", which in practice means it accepts text, images, audio and video and can use them to generate up to 15 second video clips with audio included.</p>
<p>This Python package ports it to MLX for running on Apple Silicon.</p>
<p>I got it running on my M5 Max MacBook Pro. I cloned the repo and ran the model like this:</p>
<pre><code># First download the models
uvx --from huggingface_hub hf download MiniMaxAI/MiniMax-H3 \
--include 'FL2VA/*' --exclude 'FL2VA/transformer/*'
uvx --from huggingface_hub hf download pipenetwork/MiniMax-H3-MLX-8bit
# Now run the prompt
uv run --with mlx-vlm \
--with-requirements requirements.txt python scripts/generate.py \
"a rainbow colored skunk leaps over a mossy log in a supermarket" \
-o skunk.mp4 \
-c ~/.cache/huggingface/hub/models--MiniMaxAI--MiniMax-H3/snapshots/fa9c8ab1eaa21c8ae25e7e40b83b2e6002f340af/FL2VA \
-t ~/.cache/huggingface/hub/models--pipenetwork--MiniMax-H3-MLX-8bit/snapshots/3ac52081470b0488921c3ec3ba84a39097bf2361
</code></pre>
<p>Here's the video I got for the prompt:</p>
<blockquote>
<p><code>a rainbow colored skunk leaps over a mossy log in a supermarket</code></p>
</blockquote>
<p><video
controls loop
preload="none"
poster="https://static.simonwillison.net/static/2026/skunk.jpg"
width="1344"
height="768"
style="display: block; width: 100%; height: auto;"
>
<source src="https://static.simonwillison.net/static/2026/skunk.web.mp4" type="video/mp4">
Your browser does not support HTML5 video.
</video>
</p>
<p>It downloaded ~115 GB of model files, and the video generation took just under 45 minutes.</p>
<p>The video is impressive, but the audio is weird speech-like garbage, because I didn't provide any prompt guidance as to what the audio should be. The <a href="https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/docs/VIDEO_PROMPT_WRITING_GUIDE_base_en.md">prompting guide</a> (which I didn't read prior to this experiment) has a whole bunch of information on how to get this to work.
<p>Tags: <a href="https://simonwillison.net/tags/ai">ai</a>, <a href="https://simonwillison.net/tags/generative-ai">generative-ai</a>, <a href="https://simonwillison.net/tags/mlx">mlx</a>, <a href="https://simonwillison.net/tags/text-to-video">text-to-video</a>, <a href="https://simonwillison.net/tags/minimax">minimax</a></p>
分享
阅读原文 ↗