Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
MarkTechPost · 2026/7/26 00:12:57
Sakana AI Releases Fugu-Cyber: An Orchestration Model Reporting 86.9% on CyberGym and 72.1% on CTI-REALM
AI 中文解读
Sakana AI发布了首个网络安全专用大模型Fugu-Cyber,在漏洞发现和威胁检测两大任务上分别跑出86.9%和72.1%的成绩,不仅超越了GPT-5.5和Claude的最新版本,更意味着AI在安全攻防的“找漏洞”和“写规则”环节都迈上了新台阶。
这套系统不是什么独立的新模型,而是Sakana之前发布的Fugu编排器上新加的一个安全专属“端口”。Fugu本身就像一个智能指挥官,读到用户问题时能当场组建一个由不同专家模型组成的小团队,分别担任思考者、执行者和验证者,协同完成任务。这项能力在两个硬核测试中得到了验证:一个是加州大学伯克利分校的CyberGym基准,要求AI根据漏洞描述写出能触发崩溃的验证代码,必须让打过补丁的版本不崩溃——这块Fugu拿下了86.9%,比OpenAI官方报告的85.6%还高一点;另一个是微软的CTI-REALM基准,要求AI阅读安全报告、设计查询规则来检测威胁,Fugu的72.1%也明显超过了微软自己测试中最佳组合的68.5%。
对普通用户来说,这意味着未来企业防御黑客攻击的速度会更快、准确率更高。当你的邮箱收到钓鱼链接或系统出现可疑行为时,背后可能就有类似Fugu-Cyber的AI在自动分析漏洞、生成规则进行拦截。而对于网络安全从业者,这套系统能大幅减轻重复劳动——过去人工数小时的漏洞验证和规则编写,现在几分钟就能交卷。当然,目前它仍是面向专业领域的工具,普通用户暂时不会直接接触到它,但很快这些能力就会融入云安全产品、反病毒软件中,让大家上网更安心。
Sakana AI has released Fugu-Cyber (model ID is fugu-cyber-v1.0), a cybersecurity-specialized addition to its Fugu orchestration family. It is not just a new frontier model. It is a third endpoint on the Fugu orchestrator, tuned for security reasoning. Sakana launched that orchestrator a month earlier.
Sakana reports a success rate of 86.9% on CyberGym and 72.1% on CTI-REALM. It describes those results as comparable to cyber-focused frontier models such as GPT-5.5-Cyber and Claude Mythos Preview.
What the two benchmarks actually measure
The two evaluations sit at opposite ends of a security workflow:
CyberGym is a UC Berkeley benchmark of 1,507 real-world vulnerabilities across 188 OSS-Fuzz projects. In its main task, an agent receives a vulnerability description and an unpatched codebase. It must write a proof-of-concept that crashes the pre-patch build but not the post-patch build. That verification step is what makes the benchmark hard to game.
CTI-REALM is Microsoft’s open-source detection-engineering benchmark. Microsoft curated 37 public threat reports from sources including Datadog Security Labs, Palo Alto Networks, and Splunk. An agent must map MITRE ATT&CK techniques, explore telemetry, iterate on KQL queries, and emit validated Sigma rules. Scoring covers Linux endpoints, Azure Kubernetes Service, and Azure cloud.
Together the pair spans ‘find and prove the bug’ and ‘turn intel into a detection.’ That framing is the most defensible part of Sakana’s announcement.
Where 86.9% sits against the field
Context matters more than the number.
When the CyberGym researchers published their first results, the best agent-model pairing reached roughly 20%. Anthropic reported 83.1% for Claude Mythos Preview under Project Glasswing in April 2026. OpenAI reported 85.6% for its updated GPT-5.5-Cyber, against 81.8% for GPT-5.5. Sakana’s 86.9% is therefore a small step past the reported frontier, not a jump.
CTI-REALM is a different story. Microsoft’s own evaluation put the top three configurations, all Claude, in a band from 0.624 to 0.685. Fugu-Cyber’s 72.1% would sit above that band. One caveat matters. CTI-REALM is scored as a trajectory reward between 0 and 1. It is not a pass/fail rate. Sakana calls it a success rate anyway.
(function(){
window.addEventListener("message", function(e){
var d = e.data;
if(!d || d.mtpFrame !== "fugu-cyber-explainer") return;
var f = document.getElementById("mtp-fugu-explainer");
if(f && d.height) f.style.height = d.height + "px";
});
})();
How the orchestration works
Fugu is itself a language model. It is trained to read a query and build an agentic scaffold on the fly. It then delegates sub-tasks to specialist models in a pool.
The approach is documented in the Fugu technical report and two ICLR 2026 papers, TRINITY and the Conductor. TRINITY assigns Thinker, Worker, and Verifier roles across multiple LLMs. The Conductor learns natural-language coordination strategies through reinforcement learning.
For security work, Sakana research team argues the verifier role is the point. A candidate vulnerability surfaced by one agent gets validated by security-specialized sub-agents before any patch is proposed. Routing remains proprietary, so you cannot see which model handled which step.
Access, policy, and price
Fugu-Cyber is gated on four dimensions.
Access requires an application form stating the intended use case and verified contact details. Sakana team reviews each one manually. The model ships under an updated Acceptable Usage Policy that prohibits offensive misuse. Billing is restricted to the Token Plan. The $20, $100, and $200 subscription tiers cover Fugu and Fugu-Ultra only. And the Fugu API is not offered in the EU or EEA while Sakana works toward GDPR compliance.
Pricing is fixed at $6 per million input tokens, $36 output, and $0.60 cached input. All thre
分享
阅读原文 ↗