Daily Tech Briefing
AI 科技速览
每天 5 分钟内学习 AI。获取最新的人工智能新闻,理解其重要性,并学习如何将其应用于您的工作。
HackerNoon AI · 2026/7/23 02:02:47

GPT-5.6 Scored 136 - That Is Not Yet a Production Verdict
AI 中文解读
GPT-5.6在一项离线IQ测试中拿下136分的高分,引发广泛关注,但专家提醒:这个数字很抢眼,却远不足以作为量产决策的依据。
这项测试由TrackingAI设计,只有14道有效题目,目的是避免AI模型因为见过类似题目而“作弊”。GPT-5.6的四个版本全部答对,折算成136分;另一款模型Luna Max答对12题,得123分。作者仔细核对了公开的方法、数据和代码,确认136分的计算是正确的,但问题在于:14道题样本太少,测试设计和校准是否可靠仍是未知数。换句话说,分数虽然漂亮,却缺乏足够的科学严谨性来支撑“可以投产”的结论。
对普通人来说,这个新闻是一个提醒:别被一个漂亮的数字冲昏头脑。AI模型的能力评测远没有表面那么简单,一个高分测试不能直接等同于实际使用中的稳定可靠。无论是开发者还是用户,在选模型时都应该多看几项指标,而不是只看一个“超高分”的结果。
Discover AnythingSignupWriteGPT-5.6 Scored 136 - That Is Not Yet a Production VerdictbyVelokeybyVelokey|@velokey9Access Top AI Models in One APISubscribeJuly 23rd, 2026TLDR ‘ai circuits abstract’ by HackerNoon AI Image GeneratorYour browser does not support the audio element.Speed1xVoiceDr. One Ms. Hacker byVelokey@velokey9byVelokey|@velokey9Access Top AI Models in One APISubscribeStory's CredibilitybyVelokey|@velokey9Access Top AI Models in One APISubscribeStory's CredibilityThe number is almost too convenient.
136 is high enough to produce a headline, precise enough to look scientific, and simple enough to become a deployment argument in one screenshot. TrackingAI currently assigns that score to GPT-5.6 Sol Ultra, Terra Ultra, and both vision variants on its offline IQ test. Luna Max and its vision variant appear at 123. The result deserves attention. It does not deserve authority it has not yet earned. I audited the public methodology, data, and site code to answer two different questions: Does TrackingAI's displayed score follow from its published artifacts? And can that score justify a production routing change? The answer to the first is yes. The answer to the second is not yet.The Public Row Does Support 136
TrackingAI's offline test is designed around a real benchmark problem: contamination. Public puzzles can appear in training data, worked examples, forums, or evaluation corpora. A custom, low-exposure bank gives a model less opportunity to reproduce a memorized answer.
The site's methodology article says the bank started with 16 questions. Two were judged invalid, leaving 14 retained items. The same write-up describes a human norming exercise with 35 usable responses. It also says the images were briefly hosted for that calibration with robots/no-index precautions, then removed. This lowers ordinary search exposure; it does not prove that the items were never online. The current public IQ log includes these six offline rows at 07/13/2026 20:50:00:
TrackingAI variant
Raw result
Retained valid result
Converted score
GPT-Sol-Ultra
16/16
14/14
136
GPT-Terra-Ultra
16/16
14/14
136
GPT-Sol-Ultra-Vision
16/16
14/14
136
GPT-Terra-Ultra-Vision
16/16
14/14
136
GPT-Luna-Max
14/16
12/14
123
GPT-Luna-Max-Vision
14/16
12/14
123
The CSV's total_possible_score field remains 16. The retained denominator of 14 comes from the methodology's removal of two invalid items. This is why both forms of the result may appear in descriptions of the data. TrackingAI's published chart code converts the valid score with:round(63.5 + 3 * 0.8823 * ((valid_score - 3) * (35 / 14)))
Fourteen valid answers produce 136.28975 before rounding. Twelve produces 123.05525. The site displays 136 and 123 accordingly. This audit matters because it separates two kinds of skepticism. There is no need to claim that 136 was conjured out of a broken row. The row and formula agree. The legitimate questions concern calibration, replication, and external validity.A 14-Item Test Has a Wide Step Size
One answer represents about 7.1% of a 14-item scored test. Two answers separate the perfect retained score of the Sol/Terra variants from Luna's 12/14.
The conversion stretches that two-answer difference into 13 IQ-like points. That is not necessarily a calculation error. It is a reminder that the integer output looks more granular than the evidence underneath it. A displayed difference of one IQ point would not mean the test observed one additional degree of reasoning ability. The raw unit is still an item. This makes the test useful for coarse discovery and fragile for universal ranking. It may distinguish "solved every retained item" from "missed two." It cannot, from one run, tell an engineering team how frequently either model will fail a tool workflow, how stable the output is, or whether the ordering persists across task families.The Human Calibration Is Evidence, Not Equivalence
TrackingAI reports R² = 0.45 between human IQ estimates from the offline
分享
阅读原文 ↗