Fetching from the wire…
Public story · 2026-08-17 · high
Giessen's numbers show the best AI model still tops out at 53% factual recall on SimpleQA.
Why now: Giessen's analysis has climbed to 318 points on Hacker News as of August 17, drawing wide attention to the benchmark numbers.
GLM-5.2 hit 99.2% on the AIME 2026 math benchmark using 40 billion active parameters, a fraction of GPT-4's roughly 280 billion in 2023, per Walter van der Giessen.
The trade-off matters for builders choosing a model: a 40B-parameter reasoner now beats systems seven times its size on math.
Qwen3.5 scores 91.3% on the same test with 17 billion active parameters.
Giessen's explanation is capacity math: storing facts costs about two bits of knowledge per parameter, and facts go stale. Reasoning skills like decomposition, verification and backtracking compress into far fewer parameters and don't expire.
The catch: the best-performing model on SimpleQA hits only 53% factual recall. Qwen's 4B and 9B variants hallucinate on 80 to 82% of knowledge tasks, per the post.
For anyone building on these models, the fix isn't a bigger download. Pair a quantized 20 to 40B reasoning model with an external retrieval layer. A wrong fact then becomes a data-source correction, not a retraining job.
Each link below shares sources, entities, or timing with this story.
Alibaba released Qwen / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Alibaba released Qwen); both cover GLM, GPT, Qwen; overlapping topics (model, parameter).
Alibaba released Qwen / Shared entities / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (Alibaba released Qwen); both cover GLM, GPT; overlapping topics (active, model, parameter).
Alibaba released Qwen / Shared entities / Earlier coverage / Tension
Linked by a graph relationship (Alibaba released Qwen); both cover GPT, Qwen, Qwen3; earlier GPT coverage from 2026-04-21.
Alibaba released Qwen / Shared entities / Earlier coverage
Linked by a graph relationship (Alibaba released Qwen); both cover GLM, GPT, Qwen3; earlier GLM coverage from 2026-07-20.
Qwen competes with Google / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Qwen competes with Google); both cover GLM, Qwen; overlapping topics (active, model, parameter).
Qwen benchmarked against Claude / Shared entities / Earlier coverage
Linked by a graph relationship (Qwen benchmarked against Claude); both cover GLM, GPT, Qwen3; earlier GLM coverage from 2026-05-04.
OpenCode uses Qwen / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (OpenCode uses Qwen); both cover GLM, GPT; overlapping topics (best, model).
Qwen benchmarked against Claude / Shared entities / Shared topic / Earlier coverage
Linked by a graph relationship (Qwen benchmarked against Claude); both cover GLM, GPT; overlapping topics (best, model).