Entity trail

Intelligence Index v4.2

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-09-06 / projects-researcherArtificial Analysis pushed Intelligence Index v4.2 with private held-out test sets and dropped IFBench as saturatedAnnounced 2026-09-04 and at 156 points on HN, v4.2 is an interim release pulling forward parts of v5. It adds AA-Briefcase, an in-house agentic knowledge-work eval with a private held-out set, and Surge's GDP.pdf, a long-context eval over 4,592 PDF pages, while removing IFBench for no longer separating frontier models. The ten-eval composite now puts Claude Fable 5.1 at 57, GPT-6 Astra (max) at 55 and GPT-6 Astra (xhigh) at 54.
2026-09-05 / thought-leaders-researcherArtificial Analysis moves 40% of its Intelligence Index to private held-out sets, double v4.1The v4.2 update published September 4 adds AA-Briefcase, a private eval of agentic knowledge work on expert-built projects, and GDP.pdf, a document-reasoning test over 4,592 pages of tables, charts and footnotes. GPQA Diamond was dropped as saturated. Claude Fable 5.1 leads the overall index, GPT-6 Astra gained roughly 85 Elo over its predecessor and dominates GDP.pdf at 33.2%, and Meta ranks third among labs. The doubling of held-out weighting is the real signal: public benchmarks are being treated as compromised.
2026-08-08 / sources-researcherQwen3.8 Max Briefly Took #1 on Artificial Analysis' Agentic Index — Then a Same-Day Grader Update Dropped It to #2, Live, in Front of Hacker NewsAlibaba's Qwen3.8 Max was reported as the best overall model on Artificial Analysis' Agentic Index (a weighted average of GDPval-AA v2 and τ³-Banking within Intelligence Index v4.1), drawing 540 points on HN. Readers watching the page saw Qwen at 55.4 vs Opus Max at 55.3, then on reload Opus Max at 59.2 vs Qwen at 58.4; George from the Artificial Analysis team replied in-thread that they had shipped a planned upgrade to their equality-checking/grader models plus the latest τ³-Banking version that day, reordering the leaderboard. Opus 5 remains first on the broader Intelligence Index. The useful lesson is about benchmark infrastructure: grader-model changes can move a public leaderboard by a point in either direction within hours, so single-snapshot rankings are not durable evidence.
2026-07-31 / reddit-researcherDeepSeek V4-Flash-0731 Scores 50 on the Artificial Analysis Index — Six Points Above Its Own Pro Tier and One Behind GPT-5.6 LunaArtificial Analysis measured DeepSeek V4 Flash 0731 at 50 on its Intelligence Index, a 10-point jump over the April 2026 V4 Flash despite identical architecture and identical pricing, putting the Flash tier 6 points ahead of DeepSeek V4 Pro and 1 point behind GPT-5.6 Luna at max effort (51). At $0.06 per 1M tokens against GLM-5.2 (max) at $0.90 for a 51, and roughly 60% lower cost per task than Luna even after OpenAI's 80% price cut, it lands on the Pareto frontier for intelligence versus cost. The distillation-without-architecture-change result is the interesting part: the same weights class gained 10 index points purely from post-training.
2026-07-28 / hn-researcher"Kimi K3 Is Not Cheap" — Per-Task Cost Lands Near OpenAI's Top Model, ~20× DeepSeek V4A July 26 post pushes back on the dominant framing of Kimi K3 as a cost breakthrough, arguing that on Artificial Analysis's Intelligence Index it cost only slightly less per task than OpenAI's top model, roughly double GLM-5.2 and about 20× DeepSeek V4. The author attributes the gap to K3's verbosity — more tokens spent per solved problem — with the penalty worse on office-work tasks than coding. It hit 22 points and 23 comments on HN and is the sharpest counter-narrative yet to the "another DeepSeek moment" reading of K3's release.
2026-06-19 / thought-leaders-researcherSimon Willison Calls Z.ai's GLM-5.2 'Probably the Most Powerful Text-Only Open Weights LLM' — 753B MoE, 1M Context, MIT License, Tops Open-Weights Intelligence Index at 51In a June 17 post, Simon Willison evaluates Z.ai's newly released GLM-5.2: a 753B-parameter Mixture-of-Experts model (40B active) with a 1M-token context window (up from GLM-5.1's 200K), released under an MIT license at roughly $1.40/$4.40 per million input/output tokens on OpenRouter. Per Artificial Analysis it leads the open-weights Intelligence Index v4.1 at 51 — beating MiniMax-M3 and DeepSeek V4 Pro (both 44) — and ranks #2 on Code Arena WebDev behind only Claude Fable 5, though it burns more output tokens per task (~43k). Willison's signature pelican-on-a-bicycle SVG test passed cleanly, but his opossum-on-an-e-scooter probe regressed versus GLM-5.1; for builders, this is now a credible MIT-licensed, self-hostable alternative to closed coding models with a genuine 1M-context window.
2026-05-02 / sources-researcherThe Batch Issue 351: Kimi K2.6 Leads Open LLMs — 1T-Parameter Open-Weight Vision-Language Model Near DeepSeek V4Andrew Ng's newsletter covers Kimi K2.6, a 1T-parameter open-weight vision-language model that leads the Artificial Analysis Intelligence Index for open models, performing near DeepSeek V4 and Qwen3.6 Max. GPT-5.5 trails Kimi K2.6 at high reasoning settings but leads Opus 4.7. Ng's letter discusses how prompting has fundamentally evolved since 2022, promoting his new 'AI Prompting for Everyone' course.

Graph relationships

DEPRECATES
IFBench
Intelligence Index v4.2 removed IFBench because it no longer separates frontier models.
Source finding
BENCHMARKED AGAINST
GPT-6 Astra
GPT-6 Astra scored between 54 and 55 points on Intelligence Index v4.2.
Source finding
BENCHMARKED AGAINST
Claude Fable 5.1
Claude Fable 5.1 scored 57 points on Intelligence Index v4.2.
Source finding
RELEASED
Artificial Analysis
Artificial Analysis released Intelligence Index v4.2 on 2026-09-04.
Source finding
BENCHMARKED AGAINST
GPT-6 Astra -> Intelligence Index v4.2
GPT-6 Astra scored between 54 and 55 points on Intelligence Index v4.2.
Source finding
RELEASED
Artificial Analysis -> Intelligence Index v4.2
Artificial Analysis released Intelligence Index v4.2 on 2026-09-04.
Source finding

Source trail

Artificial Analysis Artificial Analysis (via Hacker News, 540 points)Artificial Analysis (corroborated by @ArtificialAnlys on X and OfficeChai; surfaced via r/LocalLLaMA, 455 upvotes)alexinch.com / Hacker News simonwillison.net The Batch (DeepLearning.AI)

Graph sources

entity graphfindings textkg edgeskg entities

Fetching from the wire…