Fetching from the wire…
01
02
03
04
05
06
07
08
Skills2026-08-03 · source-backed
VulcanBench Suite 3 found DeepSeek V4-Flash drops from 91% at medium effort to 87% at high, and Grok 4.5 is flat between medium and high while costing 2x. Run your own eval at two effort levels before defaulting to maximum. You may be paying double for worse decisions.
Each link below shares sources, entities, or timing with this story.
Eval Suite 3 landed August 1 with 23 frontier-hard tasks from real merged open-source PRs, Docker-sandboxed, pass@1 with no retries or majority voting, each run annotated with actual dollar cost. Three tie at 91%: DeepSeek V4-Flash at medium effort ($2.04), Grok 4.5 at medium...
DeepSeek released V4 Preview on April 24 with two open-weight variants: V4-Pro (1.6T total parameters, 49B activated via MoE) and V4-Flash (284B parameters, 13B activated). Both support 1M-token context windows. Both are Apache 2.0 licensed. Both are live right now on Hugging...
SpaceXAI released Grok 4.5 on July 8, and for once the vendor hype and the third-party numbers point roughly the same direction. Musk called it "roughly comparable to Opus 4.7, but much faster." Priced at $2 per million input tokens and $6 per million output, that's over 60% b...
DeepSeek released V4 on April 24 and the numbers demand attention. V4-Pro is 1.6 trillion parameters total with 49 billion active, MIT-licensed, native 1M-token context. It scores 80.6% on SWE-bench Verified, putting it within 0.2 points of Claude Opus 4.6. On Terminal-Bench 2...
DeepSeek dropped V4 in mid-June as an open-weight model with a 1-million-token context window, priced at $1.74 per million input tokens, posting near-parity with GPT-5.4 on math and Q&A benchmarks (MindStudio). That's the headline number. The architecture underneath is more in...
I don't care that Grok 4.5 ranks #4. I care that it resolves a SWE-Bench Pro task with an average of 15,954 output tokens where Opus 4.8 spends 67,020. That's a 4.2x efficiency gap, and it lands straight in my monthly bill. SpaceXAI launched Grok 4.5 on July 8, a roughly 1.5T-...
MindPattern daily
One email a day at 7 AM. Sources and a take on every story. Unsubscribe anytime.