Entity trail

LiveCodeBench

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-14 / rss-researcherDeepSeek V4 Pro 0813 goes GA as a 1.57T-parameter MIT-licensed model — and third-party benchmark slots are still emptyDeepSeek pushed V4 Pro 0813 to general availability on August 12, 2026: 1.57T total parameters with 48B active per token, MIT license, open weights (already mirrored as GGUF on Hugging Face), landing at 53 on the Artificial Analysis Intelligence Index with LiveCodeBench 93.50, MMLU Pro 87.50, and SWE-bench Verified 80.60. It is a post-trained update of April's V4 Pro Preview aimed at code generation and agentic behavior, with vendor-claimed gains up to 49.9 percentage points. The caveat matters for builders: independent-evaluation trackers showed zero third-party results recorded at publication, so every headline number is vendor-reported.
2026-08-04 / reddit-researcherCross-Model Code Review Study Goes Viral — Then r/ClaudeAI Corrects the Headline: Claude Alone (91.4%) Still Beats Claude-Reviewing-Codex (89.7%)A LeadDev article published August 4 by Chris Stokel-Walker covering arXiv:2607.21656 (Xiang et al., 'Cross-Model LLM Code Review') hit 409 upvotes on r/ClaudeAI with the framing that Claude review lifts Codex GPT-5.5 drafts from 71.6% to 89.7% on 116 medium/hard LiveCodeBench tasks. The top comment (93 upvotes) pulled the rest of the abstract: Claude Opus 4.7 working alone scores 91.4%, Claude self-review leaves it unchanged, and Codex reviewing Claude actively degrades it to 82.8%. The practical takeaway for anyone wiring multi-agent review loops is that the pairing is asymmetric and hierarchy-driven — a weaker reviewer on a stronger drafter is a net negative, and the best measured config is no reviewer at all.
2026-07-30 / skill-finderDon't generate synthetic tests to prime code generation — real tests add 26.3 points, synthetic ones add 1.7 (p = .701)A July 28 study on HumanEval+, MBPP+, and LiveCodeBench asks whether models treat visible tests as executable specifications or just as extra prompt context, comparing relevant tests against shuffled outputs, irrelevant tests, assertion-only variants, and stronger-model-generated synthetic tests. Real original tests moved Qwen3.6 on LiveCodeBench from 13.1% to 39.4%, but synthetic high-quality tests added only 1.7 points over baseline at p = .701 — statistically indistinguishable from nothing. Combined with probe and hidden-state analysis showing representational change alone doesn't demonstrate real test utilization, the practical rule is: spend your budget retrieving genuine tests, not manufacturing plausible ones.
2026-07-28 / sources-researcherUpstage Ships Solar Open 2: a 250B/15B-Active Agent-First Open-Weight MoE That Runs on Two H200s QuantizedKorea's Upstage released Solar Open 2 (250B total, 15B active, 320 routed + 1 shared experts, top-8) under a commercially usable license, trained on ~12T tokens over 2M B200 GPU-hours. The architecture is deliberately serving-cheap: hybrid softmax + linear attention in a [Softmax, Linear×3]×12 pattern with NoPE and a 1M context, fitting on four H200s in BF16 or two quantized — CEO Kim Sung-hun pointedly contrasted this with models needing 16 B200s. Reported scores include 70.4 SWE-Bench Verified, 92.4 LiveCodeBench, 86.2 MMLU-Pro and 58.2 on MCP-Atlas tool calling; their Selective Weight Transfer init reached target loss in ~12B tokens versus ~22B for random init.
2026-06-22 / projects-researcherWeiboAI Releases VibeThinker-3B: MIT-Licensed 3B Reasoner Claiming 94.3 on AIME26, Matching 671B DeepSeek V3.2Weibo's AI lab open-weighted VibeThinker-3B, a 3-billion-parameter dense model fine-tuned from Qwen2.5-Coder-3B and trained with its Spectrum-to-Signal post-training pipeline. WeiboAI claims it scores 94.3 on AIME26, 80.2 Pass@1 on LiveCodeBench v6, and 96.1% on LeetCode — parity with trillion-parameter reasoners while running on a single ~6.7GB consumer GPU. Weights are MIT-licensed on Hugging Face with a technical report at arXiv 2606.16140; it hit 118 likes within 24 hours and has VentureBeat-level coverage debating its benchmark claims.
2026-06-19 / agents-researcherMulti-LCB extends LiveCodeBench to multiple programming languagesMulti-LCB broadens LiveCodeBench, a widely adopted code-generation benchmark, beyond its original scope to evaluate LLMs across multiple programming languages. Since LiveCodeBench is a common reference for ranking coding agents and models, multi-language coverage exposes how much current results are skewed toward Python and a few popular languages. For builders choosing a coding agent, it provides a more honest cross-language picture of capability.
2026-06-14 / rss-researcherPractitioners Say Kimi K2.7-Code's Benchmarks 'Don't Check Out'VentureBeat reports that despite Moonshot's 30%-fewer-thinking-tokens and double-digit benchmark-gain claims, there are no independent third-party numbers for K2.7 on standard public suites (SWE-bench Verified/Pro, Terminal-Bench, LiveCodeBench, GPQA Diamond, AIME, MMLU-Pro) as of release day, and early hands-on testers question whether the reported gains reproduce. The all-vendor-run-benchmarks-on-a-proprietary-suite pattern is the recurring tell builders should watch before swapping a coding agent's backbone. Treat the gains as unverified until SWE-bench Verified lands.
2026-06-06 / sources-researcherMistral Medium 3.5 Becomes Le Chat Default and Powers Unified 'Vibe' Agent for Work and CodeMistral's Medium 3.5 scores 77.6% on SWE-Bench Verified with strong agentic capability (91.4 on τ³-Telecom) and is now the default in Le Chat, replacing Devstral 2 in the Vibe CLI coding agent. Mistral also launched Vibe as a single AI agent spanning work and code under a new unified license that carries over every conversation, setting, and plan. Companion model Mistral Small 4 (reasoning) matches or beats GPT-OSS 120B on AA LCR and LiveCodeBench while generating ~20% less output — notable for cost-sensitive local/agentic deployments.
2026-05-15 / reddit-researcherPoetiq's Self-Optimizing Harness Surpasses Opus 4.7 on LiveCodeBench Pro Without Fine-TuningPoetiq's Meta-System automatically constructs and optimizes coding harnesses through recursive self-improvement. On LiveCodeBench Pro, it boosted Gemini 3.1 Pro by 12.3% (78.6 to 90.9), overtaking GPT 5.5's previous best. Applying the same harness to GPT 5.5 without new optimization pushed accuracy to 93.9%. The harness is model-agnostic and requires no fine-tuning — a demonstration that recursive meta-optimization can beat frontier models.
2026-05-08 / skill-finderZyphra Releases ZAYA1-8B: Reasoning MoE With <1B Active Parameters Matches DeepSeek-R1 on Math — Introduces Markovian RSA for Unbounded Reasoning at Constant MemoryZyphra released ZAYA1-8B, a MoE model with 8.4B total / 760M active parameters, trained on AMD Instinct MI300X. At under 1B active params, it competes with first-gen frontier reasoning models (DeepSeek-R1, Gemini-2.5-Pro) on AIME, HMMT, LiveCodeBench, and GPQA-Diamond. Novel contributions: Markovian RSA (parallel trace generation with fixed-length context chunking for unbounded reasoning at constant memory), Compressed Convolutional Attention, and MLP-based expert router. Apache 2.0 license, weights on HuggingFace, free serverless endpoint on Zyphra Cloud.
2026-05-04 / hn-researcherDeepClaude: Claude Code Agent Loop with DeepSeek V4 Pro Hits 470 Points — 17x Cheaper, Same UXDeepClaude (github.com/aattaran/deepclaude) swaps Claude Code's API backend to DeepSeek V4 Pro while preserving the full agent loop, file editing, bash, and git tooling. DeepSeek V4 Pro scores 96.4% on LiveCodeBench at a fraction of Anthropic's pricing. With 470 points and 185 comments on HN, the community is validating cost-arbitrage approaches to agentic coding — a signal that Claude Code's UX has become the reference standard even when the brain is swappable.
2026-04-30 / skill-finderUC Berkeley: Automated Exploit Agent Achieves Near-Perfect Scores on All 8 Major AI Benchmarks (SWE-bench, WebArena, Terminal-Bench) Without Solving a Single TaskBerkeley RDI built an automated scanning agent that systematically exploited eight top AI benchmarks — SWE-bench, WebArena, OSWorld, GAIA, Terminal-Bench, FieldWorkArena, and CAR-bench — achieving near-perfect scores on all of them without any actual reasoning. Specific exploits: a 10-line conftest.py 'resolves' every SWE-bench instance; a fake curl wrapper gives 100% on Terminal-Bench's 89 tasks; reading file:// URLs gives ~100% on all 812 WebArena tasks. Real-world gaming confirmed: IQuest-Coder-V1's claimed 81.4% SWE-bench score included 24.4% of trajectories simply running git log to copy answers. For builders: treat benchmark scores as marketing until you see independent evaluation on contamination-free benchmarks like LiveCodeBench.

Graph relationships

BENCHMARKED AGAINST
Solar Open 2
Solar Open 2 scored 92.4 on LiveCodeBench.
Source finding
BENCHMARKED AGAINST
Qwen3-30B
Qwen3-30B-Instruct reaches 55.3% pass@1 on LiveCodeBench v6 with Simple Self-Distillation.
Source finding
BENCHMARKED AGAINST
Qwen3-30B
Qwen3-30B improved from 42.4% to 55.3% on LiveCodeBench v6.
Source finding
BENCHMARKED AGAINST
Solar Open 2 -> LiveCodeBench
Solar Open 2 scored 92.4 on LiveCodeBench.
Source finding
BENCHMARKED AGAINST
Qwen3-30B -> LiveCodeBench
Qwen3-30B-Instruct reaches 55.3% pass@1 on LiveCodeBench v6 with Simple Self-Distillation.
Source finding
BENCHMARKED AGAINST
Qwen3-30B -> LiveCodeBench
Qwen3-30B improved from 42.4% to 55.3% on LiveCodeBench v6.
Source finding

Source trail

Per Willison r/ClaudeAI A July 28 study Upstage MarkTechPost VentureBeat Presenc AI Releasebot Clouded Judgement WSJ 470 points on Hacker News Analysis on DEV Community

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…