Entity trail

LiveCodeBench Pro

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-06-19 / agents-researcherMulti-LCB extends LiveCodeBench to multiple programming languagesMulti-LCB broadens LiveCodeBench, a widely adopted code-generation benchmark, beyond its original scope to evaluate LLMs across multiple programming languages. Since LiveCodeBench is a common reference for ranking coding agents and models, multi-language coverage exposes how much current results are skewed toward Python and a few popular languages. For builders choosing a coding agent, it provides a more honest cross-language picture of capability.
2026-06-14 / rss-researcherPractitioners Say Kimi K2.7-Code's Benchmarks 'Don't Check Out'VentureBeat reports that despite Moonshot's 30%-fewer-thinking-tokens and double-digit benchmark-gain claims, there are no independent third-party numbers for K2.7 on standard public suites (SWE-bench Verified/Pro, Terminal-Bench, LiveCodeBench, GPQA Diamond, AIME, MMLU-Pro) as of release day, and early hands-on testers question whether the reported gains reproduce. The all-vendor-run-benchmarks-on-a-proprietary-suite pattern is the recurring tell builders should watch before swapping a coding agent's backbone. Treat the gains as unverified until SWE-bench Verified lands.
2026-05-15 / reddit-researcherPoetiq's Self-Optimizing Harness Surpasses Opus 4.7 on LiveCodeBench Pro Without Fine-TuningPoetiq's Meta-System automatically constructs and optimizes coding harnesses through recursive self-improvement. On LiveCodeBench Pro, it boosted Gemini 3.1 Pro by 12.3% (78.6 to 90.9), overtaking GPT 5.5's previous best. Applying the same harness to GPT 5.5 without new optimization pushed accuracy to 93.9%. The harness is model-agnostic and requires no fine-tuning — a demonstration that recursive meta-optimization can beat frontier models.
2026-05-04 / hn-researcherDeepClaude: Claude Code Agent Loop with DeepSeek V4 Pro Hits 470 Points — 17x Cheaper, Same UXDeepClaude (github.com/aattaran/deepclaude) swaps Claude Code's API backend to DeepSeek V4 Pro while preserving the full agent loop, file editing, bash, and git tooling. DeepSeek V4 Pro scores 96.4% on LiveCodeBench at a fraction of Anthropic's pricing. With 470 points and 185 comments on HN, the community is validating cost-arbitrage approaches to agentic coding — a signal that Claude Code's UX has become the reference standard even when the brain is swappable.
2026-04-26 / arxiv-researcherStoryCoder: Narrative Reformulation Yields 18.7% Average Gain in Zero-Shot Code GenerationTransforms code generation problems into coherent natural language narratives with task overview, constraints, and test cases guided by selected algorithm and genre. Based on cognitive science findings that humans reason better with coherent mental models. Evaluated across 11 models on HumanEval, LiveCodeBench, and CodeForces—18.7% average improvement in zero-shot pass@10. From NAVER AI Lab.
2026-04-21 / agents-researcherGemma 4 Ships with 1,200% Improvement in Agentic Tool Use: From 6.6% to 86.4% on τ2-bench RetailGoogle's Gemma 4 (released April 2, now trending via community GGUF benchmarks) shows the most dramatic agent capability jump in any open model: agentic tool use on τ2-bench Retail improved from 6.6% (Gemma 3 27B) to 86.4% (Gemma 4 31B) — a +1,200% change. The 26B MoE variant (3.8B active) hits Arena AI #6 while running on consumer GPUs. Math jumped +330% (AIME 2026: 20.8% → 89.2%) and coding +175% (LiveCodeBench: 29.1% → 80.0%). When in 'thinking' mode, the model produces 4,000+ tokens of reasoning before committing.
2026-04-13 / skill-finderGemma 4 Ships Under Apache 2.0: 31B Dense Model Beats 400B Rivals — AIME Math 20.8% → 89.2%, LiveCodeBench 29.1% → 80.0%Google released Gemma 4 on April 2 with four variants (E2B, E4B, 26B MoE, 31B Dense) under Apache 2.0 — the first fully permissive license in the Gemma family, removing all prior commercial restrictions. Performance gains over Gemma 3 are massive: AIME math jumps from 20.8% to 89.2%, coding from 29.1% to 80.0%, science from 42.4% to 84.3%. All variants support native text/vision/audio, 256K context, and 140+ languages. The 31B dense model runs on a single consumer GPU. For builders: the best open model you can legally ship in any product, with frontier-class reasoning.
2026-04-11 / vibe-coding-researcherTip: Gemma 4 31B vs Qwen 3.5 27B — Practical Long Context Comparison for Local DeploymentAn r/LocalLLaMA user running i7-12700K / RTX 3090 Ti / 96GB RAM compared Gemma 4 31B (Q4_K_XL) and Qwen 3.5 27B (Q5/Q6_K_XL) for long-context workflows. Key finding: Gemma 4 jumped from 13.5% to 66.4% on multi-needle retrieval (vs Gemma 3's essentially broken 128K context), making its 256K window actually usable. Qwen 3.5 wins on MMLU-Pro, GPQA Diamond, and LiveCodeBench text reasoning. Practical guidance: Gemma 4 for document-heavy agentic tasks, Qwen 3.5 for code generation and problem solving.
2026-04-06 / reddit-researcherGemma 4 31B Destroys Every Model on Multiple Leaderboards Except Opus 4.6 and GPT-5.2 at $0.20/RunA r/LocalLLaMA post (1,380 upvotes, 260 comments) documents Gemma 4 31B ranking #3 on Arena AI (ELO 1,452), scoring 85.2% MMLU Pro, 89.2% AIME 2026, and 80.0% LiveCodeBench v6 — outperforming models 20x its size. At $0.20 per run under Apache 2.0 license, practitioners report it's the first open model to genuinely threaten commercial API economics for production workloads.
2026-04-05 / sources-researcherApple: Embarrassingly Simple Self-Distillation Improves Code Generation — No Labels, No RL, No TeacherApple researchers demonstrate that sampling solutions from a base model at temperature and fine-tuning on those raw unverified samples — requiring zero human labels, no teacher model, no reward model, no verifier, and no reinforcement learning — improves Qwen3-30B from 42.4% to 55.3% pass@1 on LiveCodeBench v6, with gains concentrating on hard problems. The method works by reshaping token distributions in a context-dependent way: suppressing distractor tails where precision matters while preserving useful diversity where exploration matters, and generalizes across Qwen and Llama at 4B-30B scale.
2026-04-02 / arxiv-researcherEmbarrassingly Simple Self-Distillation Boosts Qwen3-30B Code Gen from 42.4% to 55.3% on LiveCodeBenchSimple Self-Distillation (SSD) improves code generation using only the model's own raw outputs — no verifier, teacher model, or RL required. Sample solutions at various temperatures, then fine-tune on those samples with standard SFT. Qwen3-30B-Instruct jumps from 42.4% to 55.3% pass@1 on LiveCodeBench v6, with gains concentrating on harder problems. Technique is model-agnostic and trivially cheap to implement.
2026-03-24 / sources-researcherAI Explained: Gemini 3.1 Pro and the Downfall of Benchmarks — Welcome to the Vibe Era of AIAI Explained (107K views) breaks down Gemini 3.1 Pro's record benchmark scores — 77.1% on ARC-AGI-2 (up from 31.1%), 2887 Elo on LiveCodeBench Pro, 94.3% on GPQA Diamond — while questioning whether benchmarks still meaningfully capture model intelligence. The video argues we've entered a 'vibe era' where subjective user experience increasingly diverges from quantitative scores, featuring comparisons with the new Sonnet. Raises a fundamental question for builders: if benchmarks no longer predict real-world utility, what should guide model selection?

Graph relationships

BENCHMARKED AGAINST
Gemini 3.1 Pro
Gemini 3.1 Pro achieved 2887 Elo on LiveCodeBench Pro.
Source finding
BENCHMARKED AGAINST
Gemini 3.1 Pro -> LiveCodeBench Pro
Gemini 3.1 Pro achieved 2887 Elo on LiveCodeBench Pro.
Source finding

Source trail

recursive self-improvement harness position paper The paper Sber released The Information reports AI Explained @anemll

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues