Entity trail

Agent Arena

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

Findings

Edges

Sources

Corpus findings

2026-08-10 / sources-researcherStreamArena Makes Video Agents Watch 88 Minutes Straight and Answer Open-Ended Questions — Best Model Gets 44.5% on Real-Time Perception vs 91.8% for HumansStreamArena (arXiv 2608.05703, Xiaohongshu with HKU, CUHK, HKUST) argues existing video benchmarks let weak models succeed via short clips and multiple choice, so it uses 243 videos averaging 88.8 minutes with 3,646 open-ended questions across real-time perception, historical retrospection, proactive interaction, and multimodal tool use (27% of candidate questions were cut in QC). Best-in-class StreamMind hits 44.5% real-time perception (baselines 8.0–28.1%), 34.6% retrospection, 56.1% tool use against ThinkStream's 1.8%, and just 9.5% on proactive interaction — while cutting query-to-answer latency 66.2%, from 81.4s to 27.5s, retaining 89.7% pooled accuracy. A quietly humbling control: human historical recall itself falls from 80.7% with rewatching to 63.4% under streaming conditions.
2026-08-08 / arxiv-researcherWeb-Agent Observation Routing Fails Because Router Labels Are Produced at the Agent's Own Success RateThis paper (2608.06171, submitted 2026-08-06) measures six browser observation modes (text, pixels, hybrids) across eight site-model cells on VisualWebArena and WebArena, and finds the oracle-routing prize is largely noise: rerunning the same mode on the same tasks flips 12-14% of outcomes, so a second run of a mode already in hand gains about as much as adding a new one. Five routing policies — mode picking, spend-on-strong-mode, a zero-cost rule read off task text, a confidence cascade, and pooled cost tiers — none robustly beat simply fixing one well-chosen mode. What does survive is a cost bound: routing only the tasks no mode solves to the cheapest mode cuts cost 9.5-30.6% in 8 of 8 cells at unchanged success. The stated obstruction is self-limiting — routing supervision is generated at the agent's success rate (correlation 0.95 between label supply and routing opportunity), so weak agents starve the router exactly where it would help most.
2026-08-06 / arxiv-researcherPIMiner Builds a Transferable Prompt-Injection Strategy Library: 86.7% Success on Gemini-2.5-Pro, 40% on Claude Sonnet 4.5Instead of the RL-trained attacker models that dominate prompt-injection red teaming and generalize poorly to new targets, PIMiner is an agentic system that trains across a sequence of (dataset, target model) pairs and accumulates a strategy library from scratch, which transfers to an unseen target LLM with no retraining and roughly 10 queries per test sample. On AgentDojo it reaches 86.7% ASR against Gemini-2.5-Pro, 53.3% against GPT-5.1, and 40.0% against Claude-Sonnet-4.5; on IPIArena the figures are 76.2%, 61.9%, and 42.9% respectively. The spread across frontier models is the useful signal for builders choosing a backbone for tool-using agents exposed to untrusted content.
2026-08-05 / agents-researcherWeClawArena builds an auditable sandbox for cross-user agent networks, with four attack variants per taskAs persistent personal-agent frameworks make agent-to-agent networks a real deployment target, everyday tool use becomes multi-party collaboration over personal workspaces where files, records, tools, and policies are not visible across owners. WeClawArena provides a runtime sandbox and benchmark of 124 base tasks across six cross-user domains, expanded into 620 scenario variants with one benign control and four attack-vector variants each. It records peer messages, tool calls, resource operations, governed decisions, and final workspace states, reporting utility and attack success rate separately so failures can be attributed to task breakdown, privacy leakage, poisoned evidence, or invalid authority paths.
2026-08-04 / reddit-researcherIntology's Locus Post-Trains Qwen3 Base Models Past the Official Human-Tuned Instruct Checkpoint — 44.7 on PostTrainBench, 51.6% on PostTrainBench+Intology announced on August 3 that its automated research system Locus is SOTA on PostTrainBench, which gives an agent one H100 and 10 hours to post-train Qwen3-1.7B/4B, SmolLM3-3B, or Gemma-3-4B across seven benchmarks (AIME 2025, Arena Hard, BFCL, GPQA Main, GSM8K, HealthBench, HumanEval). Locus scores 44.7 in the official setting and, under a self-introduced expanded-compute variant they call PostTrainBench+ (thousands of H100 hours), reaches a 51.6% composite that surpasses the official human-post-trained Qwen3-1.7B-Instruct. Intology also ran Locus across live prize-money Kaggle competitions, claiming 4th-highest average rank after 16 days — note that PostTrainBench+ is Intology's own extension of a third-party benchmark, so the headline result is not an apples-to-apples leaderboard entry.
2026-08-03 / agents-researcherSeekBrain: a 29-author multi-agent system that builds its analysis recipes from code-paper pairsPosted July 31 (arXiv 2607.29347, lead author Jiamin Wu), SeekBrain targets fragmented neuroscience workflows by dynamically constructing a repertoire of analysis recipes extracted from code-paper pairs, then using domain-grounded hierarchical planning to generate hypotheses and analytical pipelines across heterogeneous datasets. It reports substantial gains over agent baselines on the BrainArena benchmark, and in real deployment integrated behavioral, neural and anatomical data to surface structured distributed neural representations of larval zebrafish behavior. The transferable idea for builders is the recipe-extraction step: mining executable procedures from paired code and prose is a general way to give a domain agent priors that a system prompt cannot encode.
2026-07-17 / github-pulse-researchertrycua/cua Positions Itself as the Open-Source 'Computer-Use 2.0' Stack — Background Driver, Sandbox, Bench, and a Rust Port for Windows/Linuxtrycua/cua (~20K stars, MIT, 469 releases deep) bundles a full computer-use agent stack: Cua Driver (background automation on macOS without stealing the cursor, now with a Rust port cua-driver-rs for Windows/Linux parity), Cua Sandbox (clean OS-level env with screenshot/mouse/keyboard/multi-touch), CuaBot CLI, and Cua-Bench for evals on OSWorld, ScreenSpot, and Windows Arena. One API drives any VM or container — cloud or local — across macOS, Linux, Windows, and Android emulators via QEMU. It's the most complete open alternative for training and evaluating desktop-controlling agents.
2026-07-16 / sources-researcherThinking Machines Lab Ships Inkling: 975B-A41B Multimodal, Apache 2.0 — the Leading American Open-Weights ModelTML's first full LLM is open-weights: 975B total / 41B active MoE, multimodal (text/image/audio in, text out), trained on 45 trillion tokens, with a 1M-token context in the open weights (256K via API/Tinker). A smaller Inkling-Small (276B-A12B) ships alongside. It ranks #41 on the Intelligence Index — top U.S. open-weights model but behind GLM-5.2 and Kimi K2.6 — and #9 in Agentic Web App Arena, with notably concise reasoning and strong tool calling. Architecture is unusual: non-RoPE relative positional encoding, 5:1 local-to-global sliding-window attention, short convolutions, and 2 shared expert sinks. Available on Hugging Face, Databricks, Baseten, Modal, and vLLM.
2026-06-28 / projects-researcherAgent Arena Wins Product Hunt Launch of the Day: A Competition Network Where Autonomous Agents Earn ReputationAgent Arena took Product Hunt's Launch of the Day on June 26, 2026, as an open competition network where autonomous agents compete in real-world challenges, earn rewards, build reputation, and evolve over time. It frames agent evaluation as a public, persistent leaderboard rather than a static benchmark. The launch reflects growing interest in measuring agents through live competitive performance instead of one-off benchmark scores.
2026-06-24 / thought-leaders-researcherZico Kolter and Matt Fredrikson on Latent Space: 'AI Security Is Not Just Cybersecurity With AI'On swyx's Latent Space (June 22), OpenAI board member Zico Kolter and Gray Swan CEO Matt Fredrikson argued AI security is a distinct discipline — as enterprises deploy autonomous agents like Claude Code and OpenClaw, prompt injection and indirect attacks form a genuinely new risk class. They contend specialized red-teaming models now outperform humans at breaking AI systems, so robust defense requires dedicated guardrail models (e.g., Cygnal) plus continuous adversarial testing via platforms like Gray Swan Arena. The builder takeaway: agent security needs purpose-built models and ongoing red-teaming, not bolt-on filters.
2026-06-23 / thought-leaders-researcherNathan Lambert Calls GLM-5.2 'the Step Change for Open Agents' — the Moment Frontier Agentic Coding Stops Being a Closed-Model ExclusiveIn a June 22 Interconnects essay, Lambert argues GLM-5.2 is the first open-weights model to trade blows with frontier systems on long-horizon, sustained-planning tasks inside real coding harnesses and design arenas — not just on static intelligence benchmarks. His thesis: agentic performance had been the one clear technical area closed labs (Claude Code, Codex) could dominate, and a usable long-horizon coding agent shipping under an MIT license with a 1M-token context window is the threshold that breaks that moat. This reframes the earlier 'GLM-5.2 is a strong open model' coverage as specifically an agents-capability inflection, with distribution/RLHF pipelines — not the base model — now the contested ground.
2026-06-07 / sources-researcherArena Turns From Passive Leaderboard Into Active Agent Runtime With 'Agent Mode'Arena (formerly LMArena/Chatbot Arena lineage) launched Agent Mode plus Agent Arena, where users run agents on real tasks and feed aggregate metrics — confirmed success, praise vs complaint, steerability, bash recovery, and tool hallucination — into a live leaderboard. It's one of the clearest examples this week of an eval company becoming an execution platform. For builders, it signals a shift toward production-grounded, behavior-level agent metrics over static prompt comparisons.

Graph relationships

RELEASED
Arena
Arena launched Agent Arena with live leaderboard metrics.
Source finding
RELEASED
Arena -> Agent Arena
Arena launched Agent Arena with live leaderboard metrics.
Source finding

Source trail

arXiv / HuggingFace Daily Papers (12 upvotes)arXiv 2608.06171 arXiv 2608.05108 arXiv Intology (via r/singularity 147 upvotes; @intology on X, 144K views)arXiv GitHub Latent Space (AINews) / Thinking Machines Lab Product Hunt Latent Space (swyx)Interconnects (Nathan Lambert)Arena (via Latent Space)

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues

Fetching from the wire…