Fetching from the wire…
01
02
03
04
05
06
07
08
Public story · 2026-08-26 · high
CAFE beat RL-trained search agents on seven benchmarks and held its edge on six more it wasn't tuned for.
Why now: CAFE's paper was up on arXiv by August 26, 2026.
CAFE trains one model to act as both a search agent and its own critic, alternating between the two roles inside a single training run.
That matters for anyone building agentic search. CAFE's ablation found gains plateau when only the agent or only the critic improves, and climb only when both train together across all seven benchmarks tested.
The corrective feedback isn't automatic. The agent has to request it mid-task, and online reinforcement learning shapes when to grant that request. The training signal comes from the gap between the agent's success rate when it calls for help and when it skips it.
A separate offline stage teaches the feedback itself, trained through preference optimization on matched pairs of successful and unsuccessful trajectories. Online RL decides when to step in. This stage decides what the intervention says.
Across those seven benchmarks, CAFE outperformed the RL-trained baselines it was tested against, and kept its lead on six additional benchmarks it wasn't tuned for.
Each link below shares sources, entities, or timing with this story.
Same source domain / Shared topic / Tension / Downstream implication
Reported by the same outlet (arxiv.org); overlapping topics (agent, alone, between); pushes against this story (but).
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (beat, benchmark, critic); pushes against this story (but).
Same source domain / Shared topic / Downstream implication
Reported by the same outlet (arxiv.org); overlapping topics (agent, between, request); traces where this leads (which means).
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (agent, alone, between); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (agent, beat, benchmark); pushes against this story (against).
Reported by the same outlet (arxiv.org); overlapping topics (agent, alone, benchmark); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (agent, agentic, search); pushes against this story (against).
Reported by the same outlet (arxiv.org); overlapping topics (agent, beat, benchmark); pushes against this story (but).