Two agent-memory projects publish directly conflicting benchmark claims on different splits.

MemPalace (57,821 stars, v3.6.0) reports 96.6% raw recall@5 on LongMemEval with no LLM required, 98.4% with hybrid v4 on a held-out 450 questions, LoCoMo R@10 rising 60.3% → 88.9%, ConvoMem 92.9%, MemBench 80.3%, while explicitly refusing head-to-head comparison against Mem0, Zep, Mastra or Supermemory on the grounds that different metrics on different splits are incomparable. rohitg00/agentmemory (25,913 stars) claims "#1 based on real-world benchmarks" at 95.2% recall@5 and 88.2% MRR on LongMemEval-S, and does publish a rival table citing mem0 at 68.5% and Letta/MemGPT at 83.2% on LoCoMo. Anyone comparing the two is comparing incompatible evaluations, and agentmemory's own docs concede only its figures are on LongMemEval-S. MemPalace's refusal is the more honest position. (GitHub)