MemPalace Reaches 57.5K Stars — And Retired Its Own 100% LoCoMo Claim After Public Methodology Critique

GitHub·medium signal

MemPalace bills itself as "the best-benchmarked open-source AI memory system," and at 57,551 stars it's a leading local-first memory layer. But its headline 100% LoCoMo score across all five question types was achieved at top_k=50 — effectively retrieving the entire corpus, so the memory system contributed nothing and the test measured Sonnet's reading comprehension. The maintainer publicly acknowledged the critique and retired the disputed numbers; the honest figures are 88.9% R@10 (hybrid v5, no rerank) and 96.6% Recall@5 in the zero-API-cost category.