Fetching from the wire…
Public story · 2026-07-31 · high
The model scores under 27% on two memory benchmarks and just over 50% on a third, with code released under a noncommercial license.
Why now: The paper carries a July 2026 arXiv identifier, and its code and checkpoints are already public alongside it.
Metis stores memory as parameters instead of retrieved text, per a paper posted under arXiv ID 2607.26760. That's a swing at retrieval-augmented memory, the default where an outside database gets queried at inference time instead of living in the weights. Metis-27B backs that bet with 50.82% on the NextMem benchmark, a number worth weighing against the 24.76% it manages on MemOps with no context.
Its memory blocks pair a local memory matrix with a normalization vector. Separate hyper-memory blocks compress hidden states into memory key-value pairs blended into standard attention. The memory persists as state across a conversation instead of being rebuilt from scratch at each turn, per the paper.
On LoCoMo Gold, Metis-27B scores 26.74%, and on the out-of-distribution ATM-Bench it drops to 18.56%, per the authors' own numbers. The code and checkpoints are public, but they're licensed CC BY-NC-SA 4.0, so nobody ships this in a commercial product without a separate deal.
The gap between that 50.82% and the 18.56% out-of-distribution score is the widest in the paper's own table.
Each link below shares sources, entities, or timing with this story.
Shared entity: Code / Shared topic / Earlier coverage / Tension
Both cover Code; overlapping topics (checkpoint, code); earlier Code coverage from 2026-07-29.
Both cover Code; overlapping topics (code, memory); earlier Code coverage from 2026-06-15.
Shared entity: Bench / Same source domain / Earlier coverage / Tension
Both cover Bench; reported by the same outlet (huggingface.co); earlier Bench coverage from 2026-06-10.
Shared entity: Code / Shared topic / Earlier coverage / Tension
Both cover Code; overlapping topics (code, foundation); earlier Code coverage from 2026-03-23.
Shared entities / Earlier coverage
Both cover Bench, Code; earlier Bench coverage from 2026-07-25.
Both cover Bench, Code; earlier Bench coverage from 2026-06-14.
Both cover Bench, Code; earlier Bench coverage from 2026-06-05.
Shared entity: Code / Shared topic / Earlier coverage
Both cover Code; overlapping topics (attention, code); earlier Code coverage from 2026-07-23.