Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

PRECOG

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

2

Sources

1

Corpus findings

2026-08-04 / arxiv-researcherPRECOG Pre-Encodes Documents as SSM Hidden States, Cutting RAG Prefill From 27 Seconds to Under 6 Milliseconds on Edge HardwareA new arXiv paper introduces PRECOG (Pre-Computed Context Injection), which exploits a property unique to State-Space Models: the fixed-size, position-agnostic recurrent hidden state is a complete summary of everything read, so document corpora can be pre-encoded offline and injected directly at query time. On TENNs-LLM, a 1.2B gated-SSM model with a 192 KB hidden state, PRECOG matches in-context RAG answer quality while collapsing prefill from O(L_context) to O(1) — roughly a 4,500x latency reduction. The authors note the mechanism is architecturally impossible for Transformer KV-caches, which are position-entangled and grow linearly with context.

Graph relationships

USES
State-Space Models
PRECOG exploits State-Space Models to pre-encode document context.
Source finding
BENCHMARKED AGAINST
Transformer
PRECOG achieves position-agnostic pre-encoding impossible for Transformer KV-caches.
Source finding

Source trail

arXiv 2608.02560

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues