Fetching from the wire…
01
02
03
04
05
06
07
08
Infra2026-07-26 · source-backed
A Rust/io_uring storage engine posted to Show HN today moves KV cache off the GPU into a petabyte-scale store co-located on GPU hosts, so a prefix computed on one GPU serves to others (GitHub). Claims million-plus IOPS within 1ms and 66x TTFT speedup on cache hits at 128K context. The demo serves Gemma4-31B on an H100 at 256K context, plugging into vLLM through an openlake-vllm connector via --kv-transfer-config. Apache-2.0, 2.3K stars, 423 forks, 164 commits, 91 open issues. Early, but the most concretely useful long-context cost lever posted this week.
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover Claims, Rust, Show HN, TTFT; reported by the same outlet (github.com); overlapping topics (cache, claim).
Mnemo built by Rust / Shared entities / Same source domain / Earlier coverage / Tension
Linked by a graph relationship (Mnemo built by Rust); both cover GitHub, Rust; reported by the same outlet (github.com).
Shared entities / Same source domain / Earlier coverage / Tension
Both cover GitHub, GPU, Rust; reported by the same outlet (github.com); earlier GitHub coverage from 2026-05-14.
Both cover GitHub, GPU, Rust; reported by the same outlet (github.com); earlier GitHub coverage from 2026-04-30.
Shared entities / Same source domain / Shared topic / Earlier coverage / Tension
Both cover Claims, GitHub; reported by the same outlet (github.com); overlapping topics (claim, context).
Shared entities / Same source domain / Shared topic / Earlier coverage
Both cover Claims, GitHub; reported by the same outlet (github.com); overlapping topics (claim, context, cost).
Codex CLI uses Rust / Shared entities / Same source domain
Linked by a graph relationship (Codex CLI uses Rust); both cover Apache, GitHub; reported by the same outlet (github.com).
Shared entities / Same source domain / Earlier coverage
Both cover Apache, GitHub, Rust; reported by the same outlet (github.com); earlier Apache coverage from 2026-07-17.