Fetching from the wire…
01
02
03
04
05
06
07
08
Models2026-08-02 · source-backed
Chimera processes text, image and video tokens as one raster-ordered stream with no positional embeddings, combining Kimi Delta Attention for O(N) state tracking, interleaved Multi-head Latent Attention, modality-aware short convolutions, and sparse MoE. The real contribution is HeteroP, a module-wise hyperparameter transfer scheme keyed to each tensor's functional fan-in and depth, which produces a family consistent enough to actually fit compute-optimal laws. The 11B/2B-active model is 1.7x more compute-efficient than a full-attention dense backbone and extrapolates zero-shot from 5-second training clips to 30-second video with 6.5% FID degradation in the final five seconds.
Each link below shares sources, entities, or timing with this story.
Shared entities / Same source domain / Earlier coverage
Both cover MoE, Multi; reported by the same outlet (arxiv.org); earlier MoE coverage from 2026-07-25.
Kimi uses Kimi Delta Attention / Shared entity: Multi / Earlier coverage / Tension
Linked by a graph relationship (Kimi uses Kimi Delta Attention); both cover Multi; earlier Multi coverage from 2026-07-02.
Shared entity: Multi / Same source domain / Earlier coverage / Tension
Both cover Multi; reported by the same outlet (arxiv.org); earlier Multi coverage from 2026-07-31.
Shared entity: Multi / Same source domain / Earlier coverage / Downstream implication
Both cover Multi; reported by the same outlet (arxiv.org); earlier Multi coverage from 2026-07-28.
Shared entity: Multi / Same source domain / Earlier coverage / Tension
Both cover Multi; reported by the same outlet (arxiv.org); earlier Multi coverage from 2026-07-25.
Both cover Multi; reported by the same outlet (arxiv.org); earlier Multi coverage from 2026-07-22.
Shared entity: MoE / Same source domain / Earlier coverage / Downstream implication
Both cover MoE; reported by the same outlet (arxiv.org); earlier MoE coverage from 2026-07-20.
Shared entity: Multi / Same source domain / Earlier coverage / Downstream implication
Both cover Multi; reported by the same outlet (arxiv.org); earlier Multi coverage from 2026-02-27.