Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

HySparse

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

0

Findings

1

Edges

2

Sources

1

Corpus findings

2026-09-23 / arxiv-researcherHySparse2 Lets Prefill Exit Halfway Through an 80B-A3B MoE by Building All Cross-Decoder KV From Self-Decoder StatesHySparse2 targets agent workloads that produce short actions over long tool observations. It pairs a YOCO-style self-decoder and cross-decoder, bridged only at full-attention layers, with token-level sparse attention. Because every cross-decoder KV cache comes from self-decoder hidden states, prefill can skip the cross-decoder layers entirely. On an 80B-A3B MoE model it beat HySparse and hybrid sliding-window attention on long-context retrieval and multi-turn agentic tasks while cutting prefill compute and KV storage.

Graph relationships

BENCHMARKED AGAINST
HySparse2
HySparse2 outperformed HySparse on long-context retrieval and multi-turn agentic tasks.
Source finding
BENCHMARKED AGAINST
HySparse2 -> HySparse
HySparse2 outperformed HySparse on long-context retrieval and multi-turn agentic tasks.
Source finding

Source trail

Graph sources

entity graphfindings textkg edgeskg entities