Skip to content

Wire Briefings Search

Fetching from the wire…

01

02

03

04

05

06

07

08

Wire Briefings Search

Entity trail

KimiLinear

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

2

Sources

1

Corpus findings

2026-09-10 / github-pulse-researcherTransformers 5.17.0 ships a 780B-parameter MoE with a 1M context and a per-channel-gated linear attention modelReleased 2026-09-09, transformers 5.17.0 adds Hy4-Preview: 780B total parameters activating 49B per token, 256 routed experts plus one always-active shared expert, top-8 routing and a 1M-token context. It combines Multi-head Latent Attention, DeepSeek Sparse Attention with shared indexer layers, gated MLA with learnable attention sinks, and Independent Hyper-Connections replacing the plain residual path. The release also lands Moonshot's KimiLinear with per-channel forget gates, Microsoft's VibeVoice long-form multi-speaker TTS, and Alibaba's 800M Fun-ASR-Nano.

Graph relationships

RELEASED
transformers
Transformers 5.17.0 ships Moonshot's KimiLinear with per-channel forget gates.
Source finding
RELEASED
transformers -> KimiLinear
Transformers 5.17.0 ships Moonshot's KimiLinear with per-channel forget gates.
Source finding

Source trail

Graph sources

entity graphfindings textkg edgeskg entitiesnewsletter issues