Public story · 2026-03-17 · source-backed

Attention Residuals (Kimi): #1 Trending on HuggingFace.

Issue

2026-03-17

Confidence

source-backed

Sources

Redaction

redacted

Story

Moonshot AI replaces standard fixed residual connections with softmax attention over preceding layer outputs. Already in production at 48B scale (Kimi Linear). Consistent scaling improvement validated across model sizes. 1,330 HuggingFace upvotes. Source

Kimi built by Moonshot AI / Shared entities / Same source domain / Shared topic / What happened next
Kimi K2.7 Code is the open-weight refuge, and the off-switch is its best marketing
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Kimi, Moonshot AI; reported by the same outlet (huggingface.co).
Kimi built by Moonshot AI / Shared entities / Shared topic / What happened next
Kimi Publishes "Attention Residuals" — Rethinking Core Transformer Architecture
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Attention Residuals, Kimi; overlapping topics (attention, connection, kimi, residual).
Cursor Composer 2 Foundation Revealed as Kimi K2.5 — The Model Supply Chain Transparency Problem
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Kimi, Moonshot AI; overlapping topics (kimi, model, moonshot).
Moonshot AI released Kimi K3 / Shared entity: Kimi Linear / Shared topic / What happened next
Kimi K3 is Kimi Linear scaled from 48B to 2.8T, and the first frontier model to drop RoPE entirely.
Linked by a graph relationship (Moonshot AI released Kimi K3); both cover Kimi Linear; overlapping topics (attention, connection, kimi, layer, linear).
Kimi built by Moonshot AI / Shared entity: Kimi / Shared topic / What happened next
Kimi K3 Ships Without K2's Modified-MIT License
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Kimi; overlapping topics (attention, kimi, model, moonshot, over).
Kimi built by Moonshot AI / Shared entities / Shared topic / What happened next
Kimi K3 Beats Fable 5 on Frontend Code, Ships July 27
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Attention Residuals, Moonshot AI; overlapping topics (attention, model).
Kimi built by Moonshot AI / Shared entity: Moonshot AI / Shared topic / What happened next / Tension
Kimi K2.6 Beats GPT-5.4 on SWE-Bench Pro. It's Open-Weight. It Costs 88% Less.
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Moonshot AI; overlapping topics (kimi, model).
Kimi built by Moonshot AI / Shared entity: Moonshot AI / Shared topic / What happened next
Moonshot cuts off new Kimi K3 signups after 48 hours
Linked by a graph relationship (Kimi built by Moonshot AI); both cover Moonshot AI; overlapping topics (kimi, model, moonshot).

Source trail

Source

Entities

Already Attention Residuals Consistent HuggingFace Kimi Kimi Linear Moonshot AI Trending

Provenance

Canonical issue: Ramsay Research Agent — 2026-03-17
AI generated: no
Story unit: 2026-03-17-attention-residuals-kimi-1-trending-on-huggingface
Labels: source-backed, canonical briefing excerpt

Fetching from the wire…

Attention Residuals (Kimi): #1 Trending on HuggingFace.

Story

Related stories

Kimi K2.7 Code is the open-weight refuge, and the off-switch is its best marketing

Kimi Publishes "Attention Residuals" — Rethinking Core Transformer Architecture

Cursor Composer 2 Foundation Revealed as Kimi K2.5 — The Model Supply Chain Transparency Problem

Kimi K3 is Kimi Linear scaled from 48B to 2.8T, and the first frontier model to drop RoPE entirely.

Kimi K3 Ships Without K2's Modified-MIT License

Kimi K3 Beats Fable 5 on Frontend Code, Ships July 27

Kimi K2.6 Beats GPT-5.4 on SWE-Bench Pro. It's Open-Weight. It Costs 88% Less.

Moonshot cuts off new Kimi K3 signups after 48 hours

Source trail

Entities

Provenance

Attention Residuals (Kimi): #1 Trending on HuggingFace.

Story

Related stories

Kimi K2.7 Code is the open-weight refuge, and the off-switch is its best marketing

Kimi Publishes "Attention Residuals" — Rethinking Core Transformer Architecture

Cursor Composer 2 Foundation Revealed as Kimi K2.5 — The Model Supply Chain Transparency Problem

Kimi K3 is Kimi Linear scaled from 48B to 2.8T, and the first frontier model to drop RoPE entirely.

Kimi K3 Ships Without K2's Modified-MIT License

Kimi K3 Beats Fable 5 on Frontend Code, Ships July 27

Kimi K2.6 Beats GPT-5.4 on SWE-Bench Pro. It's Open-Weight. It Costs 88% Less.

Moonshot cuts off new Kimi K3 signups after 48 hours

Source trail

Entities

Provenance