MindPatternSubscribe

Entity trail

ResNet

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs

1

Findings

1

Edges

0

Sources

1

Corpus findings

2026-03-21 / reddit-researcherKimi Publishes 'Attention Residuals' Paper — Proposes Replacing Standard Transformer Residual ConnectionsMoonshot AI (Kimi) published a paper proposing 'attention residuals' to replace the residual connections used in every transformer since the ResNet era — routing skip-connection information through learned attention weights instead of direct addition. The r/LocalLLaMA post (117 upvotes) reports results 'look legit' at the scales tested. If the architecture validates at frontier scale, this would be a meaningful departure from core transformer topology that has been stable since 2017.

Source trail

attention residuals

Graph sources

entity graphfindings textkg entitiesnewsletter issues