Fetching from the wire…
01
02
03
04
05
06
07
08
Research2026-07-26 · source-backed
Tao et al. diagnose long-context degradation as two opposite spectral pathologies: homogenization collapse from attention sinks driving rank deficiency, and isolation collapse (arXiv 2607.20484). TRSP is a non-invasive side-path combining a parameter-free triangular mechanism with a lightweight context-length-aware scaling term to rebalance the spectrum without changing the base architecture. 83% retention at eight times training length, substantially above competing long-context interventions.
Each link below shares sources, entities, or timing with this story.
Same source domain / Shared topic / Tension
Reported by the same outlet (arxiv.org); overlapping topics (architecture, attention, long-context); pushes against this story (versus).
Reported by the same outlet (arxiv.org); overlapping topics (architecture, attention); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (accuracy, attention); pushes against this story (but).
Reported by the same outlet (arxiv.org); overlapping topics (accuracy, attention); pushes against this story (against).
Same source domain / Shared topic
Reported by the same outlet (arxiv.org); overlapping topics (accuracy, long-context, training).
Shared topic / Downstream implication
Overlapping topics (accuracy, architecture, base); traces where this leads (downstream).
Same source domain / Shared topic
Reported by the same outlet (arxiv.org); overlapping topics (architecture, base).
Reported by the same outlet (arxiv.org); overlapping topics (changing, degradation).