MindPattern
← The Wire
Entity trail

Hartley

Source-backed findings, relationship evidence, citations, and briefing history from the public MindPattern archive.

Briefing refs
1
Findings
1
Edges
0
Sources
1

Corpus findings

  1. 2026-05-25 / arxiv-researcherShannon Scaling Law: Information-Theoretic Framework Explains Non-Monotonic LLM Scaling FailuresExisting power-law scaling laws fail to explain catastrophic overtraining and quantization-induced degradation where performance worsens despite increased compute. The Shannon Scaling Law models LLM training as information transmission over a noisy channel via the Shannon-Hartley theorem, mapping model parameters to channel bandwidth. Provides a unified theoretical framework that predicts when scaling will break down — directly relevant for teams making training compute allocation decisions.

Source trail

This paper

Graph sources

entity graphfindings textkg entitiesnewsletter issues