Fetching from the wire…
Research2026-08-12 · source-backed
Annie Sexton of ngrok grounds the compression/language-modeling equivalence in arithmetic coding: a no-context model needs 2.59 bits/symbol, an order-1 model 1.16 on the same text, and GPT-2 compresses Dickens to about 10% of original size against 24% for the order-1 baseline (ngrok). The argument is that LLMs minimize exactly the cross-entropy that sets the compression limit, making them the same mathematical object. 243 comments.
Each link below shares sources, entities, or timing with this story.
GPT competes with Claude / Shared entity: GPT / Shared topic / Earlier coverage / Tension
Linked by a graph relationship (GPT competes with Claude); both cover GPT; overlapping topics (against, model).
Linked by a graph relationship (GPT competes with Claude); both cover GPT; overlapping topics (against, model).
Copilot uses GPT / Shared entity: GPT / Shared topic / Earlier coverage
Linked by a graph relationship (Copilot uses GPT); both cover GPT; overlapping topics (coding, model).
GPT competes with Claude / Shared entity: GPT / Shared topic / Earlier coverage
Linked by a graph relationship (GPT competes with Claude); both cover GPT; overlapping topics (coding, model).
GPT competes with Claude / Shared entity: GPT / Earlier coverage / Tension
Linked by a graph relationship (GPT competes with Claude); both cover GPT; earlier GPT coverage from 2026-03-20.
Copilot uses GPT / Shared entity: GPT / Earlier coverage
Linked by a graph relationship (Copilot uses GPT); both cover GPT; earlier GPT coverage from 2026-07-20.
GPT competes with Claude / Shared entity: GPT / Shared topic / Earlier coverage
Linked by a graph relationship (GPT competes with Claude); both cover GPT; overlapping topics (coding, comment, model, same).
OpenHands uses GPT / Shared entity: GPT / Shared topic / Earlier coverage
Linked by a graph relationship (OpenHands uses GPT); both cover GPT; overlapping topics (comment, model, same).