LLM Neuroanatomy III: Research Suggests LLMs Think in Geometry, Not Language — 147↑ with 95 Comments

r/LocalLLaMA·medium signalXBlueskyLinkedInCopy link

A detailed r/LocalLLaMA post with 147 upvotes and 95 comments presents research mapping internal LLM representations, finding that models appear to encode concepts as geometric structures rather than linguistic tokens. The author rewrote the post after community feedback on overselling novelty, adding a Related Work section citing four prior papers. The high comment-to-score ratio (0.65) indicates deep technical engagement — this kind of mechanistic interpretability work has direct implications for understanding model failures, hallucinations, and steering.