Andrej Karpathy's 'LLM Wiki' Pattern Goes Viral: Stateful Knowledge That Compounds vs. Stateless RAG

GitHub·high signalXBlueskyLinkedInCopy link

Karpathy published a GitHub Gist in April 2026 describing an 'idea file' pattern where an LLM builds and maintains an entire interlinked wiki from raw research materials — reading sources, extracting concepts, creating backlinks, and updating existing pages when new information arrives. His personal research wiki has grown to ~100 articles and 400K words. The pattern is being framed as 'Beyond RAG' because the LLM pre-compiles knowledge into permanent markdown rather than retrieving on the fly, making knowledge compound over time.