Pattern: Karpathy's 'Software 3.0' — The Context Window Becomes the Primary Programming Interface

Karpathy Blog·high signalXBlueskyLinkedInCopy link

Karpathy's Sequoia Ascent framework positions context engineering as the successor to prompt engineering: in Software 3.0, what goes into the context window IS the program. CLAUDE.md files, skill definitions, memory systems, tool schemas, and structured examples are all 'source code' for agent behavior. The practical implication: invest in context architecture (what loads, when, in what order, with what priority) the same way you'd invest in code architecture. Teams building agentic systems should treat context as a first-class engineering artifact with version control, testing, and review.