Karpathy's New LLM Yardstick: Claude Opus Ran Two Hours and Emitted 5,500 Lines of Three.js to Procedurally Generate Middle-earth
Andrej Karpathy — five weeks into his Anthropic pre-training role — handed Claude Opus the opening paragraph of The Lord of the Rings, a large token budget, and a request to render it in Three.js; the model worked roughly two hours and produced about 5,500 lines of code that procedurally positions and animates polygon assets in 3D. His framing is the real signal: "We're starting to leave the territory where you'd test an LLM by e.g. 'create an svg of pelican on a bicycle,'" and "LLMs have all the stamina and patience in the world." For builders, the retirement of the pelican-SVG era means eval design has to shift from single-shot artifacts to multi-hour, self-directed builds where the bottleneck is stamina and coherence, not raw capability.
Source
↳ Follow the thread