Shopify/liquid: 53% Faster Parsing and 61% Fewer Allocations via Karpathy Autoresearch Loop Applied to Production Ruby Gem

simonwillison.net·medium signal

Shopify CEO Tobias Lütke submitted a PR achieving 53% faster parsing and 61% fewer allocations to the production Shopify/liquid Ruby gem using Karpathy's autoresearch autonomous experiment loop with a coding agent. This is the first documented application of the autoresearch methodology to a production open source library rather than a toy benchmark, demonstrating the approach generalizes beyond ML training scripts. Willison covered this as a signal that autoresearch is now a viable pattern for performance optimization in any language.