Hacker News
FROGS: One Absurd Prompt, 14 Models, Three Tries a Month — 'Generate an SVG of a Frog With a Habsburg Jaw'
A personal benchmark that hit 143 points and 77 comments on HN runs a single deliberately weird prompt across 14 models from Anthropic (Opus 5, Sonnet 5, Haiku 4.5), OpenAI (GPT-5.5, GPT-5.4-mini) and Google (Gemini 2.5 Pro, Gemini 3.6 Flash), three attempts each per month, tracking execution time, output file size, and the comments models leave inside the SVG source. All 42 August attempts produced valid SVGs; the differentiator turned out to be annotation style — some models write interpretive commentary about anatomical exaggeration and royal framing, others emit bare structural labels. Dataset on Hugging Face, code on GitHub for reproducible runs.
↳ Follow the thread