Discovered Materials' Benchmark: Frontier Models Found 500+ New Materials, Experts Judged Exactly One Synthesizable
YC-backed Discovered Materials launched on Hacker News August 12 with Material Discovery Bench, which measures LLM progress on discovering thermally conductive dielectrics for 3D chip packaging using the AI Security Institute's open-source Inspect framework, with models given web search, Python/bash sandboxes, and property-computation ML tools. Across seven models and runs of 30–100M tokens each, over 500 previously unknown materials were computationally discovered — and expert reviewers judged only one to have a plausible synthesis pathway worth attempting. GPT-5.6 Sol led at 4.0 favorable materials per run. This is the most useful anti-hype datapoint of the week for anyone building vertical R&D agents: generation volume and validated output are separated by roughly three orders of magnitude.
↳ Follow the thread