Research
MIT Lincoln Lab Publishes DARPA's TRACTOR Benchmark for C-to-Rust Translators
MIT Lincoln Laboratory is the independent test and evaluation organization for DARPA's Translating All C to Rust program. It released the program's standardized benchmark, with progressively harder test batteries plus larger milestone projects. Translations are scored on correctness, safety, idiomaticity and performance, and the benchmark and evaluation infrastructure are public. Paired with the same-day C-to-Rust Fallacy results, it gives LLM translation agents a shared yardstick in place of vendor-chosen demos.
Source
↳ Follow the thread