arXiv: AI Coding Agents Can Reproduce Published Social-Science Findings

arXiv·low signal

A new preprint (arXiv:2606.11447) tests whether AI coding agents can replicate published social-science results from raw data and methods sections — a real-world replication task rather than a synthetic benchmark. Early results suggest agents can reproduce a meaningful share of findings, a useful data point for builders weighing agents on open-ended data-analysis work. Single-source preprint, so treat the numbers as preliminary.