MCPZoo Study: Scanners Call 96.89% of MCP Servers 'Risky' — But Under Half of Those Alerts Are Real

arXiv·high signal

Researchers built MCPZoo, the largest dynamic-analysis corpus of Model Context Protocol servers to date — 64,611 unique servers (113,927 total), 37,288+ runnable — by using a multi-agent framework to turn static repos into live services. Ecosystem-scale measurement shows current MCP security scanners flag 96.89% of servers as risky, yet manual validation finds fewer than 50% of sampled alerts are true positives, with scanners disagreeing wildly with each other. For anyone wiring MCP tools into an agent, the takeaway is that today's scanner verdicts are close to noise; a public query interface is released for real risk assessment.