Making OpenAPI Docs Agent-Ready: Hermes Finds 2,450 Documentation Smells Across 600 Production Endpoints

arXiv·medium signal

A new arXiv paper (2605.14312, May 14) introduces Hermes, a multi-agent LLM system that detects documentation and REST smells at the endpoint level. Evaluating 600 endpoints across 16 production APIs, Hermes found 2,450 smells — deficiencies present in all analyzed operations. Key insight for builders: structural OpenAPI validity does not guarantee semantic readiness for agent-based consumption, meaning your API docs may look valid but still break AI agents.