Hacker News
Show HN: Agent-Desktop — Native Desktop Automation CLI for AI Agents via OS Accessibility Trees
Agent-desktop is a Rust-based CLI tool (82 HN points, 26 comments) that gives AI agents native desktop automation through OS accessibility trees rather than screenshots or OCR. It provides 53 commands covering window management, keyboard, mouse, clipboard, and notifications, with progressive skeleton traversal achieving 78–96% token reduction on dense applications. The tool follows an accessibility-first approach — exhausting pure AX API strategies before falling back to mouse events — making it more reliable than vision-based desktop agents.
↳ Follow the thread