First Orion replaced selector-based UI tests with plain-English agents on Amazon Nova Act — 20–25% shorter QA cycles, test authoring from days to minutes
AWS Machine Learning Blogmedium signalAWS published the case study on 2026-08-11: First Orion, a pre-release Nova Act adopter since March 2025, moved from brittle selector-driven UI test code to describing tests in natural language and letting an agent execute them. Reported results are 20–25% reduction in QA cycle time for specific test types, 25–30% engineering time saved by cutting context switches, up to 15% coverage increase from fully automated regression runs, and test-case authoring turnaround dropping from days to minutes. The architecture is a React authoring UI, S3 for test storage, ECS on Fargate running the Nova Act Test Runner, AgentCore Browser for managed browser provisioning and session recording, and Allure reporting piped into Microsoft Teams.
↳ Follow the thread