AWS Strands Evals Adds ActorSimulator: Synthetic Users for Multi-Turn Agent Evaluation

AWS Machine Learning Blog·medium signal

AWS published a new Strands Evals capability — ActorSimulator — that generates AI-powered simulated users to drive multi-turn evaluation of conversational agents. The simulator creates realistic user profiles with personality traits, expertise levels, and communication styles, then adaptively responds to agent output rather than following a script. Built-in goal completion assessment automatically ends conversations when objectives are met. Transcripts feed directly into the standard evaluation pipeline for helpfulness scores and goal success rates.