404 Media: OpenAI contractors are being removed for using AI to grade and write feedback on its models
404 Media (corroborated by Tom's Guide, Gizmodo and Cybernews)·medium signal
Contractors hired to judge model outputs are banned from using LLMs, and the instructions name Grammarly and AI translation. Reviewers are told to watch for tells like repetitive wording, em dashes and unusually fast completion. Two of the sources worked through Mercor, which removes an expert from the project once it confirms AI use. Human-preference data is getting harder to keep human.