Evaluating a Change to the Agent's System Prompt

You want to change your coding agent's system prompt to push it to "always run the tests before declaring a task done". Design the evaluation that decides whether the change ships. Cover the offline suites (what they contain and which metrics gate), how you judge trajectory quality, the safety checks, and what you watch online — and explain why "pass rate went up" is not, on its own, a green light.