100 AI-Written Playwright Tests vs 5 Planted Bugs: 94 Stayed Green
A coding agent can write you 100 Playwright tests in half an hour. They all pass. But do they protect you? On 10 November 2026 we measured it live on YouTube. Claude Code wrote 100 tests for a food-delivery demo app, all green. Then we shipped a refactor with 5 planted bugs and ran the same 100 tests against it.
94 stayed green. 3 bugs were caught. 2 got past every test, including one that hides the order total from the customer.
Here is how the tests were written, which bugs slipped and why, and what caught the one the tests could not see.
