Skip to main content
Experimental preview

Your AI tester said PASSED.
Did it prove it?

Wopee.io is the AI tester that audits its own passes. Every test our agent passes is checked against the run's own record. Report only flags missing proof by default; switch on Enforce and an unproven pass becomes Incomplete.

No proof, no pass.

On every plan, Free too. No credit card required.

When AI tests pass but prove nothing

When AI tests pass but prove nothing · 6:19 · A real run on our demo project. Watch on YouTube

One real run, three moments

We set our own agent a trap.

Our demo project on a public demo shop, with Enforce switched on. Frames from runs of 3 and 4 November 2026, as they appear in the video.

  1. 01The trap

    A test that names two prices, and checks neither

    The test expects a checkout total of $32.39: the backpack at $29.99 plus $2.40 tax. Its only defined check reads Thank you for your order! The agent completes the order and reports PASSED, quoting both prices.

    Test card: Checkout total matches the backpack price, with one text assert for Thank you for your order and an expected result naming $29.99 plus tax $2.40
  2. 02Pass withdrawn

    No check read those prices. In Enforce, the pass is taken back

    The integrity gates compare the reported pass with what the run recorded. Both prices are flagged as unverified, so the pass becomes Incomplete: amber, not red. The run didn't find a bug, it proved nothing, and it never counts as a pass.

    The same test card with an amber dot and the label Test incomplete, 6 steps, tagged pass withdrawn in Enforce
  3. 03Proof in, pass back

    Add the checks that read the numbers. Same test, rerun: green

    We added checks for the item total, the tax and the total. The rerun passes with nothing flagged, and this time the green comes with its proof.

    The same test card after the rerun with a green dot: Test passed, 9 steps
Start here

Report only: on by default. Your stored results don't change.

Watch the gates on your own runs before they touch a single result. When the flags look right on your project, switch on Enforce.

Report only · default

A second opinion, in the report

  • Every run gets a Verdict Integrity section with a shadow verdict.
  • A pass the gates disagree with gets an amber ring, with the gate named.
  • Stored results, counts and filters stay as they are.
Enforce · one switch per project

No proof, no pass

  • An unproven pass becomes Incomplete, with the reason.
  • A withdrawn pass never inflates your pass rate.
  • Project admins switch it on in Project Settings › Verdict.
  • PassedThe run recorded the proof. No gate withheld the pass.
  • IncompleteNot fully proven. Never counted as a pass. Fix: add the missing check, not a bug ticket.
  • FailedThe run found a failure. In Enforce, a Failed with no failure on record is withdrawn to Incomplete too.

In both modes, the agent can be sent back for a missing check before it stops: at most eight extra steps per run, counted toward your plan's steps. Experimental preview: today it's one switch per project, and per-check switches are in design. How verdict integrity works

Report only is on by default. Nothing changes until you switch on Enforce.
Who audits their passes?

Some come close. As far as we can find, nobody else does all three.

Most AI testing tools explain their failures. A few check their passes too, and we credit them below. What we couldn't find anywhere else: an unproven pass downgraded to its own verdict, and a shadow mode to watch it first.

  • Wopee.io
    1 · Audits the pass against the run
    YesIntegrity gates check every agent pass against the run's own record.
    2 · Downgrades an unproven pass
    YesIn Enforce, an unproven pass becomes Incomplete, with the gate and the evidence named.
    3 · Shadow mode first
    YesReport only, on by default: a shadow verdict that never changes a stored result.
    docs.wopee.io
  • TestMu AI · Kane CLI
    1 · Audits the pass against the run
    Close“A separate verification step decides the verdict.” The model's own account is not enough.
    2 · Downgrades an unproven pass
    CloseA July 2026 launch note: strict mode demotes tests that passed against a since-changed spec. Not on the product page today.
    3 · Shadow mode first
    Not foundNot found in public docs.
    testmuai.com/kane-cliLaunch note, 24 Jul 2026
  • QA.tech
    1 · Audits the pass against the run
    CloseA review agent writes one verdict per test plan. “Passed tests count as verified.”
    2 · Downgrades an unproven pass
    ClosePlan level: “Needs attention” when unverifiable tests leave part of the plan unproven. PR comments show “needs review” by confidence tier.
    3 · Shadow mode first
    Not foundNot found in public docs.
    docs.qa.techChangelog, 22 Apr 2026
  • Momentic · Mo
    1 · Audits the pass against the run
    CloseEach verdict lists what the agent verified and “the gaps it could not close”. Step level: an independent reviewer judges the settled app state, the recorded actions and your goal.
    2 · Downgrades an unproven pass
    Not foundNot found in public docs. A separate agent re-checks reported bugs, not passes.
    3 · Shadow mode first
    Not foundNot found in public docs.
    momentic.ai/docsmomentic.ai/changelog

Public docs and product pages, read 3-4 Nov 2026. Not exhaustive: something missing from public docs may still exist in a product. We also read mabl, BrowserStack, Applitools, testRigor, Tricentis, Katalon and Playwright's test agents, and found failure explanations and healing, but no documented audit of a pass. Tell us if we're wrong and we'll fix this table.

The False Pass Checklist

Seven questions to ask any AI testing tool before you trust its green.

If a tool can't answer 2, 3 and 5, its green is a claim, not a result.

  1. 2Does anything check the pass against that record, or only the agent's own account of it?An agent can describe a check it never ran.
  2. 3What happens to a pass the record doesn't back up?If it stays green, the dashboard is lying.
  3. 5Can you try the stricter verdict on your own runs before it changes any result?Teams adopt what they can trial without risk.
Read all seven, with our own answers →Free, no sign-up, saves as a PDF.
Experimental preview · on every plan

Make your green mean something.

Start free and watch Report only on your own runs. Or book 20 minutes and we'll walk you through every verdict your passes got.

Verdict integrity is in experimental preview; we ship improvements to it continuously. Changelog · Docs