Testing

AI testing covers what can actually be measured.

Every credible test of AI output begins with a rule you could have written yourself. Tests built on a model's opinion inherit that model's blind spots, and no two runs agree on the number.

The work is the evidence that it held.

A test is only as good as its rule

Deterministic checks are boring and that is their value: the same input produces the same findings today and in three years. When a rule fires, you can read the sentence behind it, decide whether you agree and open the line it flagged.

Model-judged grading cannot do that. It is useful for exploration, but you cannot attach it to a release decision, because a re-run may quietly reach a different conclusion.

The tests that pay for themselves

Across generated code, copy, documents and media, a small number of checks catch a disproportionate share of the defects.

  • Secret scanning over anything an assistant produced, because credentials in source is the one finding that costs real money to fix late.
  • Known-bad patterns: eval, innerHTML with interpolated input, empty catch blocks, unescaped template output.
  • Completeness: does the output end where it should, and are placeholders still present?
  • Sourcing: is every number, quotation and date attached to something a reader can open?
  • Metadata: has the file been stripped, resampled or re-encoded in a way that destroys its provenance?

What testing cannot tell you

No automated check knows whether the work is useful, whether the strategy is sound or whether the phrasing will land badly in one market and well in another. A green result means the known defects are absent, nothing more.

Read the score that way and it stays honest. Treat it as approval and it becomes the reason a problem ships.

What the checks look for

  • Credential literals

    Keys, tokens and passwords assigned in source, in code or in an example that will be copied.

  • Injection surfaces

    Strings handed to eval, new Function or innerHTML without a parser in between.

  • Truncated output

    Work that stopped mid-structure and cannot be executed or read as written.

  • Claim density

    Paragraphs of assertion with no citation, no measurement and no qualifier.

  • Lossy media

    Re-encoded images and audio whose original signals no longer survive.

Questions this page usually raises

Can these tests run without sending data anywhere?
Yes. The checkers are plain JavaScript executing in your browser against pasted text, so results do not depend on a server round-trip and nothing is stored unless you save the report.
Does a high score mean the output is good?
It means the tested defects are absent. Quality of judgement, strategy and fit is outside what a rule set can measure, which is why escalation exists.
Can we test images as well as text?
Image checks cover what the file carries: dimensions, format and whether the metadata that should be present has been stripped. They cannot tell you whether a picture was generated.

AI testing

Run the checks, then decide who needs to sign it.

The automated pass is free, needs no account and uploads nothing. Escalate to a named reviewer only where being wrong is expensive.