Validation

AI validation: evidence the output is fit to publish.

Validation answers one question in a way an auditor can accept: on what basis was this output declared acceptable? The answer has to be a standard, a result and a person, not a feeling about the tone of the answer.

The work is the evidence that it held.

Validation is not testing

Testing asks whether something breaks. Validation asks whether it is the right thing. A generated report can pass every check in a test suite and still be invalid, because it answers a slightly different question than the one a contract asked for.

That distinction matters more with AI output than anywhere else, because the system is optimised to produce something that looks responsive. Fluency is not fitness.

What gets validated

We validate the output against the claims made about it, in four domains.

  • Code: does it do what the ticket says, without credentials, injection paths or swallowed errors?
  • Copy: is every factual claim sourced, and does it avoid promises the business cannot keep?
  • Documents: are prerequisites, versions and cross-references accurate against the real system?
  • Media: does the file carry the provenance and integrity signals that were implied when it was delivered?

A verdict you can attach

Validation ends in an artefact, not a conversation. The record holds the rule set version, the findings with severities, the score they produce and, where a human was involved, the reviewer's name and the changes they requested.

That record is what makes the process reusable a year later, when someone asks why a deliverable was signed off and nobody remembers the meeting.

What the checks look for

  • Requirement drift

    Output that is competent but answers a nearby question instead of the asked one.

  • Unverifiable statements

    Claims a reader cannot check, presented with the same weight as the ones they can.

  • Scope gaps

    Sections promised in the brief that quietly disappear from the deliverable.

  • Configuration assumptions

    Hardcoded values that only hold on the machine the output was generated against.

  • Silent language

    Confident phrasing where the underlying data supports only a hedge.

Questions this page usually raises

What does validation output look like?
A scored report with each finding tied to a rule and a severity, the set of checks that ran, and an optional human sign-off naming the reviewer and their discipline.
Can validation be part of a CI process?
The checks are deterministic functions over the input, so the same text always produces the same report. That is what makes the result safe to gate a release on rather than treating it as advisory opinion.
Who signs off when a human is involved?
A named specialist in the relevant discipline, listed with their rate and turnaround. You know who read the work; it is never an anonymous pool.

AI validation

Run the checks, then decide who needs to sign it.

The automated pass is free, needs no account and uploads nothing. Escalate to a named reviewer only where being wrong is expensive.