Skip to content

Change validation

Validate Core changes against the scientific sentence they alter. The proof must widen when a change moves from implementation detail to public model, algorithm, artifact, workflow-family behavior, or benchmark posture.

Change-to-proof map

Change Required proof Claim review
parser or adapter accepted and rejected fixtures, mutation cases, producer/version provenance, stable export native versus imported language
domain model or lifecycle invariants, forbidden combinations and transitions, schema and consumer compatibility public contract meaning
score, FDR, threshold, or inference reference values, orientation, boundaries, ties, missingness, decoys, sensitivity acceptance and confidence language
quantification or normalization design, scale, zero/missing distinctions, batch, ordering, reproducibility transfer and quantitative truth
PTM, DIA, or targeted rule ambiguity, library or panel context, calibration, interference, acceptance family-specific ceiling
benchmark asset or acceptance bar license, lineage, freshness, holdout role, expected failure, generated artifacts release-readiness matrix
performance implementation serial equivalence, determinism, exhaustion, cancellation, partial output no scientific claim widens from speed alone
public CLI, API, or artifact parity, schema, round trip, errors, lineage, downstream reader public examples and compatibility

Validation route

flowchart TD
    E["Core edit"] --> S["name scientific sentence"]
    S --> I["identify invariant and failure modes"]
    I --> F["focused positive and negative proof"]
    F --> B{"benchmark or transfer claim?"}
    B -->|yes| H["primary, companion, holdout, acceptance"]
    B -->|no| X["boundary and consumer review"]
    H --> X
    X --> C{"evidence supports sentence?"}
    C -->|yes| V["validated"]
    C -->|no| N["narrow, refuse, or add evidence"]

Inspect accepted, rejected, failed, and missing counts—not only the headline result. Compare policies and provenance as well as numeric output. Run affected Runtime, Knowledge, Intelligence, or Lab boundary tests when the artifact crosses package ownership.

Validation record

State input level and provenance, scientific policy, expected result and negative disposition, reference or benchmark independence, tolerances, workflow family, transfer envelope, exact checks, and resulting public claim. If a relevant corpus or consumer was not run, preserve that gap explicitly.