Skip to content

Verification Matrix

The matrix below names the strongest relationship the repository currently supports for each external reference. A stronger row must not be inferred from a weaker one: successful execution is not numerical agreement, and a checked study fixture is not a package-wide live parity surface.

Read each row as a ceiling on the public statement, not as a score. The reference name identifies an external owner; the verification mode identifies how that owner was observed; the strongest claim states the largest supported scope; and the primary record contains the denominator, failures, and limits.

Reference Verification mode Strongest current claim Primary record
APE live R registry; checked study fixtures 180 governed cases across 35 function shards, plus named study comparisons APE correspondence
GEIGER live R registry 48 governed cases across 17 model shards with optimizer and parameterization review GEIGER correspondence
phytools live R registry 65 governed cases across 21 function shards, with distribution rules for stochastic outputs phytools correspondence
APE + nlme checked R-derived fixtures PGLS coefficients, likelihoods, model comparisons, and selected diagnostics for named fixtures study-specific R references
treeio + tidytree governed study evidence structural node mapping and tree–trait join observations for the primate longevity fixture study-specific R references
ggtree source and plot-intent provenance plot-only study fragments study-specific R references
MAFFT + trimAl external execution adapters validated invocation, captured configuration and output, parsed alignment diagnostics alignment and trimming
IQ-TREE2 + FastTree external execution adapters and cross-engine workflow complete run bundles and comparable topology/likelihood fields where meanings align tree inference
MrBayes + BEAST external execution and parser adapters prepared or executed analyses with trace/tree diagnostics and explicit engine ownership Bayesian inference
MCMCglmm source-backed study boundary PCM4 and PCM5 bundles retain not_comparable verdicts and open posterior follow-through; no posterior parity claim study-specific R references

Mode, Outcome, And Verdict

Term Applies to Read from
verification mode strength and ownership of the comparison relationship this matrix and the tool-specific guide
case outcome passed, failed, or skipped execution of a registered parity case parity summary, observations, and failure artifacts
evidence verdict governed scientific conclusion for identified claims Evidence Book manifest and indexes
resolution state open follow-through, blocker, or accepted bounded state verdict workflow and study boundary records

Do not translate a mode into an outcome or an outcome into a verdict. They answer different questions and may change on different schedules.

Coverage Requires The Full Case Population

A passing-case count is uninterpretable without the selection and execution denominators.

Count Membership rule Required visibility
registered every case defined by the governed registry revision operation, parameterization, fixture and support state
selected cases included by the declared filter before execution filter, exclusions and unsupported boundaries
executed selected cases for which both required lanes reached a comparable observation stage failures, missing tools and incomplete outputs
passed executed comparable cases satisfying every registered rule keyed observations and rules
failed executed comparable cases violating at least one rule mismatch artifacts and owning observation
skipped or not comparable selected cases without an eligible comparison exact absence, capability, environment or identity reason

Publish all counts and their case keys. A pass rate over executed cases can be useful, but it must not hide selected cases that never became comparable. A larger registry is stronger coverage only when its new cases retain explicit outcomes and comparable observation contracts.

Verification Has Independent Axes

Do not read the modes as one universal maturity ladder. Strength depends on at least four independent properties:

Axis Weaker evidence Stronger evidence
execution freshness frozen source or fixture live execution under recorded versions
comparison precision provenance or structural compatibility named observations with explicit tolerances
scientific scope one operation or adapter contract claim-bound study evidence
reproducibility prose description retained inputs, raw outputs, manifest, observations, and failures

A checked fixture can be more reproducible than an undocumented live run. A live run can be fresher while remaining scientifically narrower than a study bundle. An external adapter can have excellent execution evidence without any numerical correspondence claim. Report the axes that matter instead of assigning one undifferentiated strength label.

What Each Mode Establishes

flowchart TD
    provenance["Source provenance"] --> fixture["Checked fixture"]
    fixture --> live["Live reference case"]
    adapter["External adapter"] --> execution["Governed execution"]
    live --> evidence["Evidence Book claim"]
    execution --> evidence
    fixture --> evidence

    provenance_note["Names the original owner"]
    fixture_note["Replays frozen observations"]
    live_note["Executes both implementations now"]
    execution_note["Captures an external engine run"]
    evidence_note["Adds sources, checks, artifacts, and verdict"]

    provenance --- provenance_note
    fixture --- fixture_note
    live --- live_note
    execution --- execution_note
    evidence --- evidence_note
  • Source provenance identifies where an operation or study originated.
  • Checked fixture compares Bijux with frozen, versioned reference outputs.
  • Live reference case executes the named external package and Bijux in the same governed run.
  • External adapter prepares, invokes, captures, and parses a program that remains the computational owner.
  • Evidence Book claim binds a scientific statement to inputs, sources, checks, results, freshness, and a reviewable verdict.

Reading A Claim Safely

Start with the verification mode, then inspect the named operation and compared fields. Confirm parameterization, taxon order, state encoding, rooting, units, likelihood convention, and support meaning before interpreting a passing case. If a scientific claim cites the run, continue to the Evidence Book verdict and its freshness. Finally, read the non-claims: they define what neither record can be used to conclude.

A row may advance only when the stronger mode is implemented and governed. Documentation language alone cannot promote provenance to a checked fixture, an adapter to parity, or an analytical match to rendered-figure equivalence.

Select The Record From The Intended Statement

Intended statement Minimum owning record
Bijux can prepare or invoke a named external engine adapter contract with executable discovery, command, process state, and native outputs
one registered operation corresponds for named cases parity registry plus selected-case summary, keyed observations, rules, and failures
one checked fixture reproduces a reference observation fixture provenance, immutable reference value, Bijux execution, and comparison record
one scientific result corresponds under a study contract Evidence Book claim, complete observation denominator, verdict, limitations, and freshness
two ecosystems are generally equivalent no matrix row supplies this claim; define and govern a finite operation and population first

Choose the record whose scope matches the sentence. More operational detail does not compensate for a missing scientific claim, and a study verdict does not expand to every function offered by its reference package.

Revision Rule

Registry sizes and strongest claims describe the checked-in revision. When a registry, normalization rule, reference version, tolerance, or governed fixture changes, regenerate its summary and reconsider the matrix claim. A larger case count is not automatically stronger evidence if new cases are skipped, incomparable, or governed by weaker observations.

The citation should retain the repository revision, verification mode, reference and Bijux versions, selected operation and population, observation rule, complete denominator, strongest supported claim, and linked evidence verdict when one exists. Without the revision and denominator, the matrix row is navigation rather than a reproducible correspondence statement.