Skip to content

Test strategy

Knowledge testing applies pressure to evidence custody: incomplete sources, ambiguous identities, duplicated lineage, contradiction, stale records, unresolved review, serialization, and downstream interpretation.

Evidence layers

Layer Contract under test Representative suite
reference custody registry integrity, source identity, citation, license and freshness fields tests/references/
biological identity exact, ambiguous, absent, obsolete, cross-species, isoform, and namespace mapping identity and biological namespace tests
claim and evidence models valid/invalid construction, context, provenance, confidence meaning, and immutability tests/memory/test_claims.py, test_evidence_bundle.py
graph integrity endpoints, edge types, support, contradiction, orphan prevention, and round trip test_evidence_graph.py
reconciliation competing contexts, deterministic policy, hold, unresolved, and audit trace test_resolution.py and contradiction surfaces
review state fixed revision, complete adverse evidence, disposition, rationale, and stable assembly tests/reviews/
grounding citations, benchmark lineage, literature coverage, deficits, contradiction, and release ceiling workflow grounding and literature tests
package boundary Foundation serialization, Core results, Intelligence references, and Lab feedback remain aligned tests/package/ and consumer tests

Challenge route

flowchart LR
    R["source and identity"] --> M["claim and evidence models"]
    M --> G["graph integrity"]
    G --> C["contradiction and reconciliation"]
    C --> V["review revision"]
    V --> B["consumer bundle"]

Run the focused source, memory, review, or grounding suite first, then the full package suite for shared models, persistence, registries, and public outputs:

uv run --project packages/bijux-proteomics-knowledge \
  pytest -q packages/bijux-proteomics-knowledge/tests

Required imperfect evidence

Include missing sources, duplicate lineage, ambiguous identifiers, stale records, unsupported namespaces, conflicting claims, context-dependent agreement, unresolved reconciliation, and incomplete review. An idealized single-source graph cannot establish honest uncertainty handling.

Fixture replay proves deterministic handling of retained records. Live-source availability and freshness require separate retrieval evidence. Keep those claims distinct in test reports.