Skip to content

Risk Register

Intelligence can remain operational while becoming untrustworthy: rankings still sort, recommendations still serialize, and review packets still render. The critical risks are therefore silent changes to evidence use, policy, calibration, explanation, refusal, and downstream authority.

flowchart LR
    E["evidence and results"] --> P["declared policy"]
    P --> J["judgment"]
    J --> C["confidence and rationale"]
    C --> D{"recommend or refuse"}
    D --> Q["consequence review"]
    F["feedback"] --> P

Active And Structural Risks

Risk Observable failure Required control
duplicate semantic ownership the same belief-audit model exists in Core and Intelligence resolve the active ownership blocker or govern the exact shared contract
evidence laundering a score appears authoritative without source claim and lineage require Knowledge references and expose missing support
policy drift threshold or default changes move recommendations silently version policy and compare decision outcomes
score orientation error larger/smaller or sign meaning reverses a rank type and test orientation at the boundary
missingness coercion absence becomes zero, neutral, or low confidence implicitly declare missingness semantics and refusal behavior
unstable ranking ties or floating-point differences reorder candidates deterministic tie policy, tolerances, and retained comparison
confidence miscalibration high confidence persists under weak or shifted evidence calibration and counterfactual challenge corpus
circular benchmark the same evidence tunes and validates policy separated challenge evidence and provenance
rationale decay output remains usable but no longer explains decisive factors structured rationale and review packet checks
refusal erosion downstream demand converts blockers into warnings refusal tests and release-language guards
consequence bypass recommendation is treated as a laboratory instruction mandatory Lab feasibility and consequence handoff
feedback contamination outcomes adapt policy without eligibility or provenance checks governed learning inputs and adaptation audit

Review Priority

Prioritize risks that can change a recommendation without changing its schema. Those failures are hardest to detect through ordinary compatibility tests. Challenge policy changes with unchanged inputs, missing evidence, ties, contradictions, adversarial counterfactuals, and downstream infeasibility.

A recommendation is trustworthy only when a reviewer can reconstruct its inputs, policy, alternatives, confidence, rationale, and refusal boundary.