Skip to content

Observability and Diagnostics

Intelligence is observable through the structure of its reasoning artifacts. The primary diagnostic is not a service metric but a trace from evidence to claim, candidate factors, scenario outcomes, recommendation, and review action. Operational logs may locate an exception; they cannot establish that a decision was justified.

Read the decision trace

Artifact Inspect
Evidence posture completeness, freshness, conflicts, confidence, and unresolved questions
Candidate ranking policy identifier, factor definitions, weights, normalized contributions, and stable ordering
Scenario evaluation action per scenario, confidence, reasons, and disagreement across scenarios
Claim review evidence for, evidence against, contradictions, uncertainty, falsifiers, and next checks
Refusal report claim, threshold that failed, evidence references, and permitted recovery action
Decision brief recommendation, rationale, alternatives, limitations, and escalation state
Review-board report agenda item, recorded disposition, rationale, and follow-up actions
Learning history observed outcome and prospective posture change without alteration of prior decisions

Start with identifiers. Candidate, claim, evidence, policy, scenario, and review identifiers should join across artifacts. Missing or mismatched identifiers are contract defects because they break the audit path. Then reconcile summary counts: every claim should have a refusal assessment, high-confidence claims must appear in the belief audit, and referenced evidence must exist in the governed evidence graph.

Explain movement

When a recommendation changes, compare evidence membership and freshness first, then policy lineage, factor contributions, contradiction state, confidence downgrades, and scenario action spread. Report the smallest causal difference. “The score changed” is not a sufficient diagnosis.

Confidence must be read with its support and uncertainty. A high baseline value can be downgraded by weak support, unresolved contradictions, or incomplete resolution. Likewise, consensus across scenarios is meaningful only when the same evidence and policy were evaluated; differing actions are evidence for escalation, not noise to suppress.

An incident record should contain the decision and policy identifiers, input fingerprints, package version, candidate ordering, factor audit, evidence posture, scenario outcomes, claim refusals, and relevant review rationale. Diagnostics are complete when an independent reviewer can reproduce the path and name exactly which evidence, rule, or uncertainty produced the outcome.