Skip to content

Change Principles

An Intelligence change is safe only when a reviewer can determine whether it changed evidence use, candidate eligibility, decision policy, uncertainty, refusal, explanation, or downstream authority. Schema compatibility alone is not enough: a recommendation can reverse while the payload shape stays fixed.

Classify the decision change

Changed surface Questions to answer Required evidence
candidate or filter Who entered, who was excluded, and can ordering or selection change? fixed cohort, rejection cases, and before/after ranking
score or orientation What does the value mean, in which direction, on which scale, and under missingness? boundary values, monotonicity, ties, and missing inputs
weight or threshold Which decisions move under the new policy? policy identity, sensitivity envelope, and decision diff
confidence or calibration Which corpus and outcome definition support the value? calibration, drift, subgroup, and abstention evidence
contradiction or falsifier Can favorable evidence bypass challenge? adverse, ambiguous, and unresolved cases
scenario or regret Which alternatives, costs, and uncertainties are modeled or omitted? counterfactual and consequence fixtures
refusal or hold Which blocker stops progression, and can a caller flatten it? refusal reason, consumer branch, and rendered packet
promotion Who grants authority, to what target, under which policy? attributable promotion and unauthorized-path rejection
learning Which outcomes are eligible to alter future policy? lineage, eligibility, audit, and preserved prior decision
flowchart LR
    change["decision change"] --> fixed["fixed evidence and candidates"]
    fixed --> compare["compare policy outcomes"]
    compare --> challenge["adverse and boundary cases"]
    challenge --> authority["verify advisory and enforced separation"]
    authority --> record["retain decision diff and limitations"]

Invariants

  • evidence identity and candidate scope are explicit before ranking;
  • score orientation, missingness, ties, and thresholds never rely on caller inference;
  • challenge evidence can downgrade, hold, or refuse a favorable result;
  • confidence is not described as probability beyond its calibration evidence;
  • rejected candidates, alternatives, and unresolved questions remain visible;
  • advisory output cannot become enforced through serialization or transport;
  • new evidence or policy supersedes rather than rewrites history; and
  • feedback changes future policy only through an attributable review record.

Review the same evidence and candidate set under both policies whenever a change can affect judgment. If the recommendation moves, publish the decisive factor and downstream consequence. If the proof does not cover the new policy envelope, narrow the posture or refuse it.