Operations¶
Operate a reasoning run as a chain of evidence, not as a command that happened to exit. Acceptance requires the intended specification and plan, a trace with resolvable support, an inspected verification report, and a run whose digests still match its retained files.
Review lifecycle¶
flowchart LR
spec["validate ProblemSpec"]
run["create content-addressed run"]
trace["inspect evidence and claim events"]
verify["review every finding"]
integrity["check manifest and fingerprints"]
replay["replay with frozen results"]
accept["accept, reject, or retain insufficient evidence"]
spec --> run --> trace --> verify --> integrity --> replay --> accept
verify -. finding .-> trace
integrity -. mismatch .-> run
Acceptance evidence¶
| Evidence | Acceptance question |
|---|---|
spec.json |
Is this the intended problem, constraint set, and output type? |
plan.json |
Is the dependency graph complete and content identity stable? |
trace.jsonl |
Can each call, result, evidence item, claim, and action be followed in order? |
verify.json |
Which checks passed, warned, or failed, and under which invariant IDs? |
fingerprint.txt |
Do the exact serialized trace bytes still match? |
run_meta.json |
Which preset, seed, runtime, tools, schema, and producer created the run? |
manifest.json |
Do all declared core, evidence, and provenance files match their digests? |
| replay diff | Does the frozen execution reproduce the retained trace under the recorded contract? |
Keep operational verdicts separate¶
One run can have different answers to each of these questions:
| Verdict | Governing evidence | Operational meaning |
|---|---|---|
| execution completion | plan nodes and terminal trace events | the declared work reached a terminal outcome |
| claim disposition | typed claim status and its support relationships | the claim is proposed, validated, rejected, or retained as insufficient |
| verification result | registered findings, severities and policy choice | structural and grounding checks passed, warned, or failed |
| bundle integrity | manifest, fingerprints, invariant checksum and safe paths | the retained files still form the content-addressed run |
| replay comparison | frozen inputs, replay trace, diff, verdict and reason | the later execution matches or diverges under the recorded contract |
| process status | command exit code and selected strictness flags | automation received the documented process-level signal |
Do not derive one verdict from another. A command may exit successfully while retaining verification findings; a valid bundle may contain an insufficient claim; and replay can diverge even when both executions terminate normally. Acceptance policy must name which verdicts it requires and retain all of them.
Failure routing¶
| Symptom | Inspect first | Safe response |
|---|---|---|
Verification findings with exit 0 |
verify.json and whether strict failure policy was requested |
do not accept the run based on exit status alone |
| Support hash or span failure | exact retained evidence bytes and registered interval | restore the original evidence or reject the claim; never update only the digest |
| Manifest mismatch | changed, missing, and unexpectedly relocated files | quarantine the bundle and recover from a trusted copy |
| Replay checksum failure | original plan, evidence order, runtime descriptor, and pinned retrieval provenance | refuse equivalence before re-execution |
| Replay trace differs | structural diff and recorded tool returns | identify the changed contract or implementation; similar prose is insufficient |
| Retrieval evidence is weak or absent | corpus, chunks, BM25 provenance, and insufficient_evidence events |
improve the declared evidence path or preserve the controlled refusal |
| Resource guard stops a run | disk, wall-time, CPU, or corpus limit | treat partial output as incomplete and rerun under an explicit safe budget |
Deployment boundary¶
The API offers an optional exact token, request-size guards, and an in-process rate counter. These are not distributed authentication, tenant isolation, malware screening, sandboxing, or secret management. Process resource budgets are guardrails, not a scheduler or hard real-time boundary. Apply production controls in the hosting system and authenticate exported manifests externally.
Operate by need¶
| Need | Guide |
|---|---|
| Install the command and API extras | Installation and setup |
| Develop with isolated artifacts | Local development |
| Create, verify, replay, and evaluate runs | Common workflows |
| Diagnose claims, checks, provenance, and replay | Observability and diagnostics |
| Plan corpus and resource bounds | Performance and scaling |
| Recover a corrupt or divergent run | Failure recovery |
| Define hosting controls | Security and safety and Deployment boundaries |
| Release an artifact- or schema-sensitive change | Release and versioning |