Retrieval Review¶
Review begins with execution intent and ends with the evidence needed to interpret replay. Each answer must be visible in contracts or artifacts rather than inferred from a backend name.
flowchart TD
intent[Exact or approximate intent]
resolve[Capability resolution]
execute[Budgeted execution]
retain[Lifecycle and provenance]
compare[Replay or exact baseline]
intent --> resolve --> execute --> retain --> compare
Audit one ranking decision¶
Choose a returned neighbor—preferably one involved in a tie or approximation— and reconstruct the decision:
| Question | Evidence to follow |
|---|---|
| why was this request admissible? | normalized intent, mode, contract, budget, dimensions, metric, and authorization |
| why was this backend selected? | registry entry, observed capability descriptor, provider availability, and fallback record |
| which state was searched? | dataset, artifact, index, embedding, and backend-native snapshot identities |
| why did this item receive this position? | normalized vector, metric, score, stable tie key, filters, top-k, and ANN witness where applicable |
| what did execution cost or omit? | latency, memory, error/approximation budget, truncation, warnings, and partial status |
| can the result be compared later? | finalized artifact, provenance join, request and result fingerprints, replay policy, and external-state identity |
If the ranking can be explained only by naming the backend, the evidence is insufficient. Backend names select implementations; they do not encode the request, corpus, parameters, numerical environment, or loss boundary.
Adversarial scenarios¶
| Scenario | Required behavior |
|---|---|
| equal scores arrive in different backend order | canonical tie ordering produces the same ranked result |
| preferred backend lacks a required capability | explicit refusal or a declared eligible fallback with visible identity |
| latency, memory, or error budget is exhausted | typed budget outcome; no complete-success classification |
| ANN seed or witness changes | new execution identity and a structured comparison against the exact or prior baseline |
| idempotency key is reused with different normalized intent | refusal before resource mutation |
| artifact says complete but ledger/native state is absent or corrupt | load and replay refusal with the missing boundary named |
| dataset or index identity changes during replay | blocking diff when the selected replay policy requires equality |
| compatibility command and canonical interface disagree | investigate canonical behavior and bridge delegation separately |
Run the scenario at the lowest owning layer first, then through the public adapter when serialization, authorization, or error mapping is part of the claim. A public smoke test alone cannot prove backend or replay semantics.
Intent and plan¶
- Does the request declare exact or non-deterministic execution without contradictory fields?
- Are metric, dimensions, top-
k, filters, budget, and randomness normalized into immutable plan identity? - Can an idempotency key bind only to equivalent normalized intent?
- Are authorization and transaction constraints checked before resource use?
Backend and ranking¶
- Does observed behavior agree with the backend capability descriptor?
- Is equal-score ordering stable across repeated runs?
- Does an ANN change include exact-versus-approximate comparison and a visible approximation witness?
- Are fallback and missing-capability paths explicit refusals rather than silent changes of algorithm?
Persistence and replay¶
- Are incomplete, failed, and complete lifecycle states distinguishable?
- Do ledger entries, result fingerprints, artifacts, and native backend state describe the same execution?
- Does replay refuse changed dataset, index, backend, parameters, or randomness when the selected policy requires equality?
- Are acceptable and blocking diffs both retained rather than reduced to one boolean?
Public and operational boundaries¶
- Do API models, error envelopes, authorization, and idempotency preserve domain meaning?
- Are vectors, service topology, credentials, and tenant details redacted from diagnostics where required?
- Do benchmark claims carry full comparison context?
- Is the canonical surface distinguished from
bijux-vexcompatibility?
Conclude with release acceptance and compare residual exposure with known limitations.