Architecture Risks¶
Core’s breadth creates a particular risk: a scientifically plausible output can look trustworthy after the assumptions, exclusions, or evidence level that produced it have been lost.
| Risk | Consequence | Control |
|---|---|---|
| Evidence-level collapse | PSM, peptide, protein group, protein, site, and proteoform results are treated as interchangeable | Preserve typed levels and explicit aggregation contracts |
| Silent row loss | Invalid or filtered source records disappear from totals | Retain source-row lineage and rejected-evidence tables |
| FDR scope drift | A threshold is applied at a different level or competition scope | Record target-decoy policy, evidence level, threshold, and audit trail |
| Protein ambiguity erasure | Shared peptides are reported as unique protein evidence | Preserve groups, mapping ambiguity, and parsimony policy |
| PTM over-localization | A modified peptide is presented as a resolved site without sufficient fragment evidence | Retain candidate sites, probabilities, and localization tier |
| Quantification opacity | Normalization, imputation, missingness, or roll-up changes meaning invisibly | Emit provenance and diagnostics with matrices |
| Context leakage | Annotation or enrichment is interpreted without foreground, background, species, or reference context | Bind interpretation to explicit context contracts |
| Workflow monolith | Composition code becomes the only usable scientific API | Keep scientific families callable and testable independently |
| Runtime coupling | Scheduling or service state changes scientific results | Keep computation deterministic and runtime-independent |
flowchart LR
I[Input and design] --> E[Evidence level]
E --> P[Declared policy]
P --> O[Output]
I --> L[Lineage and exclusions]
E --> L
P --> L
L --> R[Reviewable result]
O --> R
The strongest control is not a success flag; it is the ability to reconstruct why each retained and rejected result has its current meaning.
Diagnose a changed scientific result¶
Compare in causal order so a downstream numerical difference is not blamed on the wrong surface.
| Compare | Question | Owner record |
|---|---|---|
| input and experimental design | did the eligible population, reference, grouping, or contrast change? | source and design identities |
| parser and normalization | were rows interpreted, filtered, keyed, or normalized differently? | accepted and rejected intake reports |
| evidence level and aggregation | did PSM, peptide, group, protein, site, or proteoform meaning change? | typed evidence-level and roll-up contracts |
| scientific policy | did thresholds, competition, inference, missingness, imputation, or QC change? | versioned policy and parameters |
| implementation | did the algorithm change under stable inputs and policy? | implementation revision, focused tests, and reference vectors |
| benchmark burden | does the changed result still satisfy the family-specific acceptance and perturbation evidence? | benchmark report, challenge corpus, and limitation record |
Only after the earlier rows match is an implementation regression the leading explanation. If the result change is intentional, its release record must name the affected evidence level, workflow families, consumers, and public claim ceiling.