shreyjain11/Veritas leakage audit
Run a Veritas contamination/leakage + robustness audit and (optionally) fail the job if the reported-vs-honest metric gap exceeds a threshold.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| sequences | Evaluation sequences (FASTA). | yes | — |
| table | Eval id,label,prediction table (CSV/TSV/parquet). | yes | — |
| reference | Reference / training sequences (FASTA). | yes | — |
| config | AuditConfig JSON (detectors, thresholds, seed, ...). | yes | — |
| seq-type | Sequence alphabet: protein | nucleotide. | no | protein |
| metric | Headline metric (auroc, accuracy, spearman, ...). | no | auroc |
| out | Path to write the audit report. | no | veritas-report.json |
| max-delta | Fail the job if reported-honest delta exceeds this. Leave empty to skip the gate. The gate also fails LOUDLY when the honest metric is undefined (insufficient clean data / undefined metric). | no | "" |
Outputs
| name | description |
|---|---|
| report-path | Path to the written audit report. |