matthewpaver/Output Regression Gate
Check saved model outputs against explicit assertions and configured budgets.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| input | Workflow suite or provider trace JSON file. | yes | — |
| policy | Optional policy JSON for provider traces. | no | — |
| format | auto, suite, generic, openai, or anthropic. | — | auto |
| report | JSON report output path. | — | reports/ai-output-gate.json |
| baseline | Optional previous report used for regression comparison. | no | — |
| min-score | Minimum average score. | — | 0.80 |
| max-score-regression | Maximum allowed average-score drop from the baseline. | — | 0.03 |
| max-monthly-cost | Maximum projected monthly workflow cost in USD; empty disables the check. | no | — |
| fail-on-review | Fail when any output needs review. | — | false |
| fail-on-block | Fail when any output is blocked. | — | true |
| fail-on-new-block | Fail when an item becomes blocked relative to the baseline. | — | true |
Outputs
| name | description |
|---|---|
| report | Path to the generated JSON report. |