synapt-dev/synapt-eval PR Gate
Run eval regression gate and post report card to PR
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| results-path | Path to eval results JSON file | yes | — |
| baseline-path | Path to baseline results JSON for regression detection | no | "" |
| threshold | Regression threshold (default: 0.05) | no | 0.05 |
| fail-on | Severity level that fails the workflow: error, warning, or none (default: error) | no | error |
| comment | Post/update a report card comment on the PR (default: true) | no | true |
| trending-path | Path to trending history directory for storing run data | no | "" |
| python-version | Python version to use (default: 3.12) | no | 3.12 |
Outputs
| name | description |
|---|---|
| passed | Whether the PR gate passed (true/false) |
| report-json | Path to the report card JSON file |
| report-markdown | Report card as markdown string |