abhi13-tech/offtrack agent regression gate
Gate CI on AI-agent trajectory regressions: record golden runs, diff new ones, fail on the first divergent step.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Activelast commit Aug 4, 2026
- License
- MIT
Pinned Snippet
uses: abhi13-tech/offtrack@aa700a69b1074f0577be88968216b64ada983161 # v0.4.0tags can be moved; commit SHAs can't. why a SHA?
Inputs
| name | description | required | default |
|---|---|---|---|
| suite | Path to offtrack.yaml | — | offtrack.yaml |
| baselines | Committed baselines directory | — | baselines |
| runs | Candidate runs per task | — | 5 |
| inconclusive-as | Map INCONCLUSIVE to: pass | fail | inconclusive | — | inconclusive |
| offtrack-version | PyPI version to install; empty string installs from the checked-out source | — | latest |
| working-directory | Directory containing the suite | — | . |
Outputs
| name | description |
|---|---|
| verdict | PASS | FAIL | INCONCLUSIVE | ERROR |
| report-path | Path to the markdown report |