abhi13-tech/offtrack agent regression gate

Gate CI on AI-agent trajectory regressions: record golden runs, diff new ones, fail on the first divergent step.

View on GitHub

Trust Signals

Scorecard Score
not yet scored
Maintenance Recency
Activelast commit Aug 4, 2026
License
MIT

Pinned Snippet

workflow.ymlSHA-pinned
uses: abhi13-tech/offtrack@aa700a69b1074f0577be88968216b64ada983161 # v0.4.0

tags can be moved; commit SHAs can't. why a SHA?

namedescriptionrequireddefault
suitePath to offtrack.yaml—offtrack.yaml
baselinesCommitted baselines directory—baselines
runsCandidate runs per task—5
inconclusive-asMap INCONCLUSIVE to: pass | fail | inconclusive—inconclusive
offtrack-versionPyPI version to install; empty string installs from the checked-out source—latest
working-directoryDirectory containing the suite—.
namedescription
verdictPASS | FAIL | INCONCLUSIVE | ERROR
report-pathPath to the markdown report