| plugin-dir | Path to the plugin (contains .claude-plugin/plugin.json, evals/ and optionally .cdc.yml) | yes | — |
| track | pinned (baseline, deterministic) or canary (alias model, latest Claude Code). Empty = .cdc.yml `track` | — | "" |
| runs | Runs per case (overrides case default and .cdc.yml) | — | "" |
| model | Agent model alias or id (overrides the track) | — | "" |
| judge-model | LLM grader model (overrides .cdc.yml judge_model) | — | "" |
| ablation | with-without (baseline proof) or none (cheaper regression runs) | — | none |
| scaffold | Run case.yaml scaffold_script (only for suites you authored) | — | true |
| threshold | Score drop that counts as a regression (overrides .cdc.yml thresholds.score) | — | "" |
| coverage-min | Fail the check when agent-config coverage (rules with an eval case) is under this percent. Empty = report only | — | "" |
| report-base-url | Public base URL of the results-branch Pages history folder (e.g. https://<you>.github.io/<repo>/history). When set, PR-comment case names deep-link into this run's HTML report | — | "" |
| claude-code-version | Claude Code version to install (overrides the track's harness pin), or "latest" | — | "" |
| results-branch | Orphan branch that stores baseline.json, canary/, history/, spend.json and the release-watch state | — | eval-results |
| promote-baseline | Overwrite baseline.json with this run (first run, or after an intentional change). Pinned track only | — | false |
| force | Skip the budget and interval gates (manual dispatch only) | — | false |
| open-prs | Open a bump PR after canary.promote_after green canaries, and a pin PR when the pinned track has no pin | — | true |
| repair | On a red result, let the agent propose a config fix, re-run the failing cases and open a repair PR (spends API credit, budget-capped) | — | false |
| slack-webhook-url | Incoming-webhook URL to notify on regression (pass a secret) | — | "" |
| github-token | Token for pushing results, opening PRs and commenting | — | ${{ github.token }} |
| pages | Also write docs/ (dashboard, report, latest.json) to the results branch for GitHub Pages (source: results branch, /docs) | — | true |
| preflight | Static checks before any model run: the skill linter and the suite format doctor (including a free load check on the installed Claude Code). warn = report in the job summary; fail = stop before spending model runs; off | — | warn |