jarjarbeatyourattitude/Evalt performance gate

Find or verify the lowest-cost AI route that clears your frozen quality contract.

Trust Signals

name	description	required	default
suite	Path to the versioned Evalt suite.	no	evalt.json
result	Path where the machine-readable Evalt result is written or read.	no	evalt-result.json
optimize	Run the budget-capped tournament before applying the gate. Set false to gate an existing result without provider calls.	no	true
evalt-version	Exact PyPI version to install. Mutable aliases such as latest are rejected.	no	0.9.5
python-version	Python version used by the action.	no	3.12
min-pass-rate	Required final-test pass rate from 0 through 1.	no	0.95
max-cost-per-success	Optional maximum USD cost per successful production call.	no	""
require-complete-coverage	Fail when the tournament did not finish all decision-relevant coverage.	no	true
fixed-prompt	Disable prompt rewrites and few-shot search while still comparing model routes.	no	false
max-parallel-models	Optional override for parallel model lanes.	no	""
max-parallel-scenarios	Optional override for parallel scenario executions per model.	no	""
request-timeout-seconds	Optional wall-clock deadline for one provider response, not the tournament.	no	""
html-report	Path for the self-contained HTML evidence report.	no	evalt-report.html
junit-report	Path for the case-level JUnit report.	no	evalt-junit.xml

name	description
status	PASS, FAIL, or ERROR.
selected-model	Model selected in the saved result, if one qualified.
final-test-pass-rate	Measured final-test pass rate.
cost-per-1000-successful-calls-usd	Measured production cost per 1,000 successful calls.
result	Path to the machine-readable result.
html-report	Path to the self-contained HTML report.
junit-report	Path to the case-level JUnit report.