rul1an/Verdict PR Gate
CI-first regression gate for RAG pipelines (Replay/Trace capable). Runs verdict ci and publishes JUnit + SARIF.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| repo | GitHub repo that hosts Verdict releases (owner/name). | no | Rul1an/verdict |
| verdict_version | Release tag to download (e.g. v0.6.0). Use a pinned tag for reproducibility. | yes | — |
| asset_name | Optional override for the release asset filename. If empty, computed from OS/arch. | no | "" |
| config | Path to eval YAML config. | no | ci-eval.yaml |
| trace_file | Optional JSONL trace file for replay mode. | no | "" |
| db | SQLite db path. | no | .eval/eval.db |
| quarantine_mode | Quarantine mode: off|warn|strict | no | warn |
| rerun_failures | Rerun failures N times (ignored/forced to 0 in replay mode). | no | 1 |
| strict | If true, Warn/Flaky become blocking (exit 1). | no | false |
| redact_prompts | If true, redact prompts in outputs/OTel. | no | true |
| junit | JUnit output path. | no | junit.xml |
| sarif | SARIF output path. | no | sarif.json |
| otel_jsonl | Optional OTel JSONL output path. | no | "" |
| upload_artifacts | Upload junit/sarif/run.json/otel.jsonl as workflow artifacts. | no | true |
| artifact_name | Artifact name if upload_artifacts is true. | no | verdict-reports |
| upload_sarif | Upload SARIF to GitHub Code Scanning. | no | true |
| working_directory | Optional working directory to run verdict in. | no | . |
Outputs
| name | description |
|---|---|
| junit_path | JUnit report path |
| sarif_path | SARIF report path |
| run_json_path | Run artifact path |
| otel_jsonl_path | OTel JSONL path |
| verdict_version | Installed verdict version |