aotp-ventures/AOTP EvalGate
Run deterministic LLM/RAG evals as a PR check
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| config | Path to evalgate YAML config | yes | — |
| openai_api_key | OpenAI API key for LLM evaluators (optional) | no | — |
| anthropic_api_key | Anthropic API key for LLM evaluators (optional) | no | — |
| azure_api_key | Azure API key for LLM evaluators (optional) | no | — |
| check_run | Create a GitHub check run with results (optional) | no | false |
Outputs
| name | description |
|---|---|
| total_score | Overall score from .evalgate/results.json |
| passed | Whether EvalGate passed |