equistamp/Evaluation tools
Tools to start and manage Equistamp evaluations
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| command | The action to be taken. The following actions are supported: * run - start a new evaluation session with on the provided evaluation and model If you want to run this asynchronously, you can also configure this tool to set an appropriate commit status. To do so, you will have to provide: * your repository (as "<owner>/<repo>", e.g. "mySuperOrg/myRepo") * the full SHA of the commit to set the status on * a github key used to send the appropriate requests | — | — |
| api-token | Your Equistamp API token | yes | — |
| evaluation | The id of the evaluation you want to use | no | — |
| model | The id of the model you want to use | no | — |
| host | The Equistamp server URL | no | https://equistamp.net |
| github-key | A github API key with commits write access | no | — |
| repository | The repository to be used when setting commit statuses | no | — |
| commit | The full SHA of the commit for which the status should be set | no | — |
| commit-status-id | An optional identifier for the resulting comment status | no | — |
Outputs
| name | description |
|---|---|
| evaluation-session-id | The id of any started evaluation session |
| evaluation-session-report | The URL of the report of any started evaluation session |