orq-ai/Orq Evaluate

Run evaluatorq evaluation files using the @orq-ai/cli

View on GitHub

Trust Signals

Scorecard Score
not yet scored
Maintenance Recency
Maintainedlast commit Jan 12, 2026
License
MIT

Pinned Snippet

workflow.ymlSHA-pinned
uses: orq-ai/cli-evaluate@5c24502c844279577e8310a9f4a6d5823d849c79 # v1.0.0

tags can be moved; commit SHAs can't. why a SHA?

namedescriptionrequireddefault
patternGlob pattern for evaluation files (e.g., '**/*.eval.ts')yes
orq-api-keyOrq API key for authentication and tracingno
orq-base-urlOrq API base URL (defaults to https://my.orq.ai)no
working-directoryWorking directory to run evaluations fromno.
bun-versionBun version to usenolatest
disable-tracingDisable OTEL tracing even when API key is setnofalse
otel-endpointCustom OTEL endpoint for traces (overrides auto-detection from orq-base-url)no

no outputs