cnqiujunhu-dev/AgentLens CI

Run AgentLens evals and optional scans against recorded AI agent traces.

Trust Signals

Scorecard Score: not yet scored
Maintenance Recency: Stale
License: None

Inputs

name	description	required	default
runs	Directory containing AgentLens trace JSON files.	no	.agentlens/runs
config	AgentLens eval config JSON file.	no	evals/default.json
node-version	Node.js version used to run AgentLens.	no	22
summary	Write a Markdown report to the GitHub Actions step summary.	no	true
pr-comment	Optional path to write Markdown suitable for a GitHub PR comment.	no	""
artifact-url	Optional uploaded run bundle or review pack URL to include in generated PR comments and review manifests.	no	""
sarif-url	Optional uploaded SARIF or code scanning URL to include in generated PR comments and review manifests.	no	""
bundle	Optional directory to write a static AgentLens run bundle.	no	""
bundle-sections	Optional dashboard sections for the generated run bundle.	no	summary,scan,tool-calls,workflow,filters,timeline
review-baseline	Optional baseline trace file for a before/after AgentLens review pack.	no	""
review-candidate	Optional candidate trace file for a before/after AgentLens review pack.	no	""
review	Optional directory to write an AgentLens review pack for review-baseline and review-candidate.	no	""
review-sections	Optional dashboard sections for the generated review pack run bundle.	no	summary,scan,tool-calls,workflow,filters,timeline
review-fail-on-failure	Fail the action when the generated review pack reports failing eval or scan gates.	no	false
scan	Run AgentLens security scan after evals.	no	true
scan-fail-on	Lowest scan severity that fails the action.	no	high
sarif	Optional path to write combined SARIF scan results. Requires scan to be true.	no	""

Outputs

name	description
status	PASS when all traces pass evals and scans and at least one trace is found; otherwise FAIL.
total	Number of trace files evaluated.
passed	Number of trace files that passed.
failed	Number of trace files that failed.
bundle	Directory containing the generated run bundle when the bundle input is set.
bundle-manifest	Path to the generated run bundle manifest when the bundle input is set.
review	Directory containing the generated review pack when review inputs are set.
review-pr-comment	Path to the generated review PR comment Markdown when review inputs are set.
review-bundle	Directory containing the generated review run bundle when review inputs are set.
review-bundle-manifest	Path to the generated review run bundle manifest when review inputs are set.
review-manifest	Path to the generated review pack manifest when review inputs are set.
review-status	PASS when the generated review pack passed eval and scan gates; otherwise FAIL.
review-generated-at	ISO timestamp recorded in the generated review manifest.
review-artifact-url	Artifact URL recorded in the generated review manifest when artifact-url is set.
review-sarif-url	SARIF URL recorded in the generated review manifest when sarif-url is set.
review-workflow-chains	Candidate chain event count from the review diff when review inputs are set.
review-workflow-tasks	Candidate task event count from the review diff when review inputs are set.
review-workflow-errors	Candidate workflow error marker count from the review diff when review inputs are set.
review-workflow-chain-delta	Candidate minus baseline chain event delta from the review diff when review inputs are set.
review-workflow-task-delta	Candidate minus baseline task event delta from the review diff when review inputs are set.
review-workflow-error-delta	Candidate minus baseline workflow error marker delta from the review diff when review inputs are set.
review-workflow-regressions	Count of workflow regressions detected from chain, task, and workflow error deltas when review inputs are set.