fractalyze/ZK Benchmark
Run benchmarks, detect regressions, and report results
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Activelast commit Jun 29, 2026
- License
- Apache 2.0
Pinned Snippet
uses: fractalyze/benchmark-action@01b8a1e990471732d0dab25af13a14d52e697a85 # v10tags can be moved; commit SHAs can't. why a SHA?
Inputs
| name | description | required | default |
|---|---|---|---|
| benchmark_cmd | Command to run the benchmark (must output JSON to benchmark_results.json) | yes | — |
| device | Device type (cpu or gpu) | yes | — |
| regression_threshold | Percentage threshold fallback when stdev is unavailable (e.g., 0.10 for 10%) | no | 0.10 |
| zscore_threshold | Z-score threshold for regression detection (e.g., 3.0) | no | 3.0 |
| baseline_path | Path to baseline JSON file for regression detection | no | benchmark_data/baseline.json |
| results_file | Path to output benchmark results JSON | no | benchmark_results.json |
| slack_webhook | Slack webhook URL for regression alerts (fallback if no bot token) | no | "" |
| slack_bot_token | Slack Bot Token (xoxb-...) for thread replies. Preferred over slack_webhook. | no | "" |
| slack_channel_id | Slack channel ID for bot messages (e.g., C0123456789) | no | "" |
| store_results | Whether to store results (true on main branch) | no | false |
| results_dir | Directory to store historical results | no | benchmark_data |
| cpu_load_threshold | CPU load threshold (0-1) above which to emit warning | no | 0.80 |
| memory_threshold | Memory usage threshold (0-1) above which to emit warning | no | 0.80 |
| rolling_window | Number of historical results to average for baseline | no | 10 |
| anthropic_api_key | Anthropic API key for Claude AI analysis | no | "" |
| ai_model | Claude model to use for analysis | no | claude-opus-4-5-20251101 |
| dashboard_token | GitHub token for triggering dashboard updates | no | "" |
| dashboard_repo | Dashboard repository (owner/repo) | no | fractalyze/benchmark-dashboard |
| repo | Source repository name for commit links (e.g., zkx). Defaults to GITHUB_REPOSITORY tail. | no | "" |
Outputs
| name | description |
|---|---|
| has_significant_change | Whether a significant change (regression or improvement) was detected |
| change_type | Type of change detected (regression, improvement, mixed, or empty) |
| results_file | Path to benchmark results JSON |
| cpu_load | Normalized CPU load (0-1) |
| memory_usage | Memory usage ratio (0-1) |