quality-max/QualityMax Test Runner
Run AI-powered E2E tests in your CI/CD pipeline. Zero configuration, instant results.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| api-key | QualityMax API key (get it from app.qualitymax.io/settings/api) | yes | — |
| project-id | QualityMax project ID (optional if project-name provided or repo auto-detected) | no | — |
| project-name | QualityMax project name (alternative to project-id) | no | — |
| test-suite | Test suite to run: all, smoke, regression, or custom | no | all |
| test-ids | Comma-separated list of specific test IDs to run (for custom suite) | no | — |
| base-url | Base URL to test against (overrides project default) | no | — |
| browser | Browser to use: chromium, firefox, or webkit | no | chromium |
| headless | Run tests in headless mode | no | true |
| timeout-minutes | Maximum execution time in minutes | no | 30 |
| fail-on-test-failure | Fail the workflow if any tests fail | no | true |
| post-pr-comment | Post test results as a PR comment | no | true |
| mode | Action mode: run (default) or seed (bootstrap tests via AI discovery) | no | run |
| auto-discover | Auto-discover test scenarios in seed mode | no | true |
| max-seed-tests | Maximum number of tests to generate in seed mode (1-10) | no | 3 |
| seed-descriptions | Newline-separated test descriptions for seed mode (overrides auto-discover) | no | — |
| shard | Matrix shard index (1-based). Use with shards-total to split tests across parallel jobs. Example: shard=2, shards-total=4 runs the second quarter. | no | — |
| shards-total | Total number of shards. Required when shard is set. Ignored otherwise. | no | — |
Outputs
| name | description |
|---|---|
| execution-id | Unique execution ID for this test run |
| status | Final status: passed, failed, cancelled, timeout |
| total-tests | Total number of tests run |
| passed-tests | Number of tests that passed |
| failed-tests | Number of tests that failed |
| duration-seconds | Total execution time in seconds |
| report-url | URL to the full test report |
| summary-markdown | Pre-formatted markdown summary for PR comments |
| tests-created | Number of tests created in seed mode |
| tests-skipped | Number of tests skipped in seed mode (already existed) |
| seed-message | Summary message from seed operation |