volter-ai/Runhuman Issue Tester

Test linked GitHub Issues when PRs are merged using AI-powered human QA testing

View on GitHub

Trust Signals

Scorecard Score
not yet scored
Maintenance Recency
Stale
License
None
namedescriptionrequireddefault
issue-numberSpecific issue number(s) to test, comma-separated (e.g., "123" or "123, 456, 789"). Bypasses filter and auto-detection.no
issue-filterFilter query for dynamic issue selection (e.g., "state:open stale:30d unassigned"). See README for syntax.no
max-issuesMaximum issues to process when using filter mode (default: 10)no10
test-urlManual test URL (overrides AI-detected URL from issue)no
api-keyRunhuman API key (starts with qa_live_). Store as secret!yes
github-tokenGitHub token for API access (defaults to GITHUB_TOKEN)no${{ github.token }}
api-urlRunhuman API base URLnohttps://runhuman.com
qa-labelLabel that marks issues for QA testingnoqa-test
auto-detectUse AI to detect testable issues without qa-label (labeled issues are always tested)notrue
target-duration-minutesTarget test duration in minutes (1-60)no5
on-not-testableActions when issue is not testable. DSL: close, open, add-label:x, remove-label:x, commentno""
on-successActions when test passes. DSL: close, open, add-label:x, remove-label:x, commentno""
on-failureActions when test fails. DSL: close, open, add-label:x, remove-label:x, commentno""
issue-patternCustom regex pattern to detect issue numbers in commit messages (must have a capture group for the issue number)no
test-mergesTest merge commits that have no linked issues (requires test-url)notrue
auto-mode-only-missing-mediaOnly test issues missing reproduction media (screenshots/videos). AI analyzes issue + comments.nofalse
screen-sizeScreen size for testing. Use preset (desktop, laptop, tablet, mobile) or custom JSON {"width": 1920, "height": 1080}nodesktop
namedescription
tested-issuesJSON array of tested issue numbers
passed-issuesJSON array of issue numbers that passed
failed-issuesJSON array of issue numbers that failed
skipped-issuesJSON array of issue numbers skipped (no URL or not testable)
total-cost-usdTotal cost of all tests in USD
resultsFull results object as JSON