yawlabs/MCP Compliance Test
Run the MCP compliance suite against an MCP server (HTTP URL or stdio command) in CI. Emits PR annotations and SARIF for code-scanning.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| target | MCP server URL (e.g. https://my-server.com/mcp) OR stdio command (e.g. "node ./dist/server.js" or "npx -y @modelcontextprotocol/server-filesystem /tmp"). Stdio commands run after a `--` separator handled internally. | yes | — |
| version | mcp-compliance npm version to use (default: latest) | no | latest |
| format | Output format: terminal, json, sarif, github, markdown | no | github |
| strict | Exit non-zero on any required-test failure | no | true |
| min-grade | Exit non-zero if grade is below this threshold (A, B, C, D, F) | no | — |
| output | Write a local SVG badge to this path (e.g. badge.svg) | no | — |
| auth | Authorization header value, e.g. "Bearer xxx" (HTTP only) | no | — |
| env-file | Path to .env file with KEY=VALUE pairs for stdio command | no | — |
| timeout | Per-request timeout in milliseconds | no | 30000 |
| only | Comma-separated categories or test IDs to run exclusively | no | — |
| skip | Comma-separated categories or test IDs to skip | no | — |
| upload-sarif | Also produce a sarif file at compliance.sarif (use with upload-sarif action for Code Scanning) | no | false |
Outputs
| name | description |
|---|---|
| grade | Final grade (A-F) |
| score | Numeric score 0-100 |
| passed | Number of passing tests |
| failed | Number of failing tests |