janibert1/robots-check
Fail a CI run if your live robots.txt is fully disallowing every crawler (or, optionally, whenever Cloudflare has silently modified it) — catches an accidental site-wide crawl block or an unexpected CDN-side robots.txt rewrite before it costs you real search visibility.
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| domain | Domain to check (e.g. example.com) — checks what is actually served at https://<domain>/robots.txt, not a local file. | yes | — |
| fail-on-cloudflare-managed | Also fail the run whenever Cloudflare has injected its own managed block into robots.txt, not just on a full site-wide block. | no | false |
Outputs
no outputs