culturecreates/Custom Artsdata Pipeline Action
A custom action for the Artsdata pipeline
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| mode | Mode of the action(fetch/push/fetch-push) | yes | push |
| page-url | URLs of the page to crawl | — | — |
| entity-identifier | Identifiers of the entity to fetch | — | — |
| downloadFile | Name of the file to download with extension | — | — |
| downloadUrl | URL of the file to download | — | — |
| is-paginated | Whether the page is paginated | — | false |
| headless | Whether to run in headless mode | — | false |
| artifact | Name of the artifact | — | — |
| token | GitHub token | — | — |
| publisher | URI of the publisher | — | — |
| comment | Comment | — | — |
| group | Group of artifacts/versions. Typically the name of the tool creating the artifact. Use unreserved characters. | — | — |
| version | Version of the artifact. Usually a date. For example: 2020-10-23. Use unreserved characters. | — | — |
| report-callback-url | URL to send back the data validation report asynchronously using POST "Content-Type: application/json" | — | — |
| shacl | URL to the SHACL file | — | — |
| fetch-urls-headlessly | Set as true to fetch the entity URLs headlessly | — | — |
| offset | Offset for paginated pages | — | — |
| custom-user-agent | Custom user agent string | — | — |
| custom-databus-url | Custom Databus URL | — | http://api.artsdata.ca/databus/ |
| html-extract-config | Custom HTML configuration as JSON | — | — |
| metadata-config | metadata for spider as JSON | — | — |
| register-only | If true, upload to databus in register-only mode | — | false |
| cloudflare-private-key | Ed25519 private key for Cloudflare signing (PEM format content) | no | — |
Outputs
no outputs