poemai-ch/Test poemai Bot
Automated testing for poemai chatbots with comprehensive scenario execution and reporting
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| config-file | Path to the test scenarios configuration YAML file | yes | — |
| role-to-assume | ARN of the AWS IAM role to assume | yes | — |
| aws-region | AWS region | no | eu-central-2 |
| python-version | Python version to use | no | 3.12 |
| openai-api-key | OpenAI API key for AI-powered test evaluation | yes | — |
| publish-s3-url | S3 URL to publish the HTML test report (e.g., s3://bucket/path/report.html) | no | "" |
| results-dir | Directory to save test results | no | . |
Outputs
| name | description |
|---|---|
| test-results-file | Path to the generated test results JSON file |
| report-url | URL of the published HTML report (if S3 publishing is enabled) |
| tests-passed | Number of tests that passed |
| tests-failed | Number of tests that failed |
| tests-skipped | Number of tests that were skipped |