rasahq/Rasa NLU Evaluation Results Comparison
A GitHub action to compare Rasa NLU Evaluation results
View on GitHubTrust Signals
- Scorecard Score
- not yet scored
- Maintenance Recency
- Stale
- License
- None
Inputs
| name | description | required | default |
|---|---|---|---|
| nlu_result_files | The json report files that should be compared and the labels to associate with each of them. The report from which diffs should be calculated should be listed first. All results must be of the same type (e.g. intent classification, entity extraction). Labels for files should be unique.For example: `intent_report.json=1 second_intent_report.json=2`. Do not put spaces before or after the = sign. Label values with spaces should be put in double quotes. For example: `previous_results/DIETClassifier_report.json="Previous Stable Results" current_results/DIETClassifier_report.json="New Results"` | yes | — |
| json_outfile | File to which to write combined json report (contents of all result files). | no | combined_results.json |
| html_outfile | File to which to write HTML table. File will be overwritten unless `append_table` is specified. | no | formatted_compared_results.html |
| table_title | Title of HTML table. | no | — |
| label_name | Type of labels predicted in the provided NLU result files e.g. 'intent', 'entity', 'retrieval intent'. | no | — |
| metrics_to_diff | Metrics to consider when determining changes across result sets. | no | — |
| metrics_to_display | Metrics to display in resulting HTML table. | no | — |
| metric_to_sort_by | Metrics to sort by (descending) in resulting HTML table. | no | — |
| display_only_diff | Display only labels with a change in at least one metric from the first listed result set. Default is false. | no | — |
| append_table | Whether to append the comparison table to the html output file, instead of overwriting it. If `true` not specified, html_outfile will be overwritten. | no | — |
| style_table | Whether to add CSS style tags to the html table to highlight changed values. Not compatible with Github Markdown format. Set to `true` to use. | no | — |
Outputs
no outputs