dr-gareth-roberts/insideLLMs PR Diff

Run harness on base/head refs, diff deterministic outputs, and comment on pull requests.

Trust Signals

name	description	required	default
harness-config	Harness config path relative to repository root.	no	ci/harness.yaml
baseline-ref	Git ref to compare against (defaults to pull request base ref or main).	no	""
python-version	Python version for the action runtime.	no	3.11
install-extras	Optional extras to install (for example: dev,nlp,visualization).	no	""
run-args	Extra arguments forwarded to each `insidellms harness` invocation.	no	""
diff-args	Extra arguments forwarded to `insidellms diff`.	no	""
fail-on-changes	When true, include --fail-on-changes and fail the action on behavior drift.	no	true
post-pr-comment	When true on pull_request events, post or update a sticky diff comment.	no	true
comment-on-forks	When true, attempt PR comments for forked pull_requests (requires token permission).	no	false
github-token	Token used for pull request comments. Defaults to github.token.	no	""

name	description
diff-json	Path to generated diff report JSON.
baseline-run-dir	Path to generated baseline run directory.
candidate-run-dir	Path to generated candidate run directory.
diff-exit-code	Exit code returned by `insidellms diff`.
baseline-commit	Resolved baseline commit used for base-vs-head comparison.
is-fork-pr	Whether the event pull_request head is from a fork.
comment-status	PR comment status (created, updated, skipped-fork, skipped-permissions, etc).