jeondaehong/lake-sift data diff

Diff two datasets (Parquet / Iceberg / Delta) at the cell level and gate a PR or pipeline on the result.

View on GitHub

Trust Signals

Scorecard Score
not yet scored
Maintenance Recency
Stale
License
None
namedescriptionrequireddefault
leftBase (before) source — Parquet path, iceberg:<catalog>/<ns>.<table>[@<snap|ref>], or delta:<path>[@<ver>].yes
rightCompared (after) source — same forms as `left`.yes
keyRow identity key (comma-separated column names).yes
columnsCompare only these columns (comma-separated).no""
excludeColumns to exclude from comparison (comma-separated).no""
toleranceNumeric tolerance — cells are equal when abs(l - r) <= tolerance.no""
ignore-caseCase-insensitive comparison for text columns.nofalse
allow-duplicatesAllow duplicate keys instead of erroring.nofalse
sampleMax rows to show per change kind in the report.no""
extraslake-sift extras to install for the source formats used, e.g. 'iceberg', 'delta', or 'iceberg,delta'. Empty installs Parquet-only.no""
versionlake-sift version to install (a PyPI version specifier). Defaults to the latest release.no""
fail-on-diffFail the step (non-zero exit) when differences are found. A comparison error always fails.notrue
commentPost/update a sticky comment with the diff report on the pull request (requires pull-requests: write and a PR context).nofalse
namedescription
diff'true' when differences were found, 'false' when the datasets are identical.
exit-codeThe lake-sift exit code (0 identical, 1 differences, 2 error).
reportPath to the Markdown report file.