Data Governance

Datafold

Data diffing and testing for pipeline changes and migrations

About Datafold

Datafold provides tooling that compares data before and after code changes so analytics engineers can catch regressions in CI. It also offers automated support for migrating data warehouses.

Common use cases

  • Regression testing in dbt
  • Warehouse migration
  • Data quality monitoring
  • Impact analysis

Products and services

Data Diff

Compares datasets across environments to show the effect of code changes.

CI/CD integration

Runs data checks on pull requests for dbt and SQL pipelines.

Migration Agent

Automates translation and validation for warehouse migrations.

Key features

  • Value-level data diffing
  • Pull request data checks
  • Column-level lineage
  • Migration validation
  • Data monitoring

Integrations

  • dbt
  • Snowflake
  • Databricks
  • BigQuery
  • GitHub
  • GitLab

Datafold alternatives

FAQs

Where does it fit in a workflow?

It runs in CI on code changes and compares affected tables before deployment.

Which warehouses does it support?

It connects to common cloud warehouses and lakehouses such as Snowflake, Databricks and BigQuery.

Does it help with migrations?

Yes, it offers validation and automation features for moving between data platforms.

Work at Datafold? Request updates to this profile. Update this profile