About lakeFS

lakeFS is an open source data version control layer that sits over object storage and lets teams branch, commit, merge and roll back data. It is used by data engineering and ML teams to isolate experiments, test pipelines before production and reproduce datasets. The company, Treeverse, sells a managed cloud and an enterprise edition.

Common use cases

  • Isolated data experiments
  • Pipeline testing before release
  • Reproducing ML training data
  • Data rollback after errors

Products and services

lakeFS Open Source

Data version control over object storage

lakeFS Cloud

Managed service

lakeFS Enterprise

Adds access control, SSO and support

Key features

  • Data branching
  • Commits and rollback
  • Merge hooks
  • Reproducible datasets
  • Object store compatibility
  • Access control

Integrations

  • AWS S3
  • Azure Blob Storage
  • Google Cloud Storage
  • Spark
  • Databricks
  • Airflow
  • Delta Lake
  • Iceberg

lakeFS alternatives

  • DVC
  • Delta Lake
  • Project Nessie
  • Dolt

FAQs

Is it open source?

Yes, the core is open source, with paid managed and enterprise editions.

What storage does it work with?

It works over object storage such as S3, Azure Blob and Google Cloud Storage.

Who uses it?

Data engineering and ML teams that need versioned, reproducible data.

Work at lakeFS? Request updates to this profile. Update this profile