DataPelago
Universal data processing engine for analytics and AI
About DataPelago
DataPelago builds a processing engine that accelerates data workloads across CPUs, GPUs and other hardware, aimed at big data, analytics and AI pipelines. It announced the engine publicly in 2024 and raised venture funding.
Common use cases
- Accelerating Spark jobs
- Data prep for AI
- Large-scale SQL analytics
Products and services
DataPelago Nucleus
Universal data processing engine that accelerates analytics and AI workloads.
Key features
- Hardware-accelerated processing
- Spark and SQL acceleration
- GPU and CPU support
- Lower compute cost
- Data pipeline speedups
- Runs alongside existing engines
Integrations
- Apache Spark
- Trino
- Velox
- Databricks
- Snowflake
DataPelago alternatives
- DPDatabricks Photon
StarburstTrino-based data lakehouse and federated query platform
- VDVoltron Data
- NRNVIDIA RAPIDS
FAQs
What does it do?
It accelerates data processing workloads using a universal engine across hardware.
Does it replace my engine?
It is designed to work with existing engines such as Spark.
Who is it for?
Enterprises with large analytics and AI data workloads.
Work at DataPelago? Request updates to this profile. Update this profile
Compare with similar providers
All Data Infrastructure providers
AerospikeReal-time NoSQL database built for low-latency, high-throughput workloadsAkamaiCloud, edge and security platform with compute and storage services
AkaveS3-compatible object storage for GPU clouds and AI data
Amazon Web ServicesCloud platform with compute, storage, database and analytics servicesAnyLogDecentralized edge data network
AtomBeamAI-based data compression that cuts bandwidth and storage
BackblazeLow-cost cloud object storage and backup
BeamrVideo compression and optimization for media and machine learning workflows