Download
Daft is a framework for ETL, analytics and ML/AI at scale. Its familiar Python Dataframe API is built to outperform Spark in performance and ease of use. Daft plugs directly into your ML/AI stack through efficient zero-copy integrations with essential Python libraries such as Pytorch and Ray. It also allows requesting GPUs as a resource for running models. Daft runs locally with a lightweight multithreaded backend. When your local machine is no longer sufficient, it scales seamlessly to run out-of-core on a distributed cluster. Underneath its Python API, Daft is built in blazing fast Rust code. Rust powers Daft’s vectorized execution and async I/O, allowing Daft to outperform frameworks such as Spark.
Features
- Integrate with ML/AI libraries
- Go Distributed and Out-of-Core
- Execute Complex Operations
- Native Support for Cloud Storage
- Deliver Unmatched Speed
- Documentation available
Project Samples
Categories
Machine LearningLicense
Apache License V2.0Follow Daft
Other Useful Business Software
Data management solutions for confident marketing
Verify, deduplicate, manipulate, and assign records automatically to keep your CRM data accurate, complete, and ready for business.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Daft!
