Download
State-of-the-art transformers, brick by brick. Curated Transformers is a transformer library for PyTorch. It provides state-of-the-art models that are composed of a set of reusable components. Supports state-of-the-art transformer models, including LLMs such as Falcon, Llama, and Dolly v2. Implementing a feature or bugfix benefits all models. For example, all models support 4/8-bit inference through the bitsandbytes library and each model can use the PyTorch meta device to avoid unnecessary allocations and initialization.
Features
- Each model is composed from a set of reusable building blocks, providing many benefits
- Consistent type annotations of all public APIs
- Integrates well with your existing type-checked code
- Great for education, because the building blocks are easy to study
- Minimal dependencies
- Adding new models to the library is low-effort
Project Samples
License
MIT LicenseFollow Curated Transformers
Other Useful Business Software
The full-stack observability platform that protects your dataLayer, tags and conversion data
Code-Cube.io detects issues instantly, alerts you in real time and helps you resolve them fast.
No manual QA. No unreliable data. Just data you can trust and act on.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Curated Transformers!
