The 'llama-recipes' repository is a companion to the Meta Llama models. We support the latest version, Llama 3.1, in this repository. The goal is to provide a scalable library for fine-tuning Meta Llama models, along with some example scripts and notebooks to quickly get started with using the models in a variety of use-cases, including fine-tuning for domain adaptation and building LLM-based applications with Llama and other tools in the LLM ecosystem. The examples here showcase how to run Llama locally, in the cloud, and on-prem.
Features
- Meta Llama 3.1 has a new prompt template and special tokens
- Documentation available
- Get the Meta Llama models
- HF support for inference
- Deferred initialization ( meta init)
- Dataset packing & padding
- Hybrid Sharded Data Parallel (HSDP)
- FSDP checkpoint conversion to HF for inference
License
MIT LicenseFollow Llama Recipes
Other Useful Business Software
Rezku Point of Sale
Rezku is an all-inclusive ordering platform and management solution for all types of restaurant and bar concepts. You can now get a fully custom branded downloadable smartphone ordering app for your restaurant exclusively from Rezku.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Llama Recipes!