Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, ChatGLM2)

Features

  • Python 3.8+ and PyTorch 1.13.1+
  • Transformers, Datasets, Accelerate, PEFT and TRL
  • jieba, rouge-chinese and nltk (used at evaluation)
  • gradio and matplotlib (used in web_demo.py)
  • uvicorn, fastapi and sse-starlette (used in api_demo.py)
  • Currently the web UI only supports training on a single GPU

Project Samples

Project Activity

See All Activity >

License

Apache License V2.0

Follow LLaMA Efficient Tuning

LLaMA Efficient Tuning Web Site

Other Useful Business Software
Raima Database Manager is an embedded in-memory database for IoT and Edge devices Icon
Raima Database Manager is an embedded in-memory database for IoT and Edge devices

Built by Developers, for Developers

Raima Database Manager (RDM) is an embedded relational database optimized to run on resource-constrained IoT edge devices that require real-time response. RDM enables intelligent decisions to be made at the device level within microseconds.
Learn More
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of LLaMA Efficient Tuning!

Additional Project Details

Programming Language

Python

Related Categories

Python Large Language Models (LLM)

Registered

2023-08-21