Download
Lorax is a multi-LoRA (Low-Rank Adaptation) inference server that scales to thousands of fine-tuned Large Language Models (LLMs). It enables efficient deployment and management of numerous fine-tuned models, facilitating scalable AI applications. Lorax is designed to handle high concurrency and provides a robust infrastructure for serving multiple LLMs simultaneously.
Features
- Multi-LoRA inference server
- Scales to thousands of fine-tuned LLMs
- Efficient deployment of multiple models
Project Samples
Categories
LLM InferenceLicense
Apache License V2.0Follow LoRAX
Other Useful Business Software
Outbound sales software
Adversus is an outbound dialing solution that helps you streamline your call strategies, automate manual processes, and provide valuable insights to improve your outbound workflows and efficiency.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of LoRAX!
