Mixtral offloading Files

Run Mixtral-8x7B models in Colab or consumer desktops

This is an exact mirror of the Mixtral offloading project, hosted at https://github.com/dvmazur/mixtral-offloading. SourceForge is not affiliated with Mixtral offloading.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
mixtral-offloading source code.tar.gz	2024-01-05	22.5 kB
mixtral-offloading source code.zip	2024-01-05	26.1 kB
Totals: 2 Items		48.6 kB

Other Useful Business Software

Eurekos LMS - Build a Smarter Customer

The Eurekos customer training LMS makes it easy to deliver product training that retains more customers and transforms partners into advocates.

Eurekos is a purpose-built LMS that engages customers throughout the entire learning journey from pre-sales, to onboarding, and everything after.

Learn More

Go beyond a virtual data room with Datasite Diligence

Datasite Diligence, helps dealmakers in more than 170 countries close more deals, faster.

The data room with a view. Evolved for next-generation M&A. Built on decades of deal experience. Packed with expert tools, yet intuitive for novices. A fully mobile platform with frictionless processes. Smart AI tools that let you close more deals, faster, plus end-to-end support at all times. Do due diligence with intelligence.

Learn More

Eurekos LMS - Build a Smarter Customer

The Eurekos customer training LMS makes it easy to deliver product training that retains more customers and transforms partners into advocates.

Eurekos is a purpose-built LMS that engages customers throughout the entire learning journey from pre-sales, to onboarding, and everything after.

Learn More

Recommended Projects

shimmy
Python-free Rust inference server
PowerInfer
High-speed Large Language Model Serving for Local Deployment
llmfit
157 models, 30 providers, one command to find what runs on hardware
KVCache-Factory
Unified KV Cache Compression Methods for Auto-Regressive Models
Punica
Serving multiple LoRA finetuned LLM as one

Mixtral offloading Files

Run Mixtral-8x7B models in Colab or consumer desktops

Get an email when there's a new version of Mixtral offloading