LLaMA-MoE Files

Building Mixture-of-Experts from LLaMA with Continual Pre-training

This is an exact mirror of the LLaMA-MoE project, hosted at https://github.com/pjlab-sys4nlp/llama-moe. SourceForge is not affiliated with LLaMA-MoE.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size	InfoDownloads / Week
v1.0.0-publish	2023-12-25		0
v0.3.2-cpt	2023-11-22		0
v0.3.1-cpt-dynamic_batch_loading	2023-11-17		0
v0.2.1-cpt-13b	2023-10-07		0
Totals: 4 Items			0

Other Useful Business Software

AestheticsPro Medical Spa Software

Our new software release will dramatically improve your medspa business performance while enhancing the customer experience

AestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.

Learn More

Outbound sales software

Unified cloud-based platform for dialing, emailing, appointment scheduling, lead management and much more.

Adversus is an outbound dialing solution that helps you streamline your call strategies, automate manual processes, and provide valuable insights to improve your outbound workflows and efficiency.

Learn More

AestheticsPro Medical Spa Software

Our new software release will dramatically improve your medspa business performance while enhancing the customer experience

Learn More

Recommended Projects

LLaMA-Factory
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
Llama 2 Everywhere (L2E)
Llama 2 Everywhere (L2E)
LLaMA 3
The official Meta Llama 3 GitHub site
DeepSeek-V3
Powerful AI language model (MoE) optimized for efficiency/performance
DeepSeek R1
Open-source, high-performance AI model with advanced reasoning

LLaMA-MoE Files

Building Mixture-of-Experts from LLaMA with Continual Pre-training

Get an email when there's a new version of LLaMA-MoE