Structured outputs for llms
Python bindings for llama.cpp
Build AI WhatsApp Bots with Pure Python
Universal LLM Deployment Engine with ML Compilation
An LLM Compiler for Parallel Function Calling
A Simple and Universal Swarm Intelligence Engine
Run Local LLMs on Any Device. Open-source
Emscripten: An LLVM-to-WebAssembly Compiler
Port of Facebook's LLaMA model in C/C++
A high-throughput and memory-efficient inference and serving engine
Low-code app builder for RAG and multi-agent AI applications
Interact with your documents using the power of GPT
Powerful AI language model (MoE) optimized for efficiency/performance
Agentic, Reasoning, and Coding (ARC) foundation models
Operating LLMs in production
Access large language models from the command-line
Easy-to-use LLM fine-tuning framework (LLaMA-2, BLOOM, Falcon
A Gym environment for web task automation
lightweight package to simplify LLM API calls
Language-model investigation agent with a terminal UI
Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)
A modular graph-based Retrieval-Augmented Generation (RAG) system
Uncertainty Quantification for Language Models, is a Python package
PandasAI is a Python library that integrates generative AI
Synthetic data curation for post-training and data extraction