The official Python client for the Huggingface Hub
A high-throughput and memory-efficient inference and serving engine
Ready-to-use OCR with 80+ supported languages
Run Local LLMs on Any Device. Open-source
Lightweight Python library for adding real-time multi-object tracking
Phi-3.5 for Mac: Locally-run Vision and Language Models
A unified framework for scalable computing
Library for OCR-related tasks powered by Deep Learning
FlashInfer: Kernel Library for LLM Serving
Large Language Model Text Generation Inference
Single-cell analysis in Python
Operating LLMs in production
LMDeploy is a toolkit for compressing, deploying, and serving LLMs
Everything you need to build state-of-the-art foundation models
Uncover insights, surface problems, monitor, and fine tune your LLM
Data manipulation and transformation for audio signal processing
Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs
State-of-the-art Parameter-Efficient Fine-Tuning
Trainable models and NN optimization tools
A library for accelerating Transformer models on NVIDIA GPUs
Efficient few-shot learning with Sentence Transformers
Multilingual Automatic Speech Recognition with word-level timestamps
The Triton Inference Server provides an optimized cloud
Libraries for applying sparsification recipes to neural networks
Gaussian processes in TensorFlow