Access large language models from the command-line
Non-Pydantic, Non-JSON Schema, efficient AutoPrompting
Official inference library for Mistral models
Library for OCR-related tasks powered by Deep Learning
AIMET is a library that provides advanced quantization and compression
The official Python Library for the Groq API
Library for serving Transformers models on Amazon SageMaker
A JAX-native LLM Post-Training Library
OpenMMLab Model Deployment Framework
Training and serving large-scale neural networks