Run Local LLMs on Any Device. Open-source
AIMET is a library that provides advanced quantization and compression
Unified Model Serving Framework
Library for serving Transformers models on Amazon SageMaker
Official inference library for Mistral models
Library for OCR-related tasks powered by Deep Learning
A unified framework for scalable computing
Deep learning optimization library: makes distributed training easy
Toolkit for allowing inference and serving with MXNet in SageMaker