Run Local LLMs on Any Device. Open-source
AIMET is a library that provides advanced quantization and compression
A set of Docker images for training and serving models in TensorFlow
Library for serving Transformers models on Amazon SageMaker
Library for OCR-related tasks powered by Deep Learning
Standardized Serverless ML Inference Platform on Kubernetes
Superduper: Integrate AI models and machine learning workflows
A unified framework for scalable computing
Neural Network Compression Framework for enhanced OpenVINO
Official inference library for Mistral models
Powering Amazon custom machine learning chips
Unified Model Serving Framework
An MLOps framework to package, deploy, monitor and manage models
The Triton Inference Server provides an optimized cloud
Deep learning optimization library: makes distributed training easy
OpenFieldAI is an AI based Open Field Test Rodent Tracker
OpenMMLab Model Deployment Framework
A computer vision framework to create and deploy apps in minutes
Framework that is dedicated to making neural data processing
Toolkit for allowing inference and serving with MXNet in SageMaker
Deploy a ML inference service on a budget in 10 lines of code