Run Local LLMs on Any Device. Open-source
AIMET is a library that provides advanced quantization and compression
A unified framework for scalable computing
Official inference library for Mistral models
Superduper: Integrate AI models and machine learning workflows
Library for OCR-related tasks powered by Deep Learning
Standardized Serverless ML Inference Platform on Kubernetes
Neural Network Compression Framework for enhanced OpenVINO
Library for serving Transformers models on Amazon SageMaker
A set of Docker images for training and serving models in TensorFlow
The Triton Inference Server provides an optimized cloud
Powering Amazon custom machine learning chips
Easy-to-use deep learning framework with 3 key features
An MLOps framework to package, deploy, monitor and manage models
Unified Model Serving Framework
A GPU-accelerated library containing highly optimized building blocks
Deep learning optimization library: makes distributed training easy
OpenFieldAI is an AI based Open Field Test Rodent Tracker
OpenMMLab Model Deployment Framework
Framework that is dedicated to making neural data processing
A computer vision framework to create and deploy apps in minutes
Guide to deploying deep-learning inference networks
Toolkit for allowing inference and serving with MXNet in SageMaker
Deploy a ML inference service on a budget in 10 lines of code