High-performance neural network inference framework for mobile
LLM.swift is a simple and readable library
Run Local LLMs on Any Device. Open-source
C++ library for high performance inference on NVIDIA GPUs
The Triton Inference Server provides an optimized cloud
Standardized Serverless ML Inference Platform on Kubernetes
A unified framework for scalable computing
Unified Model Serving Framework
An MLOps framework to package, deploy, monitor and manage models
A computer vision framework to create and deploy apps in minutes
Deep learning inference framework optimized for mobile platforms
Uniform deep learning inference framework for mobile
Deploy a ML inference service on a budget in 10 lines of code