A Pythonic framework to simplify AI service building
A general-purpose probabilistic programming system
GPU environment management and cluster orchestration
LLM training code for MosaicML foundation models
Port of OpenAI's Whisper model in C/C++
Bring the notion of Model-as-a-Service to life
A unified framework for scalable computing
Ready-to-use OCR with 80+ supported languages
Protect and discover secrets using Gitleaks
Open-Source AI Camera. Empower any camera/CCTV
Powering Amazon custom machine learning chips
Fast inference engine for Transformer models
A library for accelerating Transformer models on NVIDIA GPUs
State-of-the-art diffusion models for image and audio generation
PyTorch library of curated Transformer models and their components
Library for OCR-related tasks powered by Deep Learning
Replace OpenAI GPT with another LLM in your app
Trainable, memory-efficient, and GPU-friendly PyTorch reproduction
Serving system for machine learning models
Library for serving Transformers models on Amazon SageMaker
MNN is a blazing fast, lightweight deep learning framework
A high-performance ML model serving framework, offers dynamic batching
Unified Model Serving Framework
Deep Learning API and Server in C++14 support for Caffe, PyTorch
Lightweight Python library for adding real-time multi-object tracking