Search Results for "decoder"
Sort By:
Showing 1 open source project for "decoder"
View related business solutions-
OpenMetal is an automated bare metal and on-demand private cloud provider.OpenMetal is an automated bare metal and on-demand private cloud provider. Our mission is to empower your team with cost effective private infrastructure that outperforms traditional public cloud.
-
A privacy-first API that predicts global consumer preferencesThrough our API, we provide contextualized personalization and insights based on a deep understanding of consumer behavior and more than 575 million people, places, and things.
-
1
Basaran
Basaran, an open-source alternative to the OpenAI text completion API
...The open source community will eventually witness the Stable Diffusion moment for large language models (LLMs), and Basaran allows you to replace OpenAI's service with the latest open-source model to power your application without modifying a single line of code. Stream generation using various decoding strategies. Support both decoder-only and encoder-decoder models. Detokenizer that handles surrogates and whitespace. Multi-GPU support with optional 8-bit quantization. Real-time partial progress using server-sent events. Compatible with OpenAI API and client libraries. Comes with a fancy web-based playground. Docker images are available on Docker Hub and GitHub Packages.
- Previous
- You're on page 1
- Next
