minbpe Files

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm

This is an exact mirror of the minbpe project, hosted at https://github.com/karpathy/minbpe. SourceForge is not affiliated with minbpe.

The interactive file manager requires Javascript. Please enable it or use sftp or scp.
You may still browse the files here.

Name	Modified	Size
minbpe source code.tar.gz	2024-04-22	299.0 kB
minbpe source code.zip	2024-04-22	302.8 kB
Totals: 2 Items		601.8 kB

Other Useful Business Software

Polygon Software | Apparel Software | PLM and ERP Solutions

Small to mid-sized sewn goods manufacturers and textile mills.

PolyPM is an integrated enterprise resource planning (ERP) and product lifecycle management (PLM) solution developed by Polygon Software. Built for small to medium-sized apparel manufacturers, PolyPM enables businesses to integrate all aspects of the product development, supply chain and production processes, as well as instantly access all their style and manufacturing information anywhere in the world. This allows businesses to shorten time-to-market, incur lower development costs, and improve customer service and worker productivity.

Learn More

Complete Data Management for Nonprofits

Designed to fit with multi-level non-profit organization, across any sector

NewOrg is a robust platform built with enhanced features to help non-profit organizations that capture and integrate the information from all of their operational areas to better manage volunteers, clients, programs, outcome reporting, activity sign-ups & scheduling, communications, surveys, fundraising activities and Development campaigns. NewOrg can truly deliver an intuitive product that will help manage your Committees, Donors, Events, and Memberships so that the organization runs efficiently.

Learn More

Polygon Software | Apparel Software | PLM and ERP Solutions

Small to mid-sized sewn goods manufacturers and textile mills.

Learn More

Recommended Projects

Tiktoken
tiktoken is a fast BPE tokeniser for use with OpenAI's models
SentencePiece
Unsupervised text tokenizer for Neural Network-based text generation
Byte Buddy
Runtime code generation for the Java virtual machine
UnsupervisedMT
Phrase-Based & Neural Unsupervised Machine Translation
LLMs-from-scratch
Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

minbpe Files

Minimal, clean code for the Byte Pair Encoding (BPE) algorithm

Get an email when there's a new version of minbpe