Download
A minimal implementation of diffusion models of text: learns a diffusion model of a given text corpus, allowing to generate text samples from the learned model. The main idea was to retain just enough code to allow training a simple diffusion model and generating samples, remove image-related terms, and make it easier to use. To train a model, run scripts/train.sh. By default, this will train a model on the simple corpus. However, you can change this to any text file using the --train_data argument. Note that you may have to increase the sequence length (--seq_len) if your corpus is longer than the simple corpus. The other default arguments are set to match the best setting I found for the simple corpus.
Features
- Training from scratch on the greetings dataset
- Experiments with using pre-trained models and embeddings
- Controllable Generation
- A minimal implementation of diffusion models of text
- Generate text samples from the learned model
- Opportunities for further minimization
Project Samples
License
MIT LicenseFollow Minimal text diffusion
Other Useful Business Software
Skillfully - The future of skills based hiring
Skillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Minimal text diffusion!
