This is a Pytorch implementation of Reformer. It includes LSH attention, reversible network, and chunking. It has been validated with an auto-regressive task (enwik8).
Features
- Positional Embeddings
- Masking
- Documentation available
- Examples available
- Reformer Encoder Decoder Architecture
- Product Key Memory
- Customize Feedforward
- Helpers for training auto-regressive models
Categories
Machine LearningLicense
MIT LicenseFollow Reformer PyTorch
Other Useful Business Software
AestheticsPro Medical Spa Software
AestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.
Rate This Project
Login To Rate This Project
User Reviews
Be the first to post a review of Reformer PyTorch!