Pipeline for training Language Models using PyTorch. Inspired by Yandex Data School NLP Course (week 03: Language Modeling) Prepared text file with space-separated words on each line.

Features

  • Statistical Language Modeling
  • Scripts for training statistical language models
  • Scripts for validation statistical language models using perplexity
  • Scripts for generation new sequences using statistical language models
  • RNN Language Modeling
  • Various implemented models

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow Pipeline for training Language Models

Pipeline for training Language Models Web Site

Other Useful Business Software
Papirfly: Best user-friendly DAM and Content Creation Software Icon
Papirfly: Best user-friendly DAM and Content Creation Software

The #1 solution to create and manage content. On‑brand. At scale.

Papirfly provides a single online destination for all your employees and other stakeholders who are engaging with your brand, ensuring consistency in all aspects of their communications. Teams can produce infinite studio-standard marketing materials from bespoke templates, store, share and adapt them for their own markets and stay firmly educated on the brand’s purpose, guidelines and evolution – with no specialist skills or agency help necessary.
Learn More
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Pipeline for training Language Models!

Additional Project Details

Programming Language

Python

Related Categories

Python AI Text Generators, Python Generative AI

Registered

2023-03-23