Bolt is a high-performance deep learning inference framework developed by Huawei Noah's Ark Lab. It is designed to optimize and accelerate the deployment of deep learning models across various hardware platforms. Bolt is a light-weight library for deep learning. Bolt, as a universal deployment tool for all kinds of neural networks, aims to automate the deployment pipeline and achieve extreme acceleration. Bolt has been widely deployed and used in many departments of HUAWEI company, such as 2012 Laboratory, CBG and HUAWEI Product Lines. If you have questions or suggestions, you can submit issue.

Features

  • Supports multiple hardware architectures, including CPUs, GPUs, and NPUs
  • Provides optimized operators for efficient computation
  • Offers model quantization for reduced memory usage and faster inference
  • Includes a model conversion tool for compatibility with various frameworks
  • Supports dynamic shape inference for flexible input sizes
  • Open-source with a focus on performance optimization

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow Bolt NLP

Bolt NLP Web Site

Other Useful Business Software
PairSoft | AP Automation and Doc Management Icon
PairSoft | AP Automation and Doc Management

Free your team from manual processes.

Streamline operations and elevate your team's efficiency with PairSoft. Our AP automation, procurement, and document management solutions eliminate manual processes, cut costs, and free your team to focus on strategic initiatives. Experience our state-of-the-art invoice-to-pay solution, now integrated with advanced AI technology for faster, smarter results. Our customers report a significant 70% reduction in approval times and annual savings of $62,000 in employee hours. At PairSoft, we aim to transform your business operations through automation. Explore the future of automation at pairsoft.com, where you can leverage cutting-edge features like invoice capture, OCR, and comprehensive AP automation to transform your workflow. Whether you are a small business or a large enterprise, our solutions are designed to scale with your needs, providing robust functionality and ease of use. Join the growing number of businesses that trust PairSoft.
Learn More
Rate This Project
Login To Rate This Project

User Reviews

Be the first to post a review of Bolt NLP!

Additional Project Details

Operating Systems

Linux, Mac, Windows

Programming Language

C++

Related Categories

C++ Natural Language Processing (NLP) Tool, C++ LLM Inference Tool

Registered

2025-01-30