Search Results for "load testing"

Drill is an HTTP load-testing application written in Rust. The main goal for this project is to build a really lightweight tool as an alternative to other that require JVM and other stuff. You can write benchmark files, in YAML format, describing all the stuff you want to test. It was inspired by Ansible syntax because it is really easy to use and extend.

Paddler is an open-source LLM infrastructure platform designed to deploy, manage, and scale large language models on private infrastructure. The system acts as a specialized load balancer and serving layer for language models, enabling organizations to run inference workloads without relying on external API providers. It supports running models locally through engines such as llama.cpp while distributing requests across multiple compute nodes to improve performance and reliability. The...

...Written in Rust, Winrk leverages native multithreading and asynchronous networking to generate a high number of requests per second with minimal overhead. It is easy to use, fast to deploy, and built with stability and precision in mind. Whether you're testing local services or public APIs, Winrk helps you analyze performance, latency, and throughput under load, right from the Windows command line. Source code: https://github.com/fomalhaut88/winrk

tarpc is an asynchronous RPC framework for Rust that embraces Rust’s type system and futures to generate ergonomic client and server stubs. Services are declared in pure Rust, and procedural macros expand those definitions into request/response types, trait implementations, and strongly typed stubs. The framework is transport-agnostic: it commonly uses Tokio with serde-based codecs, but you can plug in your own framing and serialization. It bakes in RPC concerns such as deadlines,...