Search Results for "multi threading"

...RoadRunner includes PSR-7/PSR-17 compatible HTTP and HTTP/2 server and can be used to replace classic Nginx+FPM setup with much greater performance and flexibility. RoadRunner can be installed and used in production right away for even the biggest applications under constant load. RoadRunner utilizes goroutines and the multi-threading capabilities of Golang to bring maximum performance to PHP applications. You can download or compile RoadRunner binaries that work on Mac OS, Windows, Linux, FreeBSD, and ARM.

llama.go is like llama.cpp in pure Golang. The code of the project is based on the legendary ggml.cpp framework of Georgi Gerganov written in C++ with the same attitude to performance and elegance. Both models store FP32 weights, so you'll needs at least 32Gb of RAM (not VRAM or GPU RAM) for LLaMA-7B. Double to 64Gb for LLaMA-13B.

...Support custom protocols to quickly and easily build high-performance servers. Support custom protocols to quickly and easily build high-performance servers. High-performance event loop based on epoll and kqueue. Support multi-core and multi-threading. Dynamic expansion of read and write buffers implemented by Ring Buffer. Asynchronous read and write. SO_REUSEPORT port reuse support. Automatically clean up idle connections. Support WebSocket/Protobuf, custom protocols. Support for scheduled tasks and delayed tasks. High-performance web socket server.