Search Results for "llama-cpp-static"
Sort By:
Showing 380 open source projects for "llama-cpp-static"
View related business solutions-
AestheticsPro Medical Spa SoftwareAestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.
-
Skillfully - The future of skills based hiringSkillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.
-
1
llama.cpp
Port of Facebook's LLaMA model in C/C++
The llama.cpp project enables the inference of Meta's LLaMA model (and other models) in pure C/C++ without requiring a Python runtime. It is designed for efficient and fast model execution, offering easy integration for applications needing LLM-based capabilities. The repository focuses on providing a highly optimized and portable implementation for running large language models directly within C/C++ environments. -
2
Distributed Llama
Connect home devices into a powerful cluster to accelerate LLM
Distributed Llama is an open-source project that enables users to connect multiple home devices into a powerful cluster to accelerate Large Language Model (LLM) inference. By leveraging tensor parallelism and high-speed synchronization over Ethernet, it allows for faster performance as more devices are added to the cluster. The system supports various operating systems, including Linux, macOS, and Windows, and is optimized for both ARM and x86_64 AVX2 CPUs. -
3
cpp-httplib
A C++ header-only HTTP/HTTPS server and client library
...If your program needs to avoid being terminated on SIGPIPE, the only fully general way might be to set up a signal handler for SIGPIPE to handle or ignore it yourself. cpp-httplib officially supports only the latest Visual Studio. It might work with former versions of Visual Studio, but I can no longer verify it. -
4
cpp-ipc
C++ IPC Library: A high-performance inter-process communication
C++ IPC Library: A high-performance inter-process communication using shared memory on Linux/Windows. -
Failed Payment Recovery for Subscription BusinessesFlexPay’s innovative platform uses multiple technologies to achieve the highest number of retained customers, resulting in reduced involuntary churn, longer life span after recovery, and higher revenue. Leading brands like LegalZoom, Hooked on Phonics, and ClinicSense trust FlexPay to recover failed payments, reduce churn, and increase customer lifetime value.
-
5
Cpp-Peglib
A single file C++ header-only PEG (Parsing Expression Grammars)
cpp-peglib is a single-file, header-only C++17 library for Parsing Expression Grammars (PEG). It enables developers to define grammars and build parsers directly within C++ code without external dependencies. -
6
tgbot-cpp
C++ library for Telegram bot API
C++ library for Telegram bot API. -
7
pytorch-cpp
C++ Implementation of PyTorch Tutorials for Everyone
C++ Implementation of PyTorch Tutorials for Everyone. This repository provides tutorial code in C++ for deep learning researchers to learn PyTorch (i.e. Section 1 to 3) Interactive Tutorials are currently running on LibTorch Nightly Version. Libtorch only supports 64bit Windows and an x64 generator needs to be specified. Create all required script module files for pre-learned models/weights during the build. Requires installed python3 with PyTorch and torch-vision. You can choose to only... -
8
restc-cpp C++ library
Modern C++ REST Client library
The magic that takes the pain out of accessing JSON API's from C++. It formulates a HTTP request to a REST API server. Then, it transforms the JSON formatted payload in the reply into a native C++ object (GET). It Serializes a native C++ object or a container of C++ objects into a JSON payload and sends it to the REST API server (POST, PUT). It formulates an HTTP request to the REST API without serializing any data in either direction (typically DELETE). It uploads a stream of data, like a... -
9
Skiplist-CPP
A tiny KV storage based on skiplist written in C++ language
Skiplist-CPP is a lightweight key-value storage engine implemented in C++ using a skip list as its core data structure. It showcases how a log-structured, ordered index can deliver fast inserts, lookups, and deletes while remaining simple to implement and reason about. The project supplies a compact codebase with a clear separation between the skip list implementation and the storage operations that use it. -
MicroStation by Bentley Systems is the trusted computer-aided design (CAD) software built specifically for infrastructure design.MicroStation is the only computer-aided design software for infrastructure design, helping architects and engineers like you bring their vision to life, present their designs to their clients, and deliver their projects to the community.
-
10
RTP-LLM
Alibaba's high-performance LLM inference engine for diverse apps
...The framework is designed for large-scale AI services and is already used internally across several Alibaba platforms such as Taobao, Amap, and other business systems that rely on conversational or search-related AI services. RTP-LLM supports a wide variety of modern model architectures, including Qwen, DeepSeek, and Llama-based models, making it a flexible engine for deploying many different open-source LLMs. -
11
PuerTS
Write your game with TypeScript in UE or Unity
...Facilitates game-building processes by combining JavaScript ecosystem with the rendering power of professional game engines. In contrast to lua script, TypeScript supports static type checking, which significantly improves code robustness and maintainability. High efficiency: supports reflection binding throughout the platform (engine), no extra steps (code generation) needed for development. High performance supports static binding throughout the platform (engine), takes care of complex scenes. -
12
llamafile
Distribute and run LLMs with a single file
...We're doing that by combining llama.cpp with Cosmopolitan Libc into one framework that collapses all the complexity of LLMs down to a single-file executable (called a "llamafile") that runs locally on most computers, with no installation. The easiest way to try it for yourself is to download our example llamafile for the LLaVA model (license: LLaMA 2, OpenAI). LLaVA is a new LLM that can do more than just chat; you can also upload images and ask it questions about them. With llamafile, this all happens locally; no data ever leaves your computer. -
13
GPT4All
Run Local LLMs on Any Device. Open-source
GPT4All is an open-source project that allows users to run large language models (LLMs) locally on their desktops or laptops, eliminating the need for API calls or GPUs. The software provides a simple, user-friendly application that can be downloaded and run on various platforms, including Windows, macOS, and Ubuntu, without requiring specialized hardware. It integrates with the llama.cpp implementation and supports multiple LLMs, allowing users to interact with AI models privately. This... -
14
btop
A monitor of resources
...It supports mouse controls, filters, signal sending (SIGTERM/KILL), theme customization, GPU, battery support, and runs on Linux, macOS, BSD (with specific builds), via static binaries linked with musl. -
15
RedPanda C++
A powerful, lighweight and cross-platform C/C++ IDE
Red Panda C++ is a lightweight yet powerful C/C++/GNU Assembly IDE. It provides users with coding experiences like vs code and CLion, but is much lightweighted than them. Highlights of its new and enhanced feature: * High DPI support * Code intellisense (Code Completion suggestion while editing). * Syntax checking while editing * Greatly improved debugger (local \ call stack \ memory view) * Theme and color scheme. * UTF-8 encoding support * Greatly improved search/replace... -
16
cpp-mate
Helpful library for C++.
The library contains classes that can be useful in addition to STL. -
17
gradle-cpp
Intended to make Gradle C++ working more comfortable.
-
18
VoxelCore
Voxel game engine in C++ with OpenGL
VoxelEngine-Cpp is a minimal voxel engine written in modern C++ using OpenGL, GLFW, and GLM, inspired by Minecraft-style block worlds. It offers a clean foundation for learning and experimenting with voxel-based rendering and world generation. With features like chunk loading, perlin noise terrain generation, and basic lighting, the engine is a perfect starting point for developers who want to create sandbox games or explore the technical aspects of 3D voxel environments. -
19
far2l
Linux port of FAR v2
Linux fork of FAR Manager v2. Works also on OSX/MacOS and BSD (but the latter is not tested on a regular manner). Plug-ins that are currently working: NetRocks (SFTP/SCP/FTP/FTPS/SMB/NFS/WebDAV), colorer, multiarc, tmppanel, align, autowrap, drawing, edit case, SimpleIndent, Calculator, Python (optional scripting support). -
20
Soufflé
Datalog variant for tool designers crafting analyses in Horn clauses
Rapid prototyping for your analysis problems with logic; enabling deep design-space explorations; designed for large-scale static analysis; e.g., points-to analysis for Java, taint-analysis, and security checks. Futamura projections/partial evaluation for effective translation to parallel C++; optimized staged compilation; specialized data-structures for logical relations. Efficient translation to parallel C++ of Datalog programs (CAV'16, CC'16) Efficient interpretation using de-specialization techniques (PLDI'21) Specialized data structure for relations (PACT'19, PPoPP'19, PMAM'19) with optimal index selection (VLDB'18) Extended semantics of Datalog, e.g., permitting unbounded recursions with numbers and terms. ... -
21
Google Highway
Performance-portable, length-agnostic SIMD with runtime dispatch
...Highway enables the same source code to run across different platforms and instruction sets, including architectures with scalable vector lengths, which are not known at compile time. This portability is achieved through dynamic or static dispatch mechanisms that select the best available instruction set at runtime or compile time. The library is designed for developers who need to maximize CPU performance in domains such as image processing, compression, cryptography, and scientific computing. -
22
N64: Recompiled
Tool to statically recompile N64 games into native executables
N64: Recompiled is an open-source recompilation framework designed to translate Nintendo 64 game binaries into modern, portable C code that can be compiled and executed natively on contemporary systems. Instead of relying on traditional emulation, which interprets instructions at runtime, N64Recomp focuses on static recompilation, converting MIPS-based N64 binaries into readable and buildable source code. This approach allows developers to run classic games with improved performance, lower latency, and better integration with modern hardware and operating systems. The framework provides tools for analyzing ROMs, reconstructing program logic, and generating code that preserves the original game’s behavior while enabling modifications and enhancements. ... -
23
JarkViewer
A lightweight, lightning-fast, and powerful image viewer
JarkViewer is a lightweight, lightning‑fast image viewer for Windows 10/11 (64‑bit) that supports a wide range of modern image formats, from traditional JPEG/PNG to newer types such as AVIF, HEIC, JPEG XL, and various RAW files. It is designed as a native portable application with fully static linking, distributed as a single executable with no separate installer, making it simple to run from any folder or removable drive. The viewer handles static images, animated formats (GIF, animated WebP/PNG/APNG/JXL/AVIF), and special “live” photo types such as iOS Live Photos (.livp) and Android Motion Photos/Micro Videos, although audio playback for live photos is not yet supported. ... -
24
Magic Enum C++
Static reflection for enums (to string, from string, iteration)
Static reflection for enums (to string, from string, iteration) for modern C++, work with any enum type without any macro or boilerplate code. magic_enum does not pretend to be a silver bullet for reflection for enums, it was originally designed for small enum. If you are using vcpkg on your project for external dependencies, then you can use the magic-enum package. -
25
Android File Transfer For Linux
Android File Transfer for Linux (and macOS!)
Android File Transfer for Linux — a reliable MTP client with a minimalistic UI similar to Android File Transfer.
