Search Results for "llama-cpp-static"
Sort By:
Showing 29 open source projects for "llama-cpp-static"
View related business solutions-
1
node-llama-cpp
Run AI models locally on your machine with node.js bindings for llama
node-llama-cpp is a JavaScript and Node.js binding that allows developers to run large language models locally using the high-performance inference engine provided by llama.cpp. The library enables applications built with Node.js to interact directly with local LLM models without requiring a remote API or external service. By using native bindings and optimized model execution, the framework allows developers to integrate advanced language model capabilities into desktop applications, server software, and command-line tools. ... -
2
Llama Coder
Open source Claude Artifacts – built with Llama 3.1 405B
Llama Coder is an open-source tool that lets you generate small applications (often React or web apps) from a single natural-language prompt using the Llama 3 family of models. It’s framed as an open-source “Claude Artifacts”-style experience: you describe the app you want, the tool calls an LLM hosted on Together.ai, and you get back a runnable code artifact. -
3
Secret Llama
Fully private LLM chatbot that runs entirely with a browser
Secret Llama is a privacy-first large-language-model chatbot that runs entirely inside your web browser, meaning no server is required and your conversation data never leaves your device. It focuses on open-source model support, letting you load families like Llama and Mistral directly in the client for fully local inference. Because everything happens in-browser, it can work offline once models are cached, which is helpful for air-gapped environments or travel. -
4
llama.vscode
VS Code extension for LLM-assisted code/text completion
llama.vscode is a Visual Studio Code extension that provides AI-assisted coding features powered primarily by locally running language models. The extension is designed to be lightweight and efficient, enabling developers to use AI tools even on consumer-grade hardware. It integrates with the llama.cpp runtime to run language models locally, eliminating the need to rely entirely on external APIs or cloud providers. The extension supports common AI development features such as code... -
5
Eliza
Autonomous agents for everyone
...Full support for voice, text, and media interactions. Built-in RAG memory system, document processing, media analysis, and autonomous trading capabilities. Supports multiple AI models including Llama, GPT-4, and Claude. Create custom actions, add new platform integrations, and extend functionality through a modular plugin system. Full TypeScript support. -
6
Jan.ai
Open source alternative to ChatGPT that runs 100% offline
...It allows you to download and run LLMs (local language models) offline while also offering optional integration with cloud-based model providers—giving you full control over your data and AI interactions. Download and run LLMs (Llama, Gemma, Qwen, GPT-oss etc.) from HuggingFace. Connect to GPT models via OpenAI, Claude models via Anthropic, Mistral, Groq, and others. Create specialized AI assistants for your tasks. MCP integration for agentic capabilities. -
7
Clippy
Clippy, now with some AI
...Users interact with the system through a simple animated assistant interface that can answer questions, generate text, and perform conversational tasks. The application includes one-click installation support for several popular models such as Meta’s Llama, Google’s Gemma, and other open models. -
8
promptfoo
Evaluate and compare LLM outputs, catch regressions, improve prompts
...Use built-in metrics, LLM-graded evals, or define your own custom metrics. Compare prompts and model outputs side-by-side, or integrate the library into your existing test/CI workflow. Use OpenAI, Anthropic, and open-source models like Llama and Vicuna, or integrate custom API providers for any LLM API. -
9
BrowserAI
Run local LLMs like llama, deepseek, kokoro etc. inside your browser
BrowserAI is a cutting-edge platform that allows users to run large language models (LLMs) directly in their web browser without the need for a server. It leverages WebGPU for accelerated performance and supports offline functionality, making it a highly efficient and privacy-conscious solution. The platform provides a developer-friendly SDK with pre-configured popular models, and it allows for seamless switching between MLC and Transformer engines. Additionally, it supports features such as... -
10
Tribe AI
Low code tool to rapidly build and coordinate multi-agent teams
Low code tool to rapidly build and coordinate multi-agent teams. Have you heard the saying, 'Two minds are better than one'? That's true for agents too. Tribe leverages on the langgraph framework to let you customize and coordinate teams of agents easily. By splitting up tough tasks among agents who are good at different things, each one can focus on what it does best. This makes solving problems faster and better. -
11
pwa-asset-generator
Automates PWA asset generation and image declaration
Automates PWA asset generation and image declaration. Automatically generates icon and splash screen images, favicons and mstile images. Updates manifest.json and index.html files with the generated images according to Web App Manifest specs and Apple Human Interface guidelines. When you build a PWA with a goal of providing native-like experiences on multiple platforms and stores, you need to meet with the criteria of those platforms and stores with your PWA assets; icon sizes and splash... -
12
LLM Wiki
Open Source Implementation of Karpathy's LLM Wiki
...The architecture supports both manual editing and automated generation, providing flexibility in how knowledge is curated. It is particularly useful for teams or individuals managing large amounts of information across domains. Overall, llmwiki transforms static documentation into a dynamic, AI-assisted knowledge system. -
13
Hollama
A minimal LLM chat app that runs entirely in your browser
...The project provides a minimal but powerful user interface for communicating with local or remote LLMs, including servers powered by Ollama or OpenAI-compatible APIs. Because the application runs as a static web interface, it does not require complex backend infrastructure and can be easily deployed or self-hosted. Hollama supports both text-based and multimodal interactions, allowing users to work with models that process images as well as text. The interface includes features for editing prompts, retrying responses, copying generated code snippets, and storing conversation history locally within the browser. ... -
14
LLM Scraper
Extract structured data from webpages using LLM-powered scraping
LLM Scraper is a TypeScript library designed to extract structured data from webpages using large language models. Instead of relying on fragile HTML selectors or manual parsing rules, the tool interprets webpage content with language models and converts it into structured data according to a defined schema. Developers can specify the data structure using tools such as Zod or JSON Schema, enabling the model to extract relevant information directly into typed objects. LLM Scraper integrates... -
15
PageLM
PageLM is a community driven version of NotebookLM
PageLM is an open-source AI-powered education platform that transforms study materials into interactive learning experiences inspired in part by the NotebookLM style of knowledge interaction. It is built to help students, educators, and researchers turn documents and topics into more engaging forms of study rather than leaving content in static notes or isolated files. The platform includes a broad set of learning tools such as contextual chat, Cornell-style note generation, flashcards, quizzes, AI podcasts, voice transcription, homework planning, exam simulation, debate practice, and a personalized study companion. It supports uploaded documents including PDF, DOCX, Markdown, and TXT, allowing users to ground questions and generated materials in source content. ... -
16
Porcupine
On-device wake word detection powered by deep learning
...It can detect multiple always-listening voice commands with no added runtime footprint. Self-service. Developers can train custom wake word models using Picovoice Console. Porcupine is the right product if you need to detect one or a few static (always-listening) voice commands. If you want to create voice experiences similar to Alexa or Google, see the Picovoice platform. -
17
Lobe Icons
Brings AI/LLM brand logos to your React & React Native apps
Lobe Icons is an open-source icon library designed to provide developers with a comprehensive collection of logos and visual assets representing popular artificial intelligence platforms, language models, and related technologies. The project focuses on making it easy for developers to include recognizable AI brand icons in applications such as dashboards, AI tools, documentation sites, or developer portals. The library includes icons for a wide range of AI providers and models, allowing... -
18
Groq AppGen
Project showcasing Llama 3.3 70B HTML codegen abilities
Groq AppGen is an interactive web application (built with Next.js and TypeScript) that uses Groq’s LLM API to generate or modify web application code based on natural-language prompts. Essentially, you tell the app what kind of web app or page you want (in plain English), and groq-appgen will produce HTML/JSX code scaffolding, layout, and optionally application logic accordingly. It supports iterative feedback: you can refine your prompt, adjust parameters or requirements, and have the app... -
19
Chrome DevTools MCP
Chrome DevTools for coding agents
...The repository spells out environment requirements and cautions that exposing a live browser to agents grants powerful access, so sensitive data should be handled carefully. Beyond static inspection, it exposes operational tools like starting a performance trace that an agent can later analyze to propose optimizations. The server is intended to slot into MCP-capable assistants and IDEs, giving them reliable, typed tools and resource endpoints rather than ad-hoc automation. Documentation from the Chrome team explains how the server augments agents with real debugging capabilities. -
20
Clawra
Openclaw as your girlfriend
Clawra is a creative open-source AI persona built as a “skill” or extension for the OpenClaw agent framework that exemplifies how flexible autonomous AI agents can become companions or interactive characters you run yourself. Rather than being a static chatbot tied to a corporate ecosystem, Clawra runs locally or on a private server, giving users full control over the software and data that back her behavior. She is designed not just to answer questions but to maintain a persistent character with memory, backstory, and the ability to present visual outputs like generated selfies through integrated image tools, blending conversational AI with a playful persona. ... -
21
Gradient Bang
Gradient Bang is an online multiplayer universe
...The project serves both as a prototype and a conceptual playground for testing how conversational AI systems behave when embedded into dynamic, game-like environments rather than static chat interfaces. It leverages the broader Pipecat architecture for multimodal and conversational AI orchestration, meaning that interactions can potentially extend beyond text into voice, events, and real-time systems. -
22
Satori
Enlightened library to convert HTML and CSS to SVG
...You can use a subset of HTML elements (see section below), or custom React components, but React APIs such as useState, useEffect, dangerouslySetInnerHTML are not supported. Satori supports a limited subset of HTML and CSS features, due to its special use cases. In general, only these static and visible elements and properties that are implemented. Also, Satori does not guarantee that the SVG will 100% match the browser-rendered HTML output since Satori implements its own layout engine based on the SVG 1.1 spec. -
23
DeepAudit
AI multi-agent platform for automated code security auditing system
DeepAudit is an open source code security auditing platform that uses a multi-agent architecture to analyze and identify vulnerabilities in software projects. Instead of relying solely on traditional static analysis, it simulates the reasoning process of security experts through coordinated agents responsible for orchestration, reconnaissance, analysis, and verification. DeepAudit performs deep semantic understanding of code, enabling it to detect complex vulnerabilities that span multiple files and business logic layers. It also includes automated proof-of-concept validation using a sandboxed environment, allowing detected issues to be tested for real exploitability. ... -
24
PromptBin
A free guide for learning to create ChatGPT3 Prompts
...The repository is also intended as a foundation for building custom prompt management systems, allowing developers or teams to fork and adapt it into internal tools or client-facing solutions. It includes a simple front-end interface that enables searching, filtering, and copying prompts quickly, emphasizing usability and accessibility. Beyond just a static list, the project embodies best practices in prompt engineering by demonstrating how structured inputs can significantly improve AI outputs. -
25
OpenPipe
Turn expensive prompts into cheap fine-tuned models
...It provides tools for training language models and agents using real-world feedback, enabling systems to learn from interactions and improve over time rather than relying solely on static prompts. One of its core components, the Agent Reinforcement Trainer, allows developers to train multi-step agents using reinforcement learning techniques such as GRPO, enhancing their ability to perform complex, sequential tasks. OpenPipe emphasizes cost reduction by enabling organizations to distill high-cost inference workflows into smaller, specialized models that can run more efficiently at scale.
