Search Results for "node.js"

node-llama-cpp is a JavaScript and Node.js binding that allows developers to run large language models locally using the high-performance inference engine provided by llama.cpp. The library enables applications built with Node.js to interact directly with local LLM models without requiring a remote API or external service. By using native bindings and optimized model execution, the framework allows developers to integrate advanced language model capabilities into desktop applications, server software, and command-line tools. ...

The Vercel AI SDK is a library for building AI-powered streaming text and chat UIs.

...The project is designed to transform the process of web searching into a multi-turn conversational experience where users can refine queries and explore results through dialogue. Built using a modern monorepo architecture, the system includes a Node.js and Koa backend alongside a Vue 3 and TypeScript frontend that delivers a responsive chat interface. The platform supports multiple AI providers, allowing developers to connect models from providers such as OpenAI, Anthropic, or Google Gemini to generate contextual responses. It can integrate with several search engines including Bing, Google, and SearXNG to retrieve external information that the language model then analyzes and summarizes.

Emscripten is a complete open-source compiler toolchain that transforms C, C++, and other LLVM-based source code into WebAssembly (and JavaScript), enabling native‑like applications to run in web browsers, Node.js, and other Wasm environments. While Emscripten mostly focuses on compiling C and C++ using Clang, it can be integrated with other LLVM-using compilers (for example, Rust has Emscripten integration, with the wasm32-unknown-emscripten and asmjs-unknown-emscripten targets). Emscripten provides Web support for popular portable APIs such as OpenGL and SDL2, allowing complex graphical native applications to be ported, such as the Unity game engine and Google Earth. ...

uzu is a high-performance inference engine designed to run artificial intelligence models efficiently on Apple Silicon hardware. Written primarily in Rust and leveraging Apple’s Metal framework, the project focuses on maximizing performance when executing large language models and other AI workloads on devices such as Mac computers with M-series chips. The engine implements a hybrid architecture in which model layers can be executed either as custom GPU kernels or through Apple’s MPSGraph...