react-llm

Easy-to-use headless React Hooks to run LLMs in the browser with WebGPU. As simple as useLLM().

Features

Supports Vicuna 7B
Use custom system prompts and "user:"/"assistant:" role names
Completion options like max tokens and stop sequences
No data leaves the browser. Accelerated via WebGPU
Hooks built to 'Bring your own UI'
Persistent storage for conversations in browser storage. Hooks for loading and saving conversations

Project Samples

Project Activity

See All Activity >

License

MIT License

Follow react-llm

react-llm Web Site

Other Useful Business Software

Skillfully - The future of skills based hiring

Realistic Workplace Simulations that Show Applicant Skills in Action

Skillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.

Learn More

Rate This Project

User Reviews

Be the first to post a review of react-llm!

Additional Project Details

Programming Language

TypeScript

Related Categories

TypeScript Large Language Models (LLM), TypeScript Headless Browsers

Registered

2023-08-25

Similar Business Software

LM-Kit.NET

LM-Kit.NET is a cutting-edge, high-level inference SDK designed specifically to bring the advanced capabilities of Large Language Models (LLM) into the C# ecosystem. Tailored for developers working within .NET, LM-Kit.NET provides a comprehensive suite of powerful Generative AI tools, making...

See Software
Vertex AI

Build, deploy, and scale machine learning (ML) models faster, with fully managed ML tools for any use case. Through Vertex AI Workbench, Vertex AI is natively integrated with BigQuery, Dataproc, and Spark. You can use BigQuery ML to create and execute machine learning models in BigQuery...

See Software
Bright Data

Bright Data is the world's #1 web data, proxies, & data scraping solutions platform. Fortune 500 companies, academic institutions and small businesses all rely on Bright Data's products, network and solutions to retrieve crucial public web data in the most efficient, reliable and flexible...

See Software
Google AI Studio

Google AI Studio is a unified development platform that helps teams explore, build, and deploy applications using Google’s most advanced AI models, including Gemini 3. It brings text, image, audio, and video models together in one interactive playground. With vibe coding, developers can use...

See Software
HasData

HasData is one of the best web scraping platforms for fast, reliable, and structured web data at scale. It turns any website into clean, usable data — without the complexity of proxies, CAPTCHAs, or anti-bot evasion. Designed for scale and reliability, HasData offers both developer-first APIs...

See Software
Mozilla Firefox

Mozilla Firefox is a free, open-source web browser developed by the Mozilla Foundation, a non-profit organization dedicated to internet health and privacy. Designed to prioritize user privacy and security, Firefox offers features like Total Cookie Protection, which provides outstanding privacy...

See Software