Search Results for "web crawler source code" - Page 2
Sort By:
Showing 213 open source projects for "web crawler source code"
View related business solutions-
Papirfly: Best user-friendly DAM and Content Creation SoftwarePapirfly provides a single online destination for all your employees and other stakeholders who are engaging with your brand, ensuring consistency in all aspects of their communications. Teams can produce infinite studio-standard marketing materials from bespoke templates, store, share and adapt them for their own markets and stay firmly educated on the brand’s purpose, guidelines and evolution – with no specialist skills or agency help necessary.
-
Zendesk: The Complete Customer Service SolutionEquip your agents with powerful AI tools and workflows that boost efficiency and elevate customer experiences across every channel.
-
1
Claude-Mem
Claude Code plugin that automatically captures everything Claude does
Claude-Mem is a persistent memory compression system built specifically for Claude Code to preserve context across coding sessions. It automatically captures Claude’s tool usage, observations, and decisions, then compresses them into semantic memories that carry forward into future sessions. By enabling long-term continuity, Claude-Mem helps Claude “remember” project history, past fixes, and prior reasoning even after restarts or reconnects. Its progressive disclosure approach intelligently... -
2
/last30days
Claude Code skill that researches any topic across Reddit + X
/last30days is a specialized Claude Code skill designed to research current trends and practices across Reddit, X, and the wider web from the last 30 days, synthesize that data, and produce copy-paste-ready prompts or summaries that reflect what the community is actually talking about now. Rather than returning generic model responses, it intelligently analyzes social media and community discussions to identify what’s genuinely trending or working in practice across topics ranging from... -
3
draw-a-ui
Draw wireframe sketches and generate HTML with AI vision models
...The result is an automated design-to-code workflow where rough interface ideas can quickly become functional web layouts. It is implemented as a modern web application built with Next.js and TypeScript and requires a compatible Node.js runtime to run locally. It is designed primarily as a demonstration of AI-assisted UI generation rather than a production-ready platform. -
4
Claude Subconscious
Give Claude Code a subconscious
Claude Subconscious is an experimental plugin that enhances AI coding workflows by introducing a persistent “memory layer” for Claude Code through integration with Letta’s agent framework. It operates as a background agent that continuously observes user interactions, reads project files, and processes session transcripts to build long-term contextual memory. Unlike standard AI interactions that reset between sessions, this system accumulates knowledge over time, allowing it to recall user... -
Assembled is the only unified platform for staffing and managing your human and AI support team.Assembled is the only platform that unifies AI agents and intelligent workforce management to power fast and flexible support operations. Built for scale, we help teams automate over 50% of customer interactions, forecast with 90%+ accuracy, and optimize staffing across in-house and BPO teams. Orchestrate every chat, email, or call, balancing workloads between human and AI agents in real time — without sacrificing quality or control. Trusted by Stripe, Canva, and Robinhood, Assembled transforms support from a cost center into a strategic advantage. Our Workforce and Vendor Management tools connect forecasting, scheduling, and performance for smarter staffing decisions. AI Agents automate conversations across channels with your workflows and brand voice. AI Copilot empowers agents with real-time guidance, suggested replies, and one-click actions for faster, higher-quality resolutions.
-
5
mgrep
A calm, CLI-native way to semantically grep everything, like code
This project is a modern, semantic search tool that brings the simplicity of traditional command-line grep to the world of natural language and multimodal content, enabling users to search across codebases, documents, PDFs, and even images using meaning-aware queries. Built with a focus on calm CLI experiences, it lets you index and query your local files with semantic understanding, delivering results that are relevant to your intent rather than simple pattern matches, which is especially... -
6
DeepWiki Open
AI-Powered Wiki Generator for GitHub/Gitlab/Bitbucket Repositories
DeepWiki Open is an open-source, AI-powered wiki generator that automatically creates fully navigable, richly structured wiki documentation for GitHub, GitLab, or Bitbucket repositories by combining code analysis, vector embeddings, retrieval-augmented generation (RAG), and visualization tools. Users can enter a repository URL and the system will clone the project, build semantic embeddings of its codebase, extract architecture and relationships, generate human-readable documentation, and produce visual diagrams to help explain complex code structure. ... -
7
AgenticSeek
Fully Local Manus AI. No APIs, No $200 monthly bills
AgenticSeek is a fully local autonomous AI assistant designed as a privacy-focused alternative to cloud-based agent platforms. It runs entirely on the user’s hardware and can autonomously browse the web, write code, and plan multi-step tasks without sending data to external services. The system is optimized for local reasoning models and emphasizes zero cloud dependency to maintain full user control. AgenticSeek includes intelligent agent selection, allowing it to determine the best internal... -
8
OpenAI.fm
Code for openai.fm, a demo for the OpenAI Speech API
OpenAI.fm is an official interactive demo application built to showcase the OpenAI Speech API and its advanced text-to-speech capabilities, providing developers and creators with a hands-on web interface to convert text into high-quality, customizable audio using state-of-the-art TTS models. Developed using Next.js and the OpenAI Speech API, this demo illustrates how the latest neural voice models can produce natural, expressive speech with adjustable styles and voices, highlighting features... -
9
DevoxxGenie
DevoxxGenie is a plugin for IntelliJ IDEA that uses local LLM's
Devoxx Genie is a fully Java-based LLM Code Assistant plugin for IntelliJ IDEA, designed to integrate with local LLM providers such as Ollama, LMStudio, GPT4All, Llama.cpp, and Exo but also cloud-based LLMs such as OpenAI, Anthropic, Mistral, Groq, Gemini, DeepInfra, DeepSeek, OpenRouter and Azure OpenAI. -
Curtain LogTrace File Activity MonitoringCurtain LogTrace File Activity Monitoring is an enterprise file activity monitoring solution. It tracks user actions: create, copy, move, delete, rename, print, open, close, save. Includes source/destination paths and disk type. Perfect for monitoring user file activities.
-
10
StarVector
StarVector is a foundation model for SVG generation
StarVector is a multimodal foundation model designed for generating Scalable Vector Graphics (SVG) from images or textual descriptions. The system treats vector graphics creation as a code generation problem, producing SVG code that can render detailed vector images. Its architecture combines computer vision techniques with language modeling capabilities so it can understand visual inputs and textual prompts simultaneously. The model converts raster images or text instructions into... -
11
Factory AI
Agent-Native Software Development
...The platform integrates deeply with existing repositories and infrastructure, allowing it to analyze source code, monitor logs, and use contextual data from observability systems to make informed decisions. -
12
Stagehand
An AI web browsing framework focused on simplicity and extensibility
An AI web browsing framework focused on simplicity and extensibility. Stagehand is the AI-powered successor to Playwright, offering three simple APIs (act, extract, and observe) that provide the building blocks for natural language-driven web automation. The goal of Stagehand is to provide a lightweight, configurable framework, without overly complex abstractions, as well as modular support for different models and model providers. It's not going to order you a pizza, but it will help you... -
13
Sim
Build, deploy, and orchestrate AI agents
Sim is an open-source platform designed to build, deploy, and orchestrate AI agent workflows through a unified intelligence layer. It positions itself as infrastructure for managing an “AI workforce,” enabling developers and teams to coordinate multiple agents and automate complex processes from a central environment. The project focuses on low-code and no-code accessibility while still supporting advanced customization through TypeScript and modern web tooling. ... -
14
Stable Diffusion Version 2
High-Resolution Image Synthesis with Latent Diffusion Models
Stable Diffusion (the stablediffusion repo by Stability-AI) is an open-source implementation and reference codebase for high-resolution latent diffusion image models that power many text-to-image systems. The repository provides code for training and running Stable Diffusion-style models, instructions for installing dependencies (with notes about performance libraries like xformers), and guidance on hardware/driver requirements for efficient GPU inference and training. ... -
15
VibeSDK
Open source full-stack AI vibe coding platform & web app generator
VibeSDK is an open source “vibe coding” platform. VibeSDK is a project built by Cloudflare. It provides a full-stack reference implementation of an AI-driven system. Users describe the application they want in natural language, and the system generates, previews, and deploys the resulting web app. It uses Cloudflare’s infrastructure (Workers, Containers, sandboxes). -
16
GLM-4.7
Advanced language and coding AI model
GLM-4.7 is an advanced agent-oriented large language model designed as a high-performance coding and reasoning partner. It delivers significant gains over GLM-4.6 in multilingual agentic coding, terminal-based workflows, and real-world developer benchmarks such as SWE-bench and Terminal Bench 2.0. The model introduces stronger “thinking before acting” behavior, improving stability and accuracy in complex agent frameworks like Claude Code, Cline, and Roo Code. GLM-4.7 also advances “vibe... -
17
AstronRPA
Agent-ready RPA suite with visual workflow automation tools engine
Astron RPA is an enterprise-grade robotic process automation platform designed to help organizations and developers build automated workflows for desktop and web applications. It provides a visual workflow designer that supports low-code and no-code development, allowing users to create automation processes through a drag-and-drop interface instead of writing extensive code. It enables automation of common desktop software and browser-based tasks, making it suitable for repetitive business... -
18
AnythingLLM
The all-in-one Desktop & Docker AI application with full RAG and AI
A full-stack application that enables you to turn any document, resource, or piece of content into a context that any LLM can use as references during chatting. This application allows you to pick and choose which LLM or Vector Database you want to use as well as supporting multi-user management and permissions. AnythingLLM is a full-stack application where you can use commercial off-the-shelf LLMs or popular open-source LLMs and vectorDB solutions to build a private ChatGPT with no... -
19
Agent Development Kit (ADK)
Open-source, code-first Python toolkit for building, evaluating, etc.
ADK (Android Device Key) Python is a reference implementation by Google for working with Android attestation keys in Python. It facilitates the integration of Android attestation features into backends or systems that require verification of device identity and integrity. This is especially important in high-security applications where verifying that a device is genuine and uncompromised is critical. ADK Python helps developers verify hardware-backed keys, work with JSON Web Tokens (JWT),... -
20
LaVague
Framework for building AI agents that automate complex web tasks
LaVague is an open source framework designed to help developers build AI-powered web agents capable of automating tasks across websites and web applications. It implements the concept of a Large Action Model framework, allowing agents to interpret a user-provided objective and translate it into a sequence of actions performed in a browser. These agents can navigate web pages, retrieve information, fill out forms, and execute multi-step workflows automatically. ... -
21
MLC LLM
Universal LLM Deployment Engine with ML Compilation
MLC LLM is a machine learning compiler and deployment framework designed to enable efficient execution of large language models across a wide range of hardware platforms. The project focuses on compiling models into optimized runtimes that can run natively on devices such as GPUs, mobile processors, browsers, and edge hardware. By leveraging machine learning compilation techniques, mlc-llm produces high-performance inference engines that maintain consistent APIs across platforms. The system... -
22
ChatCraft.org
Developer-oriented ChatGPT clone
Welcome to ChatCraft.org, your open-source web companion for coding with Large Language Models (LLMs). Designed with developers in mind, ChatCraft transforms the way you interact with GPT models, making it effortless to read, write, debug, and enhance your code. Whether you're exploring new designs or learning about the latest technologies, ChatCraft is your go-to platform. -
23
Spark TTS
Spark-TTS Inference Code
Spark TTS is an open-source, PyTorch-based text-to-speech inference system that leverages large language models to produce highly natural, intelligible speech from text input. It uses an efficient single-stream architecture where speech tokens are directly reconstructed from the predictions of an LLM, removing the need for external acoustic models or complex vocoders and making the generation pipeline cleaner and faster. The project supports zero-shot voice cloning, meaning it can imitate a... -
24
OpenSumi
A framework helps you quickly build Cloud or Desktop IDE products
A framework helps you quickly build Cloud or Desktop IDE products. Integrate with your coding frameworks with ease. Support the container, Electron and front-end frameworks. Also help to ship and deploy quickly. Support VS Code plugins, OpenSumi plugins and OpenSumi modules to meet various business requirements. Customize the UI design in any way you like, no matter to simply configure the built-in UI, or develop a UI template, or build your own UI through plugins. OpenSumi framework aims to... -
25
nanobot
🐈 nanobot: The Ultra-Lightweight Clawdbot / OpenClaw
nanobot is an ultra-lightweight personal AI assistant designed to deliver powerful agent capabilities without unnecessary complexity. Built in just ~4,000 lines of clean, readable code, it offers a minimalist alternative to heavyweight agent frameworks while retaining core intelligence and extensibility. nanobot is optimized for speed and efficiency, enabling fast startup times and low resource usage across environments. Its research-ready architecture makes it easy for developers to...
