Search Results for "web crawler source code"
Sort By:
793 projects for "web crawler source code" with 2 filters applied:
-
Next-Gen Encryption for Post-Quantum Security | CLEAR by Quantum KnightCLEAR by Quantum Knight is a FIPS-140-3 validated encryption SDK engineered for enterprises requiring top-tier security. Offering robust post-quantum cryptography, CLEAR secures files, streaming media, databases, and networks with ease across over 30 modern platforms. Its compact design, smaller than a single smartphone image, ensures maximum efficiency and low energy consumption.
-
Skillfully - The future of skills based hiringSkillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.
-
1
Spatie Crawler
An easy to use, powerful crawler implemented in PHP
Spatie Crawler is a PHP library that allows developers to crawl websites and extract information efficiently. It can be used for web scraping, link checking, or automated testing of web pages. The library is simple to use and supports customizable crawling strategies, including controlling crawl depth and handling redirects. It’s suitable for building crawlers that navigate large or dynamically generated websites. -
2
Phoenix Code Editor
Phoenix is a modern open-source Code Editor for the web
Phoenix is a modern open-source and free software code editor for the web, built for the browser. -
3
Heritrix
Internet Archive's open-source, web-scale, web crawler project
Heritrix is the Internet Archive's open-source, extensible, web-scale, archival-quality web crawler project. Heritrix (sometimes spelled heretrix, or misspelled or missaid as heratrix/heritix/heretix/heratix) is an archaic word for heiress (woman who inherits). Since our crawler seeks to collect and preserve the digital artifacts of our culture for the benefit of future researchers and generations, this name seemed apt. -
4
Laravel Web Tinker
Tinker in your browser
Artisan's tinker command is a great way to tinker with your application in the terminal. Unfortunately running a few lines of code, making edits, and copy/pasting code can be bothersome. Wouldn't it be great to tinker in the browser? This package will add a route to your application where you can tinker to your heart's content. In case light hurts your eyes, there's a dark mode too. -
Failed Payment Recovery for Subscription BusinessesFlexPay’s innovative platform uses multiple technologies to achieve the highest number of retained customers, resulting in reduced involuntary churn, longer life span after recovery, and higher revenue. Leading brands like LegalZoom, Hooked on Phonics, and ClinicSense trust FlexPay to recover failed payments, reduce churn, and increase customer lifetime value.
-
5
claude-code-transcripts
Tools for publishing transcripts for Claude Code sessions
claude-code-transcripts is a command-line utility that takes session files exported from Claude Code (in JSON or JSONL format) and turns them into clean, navigable HTML transcripts that can be viewed in any modern web browser. It is designed to make the often dense and verbose outputs from AI coding sessions easier to read, share, and archive by breaking conversations into paginated, annotated pages with navigable timelines of prompts and responses. Users can run this tool locally or fetch... -
6
The Apache Struts web framework
Mirror of Apache Struts
The Apache Struts web framework is a free open-source solution for creating Java web applications. Web applications differ from conventional websites in that web applications can create a dynamic response. Many websites deliver only static pages. A web application can interact with databases and business logic engines to customize a response. Web applications based on JavaServer Pages sometimes commingle database code, page design code, and control flow code. ... -
7
Python-Spider
Python3 web crawler practice
Python-Spider is a repository intended to teach or provide examples for writing web spiders / crawlers in Python — part of a broader learning and resource collection by its author. The code and documentation are oriented toward beginners or intermediate learners who want to learn how to fetch, parse, and extract data from websites programmatically. As part of the author’s public learning-path repositories, python-spider likely includes examples of HTTP requests, HTML parsing, maybe... -
8
X-Crawl
Flexible Node.js AI-assisted crawler library
A high-performance web crawling and scraping framework for Node.js, designed for large-scale data extraction. -
9
Monaco Editor
A browser based code editor
Monaco Editor is the rich, browser-based code editor that powers Visual Studio Code, providing advanced editing capabilities as a standalone embeddable library for web applications. Models are at the heart of Monaco editor. It's what you interact with when managing content. A model represents a file that has been opened. This could represent a file that exists on a file system, but it doesn't have to. For example, the model holds the text content, determines the language of the content, and... -
Loan management software that makes it easy.Bryt Software is ideal for lending professionals who are looking for a feature rich loan management system that is intuitive and easy to use. We are 100% cloud-based, software as a service. We believe in providing our customers with fair and honest pricing. Our monthly fees are based on your number of users and we have a minimal implementation charge.
-
10
Frappe
Low code web framework for real world applications
Frappe is a full-stack, low-code web framework written in Python and JavaScript, used to build scalable and modular enterprise applications. It powers ERPNext and includes tools for REST APIs, user management, document modeling, workflows, and real-time updates. Frappe uses a "model-view-controller" approach with its own ORM and frontend system, enabling rapid development without sacrificing control or performance. -
11
Odigos
Distributed tracing without code changes
...Manage and configure collectors via a convenient web UI. Installing Odigos takes less than 5 minutes, and requires no code changes. -
12
Srcbook
TypeScript-centric app development platform
Srcbook is an open-source, local-first development environment that blends a TypeScript notebook with an AI-assisted app builder, giving developers a flexible space to prototype, explore, and build full web applications with AI support and real execution. It runs locally through a CLI tool backed by Node.js, launching a web interface where users can write and execute TypeScript code interactively, visualize results, and iterate quickly on ideas without leaving the browser. ... -
13
Cloud CLI
Use Claude Code, Cursor CLI or Codex on mobile and web with CloudCLI
ClaudeCodeUI, also known as CloudCLI, is an open-source web and mobile interface that enables developers to control Claude Code and similar AI coding tools through a graphical environment. The project provides a browser-based dashboard that allows users to manage coding sessions, projects, and prompts remotely from virtually any device. It is designed to bridge the gap between terminal-first AI coding workflows and more accessible visual interfaces, improving usability without sacrificing power. ... -
14
KodExplorer
A web based file manager, web IDE / browser based code editor
KodExplorer is a file manager for the web. It is also a web code editor, which allows you to develop websites directly within the web browser. You can run KodExplorer either online or locally, on Linux, Windows, or Mac-based platforms. The only requirement is to have PHP 5 available. Use experience like operating system, Rich context menu, and toolbar, drag, and drop, shortcut keys. All operations with files and folders on a remote server (copy, cut, paste, move, remove, upload, create... -
15
The Vibe Companion
Open-source Claude Code/Codex Web UI
The Companion project by The-Vibe-Company is an open-source web-based UI for interacting with Claude Code, offering a fully graphical interface to launch sessions, stream responses, and approve or deny AI tool usage—all via web browsers on desktop or mobile. Instead of working solely through a command-line interface, developers and creators can start, manage, and visualize Claude Code sessions in a modern web environment built with TypeScript, enabling more natural interaction with AI models. ... -
16
Cutelyst
Web Framework built on top of Qt, using the approach of Catalyst
Create fast and modern web applications that share the same code as your desktop or mobile apps. Why have two or more development teams focused on a specific platform when you can have a single team coding the same code, sharing skills and lines of code. With Qt, you already can write applications for Windows, Linux, Android, MacOS, and iOS using the same source code, Cutelyst allows you to share your C++ code with your web application. ... -
17
Vanilla Framework
From community websites to web applications, this CSS framework
Backed by open-source code and written in Sass by the Canonical Web Team. Vanilla contains a responsive CSS grid, basic style for HTML elements and a selection of key useful patterns and utility classes that you can extend. Designed to be composable, you can include the whole framework to avail of all styles or you can use only what you need for your project. -
18
Penpot
The first open source design and prototyping tool
Penpot is the first open-source design and prototyping platform for product teams that allows true collaboration between designers and developers. What will designers and developers find in Penpot? - Powerful UI tool for the team. All stakeholders can access a complete set of interactive prototypes, design systems, components, feedback loop and pixel designs. - Design and development collaborate for real. Penpot brings both code-ready design capabilities and the familiarity of developer... -
19
JavaScript Obfuscator
A powerful obfuscator for JavaScript and Node.js
JavaScript Obfuscator is a Node.js library and CLI that transforms readable JavaScript into hardened, difficult-to-reverse code. It applies techniques such as identifier mangling, string array extraction/encoding, control-flow flattening, dead-code injection, and numeric literal transformations to disguise intent. Advanced options include self-defending code, domain locking, debug/console protection, and property key transformation, allowing you to tailor defenses to your threat model. The... -
20
Claude Run
A beautiful web UI for browsing Claude Code conversation history
Claude Run is a user-friendly web interface for browsing, searching, and managing Claude Code conversation history in a visually appealing way, making it easier to revisit past interactions, track project progress, and resume long-running coding sessions. Running locally via a single command (npx claude-run), it launches a web UI that displays all stored Claude Code sessions – including conversation threads, tool calls, and timestamps – in a clean chat layout, helping developers quickly find... -
21
Bloxtor framework
Bloxtor is a professional and intelligent framework
Bloxtor is a professional and intelligent web-development framework designed for No-Coders, Low-Coders, and Coders alike. It functions as a versatile code reader and converter, seamlessly transforming code into visual environments and visual components back into code. The concept is to provide a centralized AI-powered web development platform with multiple levels of Citizen Development, empowering both technical and non-technical developers to easily create any type of web application, while... -
22
Laravel Framework
Elegant PHP web application framework with expressive syntax
Laravel is a popular open-source PHP web framework designed for building modern web applications with an elegant and readable syntax. It emphasizes developer productivity, offering features like routing, Eloquent ORM, blade templating, and an extensive ecosystem of packages. Laravel makes common tasks like authentication, caching, and session management simple and intuitive, making it a top choice for PHP developers. -
23
FastAPI Python
FastAPI framework, high performance, easy to learn, fast to code
FastAPI framework, high performance, easy to learn, fast to code, ready for production. FastAPI is a modern, fast (high-performance), web framework for building APIs with Python based on standard Python type hints. -
24
Prism
Lightweight, robust, elegant syntax highlighting
Prism is a lightweight, extensible syntax highlighter, built with modern web standards in mind. It’s used in millions of websites, including some of those you visit daily. -
25
SikuliX
SikuliX version 2.0.0+ (2019+)
...It uses image recognition powered by OpenCV to identify GUI components and can act on them with mouse and keyboard actions. This is handy in cases when there is no easy access to a GUI's internals or the source code of the application or web page you want to act on.
