Search Results for "web crawler source code"
Sort By:
Showing 19 open source projects for "web crawler source code"
View related business solutions-
Searching for a better way to ship ecommerce? We can helpShipHero is built for multi-channel commerce. With a few clicks, you can connect your stores. ShipHero will download new products, as well as sync existing ones. When changes are made to your inventory all connected stores will be updated.
-
Free Website Monitoring Service | UptimeRobotWith the Free Plan, you can monitor up to 50 URLs, check for a website's content (using the keyword monitor), ping your server or monitor your ports in 5-minute intervals. You can create a status page to showcase your uptime. SMS or Call alerts can be bought anytime.
-
1
Yii Web Programming Framework
Yii PHP Framework 1.1.x
Yii, a high-performance component-based PHP framework. Yii is a fast, secure, and efficient PHP framework. Flexible yet pragmatic. Works right out of the box. Has reasonable defaults. Yii gives you the maximum functionality by adding the least possible overhead. Sane defaults and built-in tools helps you write solid and secure code. Write more code in less time with simple, yet powerful APIs and code generation. The minimum requirement by Yii is that your Web server supports PHP 5.1.0 or... -
2
cc-switch
A cross-platform desktop All-in-One assistant tool for Claude Code
cc-switch is a cross-platform desktop assistant designed to unify and streamline the management of multiple AI coding tools such as Claude Code, Codex, OpenCode, and Gemini CLI within a single interface. The application focuses on improving developer productivity by providing centralized configuration, provider switching, and workflow orchestration across different AI backends. Built as a modern desktop app using Tauri and web technologies, it enables users to manage credentials, sessions,... -
3
SiteOne Crawler (desktop app)
A free, feature-rich web analyzer and exporter/cloner you will love!
A free in-depth website analyzer providing audits of security, performance, SEO, accessibility and other technical aspects. Available as a desktop application for Windows/macOS/Linux and as a CLI tool for advanced users and CI/CD processes. It also includes an offline web page exporter (website clone, mirror). -
4
cargo-crev
A cryptographically verifiable code review system for the cargo
...Increase the trustworthiness of your own code. Build a web of trust of other reputable users to help verify the code you use. Static binaries are available from the releases page. Crev is a system for verifying the security and reliability of dependencies based on collaborative code reviews. Crev users review the source code of packages/libraries/crates and share their findings with others. -
HR Outsourcing Built for Small and Midsize BusinessesTriNet is a leading provider of HR outsourcing solutions built for small and midsize businesses. Its platform combines payroll, benefits, risk management, compliance, and HR technology in one integrated system. Through its PEO (Professional Employer Organization) and HR Plus (ASO) offerings, TriNet helps companies streamline HR administration, stay compliant, and access enterprise-level benefits. Businesses can run payroll efficiently, manage compliance with complex state and federal regulations, and offer competitive employee benefits with ease. The company’s intuitive HR platform also automates time tracking, leave requests, and onboarding. With TriNet, organizations can focus on growth while ensuring their people and processes are supported by expert HR guidance.
-
5
Cloud CLI
Use Claude Code, Cursor CLI or Codex on mobile and web with CloudCLI
ClaudeCodeUI, also known as CloudCLI, is an open-source web and mobile interface that enables developers to control Claude Code and similar AI coding tools through a graphical environment. The project provides a browser-based dashboard that allows users to manage coding sessions, projects, and prompts remotely from virtually any device. It is designed to bridge the gap between terminal-first AI coding workflows and more accessible visual interfaces, improving usability without sacrificing power. ... -
6
mgrep
A calm, CLI-native way to semantically grep everything, like code
This project is a modern, semantic search tool that brings the simplicity of traditional command-line grep to the world of natural language and multimodal content, enabling users to search across codebases, documents, PDFs, and even images using meaning-aware queries. Built with a focus on calm CLI experiences, it lets you index and query your local files with semantic understanding, delivering results that are relevant to your intent rather than simple pattern matches, which is especially... -
7
Yeoman (Yo)
CLI tool for running Yeoman generators
Yeoman is a robust scaffolding tool for modern web applications, enabling developers to generate complete project structures and boilerplate code through a vast ecosystem of generators. -
8
Playwriter
Chrome extension to let agents control your browser
Playwriter is an open-source project that combines a Chrome extension with a CLI to allow autonomous agents to control a web browser directly using Playwright code in a stateful sandbox environment. The system enables browser automation by running Playwright commands through a persistent session managed by a background extension, allowing agents or scripts to navigate, interact with, and query browser contexts without losing state between commands. -
9
ffsend
Easily and securely share files from the command line
Easily and securely share files and directories from the command line through a safe, private and encrypted link using a single simple command. Files are shared using the Send service and may be up to 1GB. Others are able to download these files with this tool, or through their web browser. All files are always encrypted on the client, and secrets are never shared with the remote host. An optional password may be specified, and a default file lifetime of 1 (up to 20) download or 24 hours is... -
Secure your business by securing your people.Take the guesswork out of password management, shadow IT, infrastructure, and secret sharing so you can keep your people safe and your business moving.
-
10
cheat.sh
The only cheat sheet you need
cheat.sh is a compact, network-accessible cheat-sheet service that serves concise examples and usage notes for hundreds of shell commands, programming languages, and tools via a simple HTTP interface. You can query it from the terminal (for example curl cht.sh/rsync or curl cheat.sh/ls) or browse the web front page; it also supports a shorthand hostname (cht.sh) and provides both online and standalone/local installation modes. The repository contains the server and client code, instructions... -
11
shot-scraper
A command-line utility for taking automated screenshots of websites
shot-scraper is a command-line utility for taking automated screenshots of web pages using a headless browser engine. After installation, a single command can capture a full-page screenshot of a URL and save it to a file, making it ideal for documentation, monitoring, and visual regression tasks. Under the hood it uses a modern browser (installed via a one-time shot-scraper install step) and exposes options for viewport size, full-page versus clipped screenshots, and device emulation. Beyond... -
12
Cross Platform Node Guide
Improve front-end engineer workflow & standard, powered by TypeScript
A command-line tool aims to improve front-end engineer workflow and standards, powered by Node.js. Feflow (pronounced /ˈfefləʊ/) is a front-end flow and rule tool to improve engineering efficiency., and is hosted on Github: feflow. At present, it has been used in many applications, such as Now, Huayang Live, Huayang Friends, Mobile QQ Near Hand, Group Video, Group Gift, Huiyin, Tencent Myapp, Penguins and etc. With 80+ WEB/IOS/Andriod stable users, the cumulative production project reached... -
13
Revel
A high productivity, full-stack web framework for the Go language
Edit, save, and refresh. Revel compiles your code and templates for you, so you don't miss a beat. Code doesn't compile? It gives you a helpful description. Run-time code panic? Revel has you covered. Revel provides routing, parameter parsing, validation, session/flash, templating, caching, job running, a testing framework, and even internationalization. Revel is built around composable middleware called filters, which implement nearly all request-processing functionality. Developers have... -
14
Aurelia
Framework entry point bringing together all the sub-modules of Aurelia
Aurelia is a modern, front-end JavaScript framework for building browser, mobile, and desktop applications. It focuses on aligning closely with web platform specifications, using convention over configuration, and having minimal framework intrusion. Basically, we want you to just write your code without the framework getting in your way. This library is part of the Aurelia platform. It contains the aurelia-framework library, which brings together all the required core aurelia libraries into... -
15
gist(1)
Potentially the best command line gister
gist(1) is a web-based code and text sharing platform created to allow developers to quickly store, share, and collaborate on snippets of code or notes. It integrates closely with Git, enabling version control, revisions, and forking, which makes it suitable for both temporary sharing and long-term storage of reusable code fragments. Users can create public or private gists, depending on whether they want to share their content openly or keep it accessible only via a link. The platform... -
16
horizon
Horizon is a realtime, open-source backend for JavaScript apps
Horizon is an open-source developer platform for building sophisticated realtime apps. It provides a complete backend that makes it dramatically simpler to build, deploy, manage, and scale engaging JavaScript web and mobile apps. Horizon is extensible, integrates with the Node.js stack, and allows building modern, arbitrarily complex applications. While technologies like RethinkDB and WebSocket make it possible to build engaging realtime apps, empirically there is still too much friction for most developers. ... -
17
This Amazon Mechanical Turk (MTurk) SDK is no longer under active development as of TK. The latest MTurk SDKs, with support for most common programming languages, are now a part of the Amazon Web Service (AWS) SDKs at https://aws.amazon.com/tools/. With the AWS SDKs, you can also connect to MTurk using the AWS Command Line Interface (https://aws.amazon.com/cli/), allowing you to perform operations from your Windows, Mac, or Linux command line without having to write code.
-
18
Nanon is a web page manager, ideal for simple sites with no server generated content. It lets you define templates and reusable html code blocks like menus and ad sections. Nanon is a spiffy command line tool that you can learn how to use in minutes.
-
19
i1n
Localization as code. One command to translate your app
i1n is a localization platform for developers. A CLI pushes your translation keys and gets them back translated with AI, with variable protection and TypeScript type generation. Review and edit translations in the dashboard, mark them as manually approved, and get notified when source text changes make translations stale. Ships with an MCP server that connects to AI coding assistants (Cursor, Claude Code, Windsurf) so your agent can internationalize components directly from the IDE. ...
- Previous
- You're on page 1
- Next
