Search Results for "web crawler source code"
Sort By:
Showing 212 open source projects for "web crawler source code"
View related business solutions-
Intelligent Automation Solutions Built for Modern Finance TeamsDigitally transform your business with workflow automation and integrated payment solutions. Digitally store and secure your data with advanced search and accessibility features that keeps your documents at the tip of your team’s fingers.
-
Secure Cloud Storage for Files, Photos and Documents | pCloudStore, sync, and share your files securely with pCloud. Get up to 10 GB of free secure cloud storage and access your files from any device, anywhere.
-
1
miniblink49
Lighter, faster browser kernel of blink to integrate HTML UI in apps
miniblink is an open source, one file, small browser widget based on chromium. By using C interface, you can create a browser with just some line code. miniblink is an open source, single-file, and currently the smallest known chromium-based browser control. Through its exported pure C interface, a browser control can be created in a few lines of code. C++, C#, Delphi and other language calls (support C++, C#, Delphi language to call). -
2
Mongoose Embedded Web Server
An embedded web server
Mongoose is a networking library for C/C++. It implements event-driven non-blocking APIs for TCP, UDP, HTTP, WebSocket, MQTT. It is designed for connecting devices and bringing them online. On the market since 2004, used by vast number of open source and commercial products - it even runs on the International Space Station! Mongoose makes embedded network programming fast, robust, and easy. Cross-platform, works on Linux/UNIX, MacOS, Windows, Android, FreeRTOS, etc. Supported embedded... -
3
webrpc
webrpc is a schema-driven approach to writing backend services
webrpc is a schema-driven approach to writing backend servers for the Web. Write your server's API interface in a schema format of RIDL or JSON, and then run webrpc-gen to generate the networking source code for your server and client apps. From the schema, webrpc-gen will generate application-based class types/interfaces, JSON encoders, and networking code. In doing so, it's able to generate fully functioning and typed client libraries to communicate with your server. ... -
4
YAO
Yao A low code engine to create web services and dashboard
Yao allows developers to create web services by processes. Yao is a low-code engine that creates a database model, writes API services, and describes dashboard interface just by JSON for web & hardware, no code, and 10x productivity. Yao is based on the flow-based programming idea, developed in the Go language, and supports multiple ways to expand the data stream processor. This makes Yao extremely versatile, which can replace programming languages in most scenarios, and is 10 times more... -
The Industry Leading Platform for eCommerce Enablement and AnalyticsMikMak’s Where to Buy Shoppable Solutions help multichannel brands drive sales, grow market share, and increase profitability while reducing costs across categories such as CPG, Grocery, Alcohol, Beauty, Personal Care, Pet Care, Home Care, Consumer Electronics, Home Appliances, Toys, and more.
-
5
Bootstrap
HTML, CSS and JS framework for developing responsive websites and apps
Bootstrap is an HTML, CSS, and JS framework designed for developing responsive, mobile first projects on the web. It's one of the most popular front-end frameworks and for good reason: it simply makes web development faster and easier. People of all skill levels can create projects of all sizes with Bootstrap, and for all types of devices too. With Bootstrap, you get a host of nifty features such as precompiled CSS, impressive scalability, dozens of custom HTML and CSS components and more. -
6
Livebook
Interactive and collaborative code notebooks for Elixir
Livebook is a web application for writing interactive and collaborative code notebooks. Write notebooks in Livebook then securely deploy and share them with your team and company with Livebook Hub/Enterprise. Code notebooks with Markdown support and Code cells where Elixir code is evaluated on demand. Rich code editor through Monaco: with support for autocompletion, inline documentation, code formatting, etc. Interactive results via Kino: display Vega-Lite charts, tables, maps, and more.... -
7
Cutelyst
Web Framework built on top of Qt, using the approach of Catalyst
Create fast and modern web applications that share the same code as your desktop or mobile apps. Why have two or more development teams focused on a specific platform when you can have a single team coding the same code, sharing skills and lines of code. With Qt, you already can write applications for Windows, Linux, Android, MacOS, and iOS using the same source code, Cutelyst allows you to share your C++ code with your web application. ... -
8
Biome
A toolchain for web projects, aimed to provide functionalities
Biome formats and lints your code in a fraction of a second. Biome supports JavaScript, TypeScript, JSON, and CSS. It aims to support all main languages of modern web development. Biome has sane defaults and requires minimal configuration. Biome helps you as much as possible by displaying detailed and contextualized diagnostics. Biome unifies functionality that has previously been separate tools. Building upon a shared base allows us to provide a cohesive experience for processing code,... -
9
Vanilla Framework
From community websites to web applications, this CSS framework
Backed by open-source code and written in Sass by the Canonical Web Team. Vanilla contains a responsive CSS grid, basic style for HTML elements and a selection of key useful patterns and utility classes that you can extend. Designed to be composable, you can include the whole framework to avail of all styles or you can use only what you need for your project. -
Diagnose and Resolve IT Issues in Real TimeScreenMeet’s unique combination of video calling, screen share, and remote desktop functionality lets you quickly diagnose hardware and software issues with no frustration.
-
10
Package Generator
Generates a PHP SDK based on a WSDL, simple and powerful, WSDL to PHP
Package Generator generates a PHP SDK from any WSDL so you can easily consume any SOAP Web Service without wondering how SOAP is used under the hood. Package Generator provides many options to generate your package even if a few are required. This project has been tested with many WSDL and is currently used on the platform Providr.IO. Package Generator generates files that are detailed in the MANIFEST. You are encouraged to read it to understand how and why the files are generated in... -
11
Elixir
Dynamic, functional language designed for building scalable apps
Elixir is a dynamic, functional language for building scalable and maintainable applications. Elixir leverages the Erlang VM, known for running low-latency, distributed, and fault-tolerant systems. Elixir is successfully used in web development, embedded software, data ingestion, and multimedia processing, across a wide range of industries. All Elixir code runs inside lightweight threads of execution (called processes) that are isolated and exchange information via messages. Due to their... -
12
Suave
Suave is a simple web development F# library
Suave is a simple web development F# library providing a lightweight web server and a set of combinators to manipulate route flow and task composition. Suave is inspired in the simplicity of Happstack and born out of the necessity of embedding web server capabilities in my own applications. Suave supports Websocket, HTTPS, multiple TCP/IP bindings, Basic Access Authentication, Keep-Alive. Suave also takes advantage of F# asynchronous workflows to perform non-blocking IO. In fact, Suave is... -
13
FastHTML
The fastest way to create an HTML app
Built on solid web foundations, not the latest fads - with FastHTML you can get started on anything from simple dashboards to scalable web applications in minutes. -
14
Gatsby
Build blazing fast, modern apps and websites with React
Gatsby is a free and open source web framework based on React that allows you to build blazing fast websites and apps. It offers the latest web technologies, such as React.js, Webpack, modern JavaScript, CSS and more to help you build really fast websites. A Progressive Web App generator, it’s fast in every way that matters. -
15
SWC
Rust-based platform for the Web
...It's used by tools like Next.js, Parcel, and Deno, as well as companies like Vercel, ByteDance, Tencent, Shopify, and more. SWC can be used for both compilation and bundling. For compilation, it takes JavaScript / TypeScript files using modern JavaScript features and outputs valid code that is supported by all major browsers. SWC is 20x faster than Babel on a single thread and 70x faster on four cores. SWC can be downloaded and used as a pre-built binary, or built from the source. SWC (stands for Speedy Web Compiler) is a super-fast TypeScript / JavaScript compiler written in Rust. It's a library for Rust and JavaScript at the same time. ... -
16
Tacit
CSS framework for dummies, without a single CSS class
Tacit is a CSS framework for dummies, who want their web services to look attractive but have almost zero skills in graphic design, just like myself. Tacit is a primitive CSS framework for dummies, like myself, who don't know anything about graphic design but want their web services to look eatable. No classes, no layouts. Just design plain and simple web pages compliant with HTML5 and they will look OK. Tacit's goal is to be super simple and always with the same look-and-feel. If you want... -
17
Bebop
No ceremony, just code. Blazing fast, typesafe binary serialization
Bebop enables schema-based, typesafe, binary serialization and code generation. It is designed to be a good fit for client–server or distributed web apps that require a faster, more concise, and more typesafe alternative to JSON or MessagePack, while avoiding the complexity of Protocol Buffers, FlatBuffers, and similar solutions. -
18
JSONView
A web extension that helps you view JSON documents in the browser
A web extension that helps you view JSON documents in the browser. Normally when encountering a JSON document (content type application/json), Firefox simply prompts you to download the view. With the JSONView extension, JSON documents are shown in the browser similar to how XML documents are shown. The document is formatted, highlighted, and arrays and objects can be collapsed. Even if the JSON document contains errors, JSONView will still show the raw text. JSONView is a Web extension... -
19
JS Beautifier
Beautifier for javascript
This little beautifier will reformat and re-indent bookmarklets, ugly JavaScript, unpack scripts packed by Dean Edward’s popular packer, as well as partly deobfuscate scripts processed by the npm package javascript-obfuscator. All of the source code is completely free and open, available on GitHub under MIT licence, and we have a command-line version, python library and a node package as well. You may install the NPM package js-beautify. When installed globally, it provides an executable js-beautify script. As with the Python script, the beautified result is sent to stdout unless otherwise configured. ... -
20
Tarsier
Vision utilities for web interaction agents
At Reworkd, we iterated on all these problems across tens of thousands of real web tasks to build a powerful perception system for web agents... Tarsier! In the video below, we use Tarsier to provide webpage perception for a minimalistic GPT-4 LangChain web agent. Tarsier visually tags interactable elements on a page via brackets + an ID e.g. [23]. In doing this, we provide a mapping between elements and IDs for an LLM to take actions upon (e.g. CLICK [23]). We define interactable elements... -
21
Kweb
A Kotlin web framework
Kweb is designed to make it easy for developers to create modern websites without having to worry about the complexities of communication between the server and the browser. With a unified codebase, you can focus on creating an intuitive and user-friendly interface, rather than spending time on technical details. By streamlining the development process, Kweb makes it easier to build functional and beautiful websites that meet the needs of your users. Kweb is a remote interface for a web... -
22
phantomas
Headless Chromium-based web performance metrics collector
Headless Chromium-based modular web performance metrics collector. Modular approach, each metric is generated by a separate "module". phantomas "core" acts as an events emitter that each module can hook into. In-depth metrics such as: number of events bound via jQuery, calls to window.writeor complex and duplicated CSS selectors (via analyze-css). JSON as an output format. Easy integration with other nodejs projects via CommonJS module (see API docs). Metrics can be emitted from the... -
23
GoatCounter
Easy web analytics. No tracking of personal data
GoatCounter is an open-source web analytics platform available as a hosted service (free for non-commercial use) or self-hosted app. It aims to offer easy-to-use and meaningful privacy-friendly web analytics as an alternative to Google Analytics or Matomo. Privacy-aware; doesn’t track users with unique identifiers and doesn't need a GDPR notice. Fine-grained control over which data is collected. Also see the privacy policy and GDPR consent notices. Lightweight and fast; adds just ~3.5KB of... -
24
Soap
A SOAP client and server for node.js
A SOAP client and server for node.js. This module lets you connect to web services using SOAP. It also provides a server that allows you to run your own SOAP services. Very simple API Handles both RPC and Document schema types. Supports multiRef SOAP messages. Support for both synchronous and asynchronous method handlers. WS-Security UsernameToken Profile 1.0. Supports Express-based web server (body parser middleware can be used) The so called one-way (or asynchronous) calls occur when an... -
25
Mavo
Create web applications entirely by writing HTML and CSS
Create complex, reactive, persistent web applications by just writing HTML & CSS, without a single line of JavaScript and no server backend. Developed in the Haystack Group at MIT CSAIL and led by Lea Verou. Mavo extends the syntax of HTML to describe Web applications that manage, store, and transform data. Store data in the cloud, locally, or not at all by just changing an HTML attribute. Edit data right on the website, with an intuitive, auto-generated, customizable interface. No more...
