Search Results for "python web crawler" - Page 4
Sort By:
Showing 211 open source projects for "python web crawler"
View related business solutions-
Collect! is a highly configurable debt collection softwareThe flexible & scalable debt collection software built to automate your workflow. From startup to enterprise, we have the solution for you.
-
Field Service+ for MS Dynamics 365 & SalesforceResco’s mobile solution streamlines your field service operations with offline work, fast data sync, and powerful tools for frontline workers, all natively integrated into Dynamics 365 and Salesforce.
-
1
Flask-APScheduler
Adds APScheduler support to Flask
Flask-APScheduler is a Flask extension that adds support for the APScheduler. Loads scheduler configuration from Flask configuration. Loads job definitions from Flask configuration. Allows to specify the hostname which the scheduler will run on. Provides a REST API to manage the scheduled jobs. Provides authentication for the REST API. Integrates with Flask Blueprints. -
2
Gerapy
Distributed Crawler Management Framework Based on Scrapy
Distributed Crawler Management Framework Based on Scrapy, Scrapyd, Scrapyd-Client, Scrapyd-API, Django and Vue.js. Someone who has worked as a crawler with Python may use Scrapy. Scrapy is indeed a very powerful crawler framework. It has high crawling efficiency and good scalability. It is basically a necessary tool for developing crawlers using Python. -
3
Flask-SQLAlchemy
Adds SQLAlchemy support to Flask
Flask-SQLAlchemy is an extension for Flask that adds support for SQLAlchemy to your application. It simplifies using SQLAlchemy with Flask by setting up common objects and patterns for using those objects, such as a session tied to each web request, models, and engines. Flask-SQLAlchemy does not change how SQLAlchemy works or is used. See the SQLAlchemy documentation to learn how to work with the ORM in depth. The documentation here will only cover setting up the extension, not how to use... -
4
Atri Framework
Open-source full-stack web development framework built on top of React
The web framework to build stunning web apps. Build frontend easily using Atri visual builder or React code. Build backend using FastAPI. Atri framework is not just limited to the JavaScript world. You can use this framework with many languages such as Python, NodeJS (upcoming), etc. Atri framework comes with a suite of productivity tools such as visual editor, asset management tools, etc. that significantly reduce development time from months to hours. -
The Most Powerful Software Platform for EHSQ and ESG ManagementChoose from a complete set of software solutions across EHSQ that address all aspects of top performing Environmental, Health and Safety, and Quality management programs.
-
5
ProxyPool
An Efficient ProxyPool with Getter, Tester and Server
Simple and efficient proxy pool, providing the following functions. Regularly crawl free proxy websites, easy and scalable. Use Redis to store brokers and sort broker availability. Regular testing and screening to eliminate unavailable proxies and leave available proxies. Provides a proxy API to randomly select available proxies that pass the test. The principle analysis of the proxy pool can be seen in " How to Build an Efficient Proxy Pool ". It is recommended to read it before using it.... -
6
Splinter
Splinter - Python test framework for web applications
Splinter is a Python test framework for web applications, providing a simple and consistent API for browser automation and testing. -
7
Hydrogen
Run code interactively, inspect data, and plot
Hydrogen is an interactive coding environment that supports Python, R, JavaScript and other Jupyter kernels. Hydrogen was inspired by Bret Victor's ideas about the power of instantaneous feedback and the design of Light Table. Running code inline and in real-time is a more natural way to develop. By bringing the interactive style of Light Table to the rock-solid usability of Atom, Hydrogen makes it easy to write code the way you want to. -
8
OpsManage
Automated operation and maintenance platform
...If you need to quote the project code in your own project, please declare the agreement and copyright information in the project. Programming language, Python3.6 + HTML + JScripts. Front-end web framework, Bootstrap. Backend Web Framework, Django. Backend Task Framework, Celery + Redis. Programming language is Python 3.6. Operating System is CentOS 6+. Ansible version 2.6+. Deployment platform and node server Rsync 3+. -
9
Wooey
A Django app that creates automatic web UIs for Python scripts
Wooey is a simple web interface to run command line Python scripts. Think of it as an easy way to get your scripts up on the web for routine data analysis, file processing, or anything else. The project was inspired by how simply and powerfully sandman could expose users to a database and by how Gooey turns ArgumentParser-based command-line scripts into WxWidgets GUIs. -
Loan management software that makes it easy.Bryt Software is ideal for lending professionals who are looking for a feature rich loan management system that is intuitive and easy to use. We are 100% cloud-based, software as a service. We believe in providing our customers with fair and honest pricing. Our monthly fees are based on your number of users and we have a minimal implementation charge.
-
10
SMSBoom
SMS bombing / SMS pressure measurement, a robust and free python
SMS bombing / SMS pressure measurement / | A robust and free python SMS bombing program, specializing in blowing up bad guys, with millions of interfaces, multi-threaded automatic addition of effective interfaces, support for millions of concurrent asynchronous coroutines, a completely free SMS bombing too! Hongkonger develops the whole network for the first time! api.jsonDefine the interface in a custom way. -
11
V2RayCloudSpider
V2RayCloudSpider
V2RSS is an "ecological mining machine" that can perform vertical mining on global providers based on the SSPanel-Uim framework; it can generate bottom-up "aggregation collection" tasks for mainstream protocol headers; it can self-digest and Compared with proxypool , the output is purer and more reliable proxy nodes; it has powerful production features such as self-discovery and service self-healing. -
12
Webware for Python
The Classic Webware for Python
Webware for Python is a suite of components for dynamic, server-side web development. -
13
Raiden Network
Raiden Network
Use Raiden to enrich your dApp with nearly instant, low-fee and scalable payments. It comes with an easy-to-use API and is compatible with the Ethereum ERC20 token standard. Incentivized, decentralized P2P live streaming with micropayments using Raiden, introducing “Proof-of-Stream-Payment”. The Raiden Network is an infrastructure layer on top of the Ethereum Blockchain. While the basic idea is simple, the underlying protocol is quite complex and the implementation non-trivial. Nonetheless... -
14
ReconSpider
Most Advanced Open Source Intelligence (OSINT) Framework
...Reconnaissance is a mission to obtain information by various detection methods, about the activities and resources of an enemy or potential enemy, or geographic characteristics of a particular area. A Web crawler, sometimes called a spider or spiderbot and often shortened to crawler, is an Internet bot that systematically browses the World Wide Web, typically for the purpose of Web indexing (web spidering). -
15
Reminiscence
Self-Hosted Bookmark And Archive Manager
Bookmark links and edit its metadata (like title, tags, summary) via web interface. Archive links to content in HTML, PDF or full-page PNG format. Automatic archival of links to non-html content like pdf, jpg, txt etc. i.e. Bookmarking links to pdf, jpg etc.. via the web interface will automatically save those files on the server. Supports archival of media elements of a web page using third-party download managers. Directory-based categorization of bookmarks. Automatic tagging of HTML... -
16
restless
A lightweight REST miniframework for Python
A lightweight REST mini framework for Python. Works great with Django, Flask, Pyramid & Tornado, but should be useful for many other Python web frameworks. Based on the lessons learned from Tastypie & other REST libraries. Restless tries to be RESTful by default, but flexible enough. The main Resource class has data methods (that you implement) for all the main RESTful actions. -
17
CEF Python
Python bindings for the Chromium Embedded Framework (CEF)
...There are numerous use cases for CEF. Use it as a modern HTML5 based rendering engine that can act as a replacement for classic desktop GUI frameworks. Think of it as Electron for Python. Embed a web browser widget in a classic Qt / GTK / wxPython desktop application. Use it for automated testing of web applications with more advanced capabilities than Selenium web browser automation due to CEF low level programming APIs. -
18
workshops_project
Workshops is an open source, simple, dead-lightweight LMS
Workshops is an open source, simple, dead-lightweight LMS (Learning Management System) application programmed in Python (version 3.8.x) with Django (version 2.2.x) web framework which main purpose is to make a standarized way to share knowledge via courses in a slide-based view in browser powered by remark javascript library, easy to create, edit, delete and show your courses using simple markdown and html if necessary. Inspired on an old project in my social labours to help share knowledge in an easy way. -
19
Flask-MongoEngine
MongoEngine flask extension with WTF model forms support
Flask-MongoEngine is a Flask extension that provides integration with MongoEngine, WtfForms and FlaskDebugToolbar. By default, Flask-MongoEngine will install integration only between Flask and MongoEngine. Integration with WTFForms and FlaskDebugToolbar are optional and should be selected as extra option, if required. This is done by users request, to limit amount of external dependencies in different production setup environments. All methods end extras described below are compatible... -
20
bioweb
polyglot language framework to analyze genetic data
polyglot framework using Python/C++/JavaScript to fast develop applications to analyze biological sequences -
21
Kore
Scalable and secure web application framework
Kore is a web application platform for writing scalable, concurrent web-based processes in C or Python. It is built with a "secure by default" approach. It is fully privileged separated while using strong security features at the operating system level such as second, pledge, unveil, and more. Today Kore is used in a variety of applications ranging from high assurance cryptographic military devices, machine-learning stacks and even in the aerospace industry. -
22
nginx ui
Nginx UI allows you to access and modify the nginx configurations
We use nginx in our company lab environment. It often happens that my colleagues have developed an application that is now deployed in our Stage or Prod environment. To make this application accessible nginx has to be adapted. Most of the time my colleagues don't have permission to access the server and change the configuration files and since I don't feel like doing this for everyone anymore I thought a UI could help us all. If you feel the same way I wish you a lot of fun with the... -
23
Zappa
Serverless Python
Zappa makes it super easy to build and deploy serverless, event-driven Python applications (including, but not limited to, WSGI web apps) on AWS Lambda + API Gateway. Think of it as "serverless" web hosting for your Python apps. That means infinite scaling, zero downtime, zero maintenance - and at a fraction of the cost of your current deployments! With a traditional HTTP server, the server is online 24/7, processing requests one by one as they come in. ... -
24
The GUIDOLib provides a powerful engine for the graphic rendering of music scores, based on the Guido Music Notation format. It supports Linux, Mac OS X, Windows, Android and iOS operating systems. A Java JNI interface is available as well as a Javascript version of the library. A Web API has also been designed, allowing to deploy the engine as a Web service.
-
25
Flask-GraphQL
Adds GraphQL support to your Flask application
Adds GraphQL support to your Flask application. This will add /graphql endpoint to your app and enable the GraphiQL IDE. If you are using the Schema type of Graphene library, be sure to use the graphql_schema attribute to pass as schema on the GraphQLView view. Otherwise, the GraphQLSchema from graphql-core is the way to go. The GraphQLSchema object that you want the view to execute when it gets a valid request. A value to pass as the context_value to graphql execute function. By default is...
