Showing 318 open source projects for "web crawler source code"

View related business solutions
  • AestheticsPro Medical Spa Software Icon
    AestheticsPro Medical Spa Software

    Our new software release will dramatically improve your medspa business performance while enhancing the customer experience

    AestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.
    Learn More
  • The Most Powerful Software Platform for EHSQ and ESG Management Icon
    The Most Powerful Software Platform for EHSQ and ESG Management

    Addresses the needs of small businesses and large global organizations with thousands of users in multiple locations.

    Choose from a complete set of software solutions across EHSQ that address all aspects of top performing Environmental, Health and Safety, and Quality management programs.
    Learn More
  • 1
    RND

    RND

    Random data generator: secure character streams and large files

    ...RND.zip contains the source code and the x86/x64 executables for Linux, Windows, Raspberry Pi.
    Downloads: 1 This Week
    Last Update:
    See Project
  • 2

    tinyfilemanager

    Web based File Manager in PHP, Single File and light weight

    Tiny PHP File Manager It is a simple, fast and small file manager with single php file. It is also a web code editor. It'll run either online or locally, on Linux, Windows or Mac based platforms. The only requirement is to have PHP 5.5+ available.
    Downloads: 2 This Week
    Last Update:
    See Project
  • 3
    Free Academic Timetable Software

    Free Academic Timetable Software

    Free web timetabling software for education and training providers.

    A user friendly web-based timetabling software designed for all types of education and training providers to schedule classes, facilities, trainers and split classes into groups. It was designed by an academic professional with over 5 years experience in education timetabling systems and 14 years experience in the education and training sector. It is easy to set up and is really user friendly for everyone. Comes with manuals, training videos and is free to use and install, but not for...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 4

    MinixD

    Rewrite Minix 3 from C to D

    The idea is to rewrite a good part of the Minix 3 OS from C to D, hopefully making the code easier to understand by grouping code in modules. Minix 3 web site: http://minix3.org/ D programming language: http://www.digitalmars.com/d/
    Downloads: 0 This Week
    Last Update:
    See Project
  • Complete Data Management for Nonprofits Icon
    Complete Data Management for Nonprofits

    Designed to fit with multi-level non-profit organization, across any sector

    NewOrg is a robust platform built with enhanced features to help non-profit organizations that capture and integrate the information from all of their operational areas to better manage volunteers, clients, programs, outcome reporting, activity sign-ups & scheduling, communications, surveys, fundraising activities and Development campaigns. NewOrg can truly deliver an intuitive product that will help manage your Committees, Donors, Events, and Memberships so that the organization runs efficiently.
    Learn More
  • 5
    DOClever

    DOClever

    The best interface management platform

    DOClever is a commercial open-source product that is completely free. Whether you are a front-end engineer or a back-end engineer, the interface is always the bridge for the interaction between the two, so DOClever is specially designed for small and medium-sized teams, aiming to solve interface management, testing and data generation, and achieve a truly integrated solution plan. Can edit and manage interface information, support five methods of getting, post, put, delete, patch, support...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 6
    OpenSearchServer Search Engine

    OpenSearchServer Search Engine

    An open source search engine with RESTFul API and crawlers

    OpenSearchServer is a powerful, enterprise-class, search engine program. Using the web user interface, the crawlers (web, file, database, etc.) and the client libraries (REST/API , Ruby, Rails, Node.js, PHP, Perl) you will be able to integrate quickly and easily advanced full-text search capabilities in your application: Full-text with basic semantic, join queries, boolean queries, facet and filter, document (PDF, Office, etc.) indexation, web scrapping,etc. OpenSearchServer runs on...
    Downloads: 11 This Week
    Last Update:
    See Project
  • 7
    JPPF

    JPPF

    The open source grid computing solution

    JPPF makes it easy to parallelize computationally intensive tasks and execute them on a Grid.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 8
    pyspider

    pyspider

    A powerful Spider(Web Crawler) system in Python

    pyspider is a powerful Spider(Web Crawler) system in Python. Components are connected by message queue. Every component, including message queue, is running in their own process/thread, and replaceable. That means, when process is slow, you can have many instances of processor and make full use of multiple CPUs, or deploy to multiple machines. This architecture makes pyspider really fast. benchmarking. Since pyspider has various components, you can just run pyspider to start a standalone and...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 9
    Easy-HotSpot

    Easy-HotSpot

    A super easy WiFi hotspot user management utility for Mikrotik router

    Easy HotSpot, A super easy WiFi hotspot user management utility for Mikrotik RouterOS based Router devices and works using the PHP PEAR2 API client by boenrobot. This PHP/MySql/Bootstrap based package can be installed in any supporting OS in a local webserver of the client or in any internet based webservers of choice. Put the contents/source code in the root or in a sub folder of the host/domain, as required. A MySql database need to be created in order to work, but the package will...
    Leader badge
    Downloads: 7 This Week
    Last Update:
    See Project
  • The most trusted software in construction Icon
    The most trusted software in construction

    HCSS is the gold standard software solution for winning, planning, and managing construction projects by connecting the office to the field.

    HCSS provides easy-to-use software built for construction companies that want to win more work, work smarter, and boost profits. For nearly 40 years, we've helped heavy civil contractors, infrastructure builders, and utility companies improve operations, from estimating and project management to field tracking, equipment maintenance, and safety. Tools like HeavyBid, HeavyJob, and HCSS Safety are built for the field and designed to work together, giving your team real-time visibility, tighter cost control, and better job outcomes. With 45+ accounting integrations and customizable APIs, HCSS fits seamlessly into your tech stack. We regularly update our software based on feedback from real crews, ensuring it fits the way your team works. Backed by award-winning 24/7/365 support and a proven implementation process, HCSS helps reduce risk, cut inefficiencies, and deliver fast ROI. If you're ready to grow your business and gain a competitive edge, HCSS is the partner that gets you there.
    Learn More
  • 10
    Accent Tool Suite

    Accent Tool Suite

    Accent interfaces and controls systems through goals and policies

    Accent (Advanced Component Control Enhancing Network Technologies) is a comprehensive tool suite that interfaces a variety of communications systems and allows these systems to be controlled through goals (high-level user aims) and policies (lower-level system rules). Accent has been applied to the domains of: o Call Control: for telecommunications, particularly call control in Internet telephony o Home Care: for home automation and telecare, particularly for domestic appliances...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 11
    Assorted projects. General-purpose libraries for Python, C++, Scala, bash, and others. Meta-programming tools. System utilities. UI components. Web APIs. Configuration files. Benchmarks. Programming competition entries. And much more.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 12

    BoneOS

    Barebone linux os build environement

    BoneOS is *not* a linux distro but a build enviroment setup to build a linux based appliance mainly targeted at embedded world and low power/memory platforms. BoneOS is based on T2 linux SDE and share it's initial code base with mon0wall, askoziapbx, teebx.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 13
    owfs and owhttpd

    owfs and owhttpd

    Project moved to https://github.com/owfs/owfs/

    Please note that OWFS source code, and all Issue/Tickets/merge requests have now been moved to https://github.com/owfs/owfs/. Developer mailing lists will still be kept at Sourceforge. ---- OWFS -- 1-Wire file system. Use the Dallas 1-Wire and iButton chips with standard filesystem commands. Create temperature loggers. Monitor everything. OWHTTPD -- same system, only used as a light weight web server.
    Downloads: 4 This Week
    Last Update:
    See Project
  • 14
    NinjaFirewall

    NinjaFirewall

    Powerfull Web Application Firewall for PHP

    NinjaFirewall (Pro Edition) is a powerful Web Application Firewall designed to protect all PHP softwares, from custom scripts to popular shopping cart softwares and CMS applications. Some of its features are: * Powerful filtering engine. * Stand alone Web Application Firewall. * Protects against remote & local file inclusions, code execution, uploads, SQL injections, bots and scanners, XSS and many other threats. * Hooks and sanitises all HTTP requests before they reach your...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 15

    Apache GUI

    A free open sourced Apache Http Server GUI developed with Java.

    This project is used to provide a free java based open source Apache Http Server GUI. The solution is deployed as a web application that is accessible through a web browser. The solution is designed to be compatible with modern Windows and IX operating systems. Source code for this project is hosted on github https://github.com/jrossi227/ApacheGUI
    Leader badge
    Downloads: 46 This Week
    Last Update:
    See Project
  • 16
    SL Operating Systems
    Welcome Everyone... SL OS is a free replacement for Windows on the PC and OS X on the Mac. We believe in the power of open source and global collaboration. That means anyone can download, use, modify, and contribute to the code we've written to bring their ideas to life. The code is developed in the open, meaning it's available for review, scrutiny, and improvement by tens of thousands of developers all around the world. All before it hits your system.SL OS is an easy-to-use Indian distribution based on linux. ...
    Downloads: 3 This Week
    Last Update:
    See Project
  • 17
    Defa Protect HTML5 Video From Download

    Defa Protect HTML5 Video From Download

    Prevent and Protect Your HTML5 Video, Music , Audio From Download Free

    Defa Protector is A Simple PHP and Wordpress Plugin To Protect and Prevent Video Save As From Browser and Some Video Grabber. There is 100% Guaranteed Protection and There might be some tradeoff but If you care about Digital Rights Management of Your Video and Music Content. This Project is for you. Defa Protector 6.7.1 Revamp Code For Better Performance To The Bone. We almost rewritten this project from scratch.
    Downloads: 0 This Week
    Last Update:
    See Project
  • 18
    Simple Movie Catalog will scan a given directory for movies, query imdb for info and generate a catalog in html which offers sorting and grouping of found movies by different criteria. Note: source code has been moved to github: https://github.com/damienlangg/SimpleMovieCatalog
    Downloads: 5 This Week
    Last Update:
    See Project
  • 19
    DCP Setup Maker

    DCP Setup Maker

    Powerful cross-platform install builder

    Great and powerful application to generate stable and multi-platform java installers. Watch a demo of DCP Setup Maker's installer being made in 2 minutes: https://www.youtube.com/watch?v=dmF5Kyla7Hg Its intuitive UI and exceptional ease of use makes it very easy to build complex installers with large amounts of files. The whole process is done step by step through a wizard-like interface, filling in fields and setting up files to finally build your package. *Required: Java...
    Downloads: 6 This Week
    Last Update:
    See Project
  • 20
    diskover

    diskover

    File system crawler and disk space usage software

    diskover is a file system crawler and disk space usage software that uses Elasticsearch to index your file metadata. diskover crawls and indexes your files on a local computer or remote storage server over network mounts. diskover helps manage your storage by identifying old and unused files and give better insights into data change "hotfiles", file duplication "dupes" and wasted space. It is designed to help deal with managing large amounts of data growth and provide detailed storage...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 21

    PeerGuardian

    PeerGuardian - a privacy oriented firewall application

    ...It's highly recommended to use PeerBlock instead, which is a continuation of PeerGuardian's development in Windows, with bug fixes and support for Windows Vista and Windows 7. Collaboration with peerblock.com is welcome! PeerGuardian is an open project. Not only is its source code open for you to read, use, and modify - but the project is open for you to join and contribute in any form (code, documentation, bug reports, web and support).
    Downloads: 33 This Week
    Last Update:
    See Project
  • 22
    lua-resty-waf

    lua-resty-waf

    High-performance WAF built on the OpenResty stack

    lua-resty-waf is a web application firewall implemented in Lua for OpenResty/NGINX, designed to run inline at the edge with low overhead. It inspects requests and responses during NGINX phases, applying rule logic and anomaly scoring to detect patterns like SQL injection, cross-site scripting, and protocol abuse. Rules are organized into policies with configurable actions—block, log, or allow—and can leverage shared dictionaries for counters, rate limits, and caching decisions. Because it...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 23
    Wobserver

    Wobserver

    Web based metrics, monitoring, and observer

    Web based metrics, monitoring, and observer. Drop-in monitoring though web interface. Metrics endpoint (/metrics) for system monitoring. (Default: Prometheus) Monitoring automation through JSON API. Node management and discovery behind firewalls and load balancers. Easy to extend. Add custom metrics and pages for your project, just by adding them in the config. Just 3 lines of code to add pages/metrics for your library when users have :wobserver installed. Wobserver does not support being...
    Downloads: 0 This Week
    Last Update:
    See Project
  • 24
    Network Tracking Database

    Network Tracking Database

    Track your ARP/MAC table changes and so much more

    The Network Tracking Database (NetDB for short) tracks all changes to the MAC address tables on your switches and the ARP tables on your routers over time stored in MySQL. It supports extensive switch, VLAN and vendor code reports from a CLI or Web App. NetDB can generate CSV reports, track the usage of static IP addresses, record neighbor discovery data and much more. There is now a VM "appliance" with easier upgrades available in the Files section. See the...
    Downloads: 5 This Week
    Last Update:
    See Project
  • 25
    recoll-firefox-extension

    recoll-firefox-extension

    Index the web pages you visit with the Recoll text search tool

    Please note that this extension is superceded by a new one based on the WebExtensions API for Firefox 57 and later: https://addons.mozilla.org/en-US/firefox/addon/recoll-we/ The source for the new version is here: https://opensourceprojects.eu/p/recollwe/code/ This Firefox extension allows you to include the web pages that you visit in Firefox in the index built by the Recoll text search tool. The extension has been reviewed and should now be directly installed from the Mozilla addons catalog: https://addons.mozilla.org/en-US/firefox/addon/recoll-indexer-1/ The package on the Mozilla site is the up-to-date version of this project, and replaces the sourceforge downloads, which are kept only as history. ...
    Downloads: 0 This Week
    Last Update:
    See Project