Search Results for "web crawler source code"
Sort By:
Showing 180 open source projects for "web crawler source code"
View related business solutions-
The Most Powerful Software Platform for EHSQ and ESG ManagementChoose from a complete set of software solutions across EHSQ that address all aspects of top performing Environmental, Health and Safety, and Quality management programs.
-
Award-Winning Medical Office Software Designed for Your SpecialtyRXNT is an ambulatory healthcare technology pioneer that empowers medical practices and healthcare organizations to succeed and scale through innovative, data-backed, AI-powered software.
-
1
Dockside
Develop, stage and test on-prem or in your private cloud
Develop, stage, and test on-prem or in your private cloud. Dockside is a tool for provisioning lightweight access-controlled IDEs, staging environments, and sandboxes - aka 'devtainers' - on local machines, on-premises raw metal or VM, or in the cloud. Dockside is a tool for provisioning lightweight access-controlled IDEs, staging environments and sandboxes - aka devtainers - on the local machines, self-hosted on-premises on bare metal or VM, or in the cloud. By provisioning a devtainer for... -
2
Perl 5
The Perl programming language
This repository contains the reference implementation of the Perl 5 programming language, including the interpreter, core modules, build system, and an extensive test suite. Perl 5 is a multi-paradigm language renowned for powerful text processing, rich regular expressions, and pragmatic glue code across systems. The core distribution is highly portable, building on Unix, Linux, Windows, and many other platforms, with stable release cycles and careful back-compatibility. A C API (XS) and... -
3
ModSecurity Nginx Connector
ModSecurity v3 Nginx Connector
ModSecurity-nginx is the connector that embeds the ModSecurity v3 (libmodsecurity) web application firewall engine into NGINX. It integrates WAF processing into the NGINX request/response phases, allowing rules to inspect headers, bodies, and even streaming request data before it reaches upstream apps. Operators can load the OWASP Core Rule Set or custom rules to detect and block common attacks such as SQLi, XSS, RCE patterns, and protocol anomalies. The module exposes directives for... -
4
Nipe
An engine to make Tor network your default gateway
Nipe is a Perl-based engine whose primary aim is to make the Tor network act as the default gateway for outgoing traffic. In practice, it configures system firewall rules (iptables) and network routing so that almost all IPv4 traffic is redirected through Tor. The tool provides commands such as install, start, stop, restart, and status to manage its behavior. When “start” is issued, it sets up the necessary rules; when “stop” is used, it attempts to remove those rules. Nipe currently... -
Skillfully - The future of skills based hiringSkillfully transforms hiring through AI-powered skill simulations that show you how candidates actually perform before you hire them. Our platform helps companies cut through AI-generated resumes and rehearsed interviews by validating real capabilities in action. Through dynamic job specific simulations and skill-based assessments, companies like Bloomberg and McKinsey have cut screening time by 50% while dramatically improving hire quality.
-
5
vRain
Chinese Ancient eBooks Generator
vRain is a small, focused automation tool aimed at simplifying routine tasks on education-oriented web platforms, particularly those that require periodic attendance or check-ins. It encapsulates login, session management, and request sequencing so repetitive actions can be executed reliably on a schedule. A configuration-driven approach lets users store multiple accounts, adjust intervals, and toggle features without modifying code. The program surfaces clear logs and result summaries so... -
6
MisterHouse is a Windows/Unix home automation program written in Perl. It can respond to voice commands, web browsers, time of day, serial port and X10 data, external files, etc and can speak via Text to Speech engines. Support is on https://sourceforge.net/p/misterhouse/mailman/misterhouse-users/ and code is maintained on https://github.com/hollie/misterhouse
-
7
bbbike
An information system for cyclists in Berlin and Brandenburg
A bike information system for cyclists in Berlin and Brandenburg (Germany) with a map view and a routing engine. There's a graphical interface (based on Perl/Tk) as well as an Web interface. Source code may be found at Github: https://github.com/eserte/bbbike/ -
8
Arexx Data Logger UI
A web UI to Arexx temperature loggers
This project aims at displaying and analysing data recorded by Arexx temperature loggers on Unix operating systems. Although the code is currently implemented for etching data from Arexx loggers, the UI itself is completely independent and can be reused with other temperature databases. -
9
BIGSdb
Software for storing and analysing bacterial sequence data
...See Jolley and Maiden 2010, BMC Bioinformatics 11:595 (http://www.biomedcentral.com/1471-2105/11/595). You can report bugs or make enhancement requests using the issues tracker at https://github.com/kjolley/BIGSdb. The source code is also mirrored there. -
AestheticsPro Medical Spa SoftwareAestheticsPro is the most complete Aesthetics Software on the market today. HIPAA Cloud Compliant with electronic charting, integrated POS, targeted marketing and results driven reporting; AestheticsPro delivers the tools you need to manage your medical spa business. It is our mission To Provide an All-in-One Cutting Edge Software to the Aesthetics Industry.
-
10
Quiz/Survey/Test - QST
A Free, complete, open source universal assessment/exam platform
QST, the worlds unparalleled open source online/lan assessment software. From a quick quiz on your phone to very large scale, high stakes, proctored desktop testing, we make it easy/secure/economical. Our intuitive design contains features (Immediate detailed results, Create/Export/Import/Convert Questions, WYSIWYG/Math-Chemistry/Basic Editors, Question/Item Bank, Multiple Question Types, Multiple Delivery Styles, Multiple Delivery/Results Options, Adaptive/Branching Questions, Randomly... -
11
A network access control (NAC) system featuring a captive-portal for registration and remediation, wired and wireless management, 802.1X support, isolation of devices, integration with IDS; it can be used to secure networks from small to large. Source code is hosted here: https://github.com/inverse-inc/packetfence Issue tracker is hosted here: https://github.com/inverse-inc/packetfence/issues
-
12
Easyspider - Distributed Web Crawler
Easy Spider is a distributed Perl Web Crawler Project from 2006
Easy Spider is a distributed Perl Web Crawler Project from 2006. It features code from crawling webpages, distributing it to a server and generating xml files from it. The client site can be any computer (Windows or Linux) and the Server stores all data. Websites that use EasySpider Crawling for Article Writing Software: https://www.artikelschreiber.com/en/ https://www.unaique.net/en/ https://www.unaique.com/ https://www.artikelschreiben.com/ https://www.buzzerstar.com/ https://easyperlspider.sourceforge.io/ https://www.sebastianenger.com/ https://www.artikelschreiber.com/opensource/ It is fun to look at some code that is few years ago and to see how one has improved himself. ... -
13
A general purpose source code indexer and cross-referencer that provides web-based browsing of source code with links to the definition and usage of any identifier. Supports multiple languages. Up-to-date information in http://lxr.sourceforge.net
-
14
This is software to create web dictionaries, esp. for Esperanto like Reta Vortaro (http://reta-vortaro.de). A dictionary is made from articles written in a special XML dialect by transformations using XSLT, ant and some Java code.
-
15
GitPrep
Portable GitHub system into your own server
GitPrep is a lightweight, self-hosted web interface for browsing Git repositories, typically deployed on a single server with minimal dependencies. It implements features like commit history browsing, file viewing and diffing, directory tree navigation, tag/branch switching, and README rendering, much like GitHub’s core UI. Because it’s written in Perl and designed for simplicity, setup is often as easy as cloning, configuring a webroot, and pointing to repositories. Authentication and basic... -
16
Erwin
Erwin is an IRC-bot in Perl, using POE.
Erwin is an IRC-bot in Perl, using POE, written with modularity and expandability in mind. Installing and configuring modules is very easy, compared to lots of other Perl bots where you have to read the source and add your own code in the various event loops. Adding additional functionality is as easy as writing a subroutine that returns something and configuring a regex to use that subroutine. By typing "!google keyword", for instance, "Google::Search" gets "keyword" as an argument,... -
17
C-squares
Concise spatial query and representation system (c-squares)
C-squares is an easily implemented method for storage, querying and display of spatial data locations, based on a hierarchical, grid-based representation of the Earth' surface. Source code for encoding, decoding, mapping, etc. is provided via this site. Additional support is available by contacting the system developer, Tony.Rees@marinespecies.org; see also the c-squares home page at http://www.cmar.csiro.au/csquares/ . -
18
TaxOnTree
A program for associating taxonomic information in a phylogenetic tree
TaxOnTree is a phylogenetic program for associating Taxonomic information in a phylogenetic tree. The output is a NEX format tree file configured to be opened in FigTree, that users can promptly color by any taxa or by the ancestrality shared by sequences with query. Input can be a Fasta formatted file to be used in a BLAST search or a list of sequences represented by their identifiers (UniProtAC or NCBI gi), if a cluster is already available. Also, a newick file produced with user software... -
19
get_iplayer
A utility for downloading TV and radio programmes from BBC iPlayer
get_iplayer enables you to search, index and record BBC iPlayer TV and BBC Sounds radio programmes. It can also download subtitles and signed or audio described programmes (where available). get_iplayer has PVR-like capabilities - you can save lists of programme searches which are automatically recorded when they become available. Requires Perl 5.16+ with LWP, LWP::Protocol:https, Mojolicious, XML::LibXML, and CGI... -
20
Codepot
Web-based subversion manager
Codepot is a web-based subversion repository manager. It incorporates the subversion revision control system and wiki-based documentation, and supports authentication via LDAP or DBMS. If you opt for the simplest, you can manage multiple subversion repositories independent of each other. Going beyond it, you can track issues, write documents, and upload release files. See it live at http://code.abiyo.net -
21
Bridge Designer and Contest
A national virtual bridge engineering contest for kids of all ages.
Bridge Designer has been replaced with the web app ASCE Bridge Designer, Cloud Edition. Binaries posted here will go away on 1 July 2026. The source repo will remain. A national virtual bridge engineering contest with prizes for middle and high school kids, grades 6 to 12, but anyone can enter for fun. Based on the award-wining Bridge Designer client software, now open source through this project. Web site infrastructure supports worldwide participation in qualifying and semifinal rounds... -
22
RoomFinder
View your company building(s) on Google Maps
More details can be found at https://sites.google.com/site/parishnetworks/home/technology/roomfinder I wrote this for my company, where the campus is large enough that people sometimes had difficulties finding other people, conference rooms, etc. It is especially handy for Helpdesk, new hires, mail room personnel, etc who often need to find people and places that are new to them. The (Perl & JavaScript) code is fairly straight forward, but getting your building floor plan(s) into... -
23
Mojo-Webqq
Perl-based smart QQ client framework
Mojo-Webqq is an unofficial Perl client and bot framework for the QQ messaging platform’s web endpoints, built on the Mojolicious real-time web stack. It manages login flows, session refresh, and long-polling or websocket-style message reception to deliver events into an asynchronous event loop. Plugins and hooks let developers implement auto-replies, keyword filters, logging, forwarding, and integrations with external services or databases. The library abstracts contacts, groups, and... -
24
ND+ - Natural Docs Plus
The Extended Natural Docs Package
...o Tables o Several Plugins o Package Merging o Syntax Highlighting o List indenting and leveling o Admonition's o Modeline support Natural Docs is an open-source documentation generator for multiple programming languages. You document your code in a natural syntax that reads like plain English. Natural Docs then scans your code and builds high-quality HTML documentation from it. Please review the ND++ web-site for details and report any issues via sourceforge.. http://ndplus.sourceforge.net/ -
25
Perlito5
"Perlito" Perl programming language compiler
Perlito is a compiler collection that implements subsets of Perl 5 and Perl 6 (now Raku), allowing Perl code to be compiled into Java or JavaScript. This facilitates running Perl code in environments like the JVM or web browsers.
