Search Results for "web crawler source code"
Sort By:
Showing 156 open source projects for "web crawler source code"
View related business solutions-
Secure Online Fax and Business Text Messaging ServiceSend and receive SMS and fax online, from email, app or with our developer friendly SMS & fax API. HIPAA compliant & ISO 27001 certified. Outstanding value and 5-star service.
-
Regpack: All-in-One Online Registration and Payment SoftwareRegpack is a powerful onboarding, registration, and payments platform trusted by thousands of organizations worldwide. Our mission is simple: to give you the tools to automate busywork, streamline your processes, and keep your focus where it belongs, on growing your programs and serving your clients.
-
1
RobotsTxt
The repository contains Google's robots.txt parser
This is a high-performance, production-tested library for parsing and evaluating robots.txt rules against crawler user agents. It implements the core semantics of the Robots Exclusion Protocol: user-agent sections, Allow/Disallow directives, wildcard handling, and precedence rules. The code is optimized for speed and low memory so large crawls can evaluate millions of URLs quickly. It also focuses on correctness—edge cases like overlapping patterns and longest-match resolution are handled... -
2
J2ObjC
A Java to iOS Objective-C translation tool and runtime
J2ObjC is an open-source command-line tool from Google that translates Java source code to Objective-C for the iOS (iPhone/iPad) platform. This tool enables Java source to be part of an iOS application's build, as no editing of the generated files is necessary. The goal is to write an app's non-UI code (such as application logic and data models) in Java, which is then shared by web apps (using GWT), Android apps, and iOS apps. -
3
iCn3D
Web-based protein structure viewer and analysis tool
"I see in 3D" (iCn3D) Structure Viewer is not only a web-based 3D viewer, but also a structure analysis tool interactively or in the batch mode using NodeJS scripts based on the npm package icn3d. iCn3D synchronizes the display of 3D structure, 2D interaction, and 1D sequences and annotations. Users' custom displays can be saved in a short URL or a PNG image. The complete package of iCn3D including Three.js and jQuery is in the directory "dist" after you get the source code with the "Code" button. ... -
4
OWASP Amass
In-depth attack surface mapping and asset discovery
The OWASP Amass Project has developed a tool to help information security professionals perform network mapping of attack surfaces and perform external asset discovery using open source information gathering and active reconnaissance techniques. The Open Web Application Security Project (OWASP) is a nonprofit foundation that works to improve the security of software. All of our projects ,tools, documents, forums, and chapters are free and open to anyone interested in improving application... -
anny is an all-in-one platform for managing hybrid workplaces and shared resources.Enable your employees to easily book desks, meeting rooms, parking spots, equipment, and more – all in one place. With flexible rules and group permissions, you stay in full control of who can access what.
-
5
STranslate
A ready-to-go translation ocr tool developed with WPF/WPF
STranslate is a lightweight, open-source machine translation front end that lets users translate text between languages using a variety of supported back-end translation engines or APIs, offering a simple GUI for quick translation tasks without needing to write code or use complex web UIs. The application is designed to be small, cross-platform, and flexible, giving users the ability to type or paste text and receive instant translations while optionally selecting the desired language pairs or switching between multiple service providers. ... -
6
PySchool
Installable / Portable Python Distribution for Everyone.
PySchool is a free and open-source Python distribution intended primarily for students who learn Python and data analysis, but it can also used by scientists, engineering, and data scientists. It includes more than 150 Python packages (full edition) including numpy, pandas, scipy, sympy, keras, scikit-learn, matplotlib, seaborn, beautifulsoup4... -
7
myFP2ESP8266 Focus Controller
This is a port of the myFP2ESP32 Wifi Focus Controller to the ESP8266
A ESP8266 WiFi focuser. DRV8825, ULN2003, L298N, L293DMINI , L9110S, Support for Webserver, ALPACA, and TCP/IP. (c) Robert Brown 2014-2025, Holger M, 2019-2021. All rights reserved. Code or portions of code may not be copied or used without appropriate credit given to author(s). -
8
mySQM+ DIY SQM WEATHER STATION
ESP32 mySQM+ Sky-Meter/Weather Station with loads of features
mySQM+ Sky Quality Meter/Weather Station (c) R Brown, 2020-2025, All rights reserved. Permission is granted for personal and Academic use only. Code or portions of code may not be copied or used without appropriate credit given to author(s). EXPANSION BOARDS - You can expand this project using the two types of project expansion boards at https://sourceforge.net/projects/myesp-boards/ -
9
myESP32S3-N16R8 Focuser
ESP32S3_DEVKITC_1 N16R8 Wifi focuser
An ESP32S3 WiFi Focuser (ALPACA-ASCOM-LINUX-INDI-TCPIP-WINDOWS) (c) Robert Brown 2014-2026, Holger M, 2019-2021. All rights reserved. Code or portions of code may not be copied or used without credit given to authors. Read Part1 pdf to determine the board you will need, then download those board files. Downloading all files will cause confusion and hinder your project progress. Both PCB and DIY are supported. Spreadsheet to calculate what stepper motor to... -
Safety Compliance Made EasyIdeally designed for business that deals with Construction, Oil & Gas, Mining, Manufacturing, Mechanical, Electrical, Plumbing, Heating, and Excavating, SiteDocs is a perfect solution for any size business looking to modernize the way Safety Compliance is organized.
-
10
...You can also connect directly with the companies supporting the development. Source code available on github https://github.com/geonetwork/
-
11
myFP2ESP32-Dev WiFi ASCOM Focuser
ASCOM-INDI ESP32-Dev Wifi focuser
An ESP32-Dev WiFi focuser. DIY or PCB designs. (c) Robert Brown 2014-2025, Holger M, 2019-2021. All rights reserved. Code or portions of code may not be copied or used without appropriate credit given to authors. Spreadsheet to calculate what stepper motor to use. https://sourceforge.net/projects/arduinoascomfocuserpro2diy/files/Documentation/Nema-Stepper-Motors.xlsx/download Spreadsheets to calculate... -
12
SPPAS
SPPAS - the automatic annotation and analyses of speech
SPPAS is a scientific computer software package written and maintained by Brigitte Bigi of the Laboratoire Parole et Langage, in Aix-en-Provence, France. Available for free, with open source code, there is simply no other package for linguists to simple use in the automatic annotations of speech, the analyses of any kind of annotated data and the conversion of annotated files. SPPAS is able to produce automatically speech annotations from a recorded speech sound and its orthographic... -
13
PlateEditor
PlateEditor, a free web application to work with multi-well plates
...It doesn't require any installation. - PlateEditor is available at this address: https://plateeditor.sourceforge.io - The source code is also available on GitHub, visit: https://github.com/vindelorme/PlateEditor More information about the source code and the API are available there (the wiki is still under construction, thanks for your patience!) For a list of recent updates, visit: https://sourceforge.net/p/plateeditor/wiki/Updates/ Hoping PlateEditor will make your life easier in the lab! ... -
14
CleverPsych Practice Management
FREE software to manage your psychology or allied health solo practice
CleverPsych is FREE software for psychologists and other allied health professionals who run their own practices. We have been using CleverPsych in our own practice in Australia since 2007. The system enables you to record your clients, appointments, services, organisations and referring doctors. The aim is to make operations like generating standard letters, claiming from the government and insurance companies, and reporting income, much easier. Look in the Files tab for... -
15
bbbike
An information system for cyclists in Berlin and Brandenburg
A bike information system for cyclists in Berlin and Brandenburg (Germany) with a map view and a routing engine. There's a graphical interface (based on Perl/Tk) as well as an Web interface. Source code may be found at Github: https://github.com/eserte/bbbike/ -
16
Astrolog
Astrology calculation, charting, and analysis
Astrolog is astrology software featuring many types of computation, display, graphics, comparison, and analysis. It supports multiple environments, such as MS Windows and Unix X Windows, with complete C++ source code available. For more information see the Web site: http://www.astrolog.org/astrolog.htm -
17
GeoTools, the Java GIS toolkit
Toolkit for working with and mapping geospatial data
GeoTools is an open source (LGPL) Java code library which provides standards compliant methods for the manipulation of geospatial data. GeoTools is an Open Source Geospatial Foundation project. The GeoTools library data structures are based on Open Geospatial Consortium (OGC) specifications. -
18
OpenClinic GA
Open Source Integrated Hospital Information Management System
OpenClinic GA is an open source integrated hospital information management system covering management of administrative, financial, clinical, lab, x-ray, pharmacy, meals distribution and other data. Extensive statistical and reporting capabilities. OpenClinic GA and OpenClinic GMAO are owned by Frank Verbeke, MD, PhD at Post-Factum BV (https://www.post-factum.be) -
19
LinAsm
Collection of fast and optimized assembly libraries for x86-64 Linux
LinAsm is collection of very fast and SIMD optimized assembly written libraries for x86-64 Linux. It implements many common and widely used algorithms for array manipulations: searching, sorting, arithmetic and vector operations, unit conversions; fast mathematical and statistic functions; numbers and time converting algorithms; finite impulse response (FIR) digital filters; spectrum analysis algorithms, Fast Hartley transformation; CPU cache friendly functions and extremely fast abstract... -
20
BIGSdb
Software for storing and analysing bacterial sequence data
...See Jolley and Maiden 2010, BMC Bioinformatics 11:595 (http://www.biomedcentral.com/1471-2105/11/595). You can report bugs or make enhancement requests using the issues tracker at https://github.com/kjolley/BIGSdb. The source code is also mirrored there. -
21
DeepSee
Visualize deep ocean biogeochemical sediment samples in 2D and 3D!
DeepSee is an interactive workspace for deep ocean scientists to upload sediment core data and map images and see their sampling history displayed across multiple connected views at once! 🦑🦀🐚 🚀 For a live demo, visit: https://www.its.caltech.edu/~datavis/deepsee/ 🌱 To get started, visit our Wiki: https://sourceforge.net/p/deepsee/wiki/Home/ 🧑💻 To modify DeepSee for your own project, visit our GitHub repository: https://github.com/orphanlab/DeepSee/ --- Created by Adam Coscia,... -
22
Traccar (GPS tracking system)
Open source system for GPS tracking devices
...Application includes embedded web server to track devices on map. Official web page: https://www.traccar.org/ Demo: https://www.traccar.org/demo-server/ Source code repository: https://github.com/tananaev/traccar Issues tracker: https://github.com/tananaev/traccar/issues -
23
SGraph
Create charts by retrieving data from Stata on-the-fly
SGraph is a web application that interacts with Stata for creating graphs. It is a demo application that demostrates how to exploit SWire for creating web applications that communicate with Stata. SGraph is an open source project and you can download the code from the project web site web site or try the app on-line here: http://sgraph-with-swire.sourceforge.net/ The source project is hosted in GitHub: https://github.com/lomagno/sgraph -
24
ESP32 Dew Controller
ESP32 4-channel dew controller.
This is an enhanced 4-Channel automated Dew Controller based on an ESP32 WiFi chip on a PCB and enclosed in a project hobby box. (c) Copyright Robert Brown 2020-2024. All Rights Reserved.Permission is granted for personal and Academic use only. Code or portions of code may not be copied or used without appropriate credit given to author. EXPANSION BOARDS - You can expand this project using the two types of project expansion boards at https://sourceforge.net/projects/myesp-boards/ -
25
Aseryla2
Aseryla2 code repositories
This project describes a model of how the semantic human memory represents the information relevant to the objects of the world in text format. It provides a system and a GUI application capable of extracting and managing concepts and relations from English texts. https://aseryla2.sourceforge.io/
