Search Results for "python web crawler"

justniffer is a TCP sniffer. It reassembles and reorders packets and displays the tcp flow in a customizable way. It can log network traffic in web server log format. It can also log network services performances (e.g. web server response times) and extract http content (images, html, scripts, etc)

Cinemagoer is a Python package useful to retrieve and manage the data of the IMDb movie database about movies, people, characters and companies. Platform-independent, it can retrieve data from both the IMDb's web server and a local copy of the whole db.

Please note that OWFS source code, and all Issue/Tickets/merge requests have now been moved to https://github.com/owfs/owfs/. Developer mailing lists will still be kept at Sourceforge. ---- OWFS -- 1-Wire file system. Use the Dallas 1-Wire and iButton chips with standard filesystem commands. Create temperature loggers. Monitor everything. OWHTTPD -- same system, only used as a light weight web server. OWFS is also ported to embedded routers, Mac OSX and Windows. Basically you can use...

PotHead What is it? Pothead: A simple lightweight packet for creating a minimal interaction honeypot How does it work? Magic, Well kinda you don’t need super dupper knowledge to use this! Oops the magic failed ;) a really nice INSTALL.md will be written unfortunately it’s not yet available. 1) Download all the files 2) Check if you got everything 3) Upload and configure the Website and backend (includes/Config.php & the .SQL files) 4) Do not forget to change your...

Parses a log (file or http), shows the relevant information in the form of a table. Allows filtering, searching, limited keyword highlighting. Is fully customizable: - which information to show - adding alternative parsers - reads from a file or a http server Current alpha version supports multiple parsers, for which the specification is found in an XML file (which should have the extension '.lpc'. The interface is not customizable yet. If you're interested in how it is done, check out the code.

privacyIDEA is a management and authentication system for two factor authentication. You can use OTP tokens, OTP cards, SMS, Smartphone Apps to incorparte the second factor. It can even manage SSH keys and supports Offline OTP. The latest version can manage and enroll user certificates. Its modular design makes it easily enhancable. It runs on Linux. Applications and workflows can be connected to privacyIDEA hence enabling two factor authentication in your system logon, web...

A system to log and track user logons, logoffs, computer information, and statistics in a Microsoft Windows environment. It includes a client side application (veloapport.exe - intended to be run as a logon and logoff script) and an analyzer (veloapportdetective.py) reporting hardware changes and populates a computer inventory table. The client (veloapport.exe) sends user and machine information to a MySQL database server and VeloApport Detective populates a computer inventory table while...

yalimon (Yet another linux monitoring tool) is a python script that runs as a cron job, gathers data from several commands, stores it in a database and then creates graphs out of it. A web interface is used to view the images and to manage the module

Use python to parse privoxy log in clf format and refer to wot ratings of the site and then dump the data in a sqlite database for statistics generation later.

Python gen-purpose log monitoring tool. Can track several log files at once, and trigger actions by regexp matching. Actions are defined via modules with a very simple interface to implement. It can monitor syslog as well as gather web server stats.

Operating system & software monitoring utility designed to be modular and reliable. Its purpose is to monitor various system state and services in a uniform way.

fwgraph is an attempt to characterize and present network traffic including network devices, QoS, and iptables under Linux.

OpenPavilion is a free surveillance suite made for observing, monitoring and benchmarking your applications and networks. OpenPavilion displays comprehensive relationships using simple to understand dashboard views.

sarplot provides automated graph generation from statistics generated by the sar (system activity recorder) utilitiy. It is intended as a drop-in utility that generates daily and hourly graphs viewable through a web interface.

PootyPedia is a tool to track the hardware in use by a software project. Its client software finds the hardware and reports it, while the server software tracks the reports and keeps them organized in a database.

A web-based human event (links/books read, songs played, etc.) logging tool focused on rich bibliographic support and library (as in books-on-shelves) systems integration.

DPytHOS is a means for administrators of large networks to both monitor and manage the servers under their control. DPytHOS is implemented in python and uses a generic database back-end (with MySQL supported and MS-SQL 2000 supported via XML)

Logpecker is a tool for syslog files like /var/log/messages. More flexible than a simple regexp matcher, you can use syslog facility and priority. Messages that appear too often are sieved out. Generates root-tail tickers, reports, active event lists

View, track, filter, archive, alert, group, rotate logs through a GUI, CLI, or WebUI.