Open Source Python Clustering Software - Page 3

This package provides Python bindings to the OpenPBS C API. All functions of the OpenPBS C library can be accessed in Python through the use of this package. We provide extensive documentation on the usage and lots of examples.

RainforestCluster is an Amazon EC2 python program that manages and load-balances dynamic clusters to allow for maximum workflow flexibility and speed at minimal cost. It enables one to quickly and cheaply create dynamic compute clusters in the cloud, which can then run computational pipelines generically. It is also able to optimize the use of spot instances - idle computers in Amazon's cloud that are available at drastically reduced cost (5x-10x cheaper) - but can be terminated at any moment if capacity drops or the bid price rises. It also provides pre-installed features such as GlusterFS distributed filesystems, ThunderstormDistributor queuing system, RAID 0 /scratch, password-less ssh, and automatic cluster management, for ease of use and maximum processing speed for computational tools. Originally it was developed as a different version for the Wall Lab at Harvard CBMI.

The Portable Highly Available Sensors (PHASE) project aims at creating an example application that demonstrates the usage of Application Interface Specification service interfaces of the Service Availability Forum.

SSS-OSCAR is an integrated release of the SciDAC:Scalable System Software (SSS) suite using the OSCAR cluster installation framework. The SSS project seeks to provide a standard interface for effective management and utilization of terascale systems.

scAMOn Clients: Open Source clients of the Scali ScaMon cluster monitoring server

Scalable Cluster Environment (SCE) is a set of interoperable opensource tools that enable users to build and use Beowulf cluster effectively to solve their problems.

Command line tools designed to setup and manage the Lustre file system on a cluster.

The purpose of this program is to prove that given a finite number of Monkeys and a finite amount of time one monkey will be able to make more money off the stock market than any human being. Checkout our web site for an uncorrupted download.

ZFS is a system of automatically replicating file servers closely resembling CODA.

Interactive web monitor for PBS/Torque batch systems, focused on providing queue and detailed job information for users.

The web bases system that allows one user register himself in web interface and run bioinformatic tasks on multiple clusters.

Virtualinux allows the deployment and configuration of clusters of virtual machines. Virtual clusters are fault tolerant and can be copied, duplicated, snapshot, migrated, etc. Storage virtualization provides services for transparent expansion.

XtreemOS project aims at building a Linux-based operating system to support virtual organizations for next generation Grids.

Zeus Grid is a Grid Computing environment usefull to run systems in heterogenous machines at same time. In this first step, it will only compile, run and collect application results and file storage.

The ZSyncer project allows multiple Zopes to easily be manually synchronized by transferring data between them using xml-rpc. This can save a lot of time over the old export / transfer / import dance. See the home page for more information.

asyncoro is a Python framework for developing concurrent, distributed, network programs with asynchronous completions and coroutines. Asynchronous completions implemented in asyncoro are sockets (non-blocking sockets), database cursors, sleep timers and locking primitives. Programs developed with asyncoro have same logic and structure as Python programs with threads, except for a few syntactic changes. asyncoro supports socket I/O notification mechanisms epoll, kqueue, /dev/poll (and poll and select, where necessary), and Windows I/O Completion Ports (IOCP) for high performance and scalability, and SSL for security

General purpose client/server python execution code. This code allows a server to serve a list of python codes to clients for execution. The client then sends the result (literally the value of the variable converted to a string) back to the server.

coNCePTuaL is a toolset for rapidly generating portable, readable, and reproducible network-performance tests. coNCePTuaL can perform the equivalent of many pages of C code with just a few mouse clicks or lines of code in a domain-specific language.

This tool lets you login with SSH to a group of machines and interact with them as if they were one machine. Each command that you enter is run in parallel on all machines in the group. The output from each machine is printed separately.

ipvsman is a ncurses GUI for the ipvs linux loabalancer. ipvsmand is a multithreaded lifekeeping daemon. This all-in-one solution makes it easy to steer ipvs in realtime with additional robust service lifekeeping.

A very lightweight Python program that executes commands on multiple Linux hosts in a user-designated number of threads via SSH. Intended for management for a large number of Linux/Unix nodes

Python Integrated Parallel Programming EnviRonment (PIPPER), Python pre-parser that is designed to manage a pipeline, written in Python. It enables automated parallelization of loops. Think of it like OpenMP for Python, but it works in a computer cluster

A python daemon to watch a directory for kernel’s inotify events and then execute an rsync command to synchronize two different directories (local or remote). A poor man’s mirroring or an alternative (not so) real data replication mechanism