Software

Misc

yalla/pkt2flow – pkt2flow extended to work with OSX. Splits a huge PCAP-file into all individual TCP- and UDP-streams, saving every stream into it’s own new PCAP-file. Works stunningly fast, splits a 100,000 packet/80 MB file in about 30 seconds. You won’t do that with Wireshark in that time.

Libraries

OpenMP

The OpenMP Application Program Interface (API) supports multi-platform shared-memory parallel programming in C/C++ and Fortran on all architectures, including Unix platforms and Windows NT platforms. Jointly defined by a group of major computer hardware and software vendors, OpenMP is a portable, scalable model that gives shared-memory parallel programmers a simple and flexible interface for developing parallel applications for platforms ranging from the desktop to the supercomputer.

OpenMP Homepage

MPICH2

MPICH2 is a freely available, portable implementation of MPI, the Standard for message-passing libraries. It implements both MPI-1 and MPI-2. The CH comes from Chameleon, the portability layer used in the original MPICH to provide portability to the existing message-passing systems.

MPICH2 homepage
Installer’s Guide (PDF)
User’s Guide (PDF)
Windows Developer’s Guide

MVAPICH2 for InfiniBand

MVAPICH is a high performance implementation of MPI-1 over InfiniBand based on MPICH1. MVAPICH2 is a high performance MPI-2 implementation based on MPICH2. High performance and scalable support over the Verbs Level Interface (VAPI) are provided by these packages. These packages also support other underlying transport interfaces (such as the emerging uDAPL, OpenIB/Gen2 and the standard TCP/IP) for portability across multiple networks.

MVAPICH2 for InfiniBand homepage

MPICH-GM for Myrinet

MPICH-GM is a port of MPICH on top of GM (ch_gm).

MPICH-GM Software at myri.com

Windows Compute Cluster Server 2003

Windows Compute Cluster Server 2003 is Microsoft’s implementation of the OpenMPI-standard with their own set of administrative software.

“Microsoft Windows Compute Cluster Server 2003 (CCS) brings the supercomputing power of high-performance computing (HPC) to the desktop and workgroup level in a familiar Windows-based development environment. CCS accelerates time-to-insight by providing an HPC platform that is simple to deploy, operate, and integrate with existing infrastructure and tools.”

Windows Compute Cluster Server 2003

The Message Passing Interface standard

Not a software on it’s own, but some homepages holding the MPI-standards all compliant MPI-Implementations must follow.

MPI Standard Homepage
MPI Forum

Grid-/Distributed-computing engines

(I’m not going to make a hard difference between grid- and distributed-computing; the boundary is not really clearly defined. If you like, you can read Ian Foster’s paper “What is the Grid? A Three Point Checklist“.)

Sun Grid Engine

The Grid Engine project is an open source community effort to facilitate the adoption of distributed computing solutions. Sponsored by Sun Microsystems and hosted by CollabNet, the Grid Engine project provides enabling distributed resource management software for wide ranging requirements from compute farms to grid computing.

Sun Gridengine project homepage

BOINC

BOINC is a software platform for distributed computing using volunteered computer resources.

BOINC Homepage

Resource/Batch/Workload Managers

Condor

Condor is a specialized workload management system for compute-intensive jobs. Like other full-featured batch systems, Condor provides a job queueing mechanism, scheduling policy, priority scheme, resource monitoring, and resource management. Users submit their serial or parallel jobs to Condor, Condor places them into a queue, chooses when and where to run the jobs based upon a policy, carefully monitors their progress, and ultimately informs the user upon completion.

Condor Project Homepage

Moab Workload Manager

Moab Workload Manager is a policy-based job scheduler and event engine that enables utility-based computing for clusters. It simplifies management across one or multiple hardware, operating system, storage, network, license and resource manager environments [...].
Moab Workload Manager combines intelligent scheduling of resources with advanced reservations to process jobs on the right resources at the right time. It also provides flexible policy and event engines [...].

Moab Workload Manager

General Links

  • Grid Resources has an amazingly long list of links – points to sites and projects i never heard about, might be worth a look

One Response to Software

  1. Keedoreors says:

    Can anyone recommend the top performing Remote Management utility for a small IT service company like mine? Does anyone use Kaseya.com or GFI.com? How do they compare to these guys I found recently: N-able N-central MSP solution
    ? What is your best take in cost vs performance among those three? I need a good advice please… Thanks in advance!

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

Follow

Get every new post delivered to your Inbox.

Join 120 other followers

%d bloggers like this: