I'm adding the ability to deploy a Map/Reduce job to a remote Hadoop cluster in Virgil. With this, Virgil allows users to make a REST POST to schedule a Hadoop job. (pretty handy)
To get this to work properly, Virgil needed to be able to remotely deploy a job. Ordinarily, to run a job against a remote cluster you issue a command from the shell:
hadoop jar $JAR_FILE $...
In response to a few requests for a binary distribution, we just posted artifacts for Virgil.
For simplicity, we're keeping the version number aligned with the version of Cassandra.
(which is important when you are running with an embedded Cassandra ;)
Also, we changed it so you can simply...
In an effort to make Hadoop/MapReduce on Cassandra more accessible, we added a REST layer to Virgil that allows you to run map reduce jobs written in Ruby against column families in Cassandra by simply posting the ruby script to a URL. This greatly reduces the skill set required to write and deploy the jobs, and allows users to rapidly develop analytics for data store in Cassandra.