Skip to main content

Blog Archive for boneill42 during December 2011

 I'm adding the ability to deploy a Map/Reduce job to a remote Hadoop cluster in Virgil. With this, Virgil allows users to make a REST POST to schedule a Hadoop job. (pretty handy)  To get this to work properly, Virgil needed to be able to remotely deploy a job. Ordinarily, to run a job against a remote cluster you issue a command from the shell: <br /> hadoop jar $JAR_FILE $...
In response to a few requests for a binary distribution, we just posted artifacts for Virgil. http://code.google.com/a/apache-extras.org/p/virgil/downloads/list   For simplicity, we're keeping the version number aligned with the version of Cassandra.  (which is important when you are running with an embedded Cassandra ;)   Also, we changed it so you can simply...
 In an effort to make Hadoop/MapReduce on Cassandra more accessible, we added a REST layer to Virgil that allows you to run map reduce jobs written in Ruby against column families in Cassandra by simply posting the ruby script to a URL. This greatly reduces the skill set required to write and deploy the jobs, and allows users to rapidly develop analytics for data store in Cassandra. To get...