boneill42's blog

Virgil moved to Github!

To make it easier for people to contribute to Virgil, we've moved the project to github!
https://github.com/hmsonline/virgil

As a side note...

I've succumb to the force and created a twitter account.
@boneill42
https://twitter.com/#!/boneill42

Bundling Gems in Jars/Wars for Jruby

As part of Virgil's ability to deploy ruby scripts to a remote Hadoop cluster, we needed to package gems' into that Hadoop jar.  After a bit of monkeying around, we got it.

Programmatically submitting jobs to a remote Hadoop cluster

 I'm adding the ability to deploy a Map/Reduce job to a remote Hadoop cluster in Virgil

Binaries available for download from Virgil

In response to a few requests for a binary distribution, we just posted artifacts for Virgil.

Hadoop/MapReduce on Cassandra using Ruby and REST!

 In an effort to make Hadoop/MapReduce on Cassandra more accessible, we added a REST layer to Virgil that allows you to run map reduce jobs written in Ruby against column families in Cassandra by simply posting the ruby script to a URL. This greatly reduces the skill set required to write and deploy the jobs, and allows users to rapidly develop analytics for data store in Cassandra.

Concurrent use of embedded Ruby in Java (using JRuby)

Last night, I was finishing up the map/reduce capabilities within Virgil. We hope to allow people to post ruby scripts that will then get executed over a column family in Cassandra using map/reduce. To do that, we needed concurrent use of a ScriptEngine that could evaluate the ruby script.

Introducing run-modes to Virgil: support for embedded or remote cassandra instances