Luwak 1.3.0 released

Posted on November 17, 2015 by Alan Woodward

The latest version of Luwak, our open-source streaming query engine, has been released on the Sonatype Nexus repository and will be making its way to Maven Central in the next few hours. Here's a summary of the new features and improvements we've made: Batch processing I...Continue reading

Faster bulk indexing in Elasticsearch

Posted on September 28, 2015 by Alan Woodward

We recently did some work for Arachnys who provide data on a wide range of emerging markets. Their data, gathered by a complex process of web crawling, is stored in HBase and served out of a 10-node Elasticsearch cluster. Periodically, better ways of extracting data from the raw crawl will be implemented...Continue reading