Lifting the hood of AI – to find a search engine?

A few years ago much marketing noise was made about Big Data. Every software vendor suddenly had a Big Data suite; you could suddenly buy Big Data capable hardware; consultants and experts would release thought pieces, blogs and books all about Big Data and how it would change the world. The reality of course was slightly different: Big Data meant...well, it meant whatever you wanted it to mean for your commercial purpose. For some people, what didn't fit in an Excel spreadsheet was Big Data, fo...Continue reading

Haystack, the search relevance conference – day 1

Last week I attended the Haystack relevance conference - I've already written about my overall impressions but the following are some more notes on the conference sessions. Note that some of the presentations I attended have already been covered in detail by Sujit Pal's excellent ...Continue reading

When even the commercial vendors are using it, has open source search won?

There have been some interesting announcements recently which may point to an increasing realisation amongst commercial search firms that an open source model is an essential advantage in today's search market. Coveo have announced that their enterprise search engine can run on an Elasticsearch core, an interesting move for a previously decidedly closed source company. BA Insight, who have previou...Continue reading

Comparing Solr and Elasticsearch – here's the code we used

A couple of weeks ago we presented the initial results of a performance study between Apache Solr and Elasticsearch, carried out by my colleague Tom Mortimer. Over the last few years we've tested both engines for client projects and noticed some significant performance differences, which we thought deserved fuller investigation. ...Continue reading

More than an API – the real third wave of search technology

I recently read a blog post by Karl Hampson of Realise Okana (who offer HP Autonomy and SRCH2 as closed source search options) on his view of the 'third wave' of search. The second wave he identifies (correctly) as open source, admitting somewhat grudgingly that "We’d heard about Lucene for years but no customers seemed to take it seriously until all of a s...Continue reading

Autumn events roundup – ESS DC, Solr vs Elasticsearch & a new Meetup

It's looking like a busy Autumn for search events - first, I'm presenting at Enterprise Search & Discovery 2014 in Washington DC on November 5th, talking about 'Turning Search Upside Down with open source software'. I'll be describing how we've replaced various underperforming, big name closed source search engines with faster & more scalable open ...Continue reading

Time for the crystal ball again…

It's always fun to make predictions about the future, especially as one can be pretty sure to be proved wrong in interesting ways. At the start of 2014 we at Flax are looking forward to another year of building open source search and we already have some great client projects in progress that we'll shortly be able to talk about, but what else might be happening this year? Here's some points to note: