Comments on: Introducing Luwak, a library for high-performance stored queries http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/ The Open Source Search Specialists Tue, 12 Feb 2019 14:44:32 +0000 hourly 1 https://wordpress.org/?v=4.9.8 By: Sergey Nikolaev http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-50643 Wed, 18 Apr 2018 04:16:44 +0000 http://www.flax.co.uk/blog/?p=1064#comment-50643 At Manticore (continuation of Sphinx Search project) we’ve developed a similar technology. Here’s the benchmark comparing that to Luwak – https://manticoresearch.com/2018/04/18/percolate-queries-manticore-search-vs-luwak/

]]>
By: romseygeek http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25982 Fri, 01 May 2015 08:24:36 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25982 Hi Bakhy,

The default query parser that comes with luwak just uses the standard lucene query parser, which will understand boolean syntax and boosting. Just be aware that the standard lucene scoring model doesn’t make a great deal of sense in this case, because each query is run across an index consisting of a single document, so the IDF value will always be 1. You can set the Similarity model to be used when constructing an InputDocument if you want to use a different model, and then retrieve scores using a ScoringMatcher.

The lucene query parser doesn’t support geosearches at the moment (although there is some work being done to include simple geospatial syntax, see https://issues.apache.org/jira/browse/LUCENE-6450), so if you want to add these type of queries you’ll have to write a new query parser. It should be possible to extend the standard parser to this end.

]]>
By: Bakhy http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25981 Thu, 30 Apr 2015 18:47:45 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25981 Hi, Charlie!

I’ve built the luwak master-5.1 branch from https://github.com/flaxsearch/luwak/tree/master-5.1 and it works perfect for me.

Here are my queries and documents.
query_01 = [Toyota Camry 2002]
query_02 = [Tesla model S]

document_01 = [Need a BMW i528 2000 in San Francisco, CA 94105]
document_02 = [Looking for a tesla in Mountain View, CA 94043]

The luwak engine found:
document_02 is matched query_02

I’m impressed with the luwak performance. For instance: 1,000,000 queries against 20 documents took only ~104seconds.

So I want to say a big thank you to all of you who have worked on this project and would like to ask the following questions:

1) Can I provide a query like this to the luwak engine?
query_n = [(+honda +volvo )^2.75 (+camry +bmw )^0.75 ]

As you see, I have the power term “^2.75” in my query, that means a particular key word is 2.75 times important than other key words in the query. So my question is does the luwak engine recognize those kind of syntaxes?

2) Also I would like to add a geo param such as latitude, longtitude and raduis to queries. Is it possible? If yes, please provide tools/plugins/links/materials.

Best,
Bakhy

]]>
By: romseygeek http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25978 Fri, 06 Jun 2014 08:10:39 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25978 Hi Elaine,

At the moment luwak is a standalone library, rather than integrated directly into Solr. It will work with any lucene Query object, and you can plug in one of the Solr query parsers if you like. Filter queries don’t make so much sense with luwak, as the queries are only ever run over a single document.

]]>
By: charlie http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25979 Fri, 06 Jun 2014 07:14:48 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25979 Hi Elaine,

Do let us know more about your use case directly if you like via http://www.flax.co.uk/contact/

Charlie

]]>
By: Elaine http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25977 Thu, 05 Jun 2014 17:51:11 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25977 We’ve been looking for a solution like this on solr; will definitely give it a spin. Wondering if this has support for filter queries or searches against particular (non-default) fields?

]]>
By: romseygeek http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25976 Wed, 19 Feb 2014 18:38:27 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25976 Could you open an issue on github? https://github.com/flaxsearch/luwak/issues

]]>
By: Anonymous http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25975 Tue, 18 Feb 2014 06:57:35 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25975 Yup done with that part but in demoqueries file how should I put regular expression queries.Whenever I try to put something like “comm*” I got errors.

]]>
By: charlie http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25974 Thu, 13 Feb 2014 08:54:45 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25974 There is an example project in the Github repository – try building it and let us know how you get on.

]]>
By: Anonymous http://www.flax.co.uk/blog/2013/12/06/introducing-luwak-a-library-for-high-performance-stored-queries/#comment-25973 Wed, 12 Feb 2014 12:11:07 +0000 http://www.flax.co.uk/blog/?p=1064#comment-25973 Hey Charlie,
Nice work.
I am a newbie to solr and I do not know how to include your work in my project any help will be appreciated
Thanks

]]>