Comments on: Exploring Lucene and Solr’s TrieRange Capabilities http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/ Exclusively dedicated to Apache Lucene/Solr open source search technology Sat, 04 Feb 2012 01:13:03 +0000 hourly 1 http://wordpress.org/?v=3.3 By: Todd Nine http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-6485 Todd Nine Wed, 06 Oct 2010 18:52:35 +0000 http://www.lucidimagination.com/blog/?p=646#comment-6485 Hey guys, Just an FYI, numeric ranges aren't properly indexed or returned in Lucene unless you use a precision step of Integer.MAX. This is currently a bug within the LuceneTermEnum not enumerating over results properly. I've filed the bug and I'm working on the fix, but you should be leery of depending on accurate results with the current source version ( 56007e4630932be57699) http://github.com/tjake/Lucandra/issues#issue/40 Hey guys,
Just an FYI, numeric ranges aren’t properly indexed or returned in Lucene unless you use a precision step of Integer.MAX. This is currently a bug within the LuceneTermEnum not enumerating over results properly. I’ve filed the bug and I’m working on the fix, but you should be leery of depending on accurate results with the current source version ( 56007e4630932be57699)

http://github.com/tjake/Lucandra/issues#issue/40

]]> By: Lucid Imagination » Lucene and Solr: the Java of data http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3952 Lucid Imagination » Lucene and Solr: the Java of data Fri, 23 Oct 2009 15:24:13 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3952 [...] there. One new thing you can do with Lucene 2.9 and Solr 1.4 more readily, is to use the new numeric search to encode proprietary business rules around ranges within data. In general, since the data is [...] [...] there. One new thing you can do with Lucene 2.9 and Solr 1.4 more readily, is to use the new numeric search to encode proprietary business rules around ranges within data. In general, since the data is [...]

]]> By: Lucid Imagination » Ranges over Functions in Solr 1.4 http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3535 Lucid Imagination » Ranges over Functions in Solr 1.4 Tue, 07 Jul 2009 01:43:09 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3535 [...] course, Solr 1.4 also contains the new TrieRange functionality that will generally have the best time/space profile for range queries over numeric [...] [...] course, Solr 1.4 also contains the new TrieRange functionality that will generally have the best time/space profile for range queries over numeric [...]

]]> By: Ranges over Functions in Solr 1.4 « Solr ‘n Stuff http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3534 Ranges over Functions in Solr 1.4 « Solr ‘n Stuff Tue, 07 Jul 2009 01:37:50 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3534 [...] course, Solr 1.4 also contains the new TrieRange functionality that will generally have the best time/space profile for range queries over numeric [...] [...] course, Solr 1.4 also contains the new TrieRange functionality that will generally have the best time/space profile for range queries over numeric [...]

]]> By: Uwe Schindler http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3452 Uwe Schindler Wed, 03 Jun 2009 14:13:26 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3452 Hi Aleksander, the only drawbacks of TrieRange are a little bit larger index sizes, because of the additional terms indexed, and you cannot read the values with tools like Luke at the moment. TrieRange fields can be natively sorted (so the FieldCache uses no String comparison, they are parsed to longs/ints/...) and so function queries are also possible. Additionally TrieRange also supports dates (there is a "tdate", too), which are stored natively (as unix ts in long format, see Date.getTime()). So sorting by date is very fast and you can also do ranges down to the millisecond. So I would recommend tdate for every date-time datatype! Date math is also possible in queries like with standard dt field types. Hi Aleksander,

the only drawbacks of TrieRange are a little bit larger index sizes, because of the additional terms indexed, and you cannot read the values with tools like Luke at the moment.

TrieRange fields can be natively sorted (so the FieldCache uses no String comparison, they are parsed to longs/ints/…) and so function queries are also possible. Additionally TrieRange also supports dates (there is a “tdate”, too), which are stored natively (as unix ts in long format, see Date.getTime()). So sorting by date is very fast and you can also do ranges down to the millisecond. So I would recommend tdate for every date-time datatype! Date math is also possible in queries like with standard dt field types.

]]> By: Grant Ingersoll http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3411 Grant Ingersoll Wed, 20 May 2009 11:11:45 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3411 Hi Aleksander, I'm not sure on your questions just yet, as I have only begun to explore the TrieRange capability. One thought, though, on dates, is I think Dates are currently stored as Strings (I presume you are talking Solr) and thus, storing as primitive Dates should be more compact, thus using less disk space, memory, etc. That being said, we likely should have a new Date field in Solr that stores as primitives even w/o the primitives. Hi Aleksander,

I’m not sure on your questions just yet, as I have only begun to explore the TrieRange capability. One thought, though, on dates, is I think Dates are currently stored as Strings (I presume you are talking Solr) and thus, storing as primitive Dates should be more compact, thus using less disk space, memory, etc. That being said, we likely should have a new Date field in Solr that stores as primitives even w/o the primitives.

]]> By: Solr/Lucene Feature Alert: TrieRange Capabilities | Productification http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3407 Solr/Lucene Feature Alert: TrieRange Capabilities | Productification Wed, 20 May 2009 01:05:18 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3407 [...] you want to read more, you can read the article posted by Grant on Lucid’s [...] [...] you want to read more, you can read the article posted by Grant on Lucid’s [...]

]]> By: StauthamerNet :: Staut’s Family Blog» Blog Archive » links for 2009-05-17 http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3398 StauthamerNet :: Staut’s Family Blog» Blog Archive » links for 2009-05-17 Sun, 17 May 2009 23:02:46 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3398 [...] Lucid Imagination » Exploring Lucene and Solr’s TrieRange Capabilities Recently, Uwe Schindler and others have added a new capability to Lucene and Solr to make working with numeric ranges a lot faster. I haven’t tried out this new functionality yet, so I thought I would walk through it here and explore it’s capabilities. [...] [...] Lucid Imagination » Exploring Lucene and Solr’s TrieRange Capabilities Recently, Uwe Schindler and others have added a new capability to Lucene and Solr to make working with numeric ranges a lot faster. I haven’t tried out this new functionality yet, so I thought I would walk through it here and explore it’s capabilities. [...]

]]> By: Webhamer Weblog: Search & ICT-related blogging » links for 2009-05-17 http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3397 Webhamer Weblog: Search & ICT-related blogging » links for 2009-05-17 Sun, 17 May 2009 22:01:56 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3397 [...] Lucid Imagination » Exploring Lucene and Solr’s TrieRange Capabilities Recently, Uwe Schindler and others have added a new capability to Lucene and Solr to make working with numeric ranges a lot faster. I haven’t tried out this new functionality yet, so I thought I would walk through it here and explore it’s capabilities. [...] [...] Lucid Imagination » Exploring Lucene and Solr’s TrieRange Capabilities Recently, Uwe Schindler and others have added a new capability to Lucene and Solr to make working with numeric ranges a lot faster. I haven’t tried out this new functionality yet, so I thought I would walk through it here and explore it’s capabilities. [...]

]]> By: Aleksander Stensby http://www.lucidimagination.com/blog/2009/05/13/exploring-lucene-and-solrs-trierange-capabilities/comment-page-1/#comment-3390 Aleksander Stensby Fri, 15 May 2009 09:23:24 +0000 http://www.lucidimagination.com/blog/?p=646#comment-3390 Great overview, Grant! What would you say are the drawbacks of using the trie range field type for foreign key like fields that you sometimes want to sort on or put range limitations on? And do you have any thoughts on efficiency of representing dates as primitives instead of the Date field, if you use date as a sort field very often? - Aleksander Great overview, Grant! What would you say are the drawbacks of using the trie range field type for foreign key like fields that you sometimes want to sort on or put range limitations on? And do you have any thoughts on efficiency of representing dates as primitives instead of the Date field, if you use date as a sort field very often?
- Aleksander

]]>