Comments on: Library Love http://www.lucidimagination.com/blog/2010/01/08/lucid-library-love/ Exclusively dedicated to Apache Lucene/Solr open source search technology Sat, 04 Feb 2012 01:13:03 +0000 hourly 1 http://wordpress.org/?v=3.3 By: Jan Høydahl http://www.lucidimagination.com/blog/2010/01/08/lucid-library-love/comment-page-1/#comment-5154 Jan Høydahl Thu, 01 Jul 2010 12:52:02 +0000 http://www.lucidimagination.com/blog/?p=1453#comment-5154 Hi, Have you profiled SolrMarc to see why it is slow? Did you run it in Embedded or remote mode? Checking the source, it appears that SolrMarc does not use the StreamingUpdateSolrServer. It would be a nice test to simply swap out CommonsHttpSolrServer with StreamingUpdateSolrServer with 5 threads in SolrRemoteProxy (http://code.google.com/p/solrmarc/source/browse/tags/release-2.1.1/lib/solrmarc/src/org/solrmarc/solr/SolrRemoteProxy.java) and see whether it helps. Hi,

Have you profiled SolrMarc to see why it is slow? Did you run it in Embedded or remote mode?

Checking the source, it appears that SolrMarc does not use the StreamingUpdateSolrServer. It would be a nice test to simply swap out CommonsHttpSolrServer with StreamingUpdateSolrServer with 5 threads in SolrRemoteProxy (http://code.google.com/p/solrmarc/source/browse/tags/release-2.1.1/lib/solrmarc/src/org/solrmarc/solr/SolrRemoteProxy.java) and see whether it helps.

]]> By: Lucid Imagination » A billion here, a billion there… pretty soon http://www.lucidimagination.com/blog/2010/01/08/lucid-library-love/comment-page-1/#comment-4392 Lucid Imagination » A billion here, a billion there… pretty soon Mon, 08 Mar 2010 16:12:38 +0000 http://www.lucidimagination.com/blog/?p=1453#comment-4392 [...] will make your head spin, and unforgiving relevancy for the masses (our own Erik Hatcher hails from that space and is still quite active in it).  Chances are if you’re running into a tough search [...] [...] will make your head spin, and unforgiving relevancy for the masses (our own Erik Hatcher hails from that space and is still quite active in it).  Chances are if you’re running into a tough search [...]

]]> By: Lucid Imagination » Book Review: Solr 1.4 Enterprise Search Server (Packt) by David Smiley and Eric Pugh http://www.lucidimagination.com/blog/2010/01/08/lucid-library-love/comment-page-1/#comment-4210 Lucid Imagination » Book Review: Solr 1.4 Enterprise Search Server (Packt) by David Smiley and Eric Pugh Mon, 11 Jan 2010 17:15:16 +0000 http://www.lucidimagination.com/blog/?p=1453#comment-4210 [...] p. 236: EmbeddedSolrServer – Streaming locally available content into Solr is not, IMO, an attractive use of embedded Solr.  It misses being able to run an indexer on a separate machine and multiprocess/thread easily.  I’ll grant that both the rich client application and upgrading from a pure Lucene-based solution make sense for embedded, but these are pretty exceptional use cases.  And the advantages to using Solr over HTTP are pretty extensive (scaling, separation, replication, distributed search).  Also, SolrMarc is not a good example, IMO, of using embedded Solr server.  See my recent foray back into this world. [...] [...] p. 236: EmbeddedSolrServer – Streaming locally available content into Solr is not, IMO, an attractive use of embedded Solr.  It misses being able to run an indexer on a separate machine and multiprocess/thread easily.  I’ll grant that both the rich client application and upgrading from a pure Lucene-based solution make sense for embedded, but these are pretty exceptional use cases.  And the advantages to using Solr over HTTP are pretty extensive (scaling, separation, replication, distributed search).  Also, SolrMarc is not a good example, IMO, of using embedded Solr server.  See my recent foray back into this world. [...]

]]>