Search Scalability & Performance
There are two constants about content and data: it will change, and it will grow
With LucidWorks Enterprise, you have the foundation you need to tame the inevitable growth and change of the content for your search application. By lowering the cost of change and delivering unmatched Scalability, you can use this fast, flexible search solution development platform to build, maintain and grow your search application to make the most of your data. You are not asked to pay unnecessary penalties for growing the breadth of your data or the count of documents to be searched. And our attractively priced subscriptions give you the headroom your search application needs to be able to grow with the requirements of the organization, without requiring big investments in hardware to match pace with that growth.
The Solr/Lucene technology at the heart of LucidWorks enterprise has been proven to scale in the most demanding environments – scaling billions of documents, multiple petabytes of storage, with subsecond query and facet response time. For ultra-large volumes of content and queries into the tens of millions of documents and beyond, Solr application developers can take advantage of shards, or sectioned indexes, to distribute search by splitting Solr instances to run across multiple servers. LucidWorks Enterprise leverages solr's replication capabilities to easily add additional server hardware resources, or dedicated load balancer systems. Lucidworks Enterprise also integrates key Solr innovations, like Solr Cloud, which includes a new and improved facility for configuration of high-scale distributed search. By maintaining the state of the distributed Solr cluster configuration (specifically, which servers have which shards), this innovation acts as a central point for search infrastructure configuration, without being a single point of failure.
Here are just a few examples demonstrating the scalability of native Solr/Lucene technology:
-
Netflix over 2 million queries per day
-
The Hathi Trust – 6,671,366 total books including of 2,334,978,100 pages and 248 terabytes (September 2010)
-
LinkedIn 100 million registered users, billions of searches analyzed
-
The Internet Archive - 1 million searchable books, 150 billion web pages
-
Digg - 13 million documents, 4.8 million queries per day
In addition to large amounts of content, Lucene and Solr deliver fast response times - often under 50 milliseconds.
