[prev in list] [next in list] [prev in thread] [next in thread] 

List:       solr-user
Subject:    Re: How to improve the Solr "OR" query performance
From:       Dotan Cohen <dotancohen () gmail ! com>
Date:       2013-07-03 11:14:43
Message-ID: CAKDXFkOoFN+EjE7JPthN-tA=JOmdyB=-PHA+qDd42CVAUhhrnw () mail ! gmail ! com
[Download RAW message or body]

On Wed, Jul 3, 2013 at 6:48 AM, huasanyelao <huasanyelao@163.com> wrote:
> Nowdays, I've got a urgent task to improve the "OR" query performance with solr.
> I have deployed 9 shards with solr-cloud in two server(each server : 16 cores, 32G \
> RAM). The total document count: 60,000,000, total index size : 9G.
> According to the requirement, I have to use the "OR" query to get results.
> The average number of query terms is about 15.
> The response time for "OR" query is around 1-2seconds(the "AND" query is just about \
> 30ms-40ms ). Our target : promote 50%, that is, at most 500ms-1s per query.
> The document will soar to 80,000,000, however, the performance should keep in \
> 500ms-1s query. Any advise or approach is appreciated. Thanks in advance.
> 

What size documents? I've currently got stats like this, only a few
more documents but 5s searches on 15 ORs:
q=love%20OR%20hate%20OR%20beer%20OR%20sex%20OR%20peace%20OR%20war%20OR%20up%20OR%20dow \
n%20OR%20this%20OR%20that%20OR%20left%20OR%20right%20OR%20north%20OR%20south%20OR%20east%20OR%20west
 <lst name="responseHeader"><int name="status">0</int><int
name="QTime">5604</int><lst name="params"><str name="q">love OR hate
OR beer OR sex OR peace OR war OR up OR down OR this OR that OR left
OR right OR north OR south OR east OR west</str></lst></lst>
<result name="response" numFound="22495012" start="0">

My index currently has 77461952 documents, most under 1 KiB each but
upwards of ten fields.

--
Dotan Cohen

http://gibberish.co.il
http://what-is-what.com


[prev in list] [next in list] [prev in thread] [next in thread]