From solr-user  Wed Jul 03 11:14:43 2013
From: Dotan Cohen <dotancohen () gmail ! com>
Date: Wed, 03 Jul 2013 11:14:43 +0000
To: solr-user
Subject: Re: How to improve the Solr "OR" query performance
Message-Id: <CAKDXFkOoFN+EjE7JPthN-tA=JOmdyB=-PHA+qDd42CVAUhhrnw () mail ! gmail ! com>
X-MARC-Message: https://marc.info/?l=solr-user&m=137285011221571

On Wed, Jul 3, 2013 at 6:48 AM, huasanyelao <huasanyelao@163.com> wrote:
> Nowdays, I've got a urgent task to improve the "OR" query performance with solr.
> I have deployed 9 shards with solr-cloud in two server(each server : 16 cores, 32G RAM).
> The total document count: 60,000,000, total index size : 9G.
> According to the requirement, I have to use the "OR" query to get results.
> The average number of query terms is about 15.
> The response time for "OR" query is around 1-2seconds(the "AND" query is just about 30ms-40ms ).
> Our target : promote 50%, that is, at most 500ms-1s per query.
> The document will soar to 80,000,000, however, the performance should keep in 500ms-1s query.
> Any advise or approach is appreciated. Thanks in advance.
>

What size documents? I've currently got stats like this, only a few
more documents but 5s searches on 15 ORs:
q=love%20OR%20hate%20OR%20beer%20OR%20sex%20OR%20peace%20OR%20war%20OR%20up%20OR%20down%20OR%20this%20OR%20that%20OR%20left%20OR%20right%20OR%20north%20OR%20south%20OR%20east%20OR%20west
<lst name="responseHeader"><int name="status">0</int><int
name="QTime">5604</int><lst name="params"><str name="q">love OR hate
OR beer OR sex OR peace OR war OR up OR down OR this OR that OR left
OR right OR north OR south OR east OR west</str></lst></lst>
<result name="response" numFound="22495012" start="0">

My index currently has 77461952 documents, most under 1 KiB each but
upwards of ten fields.

--
Dotan Cohen

http://gibberish.co.il
http://what-is-what.com