[prev in list] [next in list] [prev in thread] [next in thread] 

List:       solr-user
Subject:    Re: master slave replication taking time
From:       Erick Erickson <erickerickson () gmail ! com>
Date:       2017-06-29 17:45:06
Message-ID: CAN4YXvcZZ9hh6xSRFy4JxzYpKMLPbNnY-1Z2mPH7AkFTyTgecg () mail ! gmail ! com
[Download RAW message or body]

So you say that master/slave replication takes up to 20 seconds but it
takes 8-10 minutes just to copy the entire index?

Solr is _already_ speeding up your copy enormously by just copying
changed segments. There's nothing magic you can do to make it faster.
And if your master happens to merge many segments into a large one
your replication will take up to the time it takes to copy your entire
index (8-10 minutes).

Going to SolrCloud would eliminate that kind of lag at the expense of
indexing on every node. Otherwise it's the best you can do.

Best,
Erick

On Thu, Jun 29, 2017 at 12:21 AM, Midas A <test.midas@gmail.com> wrote:
> Erick,
>
> when we copy entire index it takes 8- 10 mins .
>
>
> On Wed, Jun 28, 2017 at 9:22 PM, Erick Erickson <erickerickson@gmail.com>
> wrote:
>
>> How long it takes to copy the entire index from one machine to another
>> over your network. Solr can't go any faster than your network can
>> support. Consider SolrCloud if you need something closer to NRT.
>>
>> Best,
>> Erick
>>
>> On Tue, Jun 27, 2017 at 11:31 PM, Midas A <test.midas@gmail.com> wrote:
>> > Hi,
>> >
>> > we have around 20000000 documents and our master to slave replication is
>> > taking time  upto 20 second.
>> >
>> > What should i check ?
>>
[prev in list] [next in list] [prev in thread] [next in thread]