[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lucene-dev
Subject:    [jira] [Assigned] (SOLR-9236) AutoAddReplicas feature with one replica loses some documents not comm
From:       "Mark Miller (JIRA)" <jira () apache ! org>
Date:       2016-06-30 16:42:10
Message-ID: JIRA.12981354.1466517139000.5689.1467304930292 () Atlassian ! JIRA
[Download RAW message or body]


     [ https://issues.apache.org/jira/browse/SOLR-9236?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel \
]

Mark Miller reassigned SOLR-9236:
---------------------------------

    Assignee: Mark Miller

> AutoAddReplicas feature with one replica loses some documents not committed during \
>                 failover
> -------------------------------------------------------------------------------------------
>  
> Key: SOLR-9236
> URL: https://issues.apache.org/jira/browse/SOLR-9236
> Project: Solr
> Issue Type: Bug
> Components: hdfs, SolrCloud
> Reporter: Eungsop Yoo
> Assignee: Mark Miller
> Priority: Minor
> Attachments: SOLR-9236.patch
> 
> 
> I need to index huge amount of logs, so I decide to use AutoAddReplica feature with \
> only one replica. When using AutoAddReplicas with one replica, some benefits are \
>                 expected.
> - no redundant data files for replicas
> -- saving disk usage
> - best indexing performance 
> I expected that Solr fails over just like HBase.
> The feature worked almost as it was expected, except for some missing documents \
> during failover. I found two regions for the missing.
> 1. The leader replica does not replay any transaction logs. But when there is only \
> one replica, it should be the leader. So I made the leader replica replay the \
> transaction logs when using AutoAddReplicas with on replica. But the above fix did \
> not resolve the problem. 2. As failover occurred, the transaction log directory had \
> a deeper directory depth. Just like this, tlog/tlog/tlog/... The transaction log \
> could not be replayed, because the transaction log directory was changed during \
> failover.  So I made the transaction log directory not changed during failover.
> After these fixes, AutoAddReplicas with one replica fails over well without losing \
> any documents.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

---------------------------------------------------------------------
To unsubscribe, e-mail: dev-unsubscribe@lucene.apache.org
For additional commands, e-mail: dev-help@lucene.apache.org


[prev in list] [next in list] [prev in thread] [next in thread]