[prev in list] [next in list] [prev in thread] [next in thread] 

List:       lucene-user
Subject:    Re: Index corruption and repair
From:       Antony Joseph <antony.dev.webmail () gmail ! com>
Date:       2022-05-25 12:54:54
Message-ID: CAH1qXdzkEN2=MRCpaF113q=bxBuCUQw1G0Q2NUrPDVwQWnuUrQ () mail ! gmail ! com
[Download RAW message or body]


Hi Mike,

Any updates?

Regards,
Antony

On Wed, 11 May 2022 at 01:02, Antony Joseph <antony.dev.webmail@gmail.com>
wrote:

> Hello Mike,
>
> 1. As requested, the full checkindex log is attached.
>
> 2. We haven't made any changes to the IndexDeletionPolicy - so the
> assumption is the default policy is being used.
>
> 3. No, we are not using near-real-time readers. We are using filesystem
> based readers only (passing Directory
> to DirectoryReader.open) as below:
>
> index_directory = FSDirectory.open(Paths.get(index_path))
> if DirectoryReader.indexExists(index_directory): # valid index or not
>    reader = DirectoryReader.open(index_directory)
>
> 4. Index readers are checked every 10 seconds as to whether they should be
> reopened or not (if the index has changed). Like this:
>
> (reader is an IndexReader)
>
> if not reader.isCurrent():
>     i_reader = DirectoryReader.openIfChanged(reader)
>
> Yes, 6.5.0 is old, but for now we are constrained to use it; till we can
> come up with a plan to upgrade (it'll involve reindexing a lot of data).
>
> If you think it would help you, I could also share with you the simple
> flow of our application which includes index, update, delete of the
> documents.
>
> By the way the users say no Antivirus/Microsoft Defender. Besides before
> upgrading to lucene 6.5.0 the same application with lucene 4.10 was running
> fine on the same system.
>
> Thanks for your assistance.
>
> Regards,
> Antony
>
> On Thu, 5 May 2022 at 20:06, Michael McCandless <lucene@mikemccandless.com>
> wrote:
>
>> Antony, do you maybe have Microsoft Defender turned on, which might
>> quarantine files that it suspects are malicious?  I'm not sure if it is on
>> by default these days on modern Windows boxes ...
>>
>> Mike McCandless
>>
>> http://blog.mikemccandless.com
>>
>>
>> On Thu, May 5, 2022 at 10:34 AM Michael McCandless <
>> lucene@mikemccandless.com> wrote:
>>
>>> On Thu, May 5, 2022 at 10:30 AM Uwe Schindler <uwe@thetaphi.de> wrote:
>>>
>>> To find all errors in an index, you should pass -ea to the java command
>>>> line to enable assertions.
>>>>
>>>
>>> +1
>>>
>>> Tempting to make CheckIndex demand that :)  Or at least, slow you down
>>> and make it clear why, if assertions are disabled.
>>>
>>> Mike McCandless
>>>
>>> http://blog.mikemccandless.com
>>>
>>>


[prev in list] [next in list] [prev in thread] [next in thread]