[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-pim
Subject:    Re: [Kde-pim] Review Request: Add indexing throttling and fixed endless indexing problems
From:       Volker Krause <vkrause () kde ! org>
Date:       2012-02-17 18:53:42
Message-ID: 10494017.P2EV9a28ll () vkpc9
[Download RAW message or body]

[Attachment #2 (multipart/signed)]


On Friday 17 February 2012 09:00:19 Sebastian Trueg wrote:
> > On Feb. 16, 2012, 7:45 p.m., Christian Mollekopf wrote:
> > > The HighPrio Queue shouldn't ever be throttled ideally, but in view of
> > > the current problems it's definitely a reasonable approach. I didn't
> > > give a close look yet, but you can ship it from my side. Thanks for the
> > > patch.
> Currently there is no way around throttling the high prio queue. As stated
> above (and as you confirmed in private email) adding a new email account
> will result in newItem events for all the emails. That in turn will put
> them into the high prio queue.

I'm currently testing this, and it indeed seems to improve indexing 
considerably. Without throttling in effect my system is now reliably indexing 
hundreds of mails per minute, without getting stuck with Virtuoso going crazy.

I (locally) reduced the idle time limit a bit though, with the new two minute 
setting it rarely switches to full speed here, maybe something we still want 
to tweak.

I get a lot of these errors now though: "nepomukservicestub(24734)" Soprano: 
"Invalid argument (1)": 
"http://www.semanticdesktop.org/ontologies/2007/03/22/nmo#messageHeader has a 
max cardinality of 1. Provided 2 values - 
<nepomuk:/res/dfc71807-249b-47e4-91c1-90e3bd940f4d>, <nepomuk:/res/93266175-
f423-481b-a371-2b6ed28c5dbb>. Existing - "

This seems to be caused by emails with more than one extra header we index 
(such as List-Id), and thus triggers on basically everything in my mailinglist 
folders. Affected emails are skipped and re-indexed at an agent restart (which 
of course fails again). Is nmo:messageHeader the right property for these 
headers, and if yes, why does it have cardinality one?

regards,
Volker
["signature.asc" (application/pgp-signature)]

_______________________________________________
KDE PIM mailing list kde-pim@kde.org
https://mail.kde.org/mailman/listinfo/kde-pim
KDE PIM home page at http://pim.kde.org/

[prev in list] [next in list] [prev in thread] [next in thread]