[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-pim
Subject:    [Kde-pim] Also fetches all items on Maildir filtering? (was: Review Request 117140: ItemSync: Only f
From:       Martin Steigerwald <Martin () lichtvoll ! de>
Date:       2014-03-31 18:47:48
Message-ID: 18878374.nQ97j1yiOa () merkaba
[Download RAW message or body]

Am Freitag, 28. März 2014, 17:26:27 schrieb Christian Mollekopf:
> -----------------------------------------------------------
> This is an automatically generated e-mail. To reply, visit:
> https://git.reviewboard.kde.org/r/117140/
> -----------------------------------------------------------
> 
> Review request for KDEPIM-Libraries.
> 
> 
> Repository: kdepimlibs
> 
> 
> Description
> -------
> 
> ItemSync: Only fetch the items that are actually required.
> 
> ItemSync used to fetch *all* items during *every* sync, which is in most
> cases completely unnecessary (at least for incremental sync). This patch
> delays the fetch of items until we know which ones we need, and then only
> fetches the required ones (usually none), resulting in an IMAP sync going
> from 10s 100%, to a couple of seconds 1% cpu.

Could it be that something similar happens for POP3 accounts with their 
typical maildir resource storage?

Currently I have all inbox mail go into a folder called "_Inbox", browse 
through them and filter them manually with Ctrl-A Ctrl-J. Often I find Akonadi 
maildir resource running for minutes then. Hogging 100% of one core. CPU-
bound, there is no bottleneck with disk utilization as far as I can tell.

For about 100 mails maybe. Happens even with just 30-50 mails. 100% of one 
core for several minutes for filtering 100 mails… on a Sandybridge Dual SSD 
system with 8 GiB of RAM… that just doesn ´t seem quite right for me.

I strace ´d it and found it getting all dentries of folders mails where filtered 
too. And then stat()ing every single file in each of these maildirs, of course 
for mail directories with several 10000 files or even the one kernel-ml folder 
with 200000 files this takes long.

But there is no need to check several times a day whether those files are still 
there. They are. Otherwise I ´d throw the filesystem or SSDs out of the window 
:).

I do think meanwhile that is the most important resource that makes POP3 + 
Maildir resource setups almost unbearable slow, as during these folder 
synchronizations Akonadi blocks out KMail as well. While as I understand one 
key advantage of Akonadi is that GUI applications never block again. Unless at 
least I access exactly the folder that is being synchronized currently.

Maybe I can get an idea on where to look on checking your review request. 
Seems it is time that I grab the source and look at it.

-- 
Martin 'Helios' Steigerwald - http://www.Lichtvoll.de
GPG: 03B0 0D6C 0040 0710 4AFA  B82F 991B EAAC A599 84C7
_______________________________________________
KDE PIM mailing list kde-pim@kde.org
https://mail.kde.org/mailman/listinfo/kde-pim
KDE PIM home page at http://pim.kde.org/
[prev in list] [next in list] [prev in thread] [next in thread]