[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-devel
Subject:    Re: Akonadi & Billions Of NNTP Headers
From:       Rohan Beckles <rohan.beckles () gmail ! com>
Date:       2012-10-12 13:31:26
Message-ID: 7040476.YCM0A19pjo () vostok
[Download RAW message or body]

Hi David --

Many thanks for that.  Will do. :)

Best.

-- =

Rohan Beckles
On Friday 12 Oct 2012 13:14:29 David Jarvie wrote:
> Hi Rohan,
> =

> The best mailing list to ask this question on is the kde-pim list. All the
> Akonadi developers read that list, but they don't necessarily read this
> list.
> =

> Cheers,
> David.
> =

> On Fri, October 12, 2012 11:59 am, Rohan Beckles wrote:
> > Hi Gael --
> >
> > Thank you for your response.  Yes, I'm aware of Kwooty - in fact I use =
it.
> >  :) Unfortunately, Kwooty depends on NZB
> > websites/search engines, and those services don't index everything which
> > is why I'd like to develop a more traditional
> > NNTP robot which indexes the headers on the local machine.  I can then
> > search them, and queue items for download.
> >
> > However, you're right about sharing code.  I'll be looking at Kwooty,
> > KNode and KLibido for inspiration - this will
> > be my first KDE project. :)  However, the pressing issue is whether
> > Akonadi can handle a full header pull from a big
> > binary newsgroup.  We're looking at around 5 billion headers from the
> > biggest group.  :)
> >
> > Best,
> > --
> > Rohan Beckles
> >
> > On Friday 12 Oct 2012 09:17:52 Ga=EBl Beaudoin wrote:
> >
> > Le 12/10/2012 01:31, Rohan Beckles a =E9crit :
> >
> > Hello --
> >
> > This is my first ever post to any KDE mailing list, so please excuse any
> > n00bidity. :)
> >
> > I'm in the process of planning an NNTP binary download robot for KDE 4.=
x,
> > something along the lines of NewsLeecher or Newsman Pro
> > (which are Windows applications).  My plan is to use the existing RFC822
> > Mail resource and the NNTP agent (if it exists, otherwise write one),
> > and feed the NNTP headers into Akonadi, so that the headers can be inde=
xed
> > and searched.
> >
> > Question:  more than a few binary newsgroups have header counts reaching
> > past hundreds of millions into billions.  Is Akonadi (or more
> > precisely its MySQL backend) capable of dealing with that many records,
> > especially on consumer hardware? I'm assuming that the average
> > desktop has 4GB RAM and a single 500GB hard disk.
> >
> > Many thanks,
> > Hi Rohan,
> >
> > Do you by any chance know kwooty ? http://kwooty.sourceforge.net/
> > It sounds like it does what you would like to do. I use it and it's
> > maintained, simple, fast and reliable. Maybe you can help the project or
> > share some code with them?
> >
> > Have a nice day,
> > Ga=EBl
> >
> >
> >
> >
> >>> Visit http://mail.kde.org/mailman/listinfo/kde-devel#unsub to
> >>> unsubscribe <<
> >
> =

> =

> >> Visit http://mail.kde.org/mailman/listinfo/kde-devel#unsub to unsubscr=
ibe <<

>> Visit http://mail.kde.org/mailman/listinfo/kde-devel#unsub to unsubscrib=
e <<
[prev in list] [next in list] [prev in thread] [next in thread]