'Re: Akonadi & Billions Of NNTP Headers'

[prev in list] [next in list] [prev in thread] [next in thread] 

List:       kde-devel
Subject:    Re: Akonadi & Billions Of NNTP Headers
From:       Gaël_Beaudoin <gaboo () gaboo ! org>
Date:       2012-10-12 7:17:52
Message-ID: 5077C420.9030303 () gaboo ! org
[Download RAW message or body]

[Attachment #2 (multipart/alternative)]

Le 12/10/2012 01:31, Rohan Beckles a écrit :
> Hello --
> 
> This is my first ever post to any KDE mailing list, so please excuse any n00bidity. \
> :) 
> I'm in the process of planning an NNTP binary download robot for KDE 4.x, something \
> along the lines of NewsLeecher or Newsman Pro (which are Windows applications).  My \
> plan is to use the existing RFC822 Mail resource and the NNTP agent (if it exists, \
> otherwise write one), and feed the NNTP headers into Akonadi, so that the headers \
> can be indexed and searched. 
> Question:  more than a few binary newsgroups have header counts reaching past \
> hundreds of millions into billions.  Is Akonadi (or more precisely its MySQL \
> backend) capable of dealing with that many records, especially on consumer \
> hardware? I'm assuming that the average desktop has 4GB RAM and a single 500GB hard \
> disk. 
> Many thanks,
Hi Rohan,

Do you by any chance know kwooty ? http://kwooty.sourceforge.net/
It sounds like it does what you would like to do. I use it and it's 
maintained, simple, fast and reliable. Maybe you can help the project or 
share some code with them?

Have a nice day,
Gaël

[Attachment #5 (text/html)]

<html>
  <head>
    <meta content="text/html; charset=ISO-8859-1"
      http-equiv="Content-Type">
  </head>
  <body bgcolor="#FFFFFF" text="#000000">
    <div class="moz-cite-prefix">Le 12/10/2012 01:31, Rohan Beckles a
      &eacute;crit&nbsp;:<br>
    </div>
    <blockquote cite="mid:1433021.D2lB14LbCg@vostok" type="cite">
      <pre wrap="">Hello --

This is my first ever post to any KDE mailing list, so please excuse any n00bidity. \
:)

I'm in the process of planning an NNTP binary download robot for KDE 4.x, something \
along the lines of NewsLeecher or Newsman Pro  (which are Windows applications).  My \
plan is to use the existing RFC822 Mail resource and the NNTP agent (if it exists, \
otherwise write one),  and feed the NNTP headers into Akonadi, so that the headers \
can be indexed and searched. 

Question:  more than a few binary newsgroups have header counts reaching past \
hundreds of millions into billions.  Is Akonadi (or more  precisely its MySQL \
backend) capable of dealing with that many records, especially on consumer hardware? \
I'm assuming that the average  desktop has 4GB RAM and a single 500GB hard disk. 

Many thanks,
</pre>
    </blockquote>
    Hi Rohan,<br>
    <br>
    Do you by any chance know kwooty ?
    <meta http-equiv="content-type" content="text/html;
      charset=ISO-8859-1">
    <a href="http://kwooty.sourceforge.net/">http://kwooty.sourceforge.net/</a><br>
    It sounds like it does what you would like to do. I use it and it's
    maintained, simple, fast and reliable. Maybe you can help the
    project or share some code with them?<br>
    <br>
    Have a nice day,<br>
    Ga&euml;l<br>
  </body>
</html>

>> Visit http://mail.kde.org/mailman/listinfo/kde-devel#unsub to unsubscribe <<

[prev in list] [next in list] [prev in thread] [next in thread] 