[prev in list] [next in list] [prev in thread] [next in thread] 

List:       python-catalog-sig
Subject:    Re: [Catalog-sig] local copy of pypi packages list, and package data,
From:       "Martin_v._Löwis" <martin () v ! loewis ! de>
Date:       2009-01-24 19:48:52
Message-ID: 497B70A4.8010009 () v ! loewis ! de
[Download RAW message or body]

> What I'm wondering is how can I keep my app in sync?

There are a number of PyPI mirroring solutions out there; I suggest
you use one of them:

http://pypi.python.org/pypi/z3c.pypimirror
https://launchpad.net/~pypi-mirror

> Here is what I'm
> doing right now, I was wondering if this is not overloading your
> servers, or is there a faster/more efficient way.

See AMK's recent message - perhaps it was you who was overloading the
server.

> 1. Is there a xmlrpc function that I can use to search for keywords
> and just get the packages I need?

No; you might use the regular UI search function, of course, but please
do restrict this to a small number of queries per hour.

> 2. Is there a better strategy then what I am doing? I would like to sync daily.

For downloading all files for a package, you might want to use the
simple API (/simple). For keeping in sync, you might want to use
changelog; updated_releases will only tell you whether a new release was
made, not whether a file has been added or replaced.

Regards,
Martin
_______________________________________________
Catalog-SIG mailing list
Catalog-SIG@python.org
http://mail.python.org/mailman/listinfo/catalog-sig
[prev in list] [next in list] [prev in thread] [next in thread]